Autopilot Testbed - Answer Moderation

Before deploying Doti Autopilot into busy or high-visibility Slack channels, it’s important to build trust in the AI’s responses. That’s where Testbed Mode comes in.

Testbed lets you review and manually approve Doti’s answers before they’re posted publicly, helping you evaluate performance and improve confidence - especially when deploying in large teams or executive channels.

What Is Testbed?

Testbed is a moderation workflow that routes Autopilot-generated answers to a private Slack channel (your moderation channel) instead of posting them directly in the original conversation.

From there, a human reviewer can:

  • Read the full proposed response

  • Review source citations, timestamps, and metadata

  • Decide whether to publish, dismiss, or take further action

When to Use Testbed

Scenario
Why Testbed Helps

Launching Doti in high-traffic channels

Preview before publishing to large audiences

Executive-facing spaces

Ensure tone, accuracy, and authority

Early-stage Autopilot testing

Fine-tune confidence thresholds before going live

Regulated/controlled teams (e.g., legal, finance)

Ensure responses follow internal guidelines

How to Enable Testbed

  1. Go to portal.doti.ai/auto-pilot

  2. Create or edit an existing Autopilot

  3. In the configuration panel:

    • Enable Testbed Mode

    • Select a moderation Slack channel (Doti must be a member)

  4. Save your changes

Now, all responses from this Autopilot will go to the moderation channel first.

✅ A single moderation channel can manage responses from multiple Autopilot instances

What a Moderated Message Looks Like

Each Testbed message includes:

  • The original question and metadata (channel, user, timestamp, message link)

  • Doti’s full proposed response

  • Sources used, with owner, source type, and modification date

  • Action buttons:

    • Publish – Sends the answer to the original channel

    • Dismiss – Rejects the answer silently

🧠 This gives reviewers everything they need to evaluate the answer without switching tools.

Moderation Example

Publishing an Answer

If you're happy with the response:

  • Click Publish

  • Doti will immediately post the exact answer to the original channel as if it had responded live

  • The message appears fully formatted, with all sources and actions

Best Practices

  • Appoint a moderator team for Testbed channels (e.g., PMs, ops, knowledge leads)

  • Set clear rules: when to publish, when to rewrite, when to reject

  • Treat it like a training phase before full Autopilot rollout

  • Use feedback from Testbed to adjust:

    • Confidence thresholds

    • Agent instructions

    • Collection sources

Summary

Feature
Description

Testbed Mode

Routes answers to a private review channel

Moderation Actions

Approve & publish, or dismiss

Transparency

Shows full source metadata & original context

Multi-Autopilot Support

One moderation channel can serve many autopilots

Use Cases

High-risk channels, early rollouts, regulated teams

🧪 Testbed lets you scale Autopilot safely and confidently — putting humans in the loop before the AI goes live.

PreviousAutopilot - Automatic answers in channelsNextBot-to-Bot Autopilot

Last updated

Was this helpful?