Agent Testing

    Agent Testing

    The Testing tab allows you to safely test how your agent would respond to comments using draft instructions before publishing changes to your live agent.

    How the testing system works

    The Testing tab provides a draft-test-publish workflow:

    1. Draft: Write new "Additional Context & Instructions" without affecting your live agent
    2. Test: See how your agent responds to real comments using the draft instructions
    3. Publish: Apply the draft instructions to your live agent (or reset to keep current settings)

    Testing interface layout

    The Testing tab has two main sections:

    Left panel: Choose what to test

    Posts tab: Test against your agent's social media posts

    • View posts from pages assigned to your agent
    • Write custom comment text to test against any post
    • See how your agent would respond to hypothetical comments

    Bookmarks tab: Test against bookmarked comments

    • Use comments you've bookmarked from the Comments section
    • Test how your agent would handle real comments with new instructions
    • No bookmarked comments? Go to Comments → bookmark some interactions first

    Right panel: Test and see results

    • Comment preview: See the full comment context, including attachments
    • Post preview: View the original post your agent would be responding to
    • Test results: See the generated reply, reasoning, and whether your agent chose to respond

    Draft instructions workflow

    Creating and saving drafts

    1. Click "Edit Additional Context & Instructions" at the bottom of the Testing tab
    2. Write your draft instructions in the text area
    3. Click "Save draft for testing" to save locally (doesn't affect your live agent)
    4. Your draft is saved and ready for testing

    Testing your drafts

    1. Select a comment or post from the left panel
    2. For posts: Write a custom comment to test against
    3. For bookmarks: The comment is already selected
    4. Click the test button to generate a response using your draft instructions
    5. Review the results:
      • Generated Reply (green): The actual response your agent would post
      • Reasoning (yellow): Why your agent decided to respond this way
      • Reply Not Generated (orange): When your agent decides not to respond, with reasoning

    Publishing or resetting

    After testing, you have three options:

    • Publish: Apply your draft instructions to the live agent (makes them active)
    • Save draft for testing: Keep testing with the current draft
    • Reset to original: Discard your draft and return to the published instructions

    Understanding test results

    When your agent generates a reply

    You'll see:

    • The full reply text your agent would post
    • The reasoning behind the response
    • Context about language detection and post analysis

    When your agent doesn't reply

    You'll see:

    • Reasoning for why no reply was generated (e.g., "Comment is just an emoji, no substantial response needed")
    • This helps you understand your agent's decision-making process

    Best practices for testing

    Start with real examples

    • Use bookmarked comments from actual interactions
    • Test against various types of comments (questions, complaints, praise)
    • Try comments in different languages if your audience is multilingual

    Test edge cases

    • Very short comments (emojis, single words)
    • Long, detailed comments
    • Comments with links or attachments
    • Off-topic or inappropriate comments

    Iterative improvement

    1. Test with current settings to establish a baseline
    2. Make small changes to your draft instructions
    3. Test the same comments again to see the difference
    4. Refine until you're satisfied with the responses

    Common testing scenarios

    Testing additional context

    If you want to provide more background about your business:

    • Add to draft: "We are a sustainable fashion brand focused on eco-friendly materials."
    • Test against product-related comments to see how this context influences responses

    Testing knowledge integration

    If you've added new knowledge to your agent:

    • Add to draft: "Reference our new product line when relevant."
    • Test against product-related comments

    Testing response specificity

    If you want different response patterns:

    • Add to draft: "Only respond to direct questions, ignore general praise comments."
    • Test against various comment types to see response behavior

    Testing brand voice instructions

    If you want to emphasize certain aspects:

    • Add to draft: "Always mention our 30-day money-back guarantee when discussing products."
    • Test against purchase-related comments

    FAQ: Testing questions

    "Do tests affect my live agent?"

    No, testing is completely separate from your live agent. Only publishing your draft affects the live agent.

    "Where are my drafts saved?"

    Drafts are saved locally in your browser. They persist until you publish them or reset to original.

    "Can I test the same comment multiple times?"

    Yes, you can test the same comment repeatedly with different draft instructions to compare results.

    "What if I don't have any bookmarked comments?"

    Go to the Comments section and bookmark some interactions first, then return to the Testing tab to use them.

    "How do I know if my changes improved the responses?"

    Test the same comments before and after your instruction changes to directly compare the responses and reasoning.

    NEXT ARTICLE

    AI-powered inbox