Generate test scenarios in the background
API Key Authentication. It should be included in the header of each request.
Number of evaluators to generate (1-100)
1 <= x <= 100ID of the agent to generate evaluator for
Alternative to agent_id - the assistant ID to generate evaluators for
List of personality IDs to use for generated evaluators
ID of the test profile to assign to generated evaluators
Type of scenarios to generate: workflow (standard scenarios), red_teaming_voice (red teaming with voice-suitable prompts only), red_teaming_text (red teaming with all prompts), or knowledge_base (knowledge base scenarios)
workflow - workflowred_teaming_voice - red_teaming_voicered_teaming_text - red_teaming_textknowledge_base - knowledge_baseworkflow, red_teaming_voice, red_teaming_text, knowledge_base Attack category for red teaming scenarios. Required when scenario_type is red_teaming_voice or red_teaming_text. Categories: system_prompt_leak (attempts to extract the system prompt), data_leak (attempts to extract sensitive data), harmful_content (attempts to generate harmful output), biased_output (attempts to generate biased responses), unauthorized_actions (attempts to trigger unauthorized tool calls or actions), off_task (attempts to derail the conversation away from the agent's purpose)
system_prompt_leak - system_prompt_leakdata_leak - data_leakharmful_content - harmful_contentbiased_output - biased_outputunauthorized_actions - unauthorized_actionsoff_task - off_task, system_prompt_leak, data_leak, harmful_content, biased_output, unauthorized_actions, off_task, null Custom expected outcome for the scenario. If not provided, a default is generated based on the attack type.
List of Knowledge Base file IDs for the agent to reference during scenario generation
Additional instructions to guide evaluator generation
Phone number ID to use for inbound evaluator
Initial message to start the conversation
1000If true, expected outcomes will be generated for each evaluator
List of tags to apply to all generated scenarios
List of tool IDs to use for generated evaluators
[
"TOOL_DTMF",
"TOOL_END_CALL",
"TOOL_END_CALL_ONLY_ON_TRANSFER"
]
Folder path to assign generated scenarios to (e.g., 'folder_name' or 'parent.child')