Run Evaluator Email
Execute evaluators against an email agent. Cekura sends an email to the agent and simulates the full conversation via inbound webhook.
Authorizations
API Key Authentication. It should be included in the header of each request.
Body
List of evaluator IDs to run.
Number of times to run each scenario.
1 <= x <= 100ID of the agent to run against. Required if none of the scenarios have an agent.
Override the agent's configured email address for this run.
Response
Name of the Result
Example: "Test Result 1"
255Unique identifier for the Result
Example: 123
ID of the AI agent that was tested
Example: 123
Whether the agent is configured for inbound calls (true) or outbound calls (false)
Example: true or false
Current status of the result
running- Runningcompleted- Completedfailed- Failedpending- Pendingin_progress- In Progressevaluating- Evaluatingin_queue- In Queuetimeout- Timeoutcancelled- Cancelledscaling_up- Scaling Up
running, completed, failed, pending, in_progress, evaluating, in_queue, timeout, cancelled, scaling_up Success rate of the test runs as a decimal (0.0 to 1.0)
Whether this test was run in text mode instead of voice mode
Example: true or false
Whether this result was created by a scheduled cronjob
Example: true or false
Run summaries for this result. For full run data including transcripts and metric scores, fetch the result detail endpoint — there runs is a dict keyed by run ID.
Timestamp when this test result was created
Example: 2021-01-01 00:00:00
Timestamp when this test result was last updated