Run Evaluator LiveKit (v2)

Authorizations

X-CEKURA-API-KEY

string

header

required

API Key Authentication. It should be included in the header of each request.

Body

scenarios

object[]

required

Show child attributes

name

string | null

Optional name for the scenario result

Maximum string length: 255

frequency

integer

default:1

Frequency to run

Required range: 1 <= x <= 100

agent

integer | null

Agent to use. Required if none of the scenarios have an agent.

personality_ids

integer[] | null

List of personality IDs to override for this run. If not provided, uses the scenario's default personality.

test_profile_ids

integer[] | null

List of test profile IDs to override for this run. If not provided, uses the scenario's default test profile.

mock_tool_names

string[] | null

Names of mock tools to activate for this run. Omit (or send null) to mock every tool configured on the agent; send an empty list to mock none so every tool keeps its original endpoint; send specific names to mock only those. Tools that belong to an MCP server should be selected via the MCP server's name or key, which mocks all of that server's tools as one unit. Legacy MCP sub-tool names are accepted as aliases for the whole parent MCP.

livekit_data

object

Per-run LiveKit overrides (config, agent_name, url). Credentials are always read from the agent/project.

Show child attributes

concurrency_limit

integer | null

Optional cap on how many of this run's calls execute concurrently.

calls_per_second

number<double> | null

Most calls started per second for this run, a number from 0.1 to 4 (e.g. 0.5 starts one call every 2 seconds). Leave unset for no limit.

Required range: 0.1 <= x <= 4

personality_id

integer | null

Single personality ID override. Merged into personality_ids; prefer personality_ids for multiple.

test_profile_id

integer | null

Single test profile ID override. Merged into test_profile_ids; prefer test_profile_ids for multiple.

Response

integer

ID of the result

agent

integer

ID of the agent

status

enum<string>

Status of the result. Poll until it is completed, failed, timeout or cancelled. It stays non-terminal until every run has ended, then becomes completed if any run completed — even if runs failed their checks or others errored.

Available options:

running,

completed,

failed,

pending,

in_progress,

evaluating,

in_queue,

timeout,

cancelled,

scaling_up

run_as_text

boolean

Whether the scenario ran as text or not

Example:

false

runs

object[]

Show child attributes

Examples:

{
  "id": 274,
  "status": "pending",
  "scenario": 1,
  "number": null,
  "inbound_number": "+11234567890",
  "scenario_name": "Customer Support Call (Agent Inbound = True)",
  "test_profile_data": null,
  "outbound_dial_window_opens_at": null,
  "outbound_dial_window_seconds": null,
  "outbound_dial_window_closes_at": null
}

{
  "id": 275,
  "status": "pending",
  "scenario": 2,
  "number": "+11234567890",
  "inbound_number": null,
  "scenario_name": "Outbound Sales Call (Agent Inbound = False)",
  "test_profile_data": null,
  "outbound_dial_window_opens_at": "2026-06-24T10:47:30Z",
  "outbound_dial_window_seconds": 300,
  "outbound_dial_window_closes_at": "2026-06-24T10:52:30Z"
}

created_at

string<date-time>

Example:

"2025-02-25T21:00:01.990052Z"