Skip to main content
Setup steps and authentication are in the Overview. This page focuses on the agent resource itself.
An agent is the AI voice assistant under test. It links to a provider (Vapi, Retell, ElevenLabs, LiveKit, Pipecat, or a custom integration), a system prompt, mock tools, a knowledge base, and a set of personalities. Most evaluation workflows start by creating or selecting an agent.

Create

For provider/telephony config, write a JSON file and pass it:

List, get, update

Mock tools

Mock tools let evaluations run without hitting your real backend.

Knowledge base

Personalities

Personalities apply across an agent’s evaluation runs (e.g. “interruptive”, “soft-spoken”).

Duplicate

Quickly fork an agent for A/B testing or a new prompt variant:

Dynamic variables

Dynamic variables let you inject runtime values into an agent’s description using {{ variable_name }} syntax. You define the variables on the agent and supply their values when sending call data to the observability endpoint.

List

Returns all variable definitions for the agent, ordered by name. Response

Create / update

Accepts a list of { name, description } objects. Each entry is upserted by name — existing variables are updated, new ones are created. Returns the full list of definitions after the operation.

Update one

Updates a single variable definition (partial update).

Delete

Returns 204 No Content.
See Dynamic Agent Description for how to use these variables at call time.

See also

Evaluators

Scenarios, test profiles, personalities — the test inputs that run against an agent.

Runs & Results

Trigger an evaluation against the agent and inspect the outcome.

Agents API

Full field reference for agent payloads.

Agent setup guide

Concepts, provider integrations, and best practices.