The Cekura CLI ships in the same package as the Python SDK. If you haven’t installed or authenticated yet, follow the Overview first.
Quickstart
--project-id / --organization-id on every command:
Common commands
--help for a full flag listing:
JSON output for scripting
Add--format json to any list/get command for clean stdout you can pipe into jq, python -c, or your own tools:
Top-level command groups
| Group | Purpose |
|---|---|
auth | Sign in / out, check current identity |
config | View and set CLI defaults |
agents | Create, update, list voice agents and their tools |
scenarios | Manage test scenarios (evaluators) |
metrics | Define evaluation metrics |
run / runs | Trigger evaluations and inspect individual runs |
calls | Production call logs and ad-hoc evaluation |
dashboards | Analytics dashboards and widgets |
predefined-metrics, critical-metric-scenarios, metric-reviews | Platform-managed metrics workflow |
test-profiles, personalities, phone-numbers | Reusable test configuration |
cron | Schedule recurring evaluations |
test-sets | Curate evaluation datasets from runs or call logs |
projects, organizations, billing, api-keys | Workspace administration |
Common workflows
Run evaluations from CI
Run evaluations from CI
- Generate an org-scoped API key in the dashboard.
-
Add it as a CI secret named
CEKURA_API_KEY. -
In your pipeline:
Fail the pipeline on a non-passing run by parsing the JSON status field:
Bulk-update scenarios from a JSON file
Bulk-update scenarios from a JSON file
Prepare Apply:The payload must be a JSON object with a top-level
scenarios.json:scenarios key, plus any of metric_ids_to_add, metric_ids_to_remove, tool_ids_to_add, etc.Promote a passing run into a test set
Promote a passing run into a test set
Schedule recurring evaluations
Schedule recurring evaluations
Troubleshooting
`Authentication failed. Check your CEKURA_API_KEY.`
`Authentication failed. Check your CEKURA_API_KEY.`
- OAuth users: your token may have expired. Run
cekura auth loginagain. - API key users: verify
cekura config getshows the rightapi_urland thatCEKURA_API_KEYis set in the current shell. Generate a fresh key in Settings → API Keys if needed.
`Please provide one of the required query parameter`
`Please provide one of the required query parameter`
Several list endpoints require a scope filter (
--project-id, --agent-id, or --organization-id). Pass one explicitly, or set defaults via cekura config set default_project_id <id>.Rate limited (429)
Rate limited (429)
The platform enforces per-plan rate limits. Throttle your loop, batch where possible, or upgrade your plan. Check usage in Settings → API Usage.
Want machine-readable output
Want machine-readable output
Add
--format json to any list/get command. Use jq or python -c to parse.References
SDK guide
Use the same operations from Python with sync or async clients.
API Reference
Full endpoint documentation for every resource the CLI exposes.