Documentation Index
Fetch the complete documentation index at: https://docs.cekura.ai/llms.txt
Use this file to discover all available pages before exploring further.
The Cekura CLI ships in the same package as the Python SDK. If you haven’t installed or authenticated yet, follow the Overview first.
Quickstart
--project-id / --organization-id on every command:
Common commands
--help for a full flag listing:
JSON output for scripting
Add--format json to any list/get command for clean stdout you can pipe into jq, python -c, or your own tools:
Top-level command groups
| Group | Purpose |
|---|---|
auth | Sign in / out, check current identity |
config | View and set CLI defaults |
agents | Create, update, list voice agents and their tools |
scenarios | Manage test scenarios (evaluators) |
metrics | Define evaluation metrics |
run / runs | Trigger evaluations and inspect individual runs |
calls | Production call logs and ad-hoc evaluation |
dashboards | Analytics dashboards and widgets |
predefined-metrics, critical-metric-scenarios, metric-reviews | Platform-managed metrics workflow |
test-profiles, personalities, phone-numbers | Reusable test configuration |
cron | Schedule recurring evaluations |
test-sets | Curate evaluation datasets from runs or call logs |
projects, organizations, billing, api-keys | Workspace administration |
Common workflows
Run evaluations from CI
Run evaluations from CI
- Generate an org-scoped API key in the dashboard.
-
Add it as a CI secret named
CEKURA_API_KEY. -
In your pipeline:
Fail the pipeline on a non-passing run by parsing the JSON status field:
Bulk-update scenarios from a JSON file
Bulk-update scenarios from a JSON file
Prepare Apply:The payload must be a JSON object with a top-level
scenarios.json:scenarios key, plus any of metric_ids_to_add, metric_ids_to_remove, tool_ids_to_add, etc.Promote a passing run into a test set
Promote a passing run into a test set
Schedule recurring evaluations
Schedule recurring evaluations
Troubleshooting
`Authentication failed. Check your CEKURA_API_KEY.`
`Authentication failed. Check your CEKURA_API_KEY.`
- OAuth users: your token may have expired. Run
cekura auth loginagain. - API key users: verify
cekura config getshows the rightapi_urland thatCEKURA_API_KEYis set in the current shell. Generate a fresh key in Settings → API Keys if needed.
`Please provide one of the required query parameter`
`Please provide one of the required query parameter`
Several list endpoints require a scope filter (
--project-id, --agent-id, or --organization-id). Pass one explicitly, or set defaults via cekura config set default_project_id <id>.Rate limited (429)
Rate limited (429)
The platform enforces per-plan rate limits. Throttle your loop, batch where possible, or upgrade your plan. Check usage in Settings → API Usage.
Want machine-readable output
Want machine-readable output
Add
--format json to any list/get command. Use jq or python -c to parse.References
SDK guide
Use the same operations from Python with sync or async clients.
API Reference
Full endpoint documentation for every resource the CLI exposes.