Skip to main content
GET
/
test_framework
/
metric-reviews
/
process_feedbacks_progress
cURL
curl --request GET \
  --url https://api.cekura.ai/test_framework/metric-reviews/process_feedbacks_progress/ \
  --header 'X-CEKURA-API-KEY: <api-key>'
{
  "improved_metric_description": "<string>",
  "improved_evaluation_trigger": "<string>",
  "improved_trigger_kind": "always",
  "metric_description_program": "<unknown>",
  "metric_description_variables": [
    "<unknown>"
  ],
  "evaluation_trigger_program": "<unknown>",
  "evaluation_trigger_variables": [
    "<unknown>"
  ],
  "review_results": [
    {
      "review_id": 123,
      "test_set_id": 123,
      "success": true,
      "actual_value": null,
      "explanation": null,
      "error": "<string>"
    }
  ],
  "custom_code": ""
}

Documentation Index

Fetch the complete documentation index at: https://docs.cekura.ai/llms.txt

Use this file to discover all available pages before exploring further.

Authorizations

X-CEKURA-API-KEY
string
header
required

API Key Authentication. It should be included in the header of each request.

Query Parameters

progress_id
string
required

Progress ID returned from the process_feedbacks endpoint

agent_id
integer

Agent ID for permission validation

project_id
integer

Project ID for permission validation

Response

200 - application/json
improved_metric_description
string
required

Improved metric description

improved_evaluation_trigger
string
required

Improved evaluation trigger. Interpretation depends on improved_trigger_kind: 'always' (literal) → run on every example; Python source → trigger.py from the sandbox (when improved_trigger_kind='custom_code'); LLM-judge prompt otherwise.

improved_trigger_kind
enum<string>
default:always

Tells the frontend how to interpret improved_evaluation_trigger. Set to 'custom_code' when meta-harness produced an optimized Python trigger; 'always' when no trigger gating is needed.

  • always - Always
  • llm_judge - LLM Judge
  • custom_code - Custom Code
Available options:
always,
llm_judge,
custom_code
trigger_type
enum<string>

Type of evaluation trigger (llm_judge or custom_code)

  • llm_judge - LLM Judge
  • custom_code - Custom Code
Available options:
llm_judge,
custom_code
metric_description_program
any

Advanced metric configuration

metric_description_variables
any[]

Variables used in metric description

evaluation_trigger_program
any

Advanced trigger configuration

evaluation_trigger_variables
any[]

Variables used in evaluation trigger

review_results
object[]

Evaluation results for each test set

custom_code
string
default:""

Optimized Python code (meta-harness output). When present, metric should switch to custom_code type.

type
enum<string>

Suggested metric type after optimization (custom_code if meta-harness produced code)

  • basic - Basic (Deprecated in favor of LLM Judge)
  • custom_prompt - Custom Prompt ( Deprecated in favor of LLM Judge)
  • custom_code - Custom Code
  • llm_judge - LLM Judge
Available options:
basic,
custom_prompt,
custom_code,
llm_judge