Auto-Improve Metric
Improve a metric using feedback from test sets. Returns improved metric configuration. Use the Update Metric endpoint to save changes.
Authorizations
API Key Authentication. It should be included in the header of each request.
Body
ID of the metric to process feedbacks for
Optional metric type
basic- Basic (Deprecated in favor of LLM Judge)custom_prompt- Custom Prompt ( Deprecated in favor of LLM Judge)custom_code- Custom Codellm_judge- LLM Judge
basic, custom_prompt, custom_code, llm_judge Test set IDs whose feedback drives the optimization. If omitted, defaults to every test set already added to this metric's Lab.
Simplified prompt to use as initial prompt for optimization. If provided, the optimizer will start from this prompt instead of the metric's original description.
If true, skip running LLM evaluations on test sets after optimization. This speeds up the process but won't show evaluation results.
Response
Returns progress_id for tracking progress