Error
A valid request URL is required to generate request examples{
"code_evaluator": {
"advanced_features_enabled": true,
"code": "<string>",
"code_evaluator_input": "thread",
"dependencies": "<string>",
"evaluator_build_error": "<string>",
"evaluator_build_status": "ENQUEUED",
"evaluator_id": "<string>",
"language": "<string>",
"managed_code_evaluator_key": "voice_metrics",
"managed_code_evaluator_settings": {},
"require_attachments": true
},
"created_at": "<string>",
"created_by": "<string>",
"feedback_keys": [
"<string>"
],
"id": "<string>",
"is_managed": true,
"llm_evaluator": {
"annotation_queue_id": "<string>",
"commit_hash_or_tag": "<string>",
"corrections_dataset_id": "<string>",
"evaluator_id": "<string>",
"num_few_shot_examples": 123,
"prompt_id": "<string>",
"prompt_repo_handle": "<string>",
"use_corrections_dataset": true,
"variable_mapping": {}
},
"name": "<string>",
"run_rules": [
{
"corrections_dataset_id": "<string>",
"dataset_id": "<string>",
"dataset_name": "<string>",
"group_by": "<string>",
"id": "<string>",
"num_few_shot_examples": 123,
"session_id": "<string>",
"session_name": "<string>",
"spend_limit": {
"limit_usd": 123,
"utilization_pct": 123,
"window": "<string>"
},
"spend_usd": 123,
"trace_count": 123,
"use_corrections_dataset": true
}
],
"tenant_id": "<string>",
"type": "llm",
"updated_at": "<string>"
}{
"error": "<string>"
}{
"error": "<string>"
}{
"error": "<string>"
}{
"error": "<string>"
}{
"error": "<string>"
}Get evaluator
Retrieve a single evaluator by its ID.
GET
/
api
/
v1
/
platform
/
evaluators
/
{evaluator_id}
Error
A valid request URL is required to generate request examples{
"code_evaluator": {
"advanced_features_enabled": true,
"code": "<string>",
"code_evaluator_input": "thread",
"dependencies": "<string>",
"evaluator_build_error": "<string>",
"evaluator_build_status": "ENQUEUED",
"evaluator_id": "<string>",
"language": "<string>",
"managed_code_evaluator_key": "voice_metrics",
"managed_code_evaluator_settings": {},
"require_attachments": true
},
"created_at": "<string>",
"created_by": "<string>",
"feedback_keys": [
"<string>"
],
"id": "<string>",
"is_managed": true,
"llm_evaluator": {
"annotation_queue_id": "<string>",
"commit_hash_or_tag": "<string>",
"corrections_dataset_id": "<string>",
"evaluator_id": "<string>",
"num_few_shot_examples": 123,
"prompt_id": "<string>",
"prompt_repo_handle": "<string>",
"use_corrections_dataset": true,
"variable_mapping": {}
},
"name": "<string>",
"run_rules": [
{
"corrections_dataset_id": "<string>",
"dataset_id": "<string>",
"dataset_name": "<string>",
"group_by": "<string>",
"id": "<string>",
"num_few_shot_examples": 123,
"session_id": "<string>",
"session_name": "<string>",
"spend_limit": {
"limit_usd": 123,
"utilization_pct": 123,
"window": "<string>"
},
"spend_usd": 123,
"trace_count": 123,
"use_corrections_dataset": true
}
],
"tenant_id": "<string>",
"type": "llm",
"updated_at": "<string>"
}{
"error": "<string>"
}{
"error": "<string>"
}{
"error": "<string>"
}{
"error": "<string>"
}{
"error": "<string>"
}Authorizations
API KeyTenant IDBearer Auth
Path Parameters
Evaluator ID
Response
OK
Show child attributes
Show child attributes
IsManaged marks a LangChain Tuned Evaluator (currently the tuned Perceived Error judge). NULL in the DB is read as false via COALESCE.
Embedded child evaluator (populated based on type)
Show child attributes
Show child attributes
Show child attributes
Show child attributes
Available options:
llm, code Was this page helpful?

