Skip to main content
GET
/
v1
/
platform
/
evaluators
/
{evaluator_id}
Error
A valid request URL is required to generate request examples
{
  "code_evaluator": {
    "code": "<string>",
    "evaluator_id": "<string>",
    "language": "<string>"
  },
  "created_at": "<string>",
  "created_by": "<string>",
  "feedback_keys": [
    "<string>"
  ],
  "id": "<string>",
  "llm_evaluator": {
    "annotation_queue_id": "<string>",
    "commit_hash_or_tag": "<string>",
    "corrections_dataset_id": "<string>",
    "evaluator_id": "<string>",
    "num_few_shot_examples": 123,
    "prompt_id": "<string>",
    "prompt_repo_handle": "<string>",
    "use_corrections_dataset": true,
    "variable_mapping": {}
  },
  "name": "<string>",
  "run_rules": [
    {
      "corrections_dataset_id": "<string>",
      "dataset_id": "<string>",
      "dataset_name": "<string>",
      "group_by": "<string>",
      "id": "<string>",
      "num_few_shot_examples": 123,
      "session_id": "<string>",
      "session_name": "<string>",
      "use_corrections_dataset": true
    }
  ],
  "spend_usd": 123,
  "tenant_id": "<string>",
  "updated_at": "<string>"
}

Documentation Index

Fetch the complete documentation index at: https://docs.langchain.com/llms.txt

Use this file to discover all available pages before exploring further.

Authorizations

X-API-Key
string
header
required

Path Parameters

evaluator_id
string
required

Evaluator ID

Response

OK

code_evaluator
object
created_at
string
created_by
string
feedback_keys
string[]
id
string
llm_evaluator
object

Embedded child evaluator (populated based on type)

name
string
run_rules
object[]
spend_usd
number

Sum of LLM-as-judge run rule spend for the requested period (omitted when feature is disabled).

tenant_id
string
type
enum<string>
Available options:
llm,
code
updated_at
string