Validate Rule
Validate a rule by executing it with test data without creating a saved rule.
This endpoint allows testing LLM-as-judge evaluators before saving them. It accepts a rule configuration (same as rule creation) and test data, executes the evaluator, and returns the evaluation results in the same format as batch_invoke_evaluator.
Only LLM-as-judge rules (evaluators) are supported. Code evaluators are not allowed.
The evaluator execution traces are written to the database (in the “evaluators” project), which allows users to see the evaluator execution history.
Documentation Index
Fetch the complete documentation index at: https://docs.langchain.com/llms.txt
Use this file to discover all available pages before exploring further.
Authorizations
Body
Schema for validating rules without creating them.
Extends RunRulesCreateSchema with test data fields for validation. Only LLM-as-judge rules (evaluators) are supported, not code_evaluators.
"thread_id"Response
Successful Response