It does not define which live objects are evaluated. That is the job of evaluation-rules.
For agent clients, the most important fields are:
type: determines which evaluator fields are present
variables: for LLM evaluators, use these exact names when building the evaluation-rule mapping array. LLM evaluators require every variable to be mapped. Code evaluators always expose the fixed runtime payload fields and Langfuse maps them automatically.
Versioning behavior:
GET /evaluators returns the latest version of each available evaluator.
GET /evaluators/{id} can return an older version.
Evaluation rules always run against the latest version for the selected evaluator name within the same source (project or managed).
One evaluator that can be used for scoring.
An evaluator describes how to score data.
It does not define which live objects are evaluated. That is the job of
evaluation-rules.For agent clients, the most important fields are:
type: determines which evaluator fields are presentvariables: for LLM evaluators, use these exact names when building the evaluation-rulemappingarray. LLM evaluators require every variable to be mapped. Code evaluators always expose the fixed runtime payload fields and Langfuse maps them automatically.Versioning behavior:
GET /evaluatorsreturns the latest version of each available evaluator.GET /evaluators/{id}can return an older version.projectormanaged).