Skip to main content
POST
/
v2
/
datasets
/
{dataset_id}
/
experiment-runs
Error
A valid request URL is required to generate request examples
{
  "items": [
    {
      "attachment_urls": {},
      "created_at": "2024-01-15T10:30:00.000Z",
      "dataset_id": "0190a1b2-c3d4-7ef0-a5b6-6ea3a82e9328",
      "id": "018e4c7e-a9fb-7ef0-a5b6-6ea3a82e9327",
      "inputs": {},
      "metadata": {},
      "modified_at": "2024-01-15T10:30:00.000Z",
      "name": "<string>",
      "outputs": {},
      "runs": [
        {
          "app_path": "/app/chains/chat.py:invoke",
          "attachments": {
            "{\"output.png\"": "\"https://storage.example.com/bucket/key?X-Amz-Signature=abc\"}"
          },
          "completion_cost": 0.0003,
          "completion_cost_details": {
            "raw": {}
          },
          "completion_token_details": {
            "raw": {}
          },
          "completion_tokens": 150,
          "dotted_order": "20240115T103000000000Z018e4c7ea9fb7ef0a5b66ea3a82e9327.",
          "end_time": "2024-01-15T10:30:01.500Z",
          "error": "context deadline exceeded",
          "error_preview": "<string>",
          "events": [
            {
              "kwargs": {},
              "name": "new_token",
              "time": "2024-01-15T10:30:00.312Z"
            }
          ],
          "extra": {},
          "feedback_stats": {},
          "first_token_time": "2024-01-15T10:30:00.312Z",
          "id": "018e4c7e-a9fb-7ef0-a5b6-6ea3a82e9327",
          "inputs": {},
          "inputs_preview": "<string>",
          "is_in_dataset": true,
          "is_root": true,
          "latency_seconds": 1.523,
          "manifest": {},
          "metadata": {},
          "name": "ChatOpenAI",
          "outputs": {},
          "outputs_preview": "<string>",
          "parent_run_ids": [
            "018e4c7e-a9fb-7ef0-a5b6-6ea3a82e9327",
            "a1b2c3d4-e5f6-4a5b-8c9d-0e1f2a3b4c5d"
          ],
          "price_model_id": "e5f6a7b8-c9d0-4e1f-2a3b-4c5d6e7f8a9b",
          "project_id": "018e4c7e-a9fb-7ef0-a5b6-6ea3a82e9327",
          "prompt_cost": 0.0002,
          "prompt_cost_details": {
            "raw": {}
          },
          "prompt_token_details": {
            "raw": {}
          },
          "prompt_tokens": 200,
          "reference_dataset_id": "c3d4e5f6-a7b8-4c5d-0e1f-2a3b4c5d6e7f",
          "reference_example_id": "b2c3d4e5-f6a7-4b5c-9d0e-1f2a3b4c5d6e",
          "run_type": "LLM",
          "share_url": "https://smith.langchain.com/public/4f7a1b2c-8d9e-4a0b-9c1d-2e3f4a5b6c7d/r",
          "start_time": "2024-01-15T10:30:00.000Z",
          "status": "SUCCESS",
          "tags": [
            "production",
            "gpt-4"
          ],
          "thread_evaluation_time": "2023-11-07T05:31:56Z",
          "thread_id": "d4e5f6a7-b8c9-4d5e-1f2a-3b4c5d6e7f8a",
          "total_cost": 0.000525,
          "total_tokens": 350,
          "trace_id": "018e4c7e-a9fb-7ef0-a5b6-6ea3a82e9327"
        }
      ],
      "source_run_id": "3c90c3cc-0d44-4b50-8888-8dd25736052a"
    }
  ],
  "next_cursor": "<string>"
}
{
  "detail": "<string>",
  "instance": "<string>",
  "remedy": "<string>",
  "status": 123,
  "title": "<string>",
  "type": "<string>"
}
{
  "detail": "<string>",
  "instance": "<string>",
  "remedy": "<string>",
  "status": 123,
  "title": "<string>",
  "type": "<string>"
}
{
  "detail": "<string>",
  "instance": "<string>",
  "remedy": "<string>",
  "status": 123,
  "title": "<string>",
  "type": "<string>"
}
{
  "detail": "<string>",
  "instance": "<string>",
  "remedy": "<string>",
  "status": 123,
  "title": "<string>",
  "type": "<string>"
}
{
  "detail": "<string>",
  "instance": "<string>",
  "remedy": "<string>",
  "status": 123,
  "title": "<string>",
  "type": "<string>"
}
{
  "detail": "<string>",
  "instance": "<string>",
  "remedy": "<string>",
  "status": 123,
  "title": "<string>",
  "type": "<string>"
}

Authorizations

​
X-API-Key
string
header
required
​
X-Tenant-Id
string
header
required

Path Parameters

​
dataset_id
string
required

Dataset ID

Body

application/json
​
comparative_experiment_id
string

comparative_experiment_id scopes pairwise-annotation feedback (optional).

​
cursor
string

cursor is the opaque string from a previous response's next_cursor. Absent for the first page.

​
example_ids
string[]

example_ids optionally restricts the page to these dataset example UUIDs (max 1000).

​
experiment_ids
string[]

experiment_ids lists the experiment (tracing session) UUIDs to query. Required, non-empty.

​
filters
object

filters maps a project (session) UUID string to a list of filter expressions (optional).

​
page_size
integer

page_size is the maximum number of examples to return. Defaults to 20, max 100.

​
selects
enum<string>[]

selects lists which run properties to include. Omitted => only id. Tokens mirror /v2/runs/query.

Available options:
ID,
NAME,
RUN_TYPE,
STATUS,
START_TIME,
END_TIME,
LATENCY_SECONDS,
FIRST_TOKEN_TIME,
ERROR,
ERROR_PREVIEW,
EXTRA,
METADATA,
EVENTS,
INPUTS,
INPUTS_PREVIEW,
OUTPUTS,
OUTPUTS_PREVIEW,
MANIFEST,
PARENT_RUN_IDS,
PROJECT_ID,
TRACE_ID,
THREAD_ID,
DOTTED_ORDER,
IS_ROOT,
REFERENCE_EXAMPLE_ID,
REFERENCE_DATASET_ID,
TOTAL_TOKENS,
PROMPT_TOKENS,
COMPLETION_TOKENS,
TOTAL_COST,
PROMPT_COST,
COMPLETION_COST,
PROMPT_TOKEN_DETAILS,
COMPLETION_TOKEN_DETAILS,
PROMPT_COST_DETAILS,
COMPLETION_COST_DETAILS,
PRICE_MODEL_ID,
TAGS,
APP_PATH,
ATTACHMENTS,
THREAD_EVALUATION_TIME,
IS_IN_DATASET,
SHARE_URL,
FEEDBACK_STATS
​
sort
object

sort controls feedback-score sorting (single project only).

Response

OK

​
items
object[]
​
next_cursor
string