Fetch shared experiment runs for dataset examples

Error

A valid request URL is required to generate request examples

{
  "items": [
    {
      "attachment_urls": {},
      "created_at": "2024-01-15T10:30:00.000Z",
      "dataset_id": "0190a1b2-c3d4-7ef0-a5b6-6ea3a82e9328",
      "id": "018e4c7e-a9fb-7ef0-a5b6-6ea3a82e9327",
      "inputs": {},
      "metadata": {},
      "modified_at": "2024-01-15T10:30:00.000Z",
      "name": "<string>",
      "outputs": {},
      "runs": [
        {
          "app_path": "/app/chains/chat.py:invoke",
          "attachments": {
            "{\"output.png\"": "\"https://storage.example.com/bucket/key?X-Amz-Signature=abc\"}"
          },
          "completion_cost": 0.0003,
          "completion_cost_details": {
            "raw": {}
          },
          "completion_token_details": {
            "raw": {}
          },
          "completion_tokens": 150,
          "dotted_order": "20240115T103000000000Z018e4c7ea9fb7ef0a5b66ea3a82e9327.",
          "end_time": "2024-01-15T10:30:01.500Z",
          "error": "context deadline exceeded",
          "error_preview": "<string>",
          "events": [
            {
              "kwargs": {},
              "name": "new_token",
              "time": "2024-01-15T10:30:00.312Z"
            }
          ],
          "extra": {},
          "feedback_stats": {},
          "first_token_time": "2024-01-15T10:30:00.312Z",
          "id": "018e4c7e-a9fb-7ef0-a5b6-6ea3a82e9327",
          "inputs": {},
          "inputs_preview": "<string>",
          "is_in_dataset": true,
          "is_root": true,
          "latency_seconds": 1.523,
          "manifest": {},
          "metadata": {},
          "name": "ChatOpenAI",
          "outputs": {},
          "outputs_preview": "<string>",
          "parent_run_ids": [
            "018e4c7e-a9fb-7ef0-a5b6-6ea3a82e9327",
            "a1b2c3d4-e5f6-4a5b-8c9d-0e1f2a3b4c5d"
          ],
          "price_model_id": "e5f6a7b8-c9d0-4e1f-2a3b-4c5d6e7f8a9b",
          "project_id": "018e4c7e-a9fb-7ef0-a5b6-6ea3a82e9327",
          "prompt_cost": 0.0002,
          "prompt_cost_details": {
            "raw": {}
          },
          "prompt_token_details": {
            "raw": {}
          },
          "prompt_tokens": 200,
          "reference_dataset_id": "c3d4e5f6-a7b8-4c5d-0e1f-2a3b4c5d6e7f",
          "reference_example_id": "b2c3d4e5-f6a7-4b5c-9d0e-1f2a3b4c5d6e",
          "run_type": "LLM",
          "share_url": "https://smith.langchain.com/public/4f7a1b2c-8d9e-4a0b-9c1d-2e3f4a5b6c7d/r",
          "start_time": "2024-01-15T10:30:00.000Z",
          "status": "SUCCESS",
          "tags": [
            "production",
            "gpt-4"
          ],
          "thread_evaluation_time": "2023-11-07T05:31:56Z",
          "thread_id": "d4e5f6a7-b8c9-4d5e-1f2a-3b4c5d6e7f8a",
          "total_cost": 0.000525,
          "total_tokens": 350,
          "trace_id": "018e4c7e-a9fb-7ef0-a5b6-6ea3a82e9327"
        }
      ],
      "source_run_id": "3c90c3cc-0d44-4b50-8888-8dd25736052a"
    }
  ],
  "next_cursor": "<string>"
}

{
  "detail": "<string>",
  "instance": "<string>",
  "remedy": "<string>",
  "status": 123,
  "title": "<string>",
  "type": "<string>"
}

{
  "detail": "<string>",
  "instance": "<string>",
  "remedy": "<string>",
  "status": 123,
  "title": "<string>",
  "type": "<string>"
}

{
  "detail": "<string>",
  "instance": "<string>",
  "remedy": "<string>",
  "status": 123,
  "title": "<string>",
  "type": "<string>"
}

{
  "detail": "<string>",
  "instance": "<string>",
  "remedy": "<string>",
  "status": 123,
  "title": "<string>",
  "type": "<string>"
}

{
  "detail": "<string>",
  "instance": "<string>",
  "remedy": "<string>",
  "status": 123,
  "title": "<string>",
  "type": "<string>"
}

POST

datasets

public

{share_token}

experiment-runs

Error

A valid request URL is required to generate request examples

{
  "items": [
    {
      "attachment_urls": {},
      "created_at": "2024-01-15T10:30:00.000Z",
      "dataset_id": "0190a1b2-c3d4-7ef0-a5b6-6ea3a82e9328",
      "id": "018e4c7e-a9fb-7ef0-a5b6-6ea3a82e9327",
      "inputs": {},
      "metadata": {},
      "modified_at": "2024-01-15T10:30:00.000Z",
      "name": "<string>",
      "outputs": {},
      "runs": [
        {
          "app_path": "/app/chains/chat.py:invoke",
          "attachments": {
            "{\"output.png\"": "\"https://storage.example.com/bucket/key?X-Amz-Signature=abc\"}"
          },
          "completion_cost": 0.0003,
          "completion_cost_details": {
            "raw": {}
          },
          "completion_token_details": {
            "raw": {}
          },
          "completion_tokens": 150,
          "dotted_order": "20240115T103000000000Z018e4c7ea9fb7ef0a5b66ea3a82e9327.",
          "end_time": "2024-01-15T10:30:01.500Z",
          "error": "context deadline exceeded",
          "error_preview": "<string>",
          "events": [
            {
              "kwargs": {},
              "name": "new_token",
              "time": "2024-01-15T10:30:00.312Z"
            }
          ],
          "extra": {},
          "feedback_stats": {},
          "first_token_time": "2024-01-15T10:30:00.312Z",
          "id": "018e4c7e-a9fb-7ef0-a5b6-6ea3a82e9327",
          "inputs": {},
          "inputs_preview": "<string>",
          "is_in_dataset": true,
          "is_root": true,
          "latency_seconds": 1.523,
          "manifest": {},
          "metadata": {},
          "name": "ChatOpenAI",
          "outputs": {},
          "outputs_preview": "<string>",
          "parent_run_ids": [
            "018e4c7e-a9fb-7ef0-a5b6-6ea3a82e9327",
            "a1b2c3d4-e5f6-4a5b-8c9d-0e1f2a3b4c5d"
          ],
          "price_model_id": "e5f6a7b8-c9d0-4e1f-2a3b-4c5d6e7f8a9b",
          "project_id": "018e4c7e-a9fb-7ef0-a5b6-6ea3a82e9327",
          "prompt_cost": 0.0002,
          "prompt_cost_details": {
            "raw": {}
          },
          "prompt_token_details": {
            "raw": {}
          },
          "prompt_tokens": 200,
          "reference_dataset_id": "c3d4e5f6-a7b8-4c5d-0e1f-2a3b4c5d6e7f",
          "reference_example_id": "b2c3d4e5-f6a7-4b5c-9d0e-1f2a3b4c5d6e",
          "run_type": "LLM",
          "share_url": "https://smith.langchain.com/public/4f7a1b2c-8d9e-4a0b-9c1d-2e3f4a5b6c7d/r",
          "start_time": "2024-01-15T10:30:00.000Z",
          "status": "SUCCESS",
          "tags": [
            "production",
            "gpt-4"
          ],
          "thread_evaluation_time": "2023-11-07T05:31:56Z",
          "thread_id": "d4e5f6a7-b8c9-4d5e-1f2a-3b4c5d6e7f8a",
          "total_cost": 0.000525,
          "total_tokens": 350,
          "trace_id": "018e4c7e-a9fb-7ef0-a5b6-6ea3a82e9327"
        }
      ],
      "source_run_id": "3c90c3cc-0d44-4b50-8888-8dd25736052a"
    }
  ],
  "next_cursor": "<string>"
}

{
  "detail": "<string>",
  "instance": "<string>",
  "remedy": "<string>",
  "status": 123,
  "title": "<string>",
  "type": "<string>"
}

{
  "detail": "<string>",
  "instance": "<string>",
  "remedy": "<string>",
  "status": 123,
  "title": "<string>",
  "type": "<string>"
}

{
  "detail": "<string>",
  "instance": "<string>",
  "remedy": "<string>",
  "status": 123,
  "title": "<string>",
  "type": "<string>"
}

{
  "detail": "<string>",
  "instance": "<string>",
  "remedy": "<string>",
  "status": 123,
  "title": "<string>",
  "type": "<string>"
}

{
  "detail": "<string>",
  "instance": "<string>",
  "remedy": "<string>",
  "status": 123,
  "title": "<string>",
  "type": "<string>"
}

Path Parameters

Dataset share token

Body

application/json

comparative_experiment_id

string

comparative_experiment_id scopes pairwise-annotation feedback (optional).

cursor

string

cursor is the opaque string from a previous response's next_cursor. Absent for the first page.

example_ids

string[]

example_ids optionally restricts the page to these dataset example UUIDs (max 1000).

experiment_ids

string[]

experiment_ids lists the experiment (tracing session) UUIDs to query. Required, non-empty.

filters

object

filters maps a project (session) UUID string to a list of filter expressions (optional).

Show child attributes

page_size

integer

page_size is the maximum number of examples to return. Defaults to 20, max 100.

selects

enum<string>[]

selects lists which run properties to include. Omitted => only id. Tokens mirror /v2/runs/query.

Available options:

ID,

NAME,

RUN_TYPE,

STATUS,

START_TIME,

END_TIME,

LATENCY_SECONDS,

FIRST_TOKEN_TIME,

ERROR,

ERROR_PREVIEW,

EXTRA,

METADATA,

EVENTS,

INPUTS,

INPUTS_PREVIEW,

OUTPUTS,

OUTPUTS_PREVIEW,

MANIFEST,

PARENT_RUN_IDS,

PROJECT_ID,

TRACE_ID,

THREAD_ID,

DOTTED_ORDER,

IS_ROOT,

REFERENCE_EXAMPLE_ID,

REFERENCE_DATASET_ID,

TOTAL_TOKENS,

PROMPT_TOKENS,

COMPLETION_TOKENS,

TOTAL_COST,

PROMPT_COST,

COMPLETION_COST,

PROMPT_TOKEN_DETAILS,

COMPLETION_TOKEN_DETAILS,

PROMPT_COST_DETAILS,

COMPLETION_COST_DETAILS,

PRICE_MODEL_ID,

TAGS,

APP_PATH,

ATTACHMENTS,

THREAD_EVALUATION_TIME,

IS_IN_DATASET,

SHARE_URL,

FEEDBACK_STATS

sort

object

sort controls feedback-score sorting (single project only).

Show child attributes

Response

items

object[]

Show child attributes

next_cursor

string

LangSmith API reference

Fetch experiment runs for dataset examples