The Coding agent type is in beta. It requires an agent-based workspace, which is available on LangSmith Cloud and not on self-hosted LangSmith.
Set up
The pull request connection and the coding charts on the agent Overview appear only on agents with the Coding type.Create an agent with the Coding type
If you send traces with an official LangSmith plugin to an agent ID that does not exist yet, LangSmith creates the agent and sets its type to Coding. Integrations that follow the Coding agent metadata contract get the same behavior. To set the type yourself, set Agent type to Coding when you create an agent. Changing the type of an existing agent requires permission to manage workspace settings. To change it, click the Agent settings icon on the agent’s Overview and select Change agent type.Send traces to the agent
Set up tracing for each coding agent your team uses, and send its traces to your LangSmith agent with the Coding type. Each guide shows how to send traces to that agent. You can send traces from all your coding agents to one LangSmith agent. That lets you run the same evaluators on every coding agent and compare them by harness (the coding agent, such as Claude Code).
To trace every engineer’s sessions, admins can install the Claude Code, Codex, and Cursor plugins with a mobile device management (MDM) tool and lock the agent and workspace the traces go to. For the managed file and the settings you can lock, see Lock settings for Claude Code, Codex, and Cursor.
Connect GitHub or GitLab
Pull request tracking uses the same GitHub and GitLab connections as LangSmith Engine. To connect an account, you need permission to update all of the agent’s environments. Each provider adds its own requirement:- GitHub: Installing the GitHub App for the first time requires permission to install it on your repositories, and your GitHub organization may require an admin to approve it. If you have already connected repositories to Engine, those installations appear in the connection dialog, and you can link them without authorizing GitHub again.
- GitLab: A workspace admin connects the account in workspace settings.
- GitHub Copilot: Records them only on the Local harness, and only for a folder with a Git remote.
- Deep Agents Code: Records them unless you turn off Git trace attribution.
Read the agent Overview
The summary cards at the top compare each metric with the period before:- Always shown: LLM cost, Threads, and Turns / thread.
- Before you connect GitHub or GitLab: Tokens and Cost / 1M tokens.
- After you connect: Cost / merged PR, Cache rate, and Time to merge, which also shows the merge rate. These replace Tokens and Cost / 1M tokens.
- Work type: Threads by the kind of work they ask for: feature, bugfix, refactor, investigation, review, or off topic. This card requires the prebuilt Coding Work Type evaluator, and walks you through setting it up.
- Skill usage: Which skills the coding agents call.
- Cost per PR by state: Average cost of open, closed, and merged pull requests.
- Top PRs by cost: The most expensive pull requests in the time range, with each one’s state, author, threads, turns, and cost. Each row links to the pull request.
- Cost by conversation length: Threads grouped by number of turns, with total cost and average cost per thread and per turn.
Example uses
Find expensive pull requests
Use Top PRs by cost to find the pull requests that cost the most. Open a pull request’s threads to see the models and the user behind it.Check the effect of shorter threads
Each new turn sends the conversation so far, so long threads cost more per turn. If you ask engineers to start new threads more often, use Cost by conversation length to check whether long threads become less common.Compare models
When your team switches models, group cost over time by model to compare spend before and after. Check the merge rate on the Time to merge card in the same time range to see whether pull requests still get merged.See also
- Trace Claude Code sessions
- Trace OpenAI Codex
- Trace Cursor
- Trace GitHub Copilot
- Trace Deep Agents Code
- Route coding agents through the LLM Gateway
- Coding agent metadata contract
- Cost tracking
Connect these docs to your agent of choice via MCP for real-time answers.

