Skip to main content

Setup

BYOC is generally available (GA) on AWS with a US control plane. Support for additional cloud providers is planned for the second half of 2026. See Regions and cloud providers for the supported AWS regions.
No. LangChain recommends a fresh account for clearer billing, and because some permissions cannot be scoped to specific resources, but it is not required.
Not today. LangChain provisions a dedicated VPC for each data plane. Support for deploying into an existing VPC is planned.
No, and there are no plans to support it. LangChain operates the cluster on your behalf, including upgrades and patching, and a dedicated cluster is what makes managing it reliably possible.
Yes, as long as they do not interfere with the functioning of LangSmith.In the AWS account, keep in mind that some permissions granted to the cross-account role cannot be scoped by tag, which is why LangChain recommends a dedicated account.In the Kubernetes cluster, passive workloads that do not interfere with LangSmith are fine, such as observability and security monitoring agents. When you deploy them:
  • Use your own node groups and tolerations rather than the ones LangSmith runs on.
  • Deploy into namespaces other than the ones LangSmith uses.
  • Do not edit the resources LangChain provisions.
LangChain is not responsible for downtime or issues caused by interfering workloads.
End-to-end provisioning of a data plane takes around 60 to 90 minutes. Provisioning time can vary, because AWS resource provisioning is inconsistent.
The data plane transitions to Provisioning Failed. Failures are usually caused by missing permissions on the cross-account role, or by a service control policy (SCP) that blocks an action LangChain needs to take.Apply the langsmith-byoc-role Terraform module exactly as published, with no edits or changes. A modified module is a common source of missing permissions.Contact the LangChain team. Once the permissions are corrected, provisioning reconciles automatically.
A private RFC 1918 range between /18 and /16. LangChain provisions a dedicated VPC for the data plane in that range.If you plan to use VPC peering, select a range that does not overlap with the VPC you intend to peer with. The CIDR range cannot be changed after provisioning.
Data planes are provisioned with a private endpoint by default, so you need private connectivity such as Tailscale, AWS PrivateLink, or VPC peering.
No. Services sit behind a private load balancer by default, reachable only from inside your VPC or through the private connectivity you configure.Data plane endpoints can be made public at provisioning time. See Onboarding.
No. Data planes are provisioned under the standard LangChain BYOC domain. Find your data plane API URL under Settings > Data Planes.
Re-apply the langsmith-byoc-role Terraform module with allow_delete_permissions = true, which grants the permissions needed to delete LangSmith-managed resources.Then select Delete Data Plane in the LangSmith UI. LangChain deprovisions the infrastructure in your account.

Data and security

No. When a user opens aws.smith.langchain.com, the browser fetches the LangSmith UI bundle from LangChain’s cloud. Once loaded, the application routes every request for sensitive data to your VPC.See Data traffic.
LangChain can manage the infrastructure of the resources LangSmith created, and nothing else. Permissions are scoped by the managed_by=langsmith tag, so the role cannot act on unrelated resources in your account.The role holds no permissions that grant data access. See How least privilege is enforced.
No. The cross-account role is infrastructure-scoped rather than data-scoped. It can manage the resources that hold your data, but holds no s3:GetObject on the trace bucket, no rds-db:connect to PostgreSQL, and no elasticache:Connect to Redis.Access to the data itself requires you to explicitly grant it, such as during an incident. See How least privilege is enforced.
There is no standing data access. If an incident requires access to your data, LangChain either asks you to run the queries yourself, or requests break-glass access.
Not today. Data is encrypted at rest with cloud provider managed keys. Support for customer-managed encryption keys (CMK) is planned.
You create and own the cross-account role in your own account, so you can revoke access without involving LangChain. Removing the role, or its trust relationship with the LangChain account, stops the control plane from assuming it, and stops reconciliation of data plane resources.
Yes, but the role needs its permissions for continuous reconciliation of the data plane, and to manage, upgrade, and scale it. Removing them can break those operations.If you need to remove specific permissions, contact the LangChain team first so the change can be reviewed. LangChain is not responsible for downtime or issues caused by permissions removed without that review.
Authentication, organization and workspace configuration, billing and usage metadata, hashed API keys, and the static frontend assets.Traces, prompts, datasets, evaluators, experiments, insights runs, annotation queues, agent deployments, and workspace secrets all live in your data plane.
Only operational data, and it travels over PrivateLink rather than the public internet:
  • Authentication requests: The data plane calls the control plane to authenticate requests, validate API keys, and resolve roles and permissions.
  • Configuration: Organization and workspace configuration loaded from the control plane.
  • Billing and usage metadata.
  • Operational telemetry.
Sensitive data such as traces does not leave your account. It goes only from the data plane to the end user requesting it. See Data traffic.
No.
  • Control plane to data plane: All communication travels over AWS PrivateLink, in both directions.
  • S3: Traffic goes over a VPC endpoint, encrypted with HTTPS.
  • Container images: Pulled from the LangChain account over a VPC endpoint.
See Connectivity.
Not today. Container images are pulled from the LangChain AWS account over a VPC endpoint. Support for private registries is on the roadmap.
Over AWS PrivateLink. The management path exposes only your cluster’s Kubernetes API server, which LangChain uses to install and reconcile the LangSmith components.The EKS cluster is private: the API server endpoint has no public access, and worker nodes have no public IP addresses. Your data is not reachable over that connection, and LangChain does not reach your environment over the public internet. See Connectivity.
The control plane runs in us-east-2 regardless of where you place your data planes. If you provision a data plane in an EU or APAC region, your sensitive application data stays in that region while control plane metadata remains in the US. See Regions and cloud providers.

Data planes and workspaces

Data planes belong to an organization, and workspaces belong to exactly one data plane. Use data planes for physical separation of data, and workspaces for logical separation within a data plane. See Organizations, data planes, and workspaces.
Yes. An organization can have several data planes, each in its own AWS account and region.The default limit is five data planes per organization. To deploy more than that, contact the LangChain team.
Yes. A workspace on LangSmith Cloud routes to the LangChain-managed backend rather than to a data plane, so both can coexist in the same organization. This also means you can move from an AWS Cloud trial to BYOC while reusing the same organization, users, roles, and SSO configuration.

Operations

LangChain upgrades the LangSmith version in your data plane once a week. Upgrades are rolling, so there is no whole-service downtime. Supporting services such as Istio and KEDA are upgraded on a regular cadence, and LangChain manages all EKS cluster upgrades.Support for release channels is coming soon. See Operations.
LangChain owns and performs EKS upgrades proactively, ahead of AWS end-of-support dates, and coordinates the window with you.Control plane upgrades are transparent. Node group upgrades roll nodes one by one with make-before-break semantics, so you might see brief connection resets as pods restart, but no data loss. See Kubernetes cluster upgrades.
No. Services run multiple replicas sized by a horizontal pod autoscaler, and pod disruption budgets cap how many replicas can be unavailable at once, so neither a rolling update nor a node drain takes a service below the capacity it needs.Maintenance that could cause downtime, such as a restart of RDS or ElastiCache, happens in a scheduled maintenance window that LangChain coordinates with you in advance.
LangChain operates the data plane after provisioning, including monitoring for uptime and error recovery, scaling, upgrades, and security patching. Because the deployment runs in your own account, the cloud controls you already operate apply to it as well.
Yes. You can install observability tooling such as collectors and agents into the EKS cluster, as long as it does not interfere with the operation of LangSmith.LangSmith services emit logs, metrics, and traces the same way they do on self-hosted, so the same configuration applies. See Export LangSmith telemetry to your observability backend.
Data planes are provisioned for high availability by default, running across multiple availability zones within a single region. All stateful components are backed up.A data plane does not span regions, so recovery from the loss of an entire region relies on those backups. See High availability.
Backups run in your own account:
  • RDS: Backups are taken daily.
  • ClickHouse: Backups are taken daily and stored in an S3 bucket.
  • ElastiCache: No backups are taken, because the data is ephemeral.
No. The data plane runs in your AWS account, so its availability depends on resources you control, including the account itself, the private connectivity you configure to reach the data plane, and the service quotas and policies that apply to the account. LangChain does not commit to an uptime target for infrastructure it does not solely control.LangChain still monitors the data plane for uptime and error recovery, scales it, and applies upgrades and security patches. See Operations.

Cost

Two separate bills:
  • Infrastructure: The data plane runs in your own AWS account, so you own the infrastructure and pay for it through your cloud provider bill.
  • LangSmith: Invoiced by LangChain based on your contract and usage.
LangChain provides integrations with AWS Marketplace.

Features and migration

See Available features for the current list of supported features.
Partly. Users, roles, datasets, experiments, prompts, annotation queue configuration, automation rules, and dashboards can be copied over from a Cloud or self-hosted instance. Traces are not migrated today. To plan a migration, contact the LangChain sales team.

See also