If you complete these diagnostic steps and still need assistance, refer to Support at the end of this guide for information on what to gather before reaching out.
Prerequisites
Before beginning the diagnostic steps, ensure you have:kubectlaccess to your Kubernetes cluster.- Appropriate permissions to view pods, deployments, services, etc.
- Familiarity with your Helm chart configuration.
Step 1. Understand your deployment
Verify what was deployed and understand the baseline state of your system. This helps you recognize what normal operation looks like and identify deviations when issues occur. Run the following commands to view all deployed Kubernetes resources.Ensure that you’re in the correct namespace when you run the commands in this section. Or, specify the namespace explictly with the
-n flag. For example: kubectl get deployments -n langsmith.lgps resources (only present after creating an Agent Server):
Key deployed components
Your deployment includes the following core components:langsmith-frontend: The LangSmith frontend UI where you create Agent Server deployments. This app makes API calls tolangsmith-host-backend. Part of the control plane.langsmith-host-backend: The LangSmith Deployment control plane that receives requests fromlangsmith-frontendand persists deployment requests to the control plane Postgres database.langsmith-listener: Part of the LangSmith Deployment data plane. Pollslangsmith-host-backendvia HTTP API for deployments to create, update, or delete. Enqueues tasks for worker processes to handle.langsmith-redis: The Redis instance serving as the task queue forlangsmith-listener. The listener enqueues tasks here and workers pull tasks from this queue.langsmith-operator: ThelgpsKubernetes operator that reconciles underlying Kubernetes resources forlgpsresources. Part of the data plane infrastructure.
Additional components may be present in your deployment depending on your configuration. For an overview, refer to LangSmith Deployment components.
Step 2. Enable debug logging
When troubleshooting issues, the first step is typically to enable debug-level logging to gather more detailed information about what’s happening in your system.For control plane or data plane deployments
If you are experiencing issues with a control plane deployment (for example,langsmith-host-backend) or a data plane deployment (for example, langsmith-listener), reinstall the Helm chart with the LOG_LEVEL=DEBUG environment variable. Add the following to your values.yaml file:
For Agent Server deployments
If the issue is with an individual Agent Server deployment:- Navigate to the Deployments tab in the LangSmith UI.
- On a deployment’s view, select + New Revision.
- Add a new environment variable
LOG_LEVELand set it toDEBUG.
You can also find debug logs in the UI on a deployment’s view, click on Server Logs and select Debug for the Log level: Info dropdown.
For widespread issues
If you are unsure where the issue originates, enableDEBUG logging everywhere (control plane, data plane, and all Agent Server deployments).
Review application logs
Tail the logs of each pod to understand baseline behavior:langsmith-listener:Reconciling projects...(appears every 10 seconds)langsmith-operator:Starting reconciliation(appears periodically)
Interpret debug logs
Look for the following problem indicators:- Exceptions or stack traces.
- Error messages (the word
"ERROR"). - Unusual patterns that differ from normal operation.
- Configuration issue: If you suspect a configuration problem, raise the issue with the person who ran
helm install. - User code bug: If you suspect a bug in user code (for example, the LangGraph OSS graph implementation), raise the issue with the owner of the Agent Server application who created the
langgraph.jsonfile.
Step 3. Describe deployments and pods
Describing Kubernetes resources reveals error events and statuses that may not appear in application logs. These errors are typically caused by configuration or infrastructure issues rather than application code bugs. Describing resources also shows their configuration (such as environment variables), which is helpful for debugging. Run the following commands to describe your resources. Describe a Kubernetes deployment:lgps resource (only relevant after creating an Agent Server):
Interpret results
Review theEvents: section of the output and verify that everything is normal. Common issues that appear include:
- Failed liveness or readiness probes
- Image pull errors
- Resource constraints (CPU, memory)
- Volume mount issues
- Configuration errors
Additional resources
For more troubleshooting information, refer to:- Troubleshooting: General troubleshooting guide with solutions to common issues.
- Architectural overview: Details on system architecture and component interactions.
- Self-hosted documentation
Support
If you have followed these diagnostic steps and still need assistance, gather the following information before contacting support:- Output from the diagnostic steps.
- Your Helm chart configuration.
- Relevant error messages and logs.
- Description of what you were trying to do when the issue occurred.