Skip to main content

API rate limits

LangSmith enforces rate limits on API endpoints to ensure service stability and fair usage. The following table shows the rate limits for different endpoints in the GCP US and GCP EU regions. GCP APAC and AWS US enforce comparable service-specific limits; contact support if you need exact limits for your organization. Note that:
  • Rate limits are expressed as count / interval where count is the number of requests allowed within the interval (in seconds). For example, 2000 / 10 means 2000 requests per 10 seconds.
  • When no HTTP method is specified in the endpoint column, the rate limit applies to all HTTP methods for that endpoint.
  • When a specific method is listed (e.g., POST, GET), the rate limit applies only to that method.

Rate limit categories

  • High throughput: General high-volume endpoints for core operations like authentication, metadata, and feedback.
  • Repository: Repository and prompt management operations.
  • Run ingest: Individual trace/run ingestion endpoints for observability.
  • Charts: Chart generation and visualization endpoints.
  • Multipart ingest: Bulk run ingestion via multipart upload for high-volume tracing.
  • Run query (API): API key-based run query operations with stricter limits for complex queries.
  • Run query (User): User-based run query operations with higher limits for interactive use.
  • Generation: AI-powered code and content generation endpoints (limited to prevent abuse).
  • Commits: Prompt versioning and commit operations.
  • Deletion: Session deletion and workflow trigger operations.
  • Run lookup: Retrieving specific runs by UUID.
  • Examples: Fetching dataset examples for few-shot prompting.
  • Default (API key): Fallback rate limit for authenticated API requests not matching specific patterns.
  • Default (User): Fallback rate limit for authenticated user requests not matching specific patterns.
  • Public download: High-volume public download endpoints for shared resources.
  • Stats: Run statistics and analytics endpoints (region-specific limits apply).
  • Public (catch-all): Default rate limit for unauthenticated public access.
For more information on rate limits and other service limits, refer to the Administration overview.