Skip to main content
Customers are turning to SambaNova to quickly deploy state-of-the-art AI capabilities to gain competitive advantage. Our purpose-built enterprise-scale AI platform is the technology backbone for the next generation of AI computing. We power the foundation models that unlock the valuable business insights trapped in data. Designed for AI, the SambaNova RDU was built with a revolutionary dataflow architecture. This design makes the RDU significantly more efficient for these workloads than GPUs as it eliminates redundant calls to memory, which are an inherent limitation of how GPUs function. This built-in efficiency is one of the features that makes the RDU capable of much higher performance than GPUs in a fraction of the footprint. On top of our architecture We have developed some platforms that allow companies and developers to get full advantage of the RDU processors and open source models.

​
Installation and setup

Install the integration package:

​
API Key

Set your API key it as an environment variable: If you are a SambaCloud user request an API key and set it as an environment variable:
Or if you are SambaStack user set your base URL and API key as environment variables:

​
Chat models

For a detailed walkthrough of the ChatSambaNova component, see the usage example

​
Embedding models

For a detailed walkthrough of the SambaNovaEmbeddings component, see the usage example
SambaNova API Reference
Connect these docs to Claude, VSCode, and more via MCP for real-time answers.
Edit this page on GitHub or file an issue.