Skip to main content
OctoAI offers easy access to efficient compute and enables users to integrate their choice of AI models into applications. The OctoAI compute service helps you run, tune, and scale AI applications easily.

​
Installation and Setup

  • Install the openai Python package: 
    pip install openai
  • Register on OctoAI and get an API Token from your OctoAI account page.

​
Chat models

See a usage example. 
from langchain_community.chat_models import ChatOctoAI

​
LLMs

See a usage example. 
from langchain_community.llms.octoai_endpoint import OctoAIEndpoint

​
Embedding models

from langchain_community.embeddings.octoai_embeddings import OctoAIEmbeddings
Edit the source of this page on GitHub.
Connect these docs programmatically to Claude, VSCode, and more via MCP for real-time answers.