OctoAI offers easy access to efficient compute and enables users to integrate their choice of AI models into applications. The OctoAI compute service helps you run, tune, and scale AI applications easily.

​
Installation and Setup

  • Install the openai Python package: 
    pip install openai
  • Register on OctoAI and get an API Token from your OctoAI account page.

​
Chat models

See a usage example. 
from langchain_community.chat_models import ChatOctoAI

​
LLMs

See a usage example. 
from langchain_community.llms.octoai_endpoint import OctoAIEndpoint

​
Embedding models

from langchain_community.embeddings.octoai_embeddings import OctoAIEmbeddings