Skip to main content
LegacyCohere has marked their generate endpoint for LLMs as deprecated. Follow their migration guide to start using their Chat API via the ChatCohere integration.
This will help you get started with Cohere completion models (LLMs) using LangChain. For detailed documentation on Cohere features and configuration options, please refer to the API reference.

Overview

Integration details

Setup

To access Cohere models you’ll need to create a Cohere account, get an API key, and install the @langchain/cohere integration package.

Credentials

Head to cohere.com to sign up to Cohere and generate an API key. Once you’ve done this set the COHERE_API_KEY environment variable:
If you want to get automated tracing of your model calls you can also set your LangSmith API key by uncommenting below:

Installation

The LangChain Cohere integration lives in the @langchain/cohere package:

Instantiation

Now we can instantiate our model object and generate text completions:

Custom client for Cohere on Azure, Cohere on AWS Bedrock, and standalone Cohere instance

We can instantiate a custom CohereClient and pass it to the Cohere constructor. Note: If a custom client is provided both COHERE_API_KEY environment variable and apiKey parameter in the constructor will be ignored.

Invocation


API reference

For detailed documentation of all Cohere features and configurations head to the API reference.