You are currently on a page documenting the use of text completion models. Many of the latest and most popular models are chat completion models.Unless you are specifically using more advanced prompting techniques, you are probably looking for this page instead.
LLMs are language models that takes a string as input and return a string as output.
If you’d like to write your own LLM, see this how-to. If you’d like to contribute an integration, see Contributing integrations.

​
All LLMs

AI21

AlephAlpha

Arcjet Redact

AWS SageMakerEndpoint

Azure OpenAI

Bedrock

ChromeAI

Cloudflare Workers AI

Cohere

Deep Infra

Fireworks

Friendli

Google Vertex AI

Gradient AI

HuggingFaceInference

IBM watsonx.ai

JigsawStack Prompt Engine

Layerup Security

Llama CPP

MistralAI

Ollama

OpenAI

RaycastAI

Replicate

Together AI

Writer

YandexGPT