Overview

​

Chat Models

1. Azure OpenAI - Provides access to OpenAI’s powerful models like o3, 4.1, and other models through Microsoft Azure’s secure enterprise platform.
2. Azure AI - Offers access to a variety of models from different providers including Anthropic, DeepSeek, Cohere, Phi and Mistral through a unified API.
3. Azure ML - Allows deployment and management of your own custom models or fine-tuned open-source models with Azure Machine Learning.

​

Azure OpenAI

Microsoft Azure, often referred to as Azure is a cloud computing platform run by Microsoft, which offers access, management, and development of applications and services through global data centers. It provides a range of capabilities, including software as a service (SaaS), platform as a service (PaaS), and infrastructure as a service (IaaS). Microsoft Azure supports many programming languages, tools, and frameworks, including Microsoft-specific and third-party software and systems.

Azure OpenAI is an Azure service with powerful language models from OpenAI including the GPT-3, Codex and Embeddings model series for content generation, summarization, semantic search, and natural language to code translation.

pip install langchain-openai

import os

os.environ["AZURE_OPENAI_ENDPOINT"] = "https://<your-endpoint.openai.azure.com/"
os.environ["AZURE_OPENAI_API_KEY"] = "your AzureOpenAI key"

from langchain_openai import AzureChatOpenAI

​

Azure AI

Azure AI Foundry provides access to a wide range of models from various providers including Azure OpenAI, DeepSeek R1, Cohere, Phi and Mistral through the AzureAIChatCompletionsModel class.

pip install -U langchain-azure-ai

export AZURE_INFERENCE_CREDENTIAL=your-api-key
export AZURE_INFERENCE_ENDPOINT=your-endpoint

from langchain_azure_ai.chat_models import AzureAIChatCompletionsModel

llm = AzureAIChatCompletionsModel(
    model_name="gpt-4o",
    api_version="2024-05-01-preview",
)

​

Azure ML Chat Online Endpoint

​

LLMs

​

Azure ML

from langchain_community.llms.azureml_endpoint import AzureMLOnlineEndpoint

​

Azure OpenAI

from langchain_openai import AzureOpenAI

​

Embedding Models

​

Azure OpenAI

from langchain_openai import AzureOpenAIEmbeddings

​

Azure AI

pip install -U langchain-azure-ai

export AZURE_INFERENCE_CREDENTIAL=your-api-key
export AZURE_INFERENCE_ENDPOINT=your-endpoint

from langchain_azure_ai.embeddings import AzureAIEmbeddingsModel

embed_model = AzureAIEmbeddingsModel(
    model_name="text-embedding-ada-002"
)

​

Document loaders

​

Azure AI Data

Azure AI Studio provides the capability to upload data assets to cloud storage and register existing data assets from the following sources:

• Microsoft OneLake
• Azure Blob Storage
• Azure Data Lake gen 2

pip install azureml-fsspec, azure-ai-generative

from langchain.document_loaders import AzureAIDataLoader

​

Azure AI Document Intelligence

Azure AI Document Intelligence (formerly known as Azure Form Recognizer) is machine-learning based service that extracts texts (including handwriting), tables, document structures, and key-value-pairs from digital or scanned PDFs, images, Office and HTML files. Document Intelligence supports PDF, JPEG/JPG, PNG, BMP, TIFF, HEIF, DOCX, XLSX, PPTX and HTML.

pip install azure-ai-documentintelligence

from langchain.document_loaders import AzureAIDocumentIntelligenceLoader

​

Azure Blob Storage

Azure Blob Storage is Microsoft’s object storage solution for the cloud. Blob Storage is optimized for storing massive amounts of unstructured data. Unstructured data is data that doesn’t adhere to a particular data model or definition, such as text or binary data.

Azure Files offers fully managed file shares in the cloud that are accessible via the industry standard Server Message Block (SMB) protocol, Network File System (NFS) protocol, and Azure Files REST API. Azure Files are based on the Azure Blob Storage.

• Serving images or documents directly to a browser.
• Storing files for distributed access.
• Streaming video and audio.
• Writing to log files.
• Storing data for backup and restore, disaster recovery, and archiving.
• Storing data for analysis by an on-premises or Azure-hosted service.

pip install azure-storage-blob

from langchain_community.document_loaders import AzureBlobStorageContainerLoader

from langchain_community.document_loaders import AzureBlobStorageFileLoader

​

Microsoft OneDrive

Microsoft OneDrive (formerly SkyDrive) is a file-hosting service operated by Microsoft.

pip install o365

from langchain_community.document_loaders import OneDriveLoader

​

Microsoft OneDrive File

Microsoft OneDrive (formerly SkyDrive) is a file-hosting service operated by Microsoft.

pip install o365

from langchain_community.document_loaders import OneDriveFileLoader

​

Microsoft Word

Microsoft Word is a word processor developed by Microsoft.

from langchain_community.document_loaders import UnstructuredWordDocumentLoader

​

Microsoft Excel

Microsoft Excel is a spreadsheet editor developed by Microsoft for Windows, macOS, Android, iOS and iPadOS. It features calculation or computation capabilities, graphing tools, pivot tables, and a macro programming language called Visual Basic for Applications (VBA). Excel forms part of the Microsoft 365 suite of software.

from langchain_community.document_loaders import UnstructuredExcelLoader

​

Microsoft SharePoint

Microsoft SharePoint is a website-based collaboration system that uses workflow applications, “list” databases, and other web parts and security features to empower business teams to work together developed by Microsoft.

from langchain_community.document_loaders.sharepoint import SharePointLoader

​

Microsoft PowerPoint

Microsoft PowerPoint is a presentation program by Microsoft.

from langchain_community.document_loaders import UnstructuredPowerPointLoader

​

Microsoft OneNote

pip install bs4 msal

from langchain_community.document_loaders.onenote import OneNoteLoader

​

Playwright URL Loader

Playwright is an open-source automation tool developed by Microsoft that allows you to programmatically control and automate web browsers. It is designed for end-to-end testing, scraping, and automating tasks across various web browsers such as Chromium, Firefox, and WebKit.

pip install playwright unstructured

from langchain_community.document_loaders.onenote import OneNoteLoader

​

Vector Stores

​

Azure Cosmos DB

​

Azure Cosmos DB for MongoDB (vCore)

Azure Cosmos DB for MongoDB vCore makes it easy to create a database with full native MongoDB support. You can apply your MongoDB experience and continue to use your favorite MongoDB drivers, SDKs, and tools by pointing your application to the API for MongoDB vCore account’s connection string. Use vector search in Azure Cosmos DB for MongoDB vCore to seamlessly integrate your AI-based applications with your data that’s stored in Azure Cosmos DB.

Installation and Setup

pip install pymongo

Deploy Azure Cosmos DB on Microsoft Azure

from langchain_community.vectorstores import AzureCosmosDBVectorSearch

​

Azure Cosmos DB NoSQL

Azure Cosmos DB for NoSQL now offers vector indexing and search in preview. This feature is designed to handle high-dimensional vectors, enabling efficient and accurate vector search at any scale. You can now store vectors directly in the documents alongside your data. This means that each document in your database can contain not only traditional schema-free data, but also high-dimensional vectors as other properties of the documents. This colocation of data and vectors allows for efficient indexing and searching, as the vectors are stored in the same logical unit as the data they represent. This simplifies data management, AI application architectures, and the efficiency of vector-based operations.

Installation and Setup

pip install azure-cosmos

Deploy Azure Cosmos DB on Microsoft Azure

from langchain_community.vectorstores import AzureCosmosDBNoSQLVectorSearch

​

Azure Database for PostgreSQL

Azure Database for PostgreSQL - Flexible Server is a relational database service based on the open-source Postgres database engine. It’s a fully managed database-as-a-service that can handle mission-critical workloads with predictable performance, security, high availability, and dynamic scalability.

​

Azure SQL Database

Azure SQL Database is a robust service that combines scalability, security, and high availability, providing all the benefits of a modern database solution. It also provides a dedicated Vector data type & built-in functions that simplifies the storage and querying of vector embeddings directly within a relational database. This eliminates the need for separate vector databases and related integrations, increasing the security of your solutions while reducing the overall complexity.

Installation and Setup

!pip install langchain-sqlserver==0.1.1

Deploy Azure SQL DB on Microsoft Azure

from langchain_sqlserver import SQLServer_VectorStore

​

Azure AI Search

from langchain_community.vectorstores.azuresearch import AzureSearch

​

Retrievers

​

Azure AI Search

Azure AI Search (formerly known as Azure Search or Azure Cognitive Search ) is a cloud search service that gives developers infrastructure, APIs, and tools for building a rich search experience over private, heterogeneous content in web, mobile, and enterprise applications.

Search is foundational to any app that surfaces text to users, where common scenarios include catalog or document search, online retail apps, or data exploration over proprietary content. When you create a search service, you’ll work with the following capabilities:

• A search engine for full text search over a search index containing user-owned content
• Rich indexing, with lexical analysis and optional AI enrichment for content extraction and transformation
• Rich query syntax for text search, fuzzy search, autocomplete, geo-search and more
• Programmability through REST APIs and client libraries in Azure SDKs
• Azure integration at the data layer, machine learning layer, and AI (AI Services)

from langchain_community.retrievers import AzureAISearchRetriever

​

Vector Store

​

Azure Database for PostgreSQL

Azure Database for PostgreSQL - Flexible Server is a relational database service based on the open-source Postgres database engine. It’s a fully managed database-as-a-service that can handle mission-critical workloads with predictable performance, security, high availability, and dynamic scalability.

​

Tools

​

Azure Container Apps dynamic sessions

pip install langchain-azure-dynamic-sessions

from langchain_azure_dynamic_sessions import SessionsPythonREPLTool

​

Bing Search

from langchain_community.tools.bing_search import BingSearchResults
from langchain_community.utilities import BingSearchAPIWrapper

api_wrapper = BingSearchAPIWrapper()
tool = BingSearchResults(api_wrapper=api_wrapper)

​

Toolkits

​

Azure AI Services

pip install azure-ai-formrecognizer azure-cognitiveservices-speech azure-ai-vision-imageanalysis

from langchain_community.agent_toolkits import azure_ai_services

​

Azure AI Services individual tools

• Image Analysis: AzureAiServicesImageAnalysisTool
• Document Intelligence: AzureAiServicesDocumentIntelligenceTool
• Speech to Text: AzureAiServicesSpeechToTextTool
• Text to Speech: AzureAiServicesTextToSpeechTool
• Text Analytics for Health: AzureAiServicesTextAnalyticsForHealthTool

​

Azure Cognitive Services

pip install azure-ai-formrecognizer azure-cognitiveservices-speech azure-ai-vision-imageanalysis

from langchain_community.agent_toolkits import AzureCognitiveServicesToolkit

​

Azure AI Services individual tools

• AzureCogsFormRecognizerTool: Form Recognizer API
• AzureCogsImageAnalysisTool: Image Analysis API
• AzureCogsSpeech2TextTool: Speech2Text API
• AzureCogsText2SpeechTool: Text2Speech API
• AzureCogsTextAnalyticsHealthTool: Text Analytics for Health API

from langchain_community.tools.azure_cognitive_services import (
    AzureCogsFormRecognizerTool,
    AzureCogsImageAnalysisTool,
    AzureCogsSpeech2TextTool,
    AzureCogsText2SpeechTool,
    AzureCogsTextAnalyticsHealthTool,
)

​

Microsoft Office 365 email and calendar

pip install O365

from langchain_community.agent_toolkits import O365Toolkit

​

Office 365 individual tools

• O365CreateDraftMessage: creating a draft email in Office 365
• O365SearchEmails: searching email messages in Office 365
• O365SearchEvents: searching calendar events in Office 365
• O365SendEvent: sending calendar events in Office 365
• O365SendMessage: sending an email in Office 365

from langchain_community.tools.office365 import O365CreateDraftMessage
from langchain_community.tools.office365 import O365SearchEmails
from langchain_community.tools.office365 import O365SearchEvents
from langchain_community.tools.office365 import O365SendEvent
from langchain_community.tools.office365 import O365SendMessage

​

Microsoft Azure PowerBI

pip install azure-identity

from langchain_community.agent_toolkits import PowerBIToolkit
from langchain_community.utilities.powerbi import PowerBIDataset

​

PowerBI individual tools

• InfoPowerBITool: getting metadata about a PowerBI Dataset
• ListPowerBITool: getting tables names
• QueryPowerBITool: querying a PowerBI Dataset

from langchain_community.tools.powerbi.tool import InfoPowerBITool
from langchain_community.tools.powerbi.tool import ListPowerBITool
from langchain_community.tools.powerbi.tool import QueryPowerBITool

​

PlayWright Browser Toolkit

Playwright is an open-source automation tool developed by Microsoft that allows you to programmatically control and automate web browsers. It is designed for end-to-end testing, scraping, and automating tasks across various web browsers such as Chromium, Firefox, and WebKit.

pip install playwright lxml

from langchain_community.agent_toolkits import PlayWrightBrowserToolkit

​

PlayWright Browser individual tools

from langchain_community.tools.playwright import ClickTool
from langchain_community.tools.playwright import CurrentWebPageTool
from langchain_community.tools.playwright import ExtractHyperlinksTool
from langchain_community.tools.playwright import ExtractTextTool
from langchain_community.tools.playwright import GetElementsTool
from langchain_community.tools.playwright import NavigateTool
from langchain_community.tools.playwright import NavigateBackTool

​

Graphs

​

Azure Cosmos DB for Apache Gremlin

pip install gremlinpython

from langchain_community.graphs import GremlinGraph
from langchain_community.graphs.graph_document import GraphDocument, Node, Relationship

​

Utilities

​

Bing Search API

Microsoft Bing, commonly referred to as Bing or Bing Search, is a web search engine owned and operated by Microsoft.

from langchain_community.utilities import BingSearchAPIWrapper

​

More

​

Microsoft Presidio

Presidio (Origin from Latin praesidium ‘protection, garrison’) helps to ensure sensitive data is properly managed and governed. It provides fast identification and anonymization modules for private entities in text and images such as credit card numbers, names, locations, social security numbers, bitcoin wallets, US phone numbers, financial data and more.

pip install langchain-experimental openai presidio-analyzer presidio-anonymizer spacy Faker
python -m spacy download en_core_web_lg

from langchain_experimental.data_anonymizer import PresidioAnonymizer, PresidioReversibleAnonymizer