> ## Documentation Index > Fetch the complete documentation index at: https://nvd-54.mintlify.site/llms.txt > Use this file to discover all available pages before exploring further. # ChatLiteLLM 和 ChatLiteLLMRouter 集成 > 使用 LangChain Python 集成 ChatLiteLLM 和 ChatLiteLLMRouter 聊天模型。 [LiteLLM](https://github.com/BerriAI/litellm) 是一个简化调用 Anthropic、Azure、Huggingface、Replicate 等服务的库。 本笔记本介绍如何开始使用 LangChain + LiteLLM I/O 库。 此集成包含两个主要类： * `ChatLiteLLM`：用于 LiteLLM 基本使用的主要 LangChain 封装 ([文档](https://docs.litellm.ai/docs/))。 * `ChatLiteLLMRouter`：利用 LiteLLM Router 的 `ChatLiteLLM` 封装 ([文档](https://docs.litellm.ai/docs/routing))。 ## 概述 ### 集成详情 | 类 | 包 | 可序列化 | JS 支持 | 下载量 | 版本 | | :--------------------------------------------------------------------------------------------------------------------------- | :----------------------------------------------------------------- | :--: | :---: | :------------------------------------------------------------------------------------------------: | :---------------------------------------------------------------------------------------------: | | [`ChatLiteLLM`](https://reference.langchain.com/python/langchain-litellm/chat_models/litellm/ChatLiteLLM) | [`langchain-litellm`](https://pypi.org/project/langchain-litellm/) | ❌ | ❌ | ![PyPI - Downloads](https://img.shields.io/pypi/dm/langchain-litellm?style=flat-square\&label=%20) | ![PyPI - Version](https://img.shields.io/pypi/v/langchain-litellm?style=flat-square\&label=%20) | | [`ChatLiteLLMRouter`](https://reference.langchain.com/python/langchain-litellm/chat_models/litellm_router/ChatLiteLLMRouter) | [`langchain-litellm`](https://pypi.org/project/langchain-litellm/) | ❌ | ❌ | ![PyPI - Downloads](https://img.shields.io/pypi/dm/langchain-litellm?style=flat-square\&label=%20) | ![PyPI - Version](https://img.shields.io/pypi/v/langchain-litellm?style=flat-square\&label=%20) | ### 模型功能 | [工具调用](/oss/python/langchain/tools) | [结构化输出](/oss/python/langchain/structured-output) | 图像输入 | 音频输入 | 视频输入 | [Token 级流式输出](/oss/python/integrations/chat/litellm#async-and-streaming-functionality) | [原生异步](/oss/python/integrations/chat/litellm#async-and-streaming-functionality) | [Token 用量](/oss/python/langchain/models#token-usage) | [对数概率](/oss/python/langchain/models#log-probabilities) | | :---------------------------------: | :----------------------------------------------: | :--: | :--: | :--: | :------------------------------------------------------------------------------------: | :-----------------------------------------------------------------------------: | :--------------------------------------------------: | :----------------------------------------------------: | | ✅ | ✅ | ✅ | ❌ | ❌ | ✅ | ✅ | ✅ | ❌ | ### 设置 要访问 `ChatLiteLLM` 和 `ChatLiteLLMRouter` 模型，您需要安装 `langchain-litellm` 包并创建 OpenAI、Anthropic、Azure、Replicate、OpenRouter、Hugging Face、Together AI 或 Cohere 账户。然后，您需要获取 API 密钥并将其导出为环境变量。 ## 凭证 您需要选择要使用的大语言模型 (LLM) 提供商，并注册获取其 API 密钥。 ### 示例 - Anthropic 前往 [Claude 控制台](https://console.anthropic.com) 注册并生成 Claude API 密钥。完成后设置 `ANTHROPIC_API_KEY` 环境变量： ### 示例 - OpenAI 前往 [platform.openai.com/api-keys](https://platform.openai.com/api-keys) 注册 OpenAI 并生成 API 密钥。完成后，设置 OPENAI\_API\_KEY 环境变量。 ```python theme={"theme":{"light":"catppuccin-latte","dark":"catppuccin-mocha"}} ## 设置环境变量 import os os.environ["OPENAI_API_KEY"] = "your-openai-key" os.environ["ANTHROPIC_API_KEY"] = "your-anthropic-key" ``` ### 安装 LangChain LiteLLM 集成可在 `langchain-litellm` 包中获取： ```python theme={"theme":{"light":"catppuccin-latte","dark":"catppuccin-mocha"}} pip install -qU langchain-litellm ``` ## 实例化 ### ChatLiteLLM 您可以通过提供 [LiteLLM 支持的](https://docs.litellm.ai/docs/providers) `model` 名称来实例化 `ChatLiteLLM` 模型。 ```python theme={"theme":{"light":"catppuccin-latte","dark":"catppuccin-mocha"}} from langchain_litellm import ChatLiteLLM llm = ChatLiteLLM(model="gpt-5.4-nano", temperature=0.1) ``` ### ChatLiteLLMRouter 您还可以通过按照 [LiteLLM 路由文档](https://docs.litellm.ai/docs/routing) 中的说明定义模型列表来利用 LiteLLM 的路由功能。 ```python theme={"theme":{"light":"catppuccin-latte","dark":"catppuccin-mocha"}} from langchain_litellm import ChatLiteLLMRouter from litellm import Router model_list = [ { "model_name": "gpt-5.4", "litellm_params": { "model": "azure/gpt-5.4", "api_key": "", "api_version": "2024-10-21", "api_base": "https://.openai.azure.com/", }, }, { "model_name": "gpt-5.4", "litellm_params": { "model": "azure/gpt-5.4", "api_key": "", "api_version": "2024-10-21", "api_base": "https://.openai.azure.com/", }, }, ] litellm_router = Router(model_list=model_list) llm = ChatLiteLLMRouter(router=litellm_router, model_name="gpt-5.4", temperature=0.1) ``` ## 调用 无论您实例化的是 `ChatLiteLLM` 还是 `ChatLiteLLMRouter`，现在都可以通过 LangChain 的 API 使用该聊天模型。 ```python theme={"theme":{"light":"catppuccin-latte","dark":"catppuccin-mocha"}} response = await llm.ainvoke( "Classify the text into neutral, negative or positive. Text: I think the food was okay. Sentiment:" ) print(response) ``` ```text theme={"theme":{"light":"catppuccin-latte","dark":"catppuccin-mocha"}} content='Neutral' additional_kwargs={} response_metadata={'token_usage': Usage(completion_tokens=2, prompt_tokens=30, total_tokens=32, completion_tokens_details=CompletionTokensDetailsWrapper(accepted_prediction_tokens=0, audio_tokens=0, reasoning_tokens=0, rejected_prediction_tokens=0, text_tokens=None), prompt_tokens_details=PromptTokensDetailsWrapper(audio_tokens=0, cached_tokens=0, text_tokens=None, image_tokens=None)), 'model': 'gpt-3.5-turbo', 'finish_reason': 'stop', 'model_name': 'gpt-3.5-turbo'} id='run-ab6a3b21-eae8-4c27-acb2-add65a38221a-0' usage_metadata={'input_tokens': 30, 'output_tokens': 2, 'total_tokens': 32} ``` ## 异步和流式输出功能 `ChatLiteLLM` 和 `ChatLiteLLMRouter` 也支持异步和流式输出功能： ```python theme={"theme":{"light":"catppuccin-latte","dark":"catppuccin-mocha"}} async for token in llm.astream("Hello, please explain how antibiotics work"): print(token.text(), end="") ``` ```text theme={"theme":{"light":"catppuccin-latte","dark":"catppuccin-mocha"}} Antibiotics are medications that fight bacterial infections in the body. They work by targeting specific bacteria and either killing them or preventing their growth and reproduction. There are several different mechanisms by which antibiotics work. Some antibiotics work by disrupting the cell walls of bacteria, causing them to burst and die. Others interfere with the protein synthesis of bacteria, preventing them from growing and reproducing. Some antibiotics target the DNA or RNA of bacteria, disrupting their ability to replicate. It is important to note that antibiotics only work against bacterial infections and not viral infections. It is also crucial to take antibiotics as prescribed by a healthcare professional and to complete the full course of treatment, even if symptoms improve before the medication is finished. This helps to prevent antibiotic resistance, where bacteria become resistant to the effects of antibiotics. ``` *** ## API 参考 有关 `ChatLiteLLM` 和 `ChatLiteLLMRouter` 所有功能和配置的详细文档，请前往 [API 参考](https://reference.langchain.com/python/langchain-litellm)。 ***
[Connect these docs](/use-these-docs) to Claude, VSCode, and more via MCP for real-time answers. [Edit this page on GitHub](https://github.com/langchain-ai/docs/edit/main/src/oss/python/integrations/chat/litellm.mdx) or [file an issue](https://github.com/langchain-ai/docs/issues/new/choose).