Skip to main content
Ollama allows you to run open-source Large Language Models (LLMs), such as gpt-oss, locally. Ollama bundles model weights, configuration, and data into a single package, defined by a Modelfile. It optimizes setup and configuration details, including GPU usage. For a complete list of supported models and model variants, 请参阅 Ollama model library.
API 参考有关所有 features and configuration options, 请前往 ChatOllama API reference.

​
概述

​
集成详情

​
模型功能

​
设置

First, follow these instructions to set up and run a local Ollama instance:
  • Download and install Ollama onto the available supported platforms (including Windows Subsystem for Linux aka WSL, macOS, and Linux)
    • macOS users can install via Homebrew with brew install ollama and start with brew services start ollama
  • Fetch available LLM model via ollama pull <name-of-model>
    • View a list of available models 通过 model library
    • e.g., ollama pull gpt-oss:20b
  • This will download the default tagged version of the model. Typically, the default points to the latest, smallest sized-parameter model.
On Mac, the models will be download to ~/.ollama/models On Linux (or WSL), the models will be stored at /usr/share/ollama/.ollama/models
  • Specify the exact version of the model of interest as such ollama pull gpt-oss:20b (View the various tags for the Vicuna model in this instance)
  • To view all pulled models, use ollama list
  • To chat directly with a model from the command line, use ollama run <name-of-model>
  • View the Ollama documentation for more commands. You can run ollama help in the terminal to see available commands.
要启用模型调用的自动追踪，请设置您的 LangSmith API key:

​
安装

LangChain 的 Ollama 集成位于 langchain-ollama 包中：

​
实例化

现在我们可以实例化模型对象并生成聊天补全：

​
调用

​
工具调用

Ollama tool calling uses the OpenAI compatible web server specification, and you can use it with the default BaseChatModel.bind_tools() methods as described in the LangChain tools documentation. Make sure to select an ollama model that supports tool calling. We can use tool calling with an LLM that has been fine-tuned for tool use such as gpt-oss:
Details on creating custom tools are available in Customize tool properties. Below, we demonstrate how to create a tool using the @tool decorator on a normal python function.

​
Multi-modal

Ollama has limited support for multi-modal LLMs, such as gemma3 Be sure to update Ollama so that you have the most recent version to support multi-modal.

​
Log probabilities

ChatOllama supports token-level log probabilities 通过 logprobs and top_logprobs parameters. Log probabilities indicate how likely each token was at each generation step.

​
Basic usage

​
Top-K alternatives per token

Use top_logprobs to return the most likely alternative tokens at each position:

​
Reasoning models and custom message roles

Some models, such as IBM’s Granite 3.2, support custom message roles to enable thinking processes. 要访问 Granite 3.2’s thinking features, pass a message with a "control" role with content set to "thinking". Because "control" is a non-standard message role, we can use a ChatMessage object to implement it:
Note that the model exposes its thought process in addition to its final response.

​
API 参考

有关所有 ChatOllama 功能和配置的详细文档，请前往 API reference.
Connect these docs to Claude, VSCode, and more via MCP for real-time answers.
Edit this page on GitHub or file an issue.