简报·YT
← 返回 GitHub 动态
ollama/ollama · 📌 手动指定 已完成

ollama/ollama v0.40.2

2026-10-08 16:53 · ⭐ 18.3万 · GitHub Release 原文 ↗
#模型升级 #备份清理 #版本发布

ollama/ollama v0.40.2

一句话概括:本版本引入模型后台自动升级机制,把旧版本下载的模型自动迁移到 llama.cpp 运行时以提升性能与兼容性,同时保留原模型作为降级备份,并附带若干列表显示与启动参数的修复。

要点

curl -s localhost:11434/api/tags | jq -r '.models[].name' | while read -r m; do
  curl -s localhost:11434/api/show -d "{\"model\":\"$m\"}" | jq -r \
    'select(any(.manifests[]?; .runner == "llamacpp")) | .manifests[] | select(.runner == "ggml") | .digest'
done | sort -u | xargs -n1 ollama rm
▸ Release Notes 英文原文(1452 字符)
## Model upgrades Models downloaded with earlier versions of Ollama are upgraded in the background the first time you run them, for better performance and compatibility when running on llama.cpp. To make downgrading safe, Ollama keeps the original copy as a backup, so upgraded models are temporarily kept on disk. A future release will remove these backups automatically. To remove backed up models now (requires `jq`): ```shell curl -s localhost:11434/api/tags | jq -r '.models[].name' | while read -r m; do curl -s localhost:11434/api/show -d "{\"model\":\"$m\"}" | jq -r \ 'select(any(.manifests[]?; .runner == "llamacpp")) | .manifests[] | select(.runner == "ggml") | .digest' done | sort -u | xargs -n1 ollama rm ``` This only deletes the backups. If you later downgrade to a version older than 0.40, you'll need to re-pull those models. **Other changes** * `ollama list` no longer shows duplicate entries for upgraded models by @dhiltgen in https://github.com/ollama/ollama/pull/18874 * `ollama launch claude` uses the model's full context length by @jberg5 in https://github.com/ollama/ollama/pull/18855 * README: add oxi to community integrations by @maziluiosif in https://github.com/ollama/ollama/pull/18739 ## New Contributors * @maziluiosif made their first contribution in https://github.com/ollama/ollama/pull/18739 **Full Changelog**: https://github.com/ollama/ollama/compare/v0.40.1...v0.40.2-rc0
▸ 主项目介绍 · ollama/ollama
▸ README 原文(同步于 2026-07-19 13:23)
<p align="center"> <a href="https://ollama.com"> <img src="https://github.com/ollama/ollama/assets/3325447/0d0b44e2-8f4a-4e99-9b52-a5c1c741c8f7" alt="ollama" width="200"/> </a> </p> # Ollama Start building with open models. ## Download ### macOS ```shell curl -fsSL https://ollama.com/install.sh | sh ``` or [download manually](https://ollama.com/download/Ollama.dmg) ### Windows ```shell irm https://ollama.com/install.ps1 | iex ``` or [download manually](https://ollama.com/download/OllamaSetup.exe) ### Linux ```shell curl -fsSL https://ollama.com/install.sh | sh ``` [Manual install instructions](https://docs.ollama.com/linux#manual-install) ### Docker The official [Ollama Docker image](https://hub.docker.com/r/ollama/ollama) `ollama/ollama` is available on Docker Hub. ### Libraries - [ollama-python](https://github.com/ollama/ollama-python) - [ollama-js](https://github.com/ollama/ollama-js) ### Community - [Discord](https://discord.gg/ollama) - [𝕏 (Twitter)](https://x.com/ollama) - [Reddit](https://reddit.com/r/ollama) ## Get started ``` ollama ``` You'll be prompted to run a model or connect Ollama to your existing agents or applications such as `Claude Code`, `OpenClaw`, `OpenCode` , `Codex`, `Copilot`, and more. ### Coding To launch a specific integration: ``` ollama launch claude ``` Supported integrations include [Claude Code](https://docs.ollama.com/integrations/claude-code), [Codex](https://docs.ollama.com/integrations/codex), [Copilot CLI](https://docs.ollama.com/integrations/copilot-cli), [Droid](https://docs.ollama.com/integrations/droid), and [OpenCode](https://docs.ollama.com/integrations/opencode). ### AI assistant Use [OpenClaw](https://docs.ollama.com/integrations/openclaw) to turn Ollama into a personal AI assistant across WhatsApp, Telegram, Slack, Discord, and more: ``` ollama launch openclaw ``` ### Chat with a model Run and chat with [Gemma 4](https://ollama.com/library/gemma4): ``` ollama run gemma4 ``` See [ollama.com/library](https://ollama.com/library) for the full list. See the [quickstart guide](https://docs.ollama.com/quickstart) for more details. ## REST API Ollama has a REST API for running and managing models. ``` curl http://localhost:11434/api/chat -d '{ "model": "gemma4", "messages": [{ "role": "user", "content": "Why is the sky blue?" }], "stream": false }' ``` See the [API documentation](https://docs.ollama.com/api) for all endpoints. ### Python ``` pip install ollama ``` ```python from ollama import chat response = chat(model='gemma4', messages=[ { 'role': 'user', 'content': 'Why is the sky blue?', }, ]) print(response.message.content) ``` ### JavaScript ``` npm i ollama ``` ```javascript import ollama from "ollama"; const response = await ollama.chat({ model: "gemma4", messages: [{ role: "user", content: "Why is the sky blue?" }], }); console.log(response.message.content); ``` ## Supported backends - [llama.cpp](https://github.com/ggml-org/llama.cpp) project founded by Georgi Gerganov. ## Documentation - [CLI reference](https://docs.ollama.com/cli) - [REST API reference](https://docs.ollama.com/api) - [Importing models](https://docs.ollama.com/import) - [Modelfile reference](https://docs.ollama.com/modelfile) - [Building from source](https://github.com/ollama/ollama/blob/main/docs/development.md) ## Community Integrations > Want to add your project? Open a pull request. ### Chat Interfaces #### Web - [Open WebUI](https://github.com/open-webui/open-webui) - Extensible, self-hosted AI interface - [Onyx](https://github.com/onyx-dot-app/onyx) - Connected AI workspace - [LibreChat](https://github.com/danny-avila/LibreChat) - Enhanced ChatGPT clone with multi-provider support - [Lobe Chat](https://github.com/lobehub/lobe-chat) - Modern chat framework with plugin ecosystem ([docs](https://lobehub.com/docs/self-hosting/examples/ollama)) - [NextChat](https://github.com/ChatGPTNextWeb/ChatGPT-Next-Web) - Cross-platform ChatGPT UI ([docs](https://docs.nextchat.dev/models/ollama)) - [Perplexica](https://github.com/ItzCrazyKns/Perplexica) - AI-powered search engine, open-source Perplexity alternative - [big-AGI](https://github.com/enricoros/big-AGI) - AI suite for professionals - [Lollms WebUI](https://github.com/ParisNeo/lollms-webui) - Multi-model web interface - [ChatOllama](https://github.com/sugarforever/chat-ollama) - Chatbot with knowledge bases - [Bionic GPT](https://github.com/bionic-gpt/bionic-gpt) - On-premise AI platform - [Chatbot UI](https://github.com/ivanfioravanti/chatbot-ollama) - ChatGPT-style web interface - [Hollama](https://github.com/fmaclen/hollama) - Minimal web interface - [Chatbox](https://github.com/Bin-Huang/Chatbox) - Desktop and web AI client - [chat](https://github.com/swuecho/chat) - Chat web app for teams - [Ollama RAG Chatbot](https://github.com/datvodinh/rag-chatbot.git) - Chat with multiple PDFs using RAG - [Tkinter-based client](https://github.com/chyok/ollama-gui) - Python desktop client #### Desktop - [Dify.AI](https://github.com/langgenius/dify) - LLM app development platform - [AnythingLLM](https://github.com/Mintplex-Labs/anything-llm) - All-in-one AI app for Mac, Windows, and Linux - [Maid](https://github.com/Mobile-Artificial-Intelligence/maid) - Cross-platform mobile and desktop client - [Witsy](https://github.com/nbonamy/witsy) - AI desktop app for Mac, Windows, and Linux - [Cherry Studio](https://github.com/kangfenmao/cherry-studio) - Multi-provider desktop client - [Ollama App](https://github.com/JHubi1/ollama-app) - Multi-platform client for desktop and mobile - [PyGPT](https://github.com/szczyglis-dev/py-gpt) - AI desktop assistant for Linux, Windows, and Mac - [Alpaca](https://github.com/Jeffser/Alpaca) - GTK4 client for Linux and macOS - [SwiftChat](https://github.com/aws-samples/swift-chat) - Cross-platform including iOS, Android, and Apple Vision Pro - [Enchanted](https://github.com/AugustDev/enchanted) - Native macOS and iOS client - [RWKV-Runner](https://github.com/josStorer/RWKV-Runner) - Multi-model desktop runner - [Ollama Grid Search](https://github.com/dezoito/ollama-grid-search) - Evaluate and compare models - [macai](https://github.com/Renset/macai) - macOS client for Ollama and ChatGPT - [AI Studio](https://github.com/MindWorkAI/AI-Studio) - Multi-provider desktop IDE - [Reins](https://github.com/ibrahimcetin/reins) - Parameter tuning and reasoning model support - [ConfiChat](https://github.com/1runeberg/confichat) - Privacy-focused with optional encryption - [LLocal.in](https://github.com/kartikm7/llocal) - Electron desktop client - [MindMac](https://mindmac.app) - AI chat client for Mac - [Msty](https://msty.app) - Multi-model desktop client - [BoltAI for Mac](https://boltai.com) - AI chat client for Mac - [IntelliBar](https://intellibar.app/) - AI-powered assistant for macOS - [Kerlig AI](https://www.kerlig.com/) - AI writing assistant for macOS - [Hillnote](https://hillnote.com) - Markdown-first AI workspace - [Perfect Memory AI](https://www.perfectmemory.ai/) - Productivity AI personalized by screen and meeting history #### Mobile - [Ollama Android Chat](https://github.com/sunshine0523/OllamaServer) - One-click Ollama on Android > SwiftChat, Enchanted, Maid, Ollama App, Reins, and ConfiChat listed above also support mobile platforms. ### Code Editors & Development - [Cline](https://github.com/cline/cline) - VS Code extension for multi-file/whole-repo coding - [Continue](https://github.com/continuedev/continue) - Open-source AI code assistant for any IDE - [Void](https://github.com/voideditor/void) - Open source AI code editor, Cursor alternative - [Copilot for Obsidian](https://github.com/logancyang/obsidian-copilot) - AI assistant for Obsidian - [twinny](https://github.com/rjmacarthy/twinny) - Copilot and Copilot chat alternative - [gptel Emacs client](https://github.com/karthink/gptel) - LLM client for Emacs - [Ollama Copilot](https://github.com/bernardo-bruning/ollama-copilot) - Use Ollama as GitHub Copilot - [Obsidian Local GPT](https://github.com/pfrankov/obsidian-local-gpt) - Local AI for Obsidian - [Ellama Emacs client](https://github.com/s-kostyaev/ellama) - LLM tool for Emacs - [orbiton](https://github.com/xyproto/orbiton) - Config-free text editor with Ollama tab completion - [AI ST Completion](https://github.com/yaroslavyaroslav/OpenAI-sublime-text) - Sublime Text 4 AI assistant - [VT Code](https://github.com/vinhnx/vtcode) - Rust-based terminal coding agent with Tree-sitter - [QodeAssist](https://github.com/Palm1r/QodeAssist) - AI coding assistant for Qt Creator - [AI Toolkit for VS Code](https://aka.ms/ai-tooklit/ollama-docs) - Microsoft-official VS Code extension - [Open Interpreter](https://docs.openinterpreter.com/language-model-setup/local-models/ollama) - Natural language interface for computers ### Libraries & SDKs - [LiteLLM](https://github.com/BerriAI/litellm) - Unified API for 100+ LLM providers - [Semantic Kernel](https://github.com/microsoft/semantic-kernel/tree/main/python/semantic_kernel/connectors/ai/ollama) - Microsoft AI orchestration SDK - [LangChain4j](https://github.com/langchain4j/langchain4j) - Java LangChain ([example](https://github.com/langchain4j/langchain4j-examples/tree/main/ollama-examples/src/main/java)) - [LangChainGo](https://github.com/tmc/langchaingo/) - Go LangChain ([example](https://github.com/tmc/langchaingo/tree/main/examples/ollama-completion-example)) - [Spring AI](https://github.com/spring-projects/spring-ai) - Spring framework AI support ([docs](https://docs.spring.io/spring-ai/reference/api/chat/ollama-chat.html)) - [LangChain](https://python.langchain.com/docs/integrations/chat/ollama/) and [LangChain.js](https://js.langchain.com/docs/integrations/chat/ollama/) with [example](https://js.langchain.com/docs/tutorials/local_rag/) - [Ollama for Ruby](https://github.com/crmne/ruby_llm) - Ruby LLM library - [any-llm](https://github.com/mozilla-ai/any-llm) - Unified LLM interface by Mozilla - [OllamaSharp for .NET](https://github.com/awaescher/OllamaSharp) - .NET SDK - [LangChainRust](https://github.com/Abraxas-365/langchain-rust) - Rust LangChain ([example](https://github.com/Abraxas-365/langchain-rust/blob/main/examples/llm_ollama.rs)) - [Agents-Flex for Java](https://github.com/agents-flex/agents-flex) - Java agent framework ([example](https://github.com/agents-flex/agents-flex/tree/main/agents-flex-llm/agents-flex-llm-ollama/src/test/java/com/agentsflex/llm/ollama)) - [Elixir LangChain](https://github.com/brainlid/langchain) - Elixir LangChain - [Ollama-rs for Rust](https://github.com/pepperoni21/ollama-rs) - Rust SDK - [LangChain for .NET](https://github.com/tryAGI/LangChain) - .NET LangChain ([example](https://github.com/tryAGI/LangChain/blob/main/examples/LangChain.Samples.OpenAI/Program.cs)) - [chromem-go](https://github.com/philippgille/chromem-go) - Go vector database with Ollama embeddings ([example](https://github.com/philippgille/chromem-go/tree/v0.5.0/examples/rag-wikipedia-ollama)) - [LangChainDart](https://github.com/davidmigloz/langchain_dart) - Dart LangChain - [LlmTornado](https://github.com/lofcz/llmtornado) - Unified C# interface for multiple inference APIs - [Ollama4j for Java](https://github.com/ollama4j/ollama4j) - Java SDK - [Ollama for Laravel](https://github.com/cloudstudio/ollama-laravel) - Laravel integration - [Ollama for Swift](https://github.com/mattt/ollama-swift) - Swift SDK - [LlamaIndex](https://docs.llamaindex.ai/en/stable/examples/llm/ollama/) and [LlamaIndexTS](https://ts.llamaindex.ai/modules/llms/available_llms/ollama) - Data framework for LLM apps - [Haystack](https://github.com/deepset-ai/haystack-integrations/blob/main/integrations/ollama.md) - AI pipeline framework - [Firebase Genkit](https://firebase.google.com/docs/genkit/plugins/ollama) - Google AI framework - [Ollama-hpp for C++](https://github.com/jmont-dev/ollama-hpp) - C++ SDK - [PromptingTools.jl](https://github.com/svilupp/PromptingTools.jl) - Julia LLM toolkit ([example](https://svilupp.github.io/PromptingTools.jl/dev/examples/working_with_ollama)) - [Ollama for R - rollama](https://github.com/JBGruber/rollama) - R SDK - [Portkey](https://portkey.ai/docs/welcome/integration-guides/ollama) - AI gateway - [Testcontainers](https://testcontainers.com/modules/ollama/) - Container-based testing - [LLPhant](https://github.com/theodo-group/LLPhant?tab=readme-ov-file#ollama) - PHP AI framework ### Frameworks & Agents - [AutoGPT](https://github.com/Significant-Gravitas/AutoGPT/blob/master/docs/content/platform/ollama.md) - Autonomous AI agent platform - [crewAI](https://github.com/crewAIInc/crewAI) - Multi-agent orchestration framework - [Strands Agents](https://github.com/strands-agents/sdk-python) - Model-driven agent building by AWS - [Cheshire Cat](https://github.com/cheshire-cat-ai/core) - AI assistant framework - [any-agent](https://github.com/mozilla-ai/any-agent) - Unified agent framework interface by Mozilla - [Stakpak](https://github.com/stakpak/agent) - Open source DevOps agent - [Hexabot](https://github.com/hexastack/hexabot) - Conversational AI builder - [Neuro SAN](https://github.com/cognizant-ai-lab/neuro-san-studio) - Multi-agent orchestration ([docs](https://github.com/cognizant-ai-lab/neuro-san-studio/blob/main/docs/user_guide.md#ollama)) ### RAG & Knowledge Bases - [RAGFlow](https://github.com/infiniflow/ragflow) - RAG engine based on deep document understanding - [R2R](https://github.com/SciPhi-AI/R2R) - Open-source RAG engine - [MaxKB](https://github.com/1Panel-dev/MaxKB/) - Ready-to-use RAG chatbot - [Minima](https://github.com/dmayboroda/minima) - On-premises or fully local RAG - [Chipper](https://github.com/TilmanGriesel/chipper) - AI interface with Haystack RAG - [ARGO](https://github.com/xark-argo/argo) - RAG and deep research on Mac/Windows/Linux - [Archyve](https://github.com/nickthecook/archyve) - RAG-enabling document library - [Casibase](https://casibase.org) - AI knowledge base with RAG and SSO - [BrainSoup](https://www.nurgo-software.com/products/brainsoup) - Native client with RAG and multi-agent automation ### Bots & Messaging - [LangBot](https://github.com/RockChinQ/LangBot) - Multi-platform messaging bots with agents and RAG - [AstrBot](https://github.com/Soulter/AstrBot/) - Multi-platform chatbot with RAG and plugins - [Discord-Ollama Chat Bot](https://github.com/kevinthedang/discord-ollama) - TypeScript Discord bot - [Ollama Telegram Bot](https://github.com/ruecat/ollama-telegram) - Telegram bot - [LLM Telegram Bot](https://github.com/innightwolfsleep/llm_telegram_bot) - Telegram bot for roleplay ### Terminal & CLI - [aichat](https://github.com/sigoden/aichat) - All-in-one LLM CLI with Shell Assistant, RAG, and AI tools - [oterm](https://github.com/ggozad/oterm) - Terminal client for Ollama - [gollama](https://github.com/sammcj/gollama) - Go-based model manager for Ollama - [tlm](https://github.com/yusufcanb/tlm) - Local shell copilot - [tenere](https://github.com/pythops/tenere) - TUI for LLMs - [ParLlama](https://github.com/paulrobello/parllama) - TUI for Ollama - [llm-ollama](https://github.com/taketwo/llm-ollama) - Plugin for [Datasette's LLM CLI](https://llm.datasette.io/en/stable/) - [ShellOracle](https://github.com/djcopley/ShellOracle) - Shell command suggestions - [LLM-X](https://github.com/mrdjohnson/llm-x) - Progressive web app for LLMs - [cmdh](https://github.com/pgibler/cmdh) - Natural language to shell commands - [VT](https://github.com/vinhnx/vt.ai) - Minimal multimodal AI chat app ### Productivity & Apps - [AppFlowy](https://github.com/AppFlowy-IO/AppFlowy) - AI collaborative workspace, self-hostable Notion alternative - [Screenpipe](https://github.com/mediar-ai/screenpipe) - 24/7 screen and mic recording with AI-powered search - [Vibe](https://github.com/thewh1teagle/vibe) - Transcribe and analyze meetings - [Page Assist](https://github.com/n4ze3m/page-assist) - Chrome extension for AI-powered browsing - [NativeMind](https://github.com/NativeMindBrowser/NativeMindExtension) - Private, on-device browser AI assistant - [Ollama Fortress](https://github.com/ParisNeo/ollama_proxy_server) - Security proxy for Ollama - [1Panel](https://github.com/1Panel-dev/1Panel/) - Web-based Linux server management - [Writeopia](https://github.com/Writeopia/Writeopia) - Text editor with Ollama integration - [QA-Pilot](https://github.com/reid41/QA-Pilot) - GitHub code repository understanding - [Raycast extension](https://github.com/MassimilianoPasquini97/raycast_ollama) - Ollama in Raycast - [Painting Droid](https://github.com/mateuszmigas/painting-droid) - Painting app with AI integrations - [Serene Pub](https://github.com/doolijb/serene-pub) - AI roleplaying app - [Mayan EDMS](https://gitlab.com/mayan-edms/mayan-edms) - Document management with Ollama workflows - [TagSpaces](https://www.tagspaces.org) - File management with [AI tagging](https://docs.tagspaces.org/ai/) ### Observability & Monitoring - [Opik](https://www.comet.com/docs/opik/cookbook/ollama) - Debug, evaluate, and monitor LLM applications - [OpenLIT](https://github.com/openlit/openlit) - OpenTelemetry-native monitoring for Ollama and GPUs - [Lunary](https://lunary.ai/docs/integrations/ollama) - LLM observability with analytics and PII masking - [Langfuse](https://langfuse.com/docs/integrations/ollama) - Open source LLM observability - [HoneyHive](https://docs.honeyhive.ai/integrations/ollama) - AI observability and evaluation for agents - [MLflow Tracing](https://mlflow.org/docs/latest/llms/tracing/index.html#automatic-tracing) - Open source LLM observability ### Database & Embeddings - [pgai](https://github.com/timescale/pgai) - PostgreSQL as a vector database ([guide](https://github.com/timescale/pgai/blob/main/docs/vectorizer-quick-start.md)) - [MindsDB](https://github.com/mindsdb/mindsdb/blob/staging/mindsdb/integrations/handlers/ollama_handler/README.md) - Connect Ollama with 200+ data platforms - [chromem-go](https://github.com/philippgille/chromem-go/blob/v0.5.0/embed_ollama.go) - Embeddable vector database for Go ([example](https://github.com/philippgille/chromem-go/tree/v0.5.0/examples/rag-wikipedia-ollama)) - [Kangaroo](https://github.com/dbkangaroo/kangaroo) - AI-powered SQL client ### Infrastructure & Deployment #### Cloud - [Google Cloud](https://cloud.google.com/run/docs/tutorials/gpu-gemma2-with-ollama) - [Fly.io](https://fly.io/docs/python/do-more/add-ollama/) - [Koyeb](https://www.koyeb.com/deploy/ollama) - [Harbor](https://github.com/av/harbor) - Containerized LLM toolkit with Ollama as default backend #### Package Managers - [Pacman](https://archlinux.org/packages/extra/x86_64/ollama/) - [Homebrew](https://formulae.brew.sh/formula/ollama) - [Nix package](https://search.nixos.org/packages?show=ollama&from=0&size=50&sort=relevance&type=packages&query=ollama) - [Helm Chart](https://artifacthub.io/packages/helm/ollama-helm/ollama) - [Gentoo](https://github.com/gentoo/guru/tree/master/app-misc/ollama) - [Flox](https://flox.dev/blog/ollama-part-one) - [Guix channel](https://codeberg.org/tusharhero/ollama-guix)
▸ 中文总结(生成于 2026-07-19 12:54)

ollama/ollama 项目介绍

Ollama 是一个用于在本地运行和管理大型语言模型(LLMs)的开源工具,旨在让用户能够轻松地下载、运行和与各种开源模型(如 DeepSeek、Qwen、Gemma 等)进行交互,无需复杂的配置或依赖云服务。

核心功能与解决的问题

  • 简化本地模型部署:用户无需手动下载模型权重、配置 GPU 环境或编写复杂的推理代码,只需通过简单的 ollama run 命令即可在本地运行一个大型语言模型。
  • 统一模型管理:提供了一个统一的接口来管理多种开源模型(如 Gemma 4、DeepSeek、Qwen、Llama 等),用户可以通过 ollama 命令或 REST API 轻松切换模型。
  • 降低使用门槛:支持 macOS、Windows、Linux 三大操作系统,并提供 Docker 镜像,方便开发者和非技术用户快速上手。
  • 支持多种集成场景:不仅支持命令行聊天,还提供了 REST API 和 Python/JavaScript 库,方便开发者将其集成到自己的应用程序或现有工具(如 Claude Code、Copilot、VS Code 扩展等)中。

核心技术架构与实现思路

  • 基于 llama.cpp 后端:Ollama 底层使用了 llama.cpp 项目作为推理引擎,这是一个高性能的 C++ 实现的 LLM 推理库,支持 CPU 和 GPU 推理,能够高效地在本地硬件上运行模型。
  • 简洁的命令行接口:核心交互通过 ollama 命令实现,包括:
    • ollama run <model_name>:直接运行模型并进行对话。
    • ollama launch <integration>:启动与特定工具或 AI 助手(如 Claude Code、OpenClaw)的集成。
  • REST API 支持:提供了完整的 REST API,允许用户通过 HTTP 请求来运行模型、管理模型列表、进行对话(支持流式输出),这使得它可以被任何编程语言调用。
  • 多语言 SDK:官方提供了 Python (ollama-python) 和 JavaScript (ollama-js) 库,以及社区贡献的 Java、.NET、Rust、Go 等多种语言的 SDK,方便在不同技术栈中集成。

值得关注的技术亮点

  • 零配置启动:安装后直接运行 ollama 命令即可开始使用,系统会引导用户选择模型或连接到现有应用,极大降低了使用门槛。
  • 丰富的社区集成生态:项目拥有极为庞大的社区集成列表,涵盖聊天界面(如 Open WebUI、AnythingLLM)、代码编辑器(如 Cline、Continue)、RAG 知识库(如 RAGFlow)、代理框架(如 AutoGPT、crewAI)等,几乎覆盖了 LLM 应用的所有主流场景。
  • 广泛的模型支持:直接支持包括 DeepSeek、Qwen、Gemma、Llama、Mistral、GLM、MiniMax 等在内的数十种主流开源模型,用户可以通过 ollama.com/library 浏览完整的模型库。
  • 跨平台与容器化:提供 macOS、Windows、Linux 原生安装脚本,以及官方 Docker 镜像,支持在 Google Cloud、Fly.io 等云平台部署,满足从个人开发到生产环境的不同需求。
  • 即时代码集成:通过 ollama launch claude 等命令,可以一键将本地模型与 Claude Code、Copilot CLI 等开发工具结合,实现本地化的 AI 编程辅助。