Ollama 精选
本地大模型一键运行器:一条命令拉取并运行 Llama/Qwen/DeepSeek 等开源模型,自动匹配 GPU,提供 OpenAI 兼容 API,是本地化部署事实标准。Run open-source LLMs locally with one command: Llama, Qwen, DeepSeek and more, with GPU auto-detection and an OpenAI-compatible API.
本地部署、推理加速、API 网关与可观测工具,共 11 条。
本地大模型一键运行器:一条命令拉取并运行 Llama/Qwen/DeepSeek 等开源模型,自动匹配 GPU,提供 OpenAI 兼容 API,是本地化部署事实标准。Run open-source LLMs locally with one command: Llama, Qwen, DeepSeek and more, with GPU auto-detection and an OpenAI-compatible API.
开源 LLM 工程可观测平台:链路追踪、成本统计、Prompt 版本管理、数据集与自动评测,Agent 上线后必备的「仪表盘」。Open-source LLM observability: tracing, cost tracking, prompt versioning, datasets and automated evals.
高吞吐 LLM 推理引擎:PagedAttention + 连续批处理大幅提升并发吞吐,OpenAI 兼容 API,生产环境自托管模型服务的首选。A high-throughput LLM inference engine with PagedAttention and continuous batching; OpenAI-compatible API, the go-to for self-hosted serving.
统一 LLM 网关:把 100+ 家模型 provider 统一成 OpenAI 格式,带配额、预算、限流与 fallback 路由,生产环境管理多模型调用的标配。A unified LLM gateway: 100+ providers normalized to the OpenAI format, with quotas, budgets, rate limits and fallback routing.
模型聚合路由:一个 API key 访问主流所有商业与开源模型,统一计费、支持比价与自动降级,免管理多家账号的烦恼。One API key for all major models: unified billing, price comparison and automatic fallback across commercial and open models.
桌面端本地模型运行器:图形界面搜索下载 GGUF 模型、调整参数、内置聊天窗口,并提供本地 OpenAI 兼容 API,适合不想碰命令行的用户。A desktop app to discover, download and run local LLMs with a GUI chat interface and a local OpenAI-compatible API server.
Agent 可观测性平台:一行代码接入,自动记录每次 LLM 调用、工具执行与成本,支持会话回放、评测与告警,是 Agent 版的「APM」。Agent observability: one line to instrument every LLM call, tool execution and cost, with session replay, evals and alerts — an APM for agents.
开源 LLM 可观测与评估平台:基于 OpenTelemetry 追踪 LLM/Agent/工具调用链,配套数据集驱动的评估体系,可自托管、厂商中立。Open-source LLM observability: OpenTelemetry-based tracing for LLMs, agents and tools, plus dataset-driven evals — self-hosted and vendor-neutral.
面向 Agent 的工具集成平台:250+ 应用(GitHub、Slack、Notion 等)的开箱即用工具与鉴权管理,支持 MCP 输出。Tool integration platform for agents: 250+ ready-made app tools (GitHub, Slack, Notion...) with auth management and MCP support.
AI 驱动的多平台舆情监控工具:聚合 GitHub/HN/Reddit 等平台热点,中文摘要日报推送,适合关注技术趋势的个人或团队每日追踪。AI-powered public opinion and trend monitor aggregating GitHub, HN and Reddit with Chinese digest reports for daily tech tracking.
让 AI Agent 直接「使用浏览器」的 Python 库:视觉+DOM 双通道理解页面,网页操作任务成功率业界领先。Python library that lets agents drive a browser visually and via DOM — state-of-the-art on web task benchmarks.