Open-source alternative to Claude: what to run on your own server

Claude is usually brought in for long document analysis, step-by-step reasoning and agent work with tools. In the open world those jobs are covered by reasoning models and large mixture-of-experts families: they deploy inside your perimeter, contracts and correspondence stay in house, there is no per-request billing, and the behaviour can be tuned to your own policies. The trade-off is hardware: reasoning answers are longer than ordinary ones, and the larger versions of these families expect server-grade GPUs, sometimes several at once. On tangled, long-context tasks an open model errs more often than a flagship cloud service, so conclusions about contracts and numbers still need a human check. A sensible start is a mid-size model tested on your own documents, with the larger tier considered only afterwards.

Updated 22 Sep 2026Find a model in 4 questions

What to use instead

TextRUOllama2023–2026

Qwen

Alibaba · China

A family of language models with strong Russian language support, from small versions for a laptop to a flagship on par with commercial APIs.

  • Chatbot and knowledge-base assistant
  • Replies to emails and customer requests
  • Document parsing and classification
Sizes
0,6B – 2,4T-A95B
Hardware
from: Laptop
Commercial use with conditionsDetails
TextOllama2025

DeepSeek-R1

DeepSeek · China

A reasoning model that thinks step by step before answering. Strong at calculations, logic and code; compact distilled versions are available.

  • Complex calculations and logic checks
  • Analysis of contracts and internal policies
  • Help for developers
Sizes
1,5B – 671B
Hardware
from: Laptop
Commercial use allowedDetails
TextOllama2025

gpt-oss

OpenAI · USA

OpenAI's first open models since GPT-2. Reasoning and tool calling; the smaller version fits on a single GPU.

  • AI agent that calls internal systems
  • Answers based on internal policies
  • Drafts of emails and reports
Sizes
20B, 120B
Hardware
from: 1 GPU
Commercial use allowedDetails
TextGGUF2025–2026

Kimi

Moonshot AI · China

Very large Moonshot MoE models for agentic work. K3 (2.8 trillion parameters) was the largest open model at release, with up to 1M tokens of context and image understanding; K2.7-Code is built for programming.

  • Multi-step agents: search, data collection, reports
  • In-depth document analysis
  • Help for developers
Sizes
16B-A3B – 2.8T-A104B
Hardware
from: 1 GPU
Commercial use with conditionsDetails
TextOllama2023–2026

GLM (ChatGLM)

Zhipu AI (Z.ai) · China

One of the oldest Chinese open lines: from ChatGLM-6B to GLM-5.3. Strong at agentic tasks and programming; GLM-5.3-Flash understands images and is released under MIT.

  • Corporate chat assistant
  • Agents for routine office tasks
  • Help for developers
Sizes
1.5B – 744B-A40B
Hardware
from: Laptop
Commercial use with conditionsDetails

DeepSeek-R1 and gpt-oss ship under MIT and Apache 2.0, while some of the larger Kimi and GLM versions carry their own licenses with carve-outs for large companies and API providers. If you plan to resell access to the model, review those terms separately.

Other alternatives

Need a model for your task?

An open model can run on your own server: data stays in-house, there is no per-request fee, and the model can be fine-tuned on your documents.

  1. SelectThe model and size for your task and hardware budget
  2. DeployOn your server or in a closed network, with an API
  3. Fine-tuneOn your data, or connect a knowledge base
  4. IntegrateInto your CRM, ERP, bot, website or team chat
Discuss deployment