Skip to content
PromptLab by FEHMER TECH
ENDE

Open AI models compared 2026

Open-weight models you can host yourself: with licence, size, context length and the memory the weights need. The facts come straight from Hugging Face and are re-checked every two weeks.

Last updated: · Next update: · Source: Hugging Face API

All models at a glance

ModelParametersTypeContextLicenceHLEOn HF since
DeepSeek V4.1 Flash
DeepSeek
763.2BMixture of Experts1MMIT–Sept 2026
GLM-5.3
Z.ai (Zhipu)
753.3BMixture of Experts1MCustom licence (GLM-5.3)39.1 %Aug 2026
GLM-5.3 Flash
Z.ai (Zhipu)
321.3BMixture of Experts1MMIT–Aug 2026
DeepSeek V4 Pro
DeepSeek
1.7TMixture of Experts1MMIT32.4 %Aug 2026
Qwen3.8 2.4T-A95B
Alibaba (Qwen)
2.4Tof which active 95BMixture of Experts256KCustom licence (Qwen3.8-Max)–Aug 2026
Qwen3.8 27B
Alibaba (Qwen)
27.8BDense256KApache 2.0–Aug 2026
Kimi K3
Moonshot AI
2.8TMixture of Experts1MCustom licence (Kimi K3)41.1 %Jun 2026
Gemma 4 12B
Google
12BDense256KApache 2.0–May 2026
Qwen3.6 35B-A3B
Alibaba (Qwen)
36Bof which active 3BMixture of Experts256KApache 2.0–Apr 2026
Mistral Medium 3.5
Mistral AI
127.7BDense256KCustom licence (see model card)–Mar 2026
Gemma 4 31B
Google
31.3BDense256KApache 2.0–Mar 2026
Gemma 4 26B-A4B
Google
25.8Bof which active 4BMixture of Experts256KApache 2.0–Mar 2026
Gemma 4 E4B
Google
8BDense128KApache 2.0–Mar 2026
Mistral Small 4
Mistral AI
119.4BMixture of Experts1MApache 2.0–Jan 2026
Mistral Large 3
Mistral AI
675BMixture of Experts–Apache 2.0–Nov 2025
gpt-oss-120b
OpenAI
116.8BMixture of Experts128KApache 2.0–Aug 2025
gpt-oss-20b
OpenAI
20.9BMixture of Experts128KApache 2.0–Aug 2025
Llama 4 Scout
Meta
108.6Bof which active 17BMixture of Experts10MLlama 4 Community License–Apr 2025
Llama 4 Maverick
Meta
401.6Bof which active 17BMixture of Experts–Llama 4 Community License–Apr 2025

HLE values come from the Statistics.

Memory needed for self-hosting

The table shows how much memory the weights alone need (parameters × bytes per parameter). Add the context cache (KV cache) and runtime overhead: plan for at least 20% headroom.

Model16-bit (BF16)8-bit4-bit
Gemma 4 E4B16 GB8 GB4 GB
Gemma 4 12B24 GB12 GB6 GB
gpt-oss-20b41.8 GB20.9 GB10.4 GB
Gemma 4 26B-A4B51.6 GB25.8 GB12.9 GB
Qwen3.8 27B55.6 GB27.8 GB13.9 GB
Gemma 4 31B62.6 GB31.3 GB15.7 GB
Qwen3.6 35B-A3B72 GB36 GB18 GB
Llama 4 Scout217 GB109 GB54.3 GB
gpt-oss-120b234 GB117 GB58.4 GB
Mistral Small 4239 GB119 GB59.7 GB
Mistral Medium 3.5255 GB128 GB63.9 GB
GLM-5.3 Flash643 GB321 GB161 GB
Llama 4 Maverick803 GB402 GB201 GB
Mistral Large 31.4 TB675 GB338 GB
GLM-5.31.5 TB753 GB377 GB
DeepSeek V4.1 Flash1.5 TB763 GB382 GB
DeepSeek V4 Pro3.3 TB1.7 TB825 GB
Qwen3.8 2.4T-A95B4.9 TB2.4 TB1.2 TB
Kimi K35.6 TB2.8 TB1.4 TB

Licences at a glance

Apache 2.0 and MIT allow commercial use without asking. Custom licences (Qwen3.8-Max, GLM-5.3, Kimi K3, Mistral Medium, Llama 4) carry special terms that should be read before a product launch.

Details

DeepSeek V4.1 Flash

DeepSeek · MIT · 763.2B · 1M

DeepSeek's current Flash model with a Mixture-of-Experts architecture and 1M tokens of context. The API supports tool calls, JSON output, image input and a thinking mode.

  • Agents and tool calls
  • Long documents
  • Low-cost API usage

Model card on Hugging Face · Downloads: 1,355,278

GLM-5.3

Z.ai (Zhipu) · Custom licence (GLM-5.3) · 753.3B · 1M

Z.ai's flagship with open weights (about 753B parameters, 1M tokens of context). Licence: GLM-5.3 licence, not MIT.

  • Agents
  • Coding
  • Data-centre deployment

Model card on Hugging Face · Downloads: 1,670,161

GLM-5.3 Flash

Z.ai (Zhipu) · MIT · 321.3B · 1M

Smaller variant of GLM-5.3 under the MIT licence (about 321B parameters, 1M tokens of context).

  • Multi-GPU servers
  • Agents and coding
  • MIT-licensed projects

Model card on Hugging Face · Downloads: 6,479,110

DeepSeek V4 Pro

DeepSeek · MIT · 1.7T · 1M

Large Pro model of the V4 family (version 0813) with 1M tokens of context. The API documentation lists tool calls and JSON output, but no image input.

  • Demanding coding tasks
  • Complex reasoning
  • Self-hosting only with a multi-GPU cluster

Model card on Hugging Face · Downloads: 87,569

Qwen3.8 2.4T-A95B

Alibaba (Qwen) · Custom licence (Qwen3.8-Max) · 2.4T · 256K

With about 2.4 trillion parameters (about 95B active according to its name) the largest Qwen model with open weights. The licence is not a standard one: read the licence text before commercial use.

  • Research and benchmarks
  • Data-centre deployment

Model card on Hugging Face · Downloads: 32,082

Qwen3.8 27B

Alibaba (Qwen) · Apache 2.0 · 27.8B · 256K

Dense model with just under 28B parameters and 262K tokens of context under Apache 2.0. Fits on a single 24 GB GPU in 4-bit quantisation (weights alone about 14 GB).

  • Local all-round assistant
  • Multilingual text
  • Coding help on your own hardware

Model card on Hugging Face · Downloads: 6,768,654

Kimi K3

Moonshot AI · Custom licence (Kimi K3) · 2.8T · 1M

Open-weight model from Moonshot AI with about 2.8 trillion parameters and 1M tokens of context. Realistically only for data-centre deployment; check the licence before commercial use.

  • Research
  • Data-centre deployment

Model card on Hugging Face · Downloads: 1,160,630

Gemma 4 12B

Google · Apache 2.0 · 12B · 256K

Mid-sized Gemma 4 for laptops and small servers (262K tokens of context). Weights alone need about 6 GB in 4-bit.

  • Laptop and mini PC
  • Everyday office text tasks
  • Getting started with local AI

Model card on Hugging Face · Downloads: 1,603,246

Qwen3.6 35B-A3B

Alibaba (Qwen) · Apache 2.0 · 36B · 256K

Mixture-of-Experts model with about 36B parameters, of which about 3B are active according to its name. Inference is fast, but memory demand follows all weights.

  • Fast local answers
  • Chat and summaries
  • Servers with limited compute

Model card on Hugging Face · Downloads: 3,545,718

Mistral Medium 3.5

Mistral AI · Custom licence (see model card) · 127.7B · 256K

Dense model with about 128B parameters and 262K tokens of context. The weights are open, but the licence is not a standard one like Apache 2.0.

  • European provider, EU hosting possible
  • Document work
  • Multilingual applications

Model card on Hugging Face · Downloads: 72,473

Gemma 4 31B

Google · Apache 2.0 · 31.3B · 256K

Largest dense model of the Gemma 4 family with 262K tokens of context. Google replaced the earlier custom licence with Apache 2.0; the model processes images and video.

  • Local multimodal applications
  • Commercial products without licence concerns
  • Workstation use

Model card on Hugging Face · Downloads: 9,619,659

Gemma 4 26B-A4B

Google · Apache 2.0 · 25.8B · 256K

Mixture-of-Experts variant of Gemma 4 with about 26B parameters, about 4B of them active according to its name, 262K tokens of context.

  • Fast local inference
  • Chat assistants
  • Prototypes

Model card on Hugging Face · Downloads: 11,854,067

Gemma 4 E4B

Google · Apache 2.0 · 8B · 128K

Small Gemma 4 model (4.5B effective parameters) for phones and edge devices; processes audio in addition to image and video.

  • Phone and edge
  • Speech and image understanding
  • Offline use

Model card on Hugging Face · Downloads: 4,305,979

Mistral Small 4

Mistral AI · Apache 2.0 · 119.4B · 1M

Mixture-of-Experts model with about 119B parameters and 1M tokens of context under Apache 2.0. Despite the name "Small", the weights need several GPUs.

  • Long documents
  • Server deployment
  • Apache-2.0 projects

Model card on Hugging Face · Downloads: 79,509

Mistral Large 3

Mistral AI · Apache 2.0 · 675B · –

At 675B parameters, Mistral's large open-weight model (November 2025) under Apache 2.0.

  • Data-centre deployment
  • Demanding text tasks

Model card on Hugging Face · Downloads: 2,037

gpt-oss-120b

OpenAI · Apache 2.0 · 116.8B · 128K

Open model from OpenAI (August 2025) with about 117B parameters and 131K tokens of context under Apache 2.0. Not updated since its release, so older than the other models.

  • Self-hosted assistants
  • Apache-2.0 projects

Model card on Hugging Face · Downloads: 3,845,925

gpt-oss-20b

OpenAI · Apache 2.0 · 20.9B · 128K

Small sibling model with about 21B parameters and 131K tokens of context under Apache 2.0 (August 2025).

  • Running on a single GPU
  • Getting started with open models

Model card on Hugging Face · Downloads: 5,950,578

Llama 4 Scout

Meta · Llama 4 Community License · 108.6B · 10M

Smaller Llama 4 model with about 109B parameters, 17B of them active (April 2025). Meta quoted up to 10M tokens of context. Access requires approval.

  • Existing Llama projects
  • Very long documents

Gated: access after approval by Meta.

Model card on Hugging Face · Downloads: 163,461

Llama 4 Maverick

Meta · Llama 4 Community License · 401.6B · –

Mixture-of-Experts model with about 400B parameters, 17B of them active (April 2025). Meta has published no newer Llama release on Hugging Face (as of 10 Oct 2026). Access requires approval.

  • Existing Llama projects
  • Multimodal tasks

Gated: access after approval by Meta.

Model card on Hugging Face · Downloads: 9,467

FAQ about open models

Which open AI models fit on a 24 GB graphics card?

With 4-bit quantisation the weights need about half a byte per parameter. With roughly 19 GB for the weights (about 80% of 24 GB, the rest is for the context cache) these fit: Qwen3.6 35B-A3B (36B), Gemma 4 31B (31.3B), Qwen3.8 27B (27.8B), Gemma 4 26B-A4B (25.8B), gpt-oss-20b (20.9B), Gemma 4 12B (12B), Gemma 4 E4B (8B). Larger models need several cards or offloading.

What does open weight mean?

The trained weights are available for download and can be run yourself. That is not automatically open source: training data and code are often not open, and the licence decides about commercial use.

Which models may I use commercially without special terms?

Models under Apache 2.0 or MIT allow commercial use without asking: DeepSeek V4.1 Flash, DeepSeek V4 Pro, Qwen3.8 27B, Qwen3.6 35B-A3B, Gemma 4 31B, Gemma 4 26B-A4B, Gemma 4 12B, Gemma 4 E4B, Mistral Small 4, Mistral Large 3, GLM-5.3 Flash, gpt-oss-120b, gpt-oss-20b. For models with their own licence, read the licence itself before using them in a product.

How current is the information?

Licence, parameter count, context length and dates are re-read from Hugging Face every two weeks. Last update: 10 October 2026.