Models and labs

Which open-weight model can you actually run, and what are you legally allowed to do with it?

Published · By Robert Scales, with AI tools · 7 min read

Short answer

On one computer, the realistic options today are small models such as Gemma 4, Qwen3.8-27B, gpt-oss-20b or Nemotron 3.5 Lightning. Models above about 300 billion parameters need a server or a hosted service. Legally, Apache 2.0, MIT and OpenMDW impose few conditions, while custom licences on many flagships add rules for attribution and for businesses selling model access.

"Open" tells you one thing: you can download the file. It doesn't tell you whether your machine can hold it or whether your business may use it. Those are two separate checks, and they often point in opposite directions, because the biggest models need the most hardware and tend to carry the most conditions.

This page compares models as of November 2, 2026, using their model cards, licence files and Hugging Face file sizes. For the basics of open versus closed, see our licence explainer.

Three numbers to read on any card

Total parameters are all the learned numbers in the file, and they largely determine the memory you need. Active parameters are those used per token (a small piece of text) in a mixture-of-experts model, where only some sections do the work at each step. They largely determine the compute, and so the speed and running cost.

The third is bits per parameter, set by quantization, which stores numbers more compactly. A trillion parameters takes about 2 TB at 16 bits, 1 TB at 8 bits, and roughly 500 GB at 4 bits. That is why a card's parameter count never tells you memory on its own. Working memory for your context comes on top of the file size too, and a million-token session can add a lot.

Models one person can realistically run

These fit a single good computer, or one graphics card in the larger cases. Sizes come from the Ollama library or Hugging Face.

ModelParametersPractical sizeLicence
Gemma 4 E2B / E4B2 and 4 billion effectiveAbout 5 to 10 GBApache 2.0
Gemma 4 12B12 billionAbout 8 GBApache 2.0
Nemotron 3.5 Bolt 74B-A9B74 billion, 9 active24 GB GGUF; recipes from 28 GB of memoryOpenMDW 1.1
gpt-oss-20b21 billion, 3.6 active14 GBApache 2.0
Muse Glimmer 30BAbout 30 billion16.8 GB (aim for 24 GB of memory)Apache 2.0
Qwen3.8-27B27 billion18 GBApache 2.0
Gemma 4 26B / 31B26 billion (4 active), 31 billion16 to 19 GB for 26BApache 2.0
Nemotron 3.5 Lightning30 billion, 3 activeAbout 22 GB NVFP4; one DGX Spark or H100OpenMDW 1.1

Note how friendly the licences are at this end. For most small projects, the question is quality on your tasks, not legal risk.

Models for one server

These need data-centre GPUs or very large unified memory. Sizes are file totals on Hugging Face, in the most compact official format listed.

ModelTotal / activeFilesHardware named by the makerLicence
gpt-oss-120b117 billion / 5.1 billion65 GB (Ollama)One 80 GB GPUApache 2.0
Kolibri-178 billion / 3.46 billionAbout 79 GBOne H200 or B200, or 2 H100sApache 2.0, weights only
Nemotron 3.5 Super VL120 billion / 12 billionAbout 75 GBOne H200 or DGX Spark, or 2 H100sOpenMDW 1.1
Qwen3.8-Flash-NextAbout 180 billionAbout 360 GB at BF16; a smaller FP8 version existsSeveral GPUs at BF16Qwen Community 1.0
MiniMax M3.1-Flash428 billion / 23 billionAbout 252 GBSeveral GPUsMiniMax Community
Beam501 billion / 23 billionAbout 294 GBSeveral GPUsApache 2.0
GLM-5.3-Flash320 billion / 18 billionAbout 328 GBSeveral GPUsMIT

Sparse designs show their value here. Beam's download is modest for 501 billion parameters because it comes in 4-bit, and few parameters are working on each token.

Models that need a cluster, or a provider

ModelTotal / activeFilesWhat to expectLicence
DeepSeek-V4.1-Flash552 billion / 8 and 16 billionAbout 510 GBMulti-GPU server, 8-way exampleMIT
MiMo-V2.6-Pro1.02 trillion / 42 billionAbout 574 GBMulti-GPU serverMIT
Mistral Large 41 trillion / 49 billionAbout 610 GB4 to 8 newest-generation GPUsModified MIT, service licence
GLM-5.3753 billionAbout 756 GBMulti-GPU serverGLM-5.3 License
Inkling975 billion / 41 billionAbout 1.9 TBMulti-GPU clusterApache 2.0
Muse Spark Open816 billion / 42 billion700 GB of memory at NVFP4Two 512 GB Mac Studios, or GPUs; form requiredMuse Model License
Kimi K32.8 trillion / 104 billionAbout 1.56 TBAt least 8 of the latest GPUsKimi K3 License
Qwen3.8 2.4T-A95B2.4 trillion / 95 billionAbout 4.9 TB at BF16Multi-nodeQwen3.8-Max License

Muse Spark Open stands out as the only one here with a real desktop route. Even so, two top-end Mac Studios are a serious purchase.

For almost everyone, these models are something you rent per token. But having the weights still has value: if a provider changes its terms or vanishes, someone else can host the same model.

What you are legally allowed to do

You want toApache 2.0, MIT, OpenMDWMistral Large 4Kimi K3GLM-5.3Qwen3.8-MaxMuse Spark OpenMiniMax Community
Use it internallyYesYesYesYesYesYes, with usage policyNon-commercial yes; business use needs a notice
Embed it in a paid productYesYesYesYesYes, with limits on work assistantsYes, show "Built with"Yes, show "Built with" and send notice
Fine-tune and share itYesYesYesYesYesYes, derivative rulesYes, on the same conditions
Sell API accessYesAlways needs a licenceAgreement above $20M USSecurity review above $10B USLicence above $50M USAgreement above $20M USAuthorization above $20M US
Use for military purposesLicence is silentLicence is silentLicence is silentLicence is silentLicence is silentCheck usage policyBanned

This table summarizes the licence files as of this date. It isn't legal advice, and licences can change with each model, as they did for GLM and Kimi. Copyright, privacy and trade laws still apply whatever the licence says. In Canada, a business handling personal information still has its privacy duties, including under Québec's Law 25, wherever the model runs.

Try it: Write down your machine's graphics memory (or a Mac's unified memory), then, as a rule of thumb, pick the largest model above whose file is at least 25 percent smaller than that figure. Run it through Ollama or LM Studio and give it one task you do every week.

How do you choose in ten minutes?

Minute 1: where can your data go? If it may go to a provider, hosted access opens up every model above. If it must stay on your machines, your hardware sets the limit.

Minutes 2 to 3: what memory do you have? Under 16 GB, begin with Gemma 4 E2B or E4B. At 24 to 32 GB, try Qwen3.8-27B, Muse Glimmer or gpt-oss-20b. With one 80 GB data-centre GPU, gpt-oss-120b fits, and at 160 GB or more you can run Kolibri-1 or Super VL. Beyond that, plan a server.

Minutes 4 to 6: what will you do with it? For your own work, or a product with the model built in, most licences are fine. If you plan to sell access to the model itself, cross off Mistral Large 4 unless you are ready to talk to Mistral, and check thresholds on the others.

Minutes 7 to 8: do you need something specific? For French, test Mistral's models and Gemma's multilingual support. For German, try Kolibri. For audio, look at Gemma 4's smaller sizes or MiMo. For image input, avoid Beam, which handles only text. For full transparency about training data, look at Nemotron or Switzerland's public Apertus.

Minutes 9 to 10: test. Benchmark tables are mostly self-reported, and each lab picks the setup that suits it. Run five real tasks on your two best candidates through a host, score them, and only then buy hardware.

Sources

  1. gpt-oss-120b model card — OpenAI (Hugging Face), August 5, 2025
  2. Gemma 4 31B model card — Google DeepMind (Hugging Face), April 2, 2026
  3. qwen3.8 - Ollama library — Ollama

Sources for the articles linked in the text

Each linked article has its own page, with its sources and its date.

From the Guide to Artificial Intelligence, by Robert Scales, published by Holistic Hybrid Inc. Share and adapt it under CC BY-NC-SA 4.0: credit the guide, link to https://guidetoartificialintelligence.com/en/learn/which-open-weight-model-compared/, no commercial use without permission, and keep the same licence.

Get the free Guide to Artificial Intelligence

Sign up for the newsletter and receive the free guide: what changed in AI, one lesson, one prompt to try. Unsubscribe in one click.

How we handle your address

Back to top

Display

Your choices are saved in this browser only. No data is sent.

Text size
100%
Colours
Reading
More settings
Accessibility statement

Get the app

Add the guide to your home screen. It opens like an app, and the pages you have read stay available offline.

Read without a connection: download the articles

iPhone and iPad (Safari, Chrome, Edge)

  1. Tap the Share button (the square with an arrow). In Chrome and Edge, it is in the address bar or the menu.
  2. Choose “Add to Home Screen”.
  3. Tap “Add”.

Android (Chrome, Edge, Samsung Internet, Firefox)

  1. Open the browser menu (⋮ or ☰).
  2. Choose “Install app” or “Add to Home screen”.
  3. Confirm with “Install”.

Computer (Chrome, Edge)

  1. Click the install icon at the right end of the address bar, or open the browser menu (⋮ or …).
  2. In Chrome, choose “Cast, save and share”, then “Install page as app”. In Edge, choose “Apps”, then “Install this site as an app”.
  3. Click “Install”.

Mac (Safari)

  1. Open the File menu.
  2. Choose “Add to Dock”.
  3. Click “Add”.

Firefox on a computer can’t install a site as an app. Use Chrome, Edge or Safari instead.