Short answer
Buy for memory first: 16 GB runs small models, 32 GB runs today's best 27-billion-parameter coding models, and 128 GB reaches models above 100 billion parameters. A memory shortage has pushed prices far above launch levels, so a 32 GB machine now starts near CA$1,800 and a 128 GB one near CA$4,800.
Follow-up question Should you buy now, or rent until prices settle?
Advice on buying local AI hardware goes stale quickly this year, because the price of memory keeps moving. NVIDIA's 128 GB DGX Spark launched at US$3,999 and now lists at US$6,950. Framework's 128 GB desktop, US$1,999 at its February 2025 launch, was US$3,449 by July. So every price below carries the date it was read, and you should check it again before paying.
The guide's 2024 hardware overview explains why memory matters, and the October 2026 setup guide covers installing the software. This article answers the next question: what to buy, at what budget.
Three numbers decide the purchase
Memory the processor can reach quickly. On a PC with a graphics card, that is the card's VRAM. On an Apple Mac or an AMD Ryzen AI Max machine, it is a shared pool called unified memory. This sets the largest model you can load.
Memory bandwidth. Measured in gigabytes per second, it sets how fast words appear once a model is loaded. A Mac mini M6 starts at 153 GB/s, a DGX Spark has 273 GB/s, and an M5 Ultra has 1.2 TB/s.
Software support. Tools usually arrive first for NVIDIA's CUDA platform. That matters little for chatting and a lot for training, as the Mac versus PC comparison explains.
Budget tiers, with prices read November 2, 2026
Prices exclude tax. Apple and Framework figures come from their store pages as shown to a Canadian visitor. Graphics card figures are the cheapest new US listings on the Tom's Hardware index for October 26, as read by PC Server and Parts, a used-card seller that discloses its interest. They cover the card alone, not the computer around it.
| Tier | Example | Price | Fast memory | What fits |
|---|---|---|---|---|
| Start | The computer you own | $0 | 8 to 16 GB | 3B to 8B models |
| Small | Mac mini M6 | CA$1,249 (US$899) | 16 GB | 8B comfortably, 14B with short context |
| Small upgrade | Radeon RX 9060 XT 16 GB or RTX 5060 Ti 16 GB | US$599 or US$765 | 16 GB | 14B |
| Coding | Framework Desktop, Max 385 | CA$1,789 | 32 GB shared | Qwen3.8-27B, measured at 17.6 GB |
| Coding, used | RTX 3090 | about US$1,559 average asking | 24 GB | 27B at 4 bits, short context |
| Large | Framework Desktop, Max+ 395 | CA$2,749 | 64 GB shared | Qwen3.5-122B-A10B at 3 bits, measured at 52.5 GB |
| Large, faster | Mac Studio M5 Max | CA$4,399 (US$3,099) | 64 GB at 614 GB/s | Same models, more than twice the bandwidth |
| Very large | Framework Desktop, Max+ 395 | CA$4,839 | 128 GB shared | gpt-oss-120b (65 GB); DeepSeek V4 Flash at 2 bits, measured at 90.9 GB |
| Very large, NVIDIA | DGX Spark | US$6,950 | 128 GB | Up to 200B by NVIDIA's count |
| Top desktop | Mac Studio M5 Ultra | CA$7,799 (US$5,499) | 96 GB at 1.2 TB/s | Fastest shared-memory option here |
| Top graphics card | RTX 4090 or RTX 5090 | US$4,450 or US$8,477 (one listing) | 24 or 32 GB | Small models at very high speed |
"B" means billion parameters, the numbers a model learned in training. The measured sizes are Framework's own, from its September 2026 reference tests.
Two things stand out. The 16 GB graphics cards cost almost as much as a small computer: the RTX 5060 Ti 16 GB launched at US$429. And prices disagree between sources: the same index lists the RTX 5080 at US$1,699 while a Hardware Unboxed survey found US$2,200 that month. Treat any single number as a snapshot.
A worked example: a private coding assistant
Suppose you want a local model to work on code you cannot send anywhere. The open coding models guide points to Qwen3.8-27B, an 18 GB download. Ollama recommends at least 64,000 tokens of context for coding tools, and that context needs memory beside the model.
- 16 GB: the model does not load. Skip this tier for that goal.
- 24 GB: it loads with little left over, so contexts stay modest.
- 32 GB shared: it fits with room for context, since the system and the model share the pool. Expect modest speed.
- 64 GB: it fits with plenty of context, and you can try larger models.
So the sensible spend for this person starts at the CA$1,789 tier, not at a CA$7,799 machine. The extra money buys speed and bigger models, which only help if you will really use them.
Try it: Write down the one model you most want to run and its download size. Add 30% as a planning margin for context and the system. Find the cheapest row in the table that clears the total, then look up today's price on the maker's own page.
Common mistakes
- Buying the chip instead of the memory. A faster processor with too little memory cannot load the model at all.
- Trusting a parameter ceiling in marketing. Those figures assume heavy compression and little context. The memory calculator shows how to check.
- Forgetting that shared memory is soldered. Macs and Ryzen AI Max machines cannot be upgraded later, so choose the memory you will need.
- Ignoring running costs and noise. A big graphics card draws far more power than a small box. The power and noise guide has the figures.
Should you buy now, or rent until prices settle?
Nobody can tell you when prices will fall. Micron, one of the largest memory makers, says it cannot see when supply and demand will balance and expects the crunch to worsen in 2027 and 2028. That is a company's forecast rather than a certainty, so waiting may or may not pay off.
The more useful test is why you want local AI. If the reason is saving money, the numbers rarely work: hosted gpt-oss-20b was listed on OpenRouter from about US$0.066 per million output tokens, which is close to what electricity alone costs to run it at home. If the reason is privacy, offline use or learning how these systems behave, then the machine buys something a hosted service cannot sell you.
A cautious path is to start with the computer you already own and a small model. Next, test the model you want through a hosted API or a rented graphics card for a few weeks. Buy only once you know which model you will really run and how much context you need. That way the purchase is sized by your own measurements, not by a spec sheet.
Sources
- Buy Mac Studio and Mac mini (Canadian and US Apple Store pages) — Apple, November 2, 2026
- Framework Desktop — Framework
- GPU Price Increase 2026: Why, and When Will Prices Drop? — PC Server and Parts, October 28, 2026
Sources for the articles linked in the text
Each linked article has its own page, with its sources and its date.
- What is Ollama, and how does it let you run AI models on your own Mac?
- Ollama repository: README, models.json and website page (commit b43ddd8, 8 July 2023) — GitHub (jmorganca/ollama), July 8, 2023
- Ollama v0.0.1 release — GitHub (jmorganca/ollama), July 8, 2023
- Large language models are having their Stable Diffusion moment — Simon Willison's Weblog, March 11, 2023
From the Guide to Artificial Intelligence, by Robert Scales, published by Holistic Hybrid Inc. Share and adapt it under CC BY-NC-SA 4.0: credit the guide, link to https://guidetoartificialintelligence.com/en/learn/local-ai-hardware-buying-guide-2026/, no commercial use without permission, and keep the same licence.