Mixtral 8x22B (local via Ollama) is the big open mixture-of-experts model, self-hosted. At 80GB it is a workstation or server model, not a laptop model, but it doubles Mixtral 8x7B's window to 64,000 tokens and keeps everything on hardware you control. Pricing is Free (self-hosted), which sidesteps the API's $2.00 / $6.00 per Mtok entirely. In atlas.json you set limit.context to 64000 and point the ollama provider at it. The capability, however, is 2024-era.
What is Mixtral 8x22B (local via Ollama) best at inside Atlas?
Mixtral 8x22B (local via Ollama) is best at giving a team with real hardware a private 64,000 token agent. Sparse routing across 8 experts of 22B keeps generation speed reasonable despite the 80GB footprint, and Free (self-hosted) pricing sidesteps the API's $2.00 / $6.00 per Mtok entirely.
The economics only work at volume. A team running Atlas all day against an API at $2.00 / $6.00 per Mtok burns real money, and Mixtral 8x22B (local via Ollama) converts that recurring spend into a one-time hardware purchase. What you get for the 80GB is a 64,000 token window, double the 8x7B variant, and a model that never sends a line of source anywhere. Atlas can build its code index with local Ollama embeddings, keeping code off third-party servers, so the private setup extends past the chat model to the semantic index.
What hardware does mixtral:8x22b actually need?
Mixtral 8x22B (local via Ollama) is an 80GB pull, and 80GB of weights realistically needs a multi-GPU box or a 96GB-plus unified-memory Mac. Anything smaller will offload and run slowly, so run `atlas device` before you spend the download.
Atlas ships `atlas device`, which reports GPU and Ollama status, and for Mixtral 8x22B (local via Ollama) that check is not optional. An 80GB download on a machine that cannot hold the weights is a wasted afternoon. Sparse routing helps once the model is resident, because only a subset of the 8 experts of 22B is active per token, which is why generation speed stays reasonable despite the footprint. Routing does not help if the weights are paging from disk. Confirm the memory first, then run `ollama pull mixtral:8x22b`.
How do you configure the 64,000 token window in atlas.json?
Mixtral 8x22B (local via Ollama) reports a 64K context window through Ollama, and Atlas needs it declared: set limit.context to 64000. Register the ollama provider with `@ai-sdk/openai-compatible` and baseURL `http://localhost:11434/v1`, then add `mixtral:8x22b` with `"limit": { "context": 64000, "output": 8192 }`.
One configuration detail matters more for Mixtral 8x22B (local via Ollama) than for smaller models: keep `"small_model"` on something tiny. Atlas uses the small model slot for cheap background work like titles and summaries, and waking an 80GB model to name a session is a waste of both memory and seconds. Set `"model": "ollama/mixtral:8x22b"` for the real work and leave the small slot on a lightweight tag. Atlas lets you switch the active model and provider on the fly with favorites and recents, so the heavy model stays one keystroke away without being the default for everything.
Is Mixtral 8x22B good enough for agentic coding in 2026?
Mixtral 8x22B (local via Ollama) is 2024-era capability. A hosted Devstral Medium will out-code Mixtral 8x22B on agentic tasks for a fraction of the setup effort, which is the honest verdict on an 80GB model in 2026 unless privacy or volume forces the local path.
Atlas's agent loop is demanding. Every Atlas tool call is permission-gated against allow, ask, and deny rules before it runs, Atlas drafts a plan in a read-only plan agent and asks before switching to a build agent, and Atlas computes a unified diff for every file edit and surfaces it for approval before writing. A 2024-generation mixture-of-experts model can drive that loop, and it will not drive it as well as a current coding model. Choose Mixtral 8x22B (local via Ollama) because your source cannot leave the building or because the $2.00 / $6.00 per Mtok bill is untenable, not because you expect better code.
When should you pick a different model than Mixtral 8x22B local?
Pick something other than Mixtral 8x22B (local via Ollama) if you do not already own a multi-GPU box or a 96GB-plus unified-memory Mac. The 80GB footprint is the whole decision, and on smaller hardware Mixtral 8x22B will be slow regardless of how efficient the sparse routing is.
The comparison set is short. Against the hosted Mixtral API, Mixtral 8x22B (local via Ollama) trades $2.00 / $6.00 per Mtok for Free (self-hosted) plus a hardware bill. Against a hosted Devstral Medium, Mixtral 8x22B loses on agentic coding quality and on setup effort. Against a smaller local model, Mixtral 8x22B wins on capability and loses badly on memory. Atlas snapshots file changes as git patches so edits can be diffed and rolled back regardless of which model you choose, so the model decision is about capability and cost, not safety.
How does the 64,000 token window compare to Mixtral 8x7B?
Mixtral 8x22B (local via Ollama) doubles Mixtral 8x7B's window to 64,000 tokens, which is the main reason to accept the 80GB download over the smaller mixture-of-experts model. Ollama reports the 64K window directly once `ollama pull mixtral:8x22b` completes.
Sixty-four thousand tokens is a real working budget for Atlas. Atlas searches code with hybrid semantic and keyword retrieval fused by reciprocal rank fusion and indexes code by AST declarations using tree-sitter, not blind line windows, so the context Atlas assembles is dense. A 64,000 token window holds a service, its tests, and several rounds of tool output without truncation. What the window does not fix is generation quality on long agentic chains, where Mixtral 8x22B (local via Ollama) remains a 2024-era model. Set limit.context to 64000 and keep expectations calibrated to that generation.
Setup
- 01Confirm you have the memory first: `atlas device` reports GPU and Ollama status before you spend an 80GB download.
- 02Run `ollama pull mixtral:8x22b` (80GB).
- 03Register the ollama provider in atlas.json (`@ai-sdk/openai-compatible`, baseURL `http://localhost:11434/v1`) with `mixtral:8x22b` and `"limit": { "context": 64000, "output": 8192 }`.
- 04Set `"model": "ollama/mixtral:8x22b"` but keep `"small_model"` on something tiny so titles do not wake the 80GB model.
- 05Point the codebase index at local Ollama embeddings so source never leaves the machine.
Frequently asked questions
- how much vram do i need to run mixtral 8x22b locally
- Mixtral 8x22B (local via Ollama) is an 80GB pull, and 80GB of weights realistically needs a multi-GPU box or a 96GB-plus unified-memory Mac. Run `atlas device` to check GPU and Ollama status first.
- what context window does mixtral 8x22b have in atlas
- Ollama reports a 64K context window for `mixtral:8x22b`, double the 8x7B variant. Declare it in atlas.json with `"limit": { "context": 64000, "output": 8192 }`.
- is it cheaper to self-host mixtral 8x22b than use the api
- Running Mixtral 8x22B locally is Free (self-hosted) and sidesteps the API's $2.00 / $6.00 per Mtok entirely, which pays for hardware on a heavy team. On light usage the API is cheaper than an 80GB-capable machine.
- how do i configure atlas for mixtral 8x22b on ollama
- Register the ollama provider in atlas.json with `@ai-sdk/openai-compatible` and baseURL `http://localhost:11434/v1`, add `mixtral:8x22b` with `"limit": { "context": 64000, "output": 8192 }`, then set `"model": "ollama/mixtral:8x22b"`.
- should i keep small_model on mixtral 8x22b
- No. Keep `"small_model"` on something tiny so titles do not wake the 80GB model. Atlas uses the small model slot for cheap background work, and an 80GB model is the wrong tool for naming a session.
- is mixtral 8x22b still good for coding in 2026
- Mixtral 8x22B capability is 2024-era. A hosted Devstral Medium will out-code it on agentic tasks for a fraction of the setup effort, so choose Mixtral 8x22B (local via Ollama) for privacy or volume, not for quality.
- why is mixtral 8x22b fast despite being 80gb
- Sparse routing across 8 experts of 22B means only a subset of parameters is active per token, which keeps generation speed reasonable despite the 80GB footprint, provided the weights are fully resident in memory.
Try Atlas in your terminal
The terminal-native AI coding agent. Free core, single binary.
Install AtlasRelated guides
Atlas for Fortran: fpm.toml, Explicit Interfaces, and fprettify in 2026
Atlas is a terminal-native AI coding agent for Fortran in 2026. It reads modules, explicit interfaces, and intent declarations, runs fpm test behind a prompt, and runs fprettify.
Locate Where a Behavior Is Implemented with Atlas in 2026
How to locate where a behavior is implemented with Atlas in 2026: codebase_search for meaning, grep for exact text, and the lsp tool for the symbol graph.
Atlas for Polars: Terminal-Native AI Coding in 2026
Atlas is a terminal-native AI coding agent for Polars. Build LazyFrame chains, push scan_csv predicates into the reader, and read explain() plans in 2026.
Atlas for SolidJS: A Terminal-Native AI Coding Agent Built on Solid, for Solid, in 2026
Atlas is a terminal-native AI coding agent for SolidJS in 2026. It reads your createSignal and createMemo graph, fixes destructured props that break reactivity, and runs vitest.
Atlas for Blazor: Terminal-Native AI Coding for .razor Components in 2026
Atlas is a terminal-native AI coding agent for Blazor developers in 2026. Work across .razor components, render modes, and the C# and JS interop boundary safely.
Atlas vs GitHub Copilot: Terminal AI Coding Agents in 2026
Comparing Atlas, the terminal-native AI coding agent, with GitHub Copilot's editor extension and chat features for developers in 2026. Explore planning, pricing, and privacy.
Atlas for Symfony in 2026
Atlas is a terminal-native AI coding agent for Symfony in 2026. It reads autowired services and Doctrine mappings, and shows migration SQL before anything runs.
Atlas for TensorFlow: Terminal-Native AI Coding for Keras 3 and tf.data in 2026
Atlas is a terminal-native AI coding agent for TensorFlow and Keras 3 in 2026, where tf.function graph tracing and tf.data pipelines are what make training fast.