# Atlas with Mixtral 8x7B (Ollama): Sparse MoE Throughput in 2026 > Mixtral 8x7B (Ollama) routes two of eight experts per token, so a 26GB model delivers 13B-class latency to Atlas at a price of Free (self-hosted). Mixtral 8x7B (Ollama) is the sparse mixture of experts that popularized the architecture: eight 7B experts with two routed per token, so you get 13B-class latency out of a 26GB model. Inside Atlas the pricing is Free (self-hosted) and the context window is 32K tokens (32,768). The catch is memory, not speed: all 26GB must stay resident, roughly 28GB to serve, which in practice means a 32GB-plus Apple Silicon machine or dual GPUs. Mixtral 8x7B is Apache 2.0 licensed, which distinguishes it from Codestral in the same lab's lineup, and its multilingual coverage is genuinely useful on codebases with non-English documentation. ## Key takeaways - Mixtral 8x7B (Ollama) routes two of eight experts per token, so you get 13B-class latency from a 26GB model. - All 26GB must be resident (roughly 28GB to serve), so despite the fast inference it needs more memory than a 32B dense model. - Pricing is Free (self-hosted) and the context window is 32K tokens (32,768). - Apache 2.0 weights with no commercial restrictions, which distinguishes it from Codestral in the same lab's lineup. - It is a 2023-generation model; newer MoEs like Qwen3 30B-A3B deliver more per gigabyte, so check both before committing 28GB. ## What is Mixtral 8x7B (Ollama) best at inside Atlas? Mixtral 8x7B (Ollama) is best at throughput inside Atlas. The sparse mixture of experts routes two of eight experts per token, so a 26GB model answers with 13B-class latency. On multi-turn agent work, where Atlas re-prompts constantly, that latency profile is worth more than raw parameter count. An Atlas turn is not one long generation. Atlas searches code with hybrid semantic and keyword retrieval fused by reciprocal rank fusion, proposes a tool call, waits for a permission decision, reads the result, and goes again. Every one of those hops pays the model's latency. Mixtral 8x7B is the model that made the case for MoE on exactly this workload: the weights are 26GB, but only two of eight experts fire per token, so the compute per token looks like a 13B and the wall-clock feel of an Atlas session is fast. Mixtral 8x7B also ships Apache 2.0 weights with no commercial restrictions, which distinguishes it from Codestral in the same lab's lineup, so it can go straight onto client work with nothing to sign. ## How much memory does Mixtral 8x7B need to run with Atlas? Mixtral 8x7B (Ollama) needs roughly 28GB of VRAM or unified memory to serve, on top of a 26GB pull. In practice that means a 32GB-plus Apple Silicon machine or dual GPUs. Sparse routing cuts compute per token, not the resident memory footprint. The memory story for Mixtral 8x7B is where most people misread the architecture. Sparse MoE means only two of the eight experts compute on a given token, but all eight experts must be loaded, so all 26GB must be resident. Roughly 28GB to serve is the real number. That produces the odd result that despite the fast inference, Mixtral 8x7B needs more memory than a 32B dense model while performing closer to a 13B. If your machine has 32GB of unified memory or two cards you can shard across, that trade is fine and the throughput is real. If you are on a single 24GB card, Mixtral 8x7B simply will not load, and the sparse-routing advantage is irrelevant to you. ## Does 32K of context limit Mixtral 8x7B in an Atlas session? Mixtral 8x7B (Ollama) offers a 32K token (32,768) window, which is modest for a model that costs 28GB to serve. Register mixtral:8x7b in atlas.json with limit.context 32768 and limit.output 8192, and expect the window, not the weights, to be your first ceiling. The asymmetry is worth stating plainly: Mixtral 8x7B asks for workstation-class memory and gives back a 32K context, the same window as a 4.4GB 7B. For an Atlas agent loop that injects retrieved chunks and unified diffs every turn, 32K is functional but never generous. What softens it is that Atlas indexes code by AST declarations using tree-sitter, not blind line windows, so the material Atlas puts inside those 32K tokens is whole declarations rather than arbitrary slices. Mixtral 8x7B also brings strong multilingual coverage inside that window, which is a real advantage on codebases with non-English documentation, comments, or identifiers that a code-only model would tokenize poorly. ## When should you pick a different model than Mixtral 8x7B? Pick a different model than Mixtral 8x7B (Ollama) when memory efficiency matters. Mixtral 8x7B is a 2023-generation model, and newer MoEs like Qwen3 30B-A3B deliver more per gigabyte. Paying 28GB of memory for 13B-class capability is a worse trade in 2026 than it was at launch. Mixtral 8x7B earned its reputation, and the architecture it demonstrated is now everywhere, which is precisely the problem for anyone choosing a model today. The honest read is that Mixtral 8x7B remains a good demonstration of why MoE wins on throughput, but as a daily driver it has been passed: newer MoEs like Qwen3 30B-A3B deliver more per gigabyte on the same idea. Choose Mixtral 8x7B when you specifically want Apache 2.0 weights, when multilingual coverage matters to your repo, or when you already have the 32GB machine and want the fastest thing that fills it. Atlas lets you switch the active model and provider on the fly with favorites and recents, so registering mixtral:8x7b alongside a newer tag and comparing them on your own repo costs you one pull. ## How do you keep an Atlas setup on Mixtral 8x7B fully local? Keep the Atlas codebase index on Ollama embeddings. Atlas can build its code index with local Ollama embeddings, keeping code off third-party servers, so an Apache-licensed model like Mixtral 8x7B is paired with a retrieval path that has no vendor terms at all. Licensing hygiene is the underrated reason to run Mixtral 8x7B. Apache 2.0 weights with no commercial restrictions solve half the problem, and the other half is retrieval. If your Atlas codebase index calls a hosted embedding endpoint, your source has crossed a vendor boundary regardless of how permissive the model license is. Pointing the index at the local Ollama embedder closes that gap, so the whole path has no vendor terms at all. On top of that, every Atlas tool call is permission-gated against allow, ask, and deny rules before it runs, Atlas computes a unified diff for every file edit and surfaces it for approval before writing, and Atlas snapshots file changes as git patches so edits can be diffed and rolled back. Confirm the model resolved with atlas models ollama before you start. ## Setup 1. Pull it: ollama pull mixtral:8x7b (26GB, aliased to :latest) 2. You need roughly 28GB of VRAM or unified memory, which in practice means a 32GB-plus Apple Silicon machine or dual GPUs 3. Add mixtral:8x7b to the ollama models map in atlas.json with limit.context 32768 and limit.output 8192 4. Set model to ollama/mixtral:8x7b and confirm with atlas models ollama 5. Keep the codebase index on Ollama embeddings so an Apache-licensed model is paired with a retrieval path that has no vendor terms at all ## FAQ ### how much VRAM does mixtral 8x7b need Roughly 28GB of VRAM or unified memory to serve, on top of a 26GB pull. In practice that means a 32GB-plus Apple Silicon machine or dual GPUs, because all 26GB of experts must be resident. ### why is mixtral 8x7b fast if it is 26GB Mixtral 8x7B is a sparse mixture of experts with two of eight experts routed per token, so compute per token looks like a 13B even though all 26GB of weights stay loaded in memory. ### is mixtral 8x7b apache licensed Yes. Mixtral 8x7B ships Apache 2.0 weights with no commercial restrictions, which distinguishes it from Codestral in the same lab's lineup. Pricing in Atlas is Free (self-hosted). ### what limit.context should I set for mixtral:8x7b in atlas Add mixtral:8x7b to the ollama models map in atlas.json with limit.context 32768 and limit.output 8192, matching the model's 32K token (32,768) window. ### mixtral 8x7b vs qwen3 30b-a3b Mixtral 8x7B is a 2023-generation model, and newer MoEs like Qwen3 30B-A3B deliver more per gigabyte. Pick Mixtral 8x7B for Apache 2.0 weights and multilingual coverage, not for memory efficiency. ### can mixtral 8x7b run on a 24GB GPU No. Mixtral 8x7B needs roughly 28GB of VRAM or unified memory because all 26GB of experts must be resident, so a single 24GB card cannot serve it. ### is mixtral good for non-english codebases Yes. Mixtral 8x7B has 32K context and strong multilingual coverage, which is useful on codebases with non-English documentation, comments, or identifiers. --- Canonical HTML: https://runatlas.sh/resources/models/mixtral-8x7b-local Source of truth: aeo_pages row `/resources/models/mixtral-8x7b-local` (segment: Models) (this file is generated from it, never hand-edited). Licence: Atlas is proprietary with a free core. It is not open source and there is no public source repository.