Mixtral 8x7B is the December 2023 Mistral AI model that popularised sparse mixture-of-experts. Eight 7B experts with two routed per token gave 47B-class quality at 13B-class inference cost, and every MoE shipped since follows the pattern.

how many experts does mixtral 8x7b activate per token

Mixtral 8x7B has 8 experts and activates 2 per token. That sparse routing is why its inference cost tracks a much smaller dense model, and it is priced at $0.70 / 1M input tokens on Mistral's API.

what is the context window of mixtral 8x7b

Mixtral 8x7B has a 32,000 token context window. That is tiny by 2026 standards and will not hold a large Atlas session, so keep the context tight with hybrid code search and AST-level chunks.

how do I run mixtral 8x7b in atlas

Export MISTRAL_API_KEY, run `atlas models mistral` and confirm open-mixtral-8x7b appears, then pin `"model": "mistral/open-mixtral-8x7b"` in atlas.json.

is mixtral 8x7b good for agentic coding

Not really. Mixtral 8x7B predates the agentic coding era, so its tool-call reliability is well behind Devstral. It is best treated as an architectural reference or a self-hosted option rather than a daily Atlas driver.

can I self host mixtral 8x7b

Yes. Mixtral 8x7B ships Apache 2.0 weights, so you can host the same model that serves the API. Pair it with Atlas's local Ollama embedding index to keep both retrieval and generation off third-party servers.

which models are based on the mixtral 8x7b architecture

Mixtral 8x7B is the reference architecture that Mixtral 8x22B, Llama 4 Scout, and Llama 4 Maverick all descend from. Its 8-expert, 2-active routing pattern became the template for later sparse mixture-of-experts models.

Atlas with Mixtral 8x7B: Running the Original Sparse MoE in 2026

Mixtral 8x7B is the December 2023 model that put sparse mixture-of-experts on the map: eight 7B experts with two routed per token, giving 47B-class quality at 13B-class inference cost. Inside Atlas it runs a 32,000 token context window at $0.70 / 1M input tokens and $0.70 / 1M output tokens, with Apache 2.0 weights you can host yourself. The 32,000 token context is tiny by 2026 standards and will not hold a large Atlas session.

How does Mixtral 8x7B's sparse mixture-of-experts design work?

Mixtral 8x7B is a sparse mixture-of-experts model: 8 experts, 2 activated per token, which is why inference cost tracks a much smaller dense model. Released in December 2023, it delivered 47B-class quality at 13B-class inference cost and defined the pattern every MoE since has followed.

Sparse routing means only a fraction of the parameters fire for any given token. Mixtral 8x7B holds eight 7B experts, a router picks two per token, and the compute bill reflects the two rather than the eight. That is the trick that made large-parameter models economically viable, and it is why Mixtral 8x7B still matters as a reference architecture. Mixtral 8x22B, Llama 4 Scout, and Llama 4 Maverick all descend from it. For an Atlas user, the architecture is history rather than a feature, but it explains why a model of this class prices at $0.70 / Mtok symmetric.

Why is Mixtral 8x7B's 32,000 token context a problem for Atlas?

Mixtral 8x7B has a 32,000 token context window, which is tiny by 2026 standards and will not hold a large Atlas session. A single service plus its tests can exceed 32,000 tokens, so the window fills fast and older turns fall out of context.

Working inside a 32,000 token budget means being deliberate about what enters it. Atlas has the tools for that: Atlas searches code with hybrid semantic and keyword retrieval fused by reciprocal rank fusion, and Atlas indexes code by AST declarations using tree-sitter, not blind line windows. Use hybrid code search to inject only the relevant AST chunks rather than whole files. A precise 32,000 tokens is workable for a scoped, single-file change. A sprawling multi-service refactor is not, and no amount of retrieval tuning will make Mixtral 8x7B behave like a 128,000 token model.

How much does Mixtral 8x7B cost, and can you self-host it?

Mixtral 8x7B costs $0.70 / 1M input tokens and $0.70 / 1M output tokens on Mistral's API, symmetric in both directions. The weights are Apache 2.0, so the same model can be hosted on your own hardware rather than called through the API.

The symmetric $0.70 / Mtok rate means output is not penalised, which softens the cost of a chatty model. Self-hosting is the more interesting option for teams with a hardware budget and a policy reason to keep source local. Atlas can build its code index with local Ollama embeddings, keeping code off third-party servers, so an Apache 2.0 model on local hardware plus a local index is a fully self-contained setup. The economics are worth checking honestly, though: at $0.70 / Mtok symmetric, hosted Mixtral 8x7B is not cheap relative to newer models with far larger windows.

Is Mixtral 8x7B good at agentic tool calling in Atlas?

Mixtral 8x7B predates the agentic coding era, so its tool-call reliability is well behind Devstral. Released in December 2023, it was trained before agent harnesses became a target, and inside Atlas that shows up as malformed calls and dropped tool arguments.

Atlas leans hard on the tool loop. Every Atlas tool call is permission-gated against allow, ask, and deny rules before it runs, and Atlas computes a unified diff for every file edit and surfaces it for approval before writing, which means a model that mangles a call wastes a turn rather than breaking anything. Still, wasted turns are the tax you pay for running a 2023 model in a 2026 agent. If tool reliability is what you need, Devstral was trained for it. Mixtral 8x7B is better understood as an architectural landmark you can still call than as a daily driver.

When does Mixtral 8x7B still make sense for an Atlas user?

Mixtral 8x7B makes sense when the sparse MoE architecture itself is the point: benchmarking, teaching, or auditing the Apache 2.0 weights that Mixtral 8x22B, Llama 4 Scout, and Llama 4 Maverick all descend from. It is a reference model more than a production driver.

There are real uses. Comparing routing behavior across MoE generations needs the original in the comparison. Evaluating what open weights actually buy you needs a model you can pull apart. And some teams simply have Mixtral 8x7B deployed and want Atlas to talk to it rather than to a new API. All of that is legitimate. What is not is picking Mixtral 8x7B as your default coding model in 2026, when its 32,000 token window will not hold a large Atlas session. Atlas lets you switch the active model and provider on the fly with favorites and recents, so keeping it as one option among several is easy.

Setup

01Export MISTRAL_API_KEY before launching Atlas.
02Run `atlas models mistral` and confirm open-mixtral-8x7b appears.
03Pin `"model": "mistral/open-mixtral-8x7b"` in atlas.json.
04Keep Atlas's context tight: use hybrid code search to inject only the relevant AST chunks, since 32,000 tokens fills fast.
05For a self-hosted run, use the Apache 2.0 weights on your own hardware instead of the Mistral API.

Frequently asked questions

what is mixtral 8x7b: Mixtral 8x7B is the December 2023 Mistral AI model that popularised sparse mixture-of-experts. Eight 7B experts with two routed per token gave 47B-class quality at 13B-class inference cost, and every MoE shipped since follows the pattern.
how many experts does mixtral 8x7b activate per token: Mixtral 8x7B has 8 experts and activates 2 per token. That sparse routing is why its inference cost tracks a much smaller dense model, and it is priced at $0.70 / 1M input tokens on Mistral's API.
what is the context window of mixtral 8x7b: Mixtral 8x7B has a 32,000 token context window. That is tiny by 2026 standards and will not hold a large Atlas session, so keep the context tight with hybrid code search and AST-level chunks.
how do I run mixtral 8x7b in atlas: Export MISTRAL_API_KEY, run `atlas models mistral` and confirm open-mixtral-8x7b appears, then pin `"model": "mistral/open-mixtral-8x7b"` in atlas.json.
is mixtral 8x7b good for agentic coding: Not really. Mixtral 8x7B predates the agentic coding era, so its tool-call reliability is well behind Devstral. It is best treated as an architectural reference or a self-hosted option rather than a daily Atlas driver.
can I self host mixtral 8x7b: Yes. Mixtral 8x7B ships Apache 2.0 weights, so you can host the same model that serves the API. Pair it with Atlas's local Ollama embedding index to keep both retrieval and generation off third-party servers.
which models are based on the mixtral 8x7b architecture: Mixtral 8x7B is the reference architecture that Mixtral 8x22B, Llama 4 Scout, and Llama 4 Maverick all descend from. Its 8-expert, 2-active routing pattern became the template for later sparse mixture-of-experts models.

Try Atlas in your terminal

The terminal-native AI coding agent. Free core, single binary.

Install Atlas

Related guides

Extract a Shared Helper from Duplicated Code with Atlas (2026 Workflow)

How to extract a shared helper from duplicated code with Atlas in 2026: codebase_search finds the copies by meaning, write creates the module, apply_patch swaps each call.

Run the Test Suite and Triage the Failures with Atlas in 2026

How to triage a failing test suite with Atlas in 2026: bash truncates at 2000 lines or 50 KB and saves the full log, then grep groups failures by root cause.

Atlas vs Blackbox AI: Choosing Your AI Coding Agent in 2026

Comparing Atlas, the terminal-native AI coding agent, with Blackbox AI, a VS Code agent with 4.7 million installs, for developers in 2026. Evaluate features, pricing, and workflow.

Atlas for C++ in 2026

In 2026, C++ developers adopt Atlas, the terminal-native AI coding agent, to enhance productivity. Atlas offers secure, context-aware assistance for modern C++ projects, integrating with CMake and ensuring code quality

Atlas vs Mistral Vibe for Code: Terminal AI Coding Agents in 2026

Compare Atlas and Mistral Vibe for Code in 2026. Atlas offers terminal-native TUI, explicit diffs, and BYO models. Mistral Vibe for Code provides a four-model stack, multi-platform access, and EU data sovereignty.

Atlas vs Jules: Terminal AI Coding Agents in 2026

Atlas and Jules comparison for 2026. Atlas offers terminal-native TUI and local code indexing. Jules provides cloud VMs and a Critic agent for PR review.

Atlas for Express in 2026

Atlas is a terminal-native AI coding agent for Express in 2026. It reads your middleware order, wraps async route handlers, and runs mocha behind a prompt.

Atlas for Polars: Terminal-Native AI Coding in 2026

Atlas is a terminal-native AI coding agent for Polars. Build LazyFrame chains, push scan_csv predicates into the reader, and read explain() plans in 2026.

Browse this resource hub