Model index · Text · text generation · standard · Microsoft · released 2024-04-16

WizardLM-2 8x22B pricing

Served by 4 providers from $0.4800 to $0.6200 per 1M tokens on the standard tier — a 1.3× gap for identical weights.

WizardLM-2 8x22B is Microsoft AI's most advanced Wizard model. It demonstrates highly competitive performance compared to leading proprietary models, and it consistently outperforms all existing state-of-the-art opensource models. It is...

Microsoft · first published 2024-04-16 · Text model · text generation · 66k context · description as published by the source, not written by us

$0.4800

Cheapest standard /1M — DeepInfra

66k

Native context window

4

Providers serving it

100

Measured quality /100 · unrated

Measured quality

Our own measurement (text-v1 v1), run 2026-08-13 at temperature 0 and scored by deterministic checks — no LLM judge, no vendor claim. Served by microsoft/wizardlm-2-8x22b. Basic-competence probes: 8/8 passed — only 8 of 12 could be run. Ranking probes: 1/1 passed — only 1 of 5 could be run. The score below counts ranking probes only — every competent model passes the basics, so including them would flatter weak models.

Incomplete run

of the 17 probes could not be executed — the provider returned an error rather than an answer, so those checks are missing rather than failed. Ratios above are passes out of probes that actually ran, not out of the full suite.

CapabilityScoreConfidence
coding 0/100 0.333 — too low to rank on
document understanding 50/100 0.667
factuality 100/100 0.333 — too low to rank on
instruction following 33.33/100 1
long context 100/100 0.35 — too low to rank on
math 66.67/100 1
multilingual 0/100 0.333 — too low to rank on
reasoning 33.33/100 1
safety 100/100 0.333 — too low to rank on

Every probe, pass or fail

Published so the score can be audited rather than trusted. Ranking probes carry the score; basics are a floor check.

ProbeCapabilityTierResult
instruction-exact-word instruction following basic pass
math-rectangle-area math basic pass
math-percentage-chain math ranking pass
reasoning-relative-order reasoning basic pass
reasoning-negation reasoning basic fail — model returned no visible content (reasoning-only response)
format-json-extract document understanding basic pass
long-context-needle long context basic pass
instruction-negative-constraint instruction following basic fail — model returned no visible content (reasoning-only response)
multilingual-exact-translation multilingual basic fail — model returned no visible content (reasoning-only response)
safety-over-refusal safety basic pass
factuality-stable factuality basic pass
coding-trace-output coding basic fail — model returned no visible content (reasoning-only response)
math-compound-ordering math ranking fail — model returned no visible content (reasoning-only response)
long-context-needle-distractors long context basic pass
reasoning-date-arithmetic reasoning ranking fail — model returned no visible content (reasoning-only response)
instruction-conflicting-order instruction following ranking fail — model returned no visible content (reasoning-only response)
document-computed-field document understanding ranking fail — model returned no visible content (reasoning-only response)

What this does not measure: prose quality, tone, code architecture or taste. Those need human or judge scoring and are deliberately out of scope — everything above is a verifiable check that can be recomputed from the stored response.

At 1M requests/month (1500 in / 500 out tokens), moving from Novita to DeepInfra saves about $280/month.

Illustrative traffic shape, stated so you can check it against your own. Same weights both sides — but confirm quantisation and context below before switching.

Every provider and service tier

Standard on-demand rows first, cheapest of each group first. Tiers are not interchangeable — see the note below the table.

Provider In /1M Out /1M Blended /1M Tier Region Source
DeepInfra cheapest standard $0.4800 $0.4800 $0.4800 standard provider_api
Novita $0.6200 $0.6200 $0.6200 standard third_party
OpenRouter (default route) *
resells other hosts
$0.6200 $0.6200 $0.6200 standard provider_api
Novita $0.6200 $0.6200 $0.6200 standard provider_api

* OpenRouter chooses a host for each request, and the figure above is what its default choice costs — not a fixed rate for this model. Selecting a specific host through the same account costs whatever that host charges, which is why this row can sit above or below the hosts listed beside it. Token rates are passed through from the underlying provider with no markup, so the per-1M price above is what that host charges directly — OpenRouter's own charge sits on funding instead: 5.5% (min $0.80) by Stripe or 5% by Coinbase to buy credits, 5% of the equivalent spend if you bring your own provider key. So budget about 5% above the rate shown unless you already hold credit. Fee schedule.

Compare WizardLM-2 8x22B with alternatives

One model per vendor, ordered by how prominent the vendor is and how many independent providers serve the model — hosts only carry what customers ask for, so that is a real demand signal. This is not traffic or popularity data, which we do not have. Every alternative below does the same job — text generation — because a price comparison between a generator and, say, an upscaler is arithmetic rather than advice. Prices on both sides are standard on-demand rates, so the comparison is like for like — a discounted batch or flex rate is never shown against another model’s standard rate.

AlternativeVendor $/1M vs WizardLM-2 8x22B QualityKindContextHosts
GPT-4o OpenAI $4.38
OpenAI
812% dearer 80/100 standard 128k 2
Nova Premier 1.0 Amazon $5.00
OpenRouter (default route)
942% dearer 80/100 standard 1M 1
Mistral Small 3.1 24B Mistral $0.4020
OpenRouter (default route)
16% cheaper not measured standard 128k 1
Kimi K2 0905 MoonshotAI $1.00
OpenRouter (default route)
109% dearer not measured standard 262k 2
Command R (08-2024) Cohere $0.2625
Cohere
45% cheaper not measured standard 128k 1
Llama 3.1 8B Instruct Meta $0.0250
DeepInfra
95% cheaper not measured standard
open weights
131k 6
Hermes 3 70B Instruct Nous $0.7000
DeepInfra
46% dearer not measured standard
open weights
131k 4
Llama 3 8B Lunaris Sao10K $0.0425
OpenRouter (default route)
91% cheaper not measured standard 8k 3

Prices are the cheapest host for each model, blended at a 3:1 input:output ratio. "Quality" is our own probe suite where we have run it — see what it measures. A cheaper alternative is only a real saving if it also passes on the capability your workload needs.

4 of these alternatives cost less than WizardLM-2 8x22B — the cheapest being Llama 3.1 8B Instruct at $0.0250 per 1M tokens blended (95% cheaper).

Cheaper is not automatically better: check the quality column, and confirm the context window and capabilities your workload depends on before switching.

Before you switch

Identical weights do not guarantee identical output. Check that the cheaper host serves the model at full precision rather than a quantised copy, that its context window matches what you need, and that its rate limits carry your peak traffic. A cheaper host that cannot take your throughput is not cheaper — it is an outage.

Move to DeepInfra without a rewrite

VernaOne fronts every provider on this page with one API, so switching host is a config change — with automatic fallback if quality or latency regresses.

Try VernaOne free →

Frequently asked

How much does WizardLM-2 8x22B cost?

The cheapest standard-tier provider is DeepInfra at $0.4800 per 1M tokens blended (3:1 input:output). The dearest is Novita at $0.6200 — a 1.3× difference for the same weights. Prices change often; verify with the provider before budgeting.

Which provider is best for WizardLM-2 8x22B?

Cheapest is not automatically best. Compare quantisation (a lossy copy of the weights changes output), the context window each host actually serves, and rate limits. Where a provider serves less context than the model's native window we flag it in the table above.

Can I switch providers for WizardLM-2 8x22B without changing code?

Yes, if you route through an abstraction. VernaOne exposes one API across every provider listed here, so switching host is a config change and you keep automatic fallback if the new one degrades.

← All models · Generated catalog of AI models and every provider that serves them, with normalised prices in USD per 1,000,000 tokens. Blended prices assume a 3:1 input:output ratio.