Model index · Text · text generation · standard · open weights · Meta · released 2024-07-23

Llama 3.1 8B Instruct pricing

Served by 7 providers from $0.0250 to $0.2200 per 1M tokens on the standard tier — a 8.8× gap for identical weights.

Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 8B instruct-tuned version is fast and efficient. It has demonstrated strong performance compared to...

Meta · 8.03B parameters · llama3.1 · first published 2024-07-23 · Text model · text generation · 131k context · description as published by the source, not written by us

Open weights: meta-llama/Llama-3.1-8B-Instruct · 8.03B parameters counted from the weight files · licence llama3.1 · 7.3M downloads in the last 30 days . Parameter count and licence come from the public weights registry, not from a seller — and the download figure exists only for models published this way, so it is not a market-wide popularity measure.

$0.0250

Cheapest standard /1M — DeepInfra

131k

Native context window

7

Providers serving it

Quality not measured yet

Quality not measured yet

We measure models on request rather than pre-scoring the whole catalog, so this one has no score yet. Absence of a score is not a low score.

At 1M requests/month (1500 in / 500 out tokens), moving from CoreWeave to DeepInfra saves about $390/month.

Illustrative traffic shape, stated so you can check it against your own. Same weights both sides — but confirm quantisation and context below before switching.

Every provider and service tier

Standard on-demand rows first, cheapest of each group first. Tiers are not interchangeable — see the note below the table.

Provider In /1M Out /1M Blended /1M Tier Region Source
DeepInfra cheapest standard $0.0200 $0.0400 $0.0250 standard third_party
Novita $0.0200 $0.0500 $0.0275 standard third_party
Novita $0.0200 $0.0500 $0.0275 standard provider_api
Groq $0.0500 $0.0800 $0.0575 standard third_party
OpenRouter (default route) *
resells other hosts
$0.0500 $0.0800 $0.0575 standard provider_api
Cloudflare $0.1520 $0.2870 $0.1858 standard third_party
CoreWeave $0.2200 $0.2200 $0.2200 standard third_party

* OpenRouter chooses a host for each request, and the figure above is what its default choice costs — not a fixed rate for this model. Selecting a specific host through the same account costs whatever that host charges, which is why this row can sit above or below the hosts listed beside it. Token rates are passed through from the underlying provider with no markup, so the per-1M price above is what that host charges directly — OpenRouter's own charge sits on funding instead: 5.5% (min $0.80) by Stripe or 5% by Coinbase to buy credits, 5% of the equivalent spend if you bring your own provider key. So budget about 5% above the rate shown unless you already hold credit. Fee schedule.

Compare Llama 3.1 8B Instruct with alternatives

One model per vendor, ordered by how prominent the vendor is and how many independent providers serve the model — hosts only carry what customers ask for, so that is a real demand signal. This is not traffic or popularity data, which we do not have. Every alternative below does the same job — text generation — because a price comparison between a generator and, say, an upscaler is arithmetic rather than advice. Prices on both sides are standard on-demand rates, so the comparison is like for like — a discounted batch or flex rate is never shown against another model’s standard rate.

AlternativeVendor $/1M vs Llama 3.1 8B Instruct QualityKindContextHosts
Mistral Small 3 Mistral $0.0575
OpenRouter (default route)
130% dearer 20/100 standard
open weights
33k 3
Command R7B (12-2024) Cohere $0.0656
Cohere
162% dearer 0/100 standard 128k 1
WizardLM-2 8x22B Microsoft $0.4800
DeepInfra
1820% dearer 100/100 standard 66k 3
DeepSeek V3 0324 DeepSeek $0.4050
DeepInfra
1520% dearer not measured standard 164k 4
Qwen2.5 7B Instruct Alibaba $0.0550
DeepInfra
120% dearer not measured standard
open weights
33k 3
Llama 3 8B Lunaris Sao10K $0.0425
OpenRouter (default route)
70% dearer not measured standard 8k 3
Nova Micro 1.0 Amazon $0.0613
OpenRouter (default route)
145% dearer not measured standard 128k 2
Granite 4.1 8B IBM $0.0625
OpenRouter (default route)
150% dearer not measured standard
open weights
131k 1

Prices are the cheapest host for each model, blended at a 3:1 input:output ratio. "Quality" is our own probe suite where we have run it — see what it measures. A cheaper alternative is only a real saving if it also passes on the capability your workload needs.

Before you switch

Identical weights do not guarantee identical output. Check that the cheaper host serves the model at full precision rather than a quantised copy, that its context window matches what you need, and that its rate limits carry your peak traffic. A cheaper host that cannot take your throughput is not cheaper — it is an outage.

Move to DeepInfra without a rewrite

VernaOne fronts every provider on this page with one API, so switching host is a config change — with automatic fallback if quality or latency regresses.

Try VernaOne free →

Frequently asked

How much does Llama 3.1 8B Instruct cost?

The cheapest standard-tier provider is DeepInfra at $0.0250 per 1M tokens blended (3:1 input:output). The dearest is CoreWeave at $0.2200 — a 8.8× difference for the same weights. Prices change often; verify with the provider before budgeting.

Which provider is best for Llama 3.1 8B Instruct?

Cheapest is not automatically best. Compare quantisation (a lossy copy of the weights changes output), the context window each host actually serves, and rate limits. Where a provider serves less context than the model's native window we flag it in the table above.

Can I switch providers for Llama 3.1 8B Instruct without changing code?

Yes, if you route through an abstraction. VernaOne exposes one API across every provider listed here, so switching host is a config change and you keep automatic fallback if the new one degrades.

← All models · Generated catalog of AI models and every provider that serves them, with normalised prices in USD per 1,000,000 tokens. Blended prices assume a 3:1 input:output ratio.