created by: @dunder_bird
inspired by: gputable.dev · Brandon @burcs

ModelTable - LLM prices · all models

Llama 3.1 8B Instruct

10 rows. Prices USD / 1M tokens.

ProviderVia$/M in$/M outCache RCache WBlendCtxTPSUp
OpenRouter DeepInfra $0.020 $0.040 — — $0.035 131k — 99.9% src
Novita — $0.020 $0.050 — — $0.043 16k — — src
Vercel AI Gateway Novita $0.020 $0.050 — — $0.043 16k 182 100.0% src
OpenRouter Novita $0.020 $0.050 — — $0.043 16k — 98.8% src
OpenRouter — $0.050 $0.080 $0.025 — $0.072 131k — — src
OpenRouter Groq $0.050 $0.080 $0.025 — $0.072 131k — 100.0% src
Vercel AI Gateway — $0.220 $0.220 — — $0.220 128k — — src
Vercel AI Gateway Bedrock $0.220 $0.220 — — $0.220 128k — 100.0% src
OpenRouter Core Weave $0.220 $0.220 $0.220 — $0.220 131k — 100.0% src
OpenRouter Cloudflare $0.152 $0.287 — — $0.253 32k — 98.9% src