DeepInfra

62 models available

Data handling can vary by model and deployment. The privacy badge above shows the more conservative of the provider-wide fallback and the policies for routes on this page; each model page shows the policy for that specific route.

Models served by DeepInfra

Model	Context	Input /M	Output /M	Cache read /M	Latency	Throughput
DeepSeek R1-0528 FP4	128k	$0.53/M	$2.26/M	$0.37/M	0.7s	30 tps
DeepSeek V3.1 FP4	128k	$0.26/M	$1.00/M	$0.14/M	0.8s	6 tps
DeepSeek V3.2 FP4	163k	$0.27/M	$0.40/M	$0.14/M	1.5s	15 tps
DeepSeek V3.2 (Thinking) FP4	163k	$0.27/M	$0.40/M	$0.14/M	1.5s	15 tps
DeepSeek V4 Flash FP8	1.0M	$0.09/M	$0.19/M	$0.02/M	1s	28 tps
DeepSeek V4 Flash (Thinking) FP8	1.0M	$0.09/M	$0.19/M	$0.02/M	1s	28 tps
DeepSeek V4 Flash 0731 FP8	1.0M	$0.06/M	$0.19/M	$0.02/M	0.9s	43 tps
DeepSeek V4 Flash 0731 (Thinking) FP8	1.0M	$0.06/M	$0.19/M	$0.02/M	0.9s	43 tps
DeepSeek V4 Flash Vision Exp FP8	1.0M	$0.23/M	$0.68/M	$0.0072/M	1.8s	35 tps
DeepSeek V4 Pro FP8	1.0M	$1.36/M	$2.73/M	$0.10/M	1.2s	38 tps
DeepSeek V4 Pro (Thinking) FP8	1.0M	$1.36/M	$2.73/M	$0.10/M	1.2s	38 tps
DeepSeek V4 Pro 0813 FP8	1.0M	$1.36/M	$2.73/M	$0.10/M	1.7s	66 tps
DeepSeek V4 Pro 0813 (Thinking) FP8	1.0M	$1.36/M	$2.73/M	$0.10/M	1.7s	66 tps
DeepSeek V4.1 Flash FP8	1.0M	$0.15/M	$0.44/M	$0.0044/M	1.4s	61 tps
DeepSeek V4.1 Flash (Thinking) FP8	1.0M	$0.15/M	$0.44/M	$0.0044/M	1.4s	61 tps
Gemma 4 26B A4B FP8	262k	$0.07/M	$0.36/M	$0.01/M	0.7s	24 tps
Gemma 4 31B FP8	262k	$0.16/M	$0.42/M	$0.02/M	2.6s	10 tps
GLM 4.6 FP4	200k	$0.53/M	$2.10/M	$0.10/M	0.7s	31 tps
GLM 4.6 (Thinking) FP4	200k	$0.53/M	$2.10/M	$0.10/M	0.7s	31 tps
GLM 4.7 FP4	200k	$0.42/M	$1.84/M	$0.08/M	1s	24 tps
GLM 4.7 (Thinking) FP4	200k	$0.42/M	$1.84/M	$0.08/M	1s	24 tps
GLM 5.2 FP4	1.0M	$0.59/M	$1.89/M	$0.11/M	1.1s	54 tps
GLM 5.2 (Thinking) FP4	1.0M	$0.59/M	$1.89/M	$0.11/M	1.1s	54 tps
GLM 5.3 FP4	1.0M	$0.59/M	$2.63/M	$0.13/M	1.9s	53 tps
GLM 5.3 (Thinking) FP4	1.0M	$0.59/M	$2.63/M	$0.13/M	1.9s	53 tps
GLM 5.3 Flash FP4	1.0M	$0.08/M	$0.26/M	$0.02/M	1.4s	29 tps
GPT OSS 120B BF16	128k	$0.16/M	$0.63/M	N/A	0.4s	110 tps
GPT OSS 20B BF16	128k	$0.03/M	$0.15/M	N/A	0.4s	75 tps
Granite 4.2 8B BF16	131k	$0.06/M	$0.26/M	$0.02/M	0.7s	64 tps
Hermes 3 70B FP8	66k	$0.73/M	$0.73/M	N/A	0.6s	27 tps
Inkling Small FP8	524k	$0.47/M	$1.26/M	$0.10/M	0.8s	57 tps
Inkling Small Thinking FP8	524k	$0.47/M	$1.26/M	$0.10/M	0.8s	57 tps
Kimi K2.6 FP4	256k	$0.79/M	$3.68/M	$0.16/M	2.2s	9 tps
Kimi K3 BF16	1.0M	$2.99/M	$14.96/M	$0.30/M	2.1s	19 tps
Llama 3.1 8B FP8	131k	$0.02/M	$0.04/M	N/A	0.8s	24 tps
Llama 3.3 70B Instruct FP8	131k	$0.10/M	$0.34/M	N/A	0.5s	14 tps
MiMo V2.5 Pro FP8	1.0M	$1.05/M	$3.15/M	$0.21/M	N/A	N/A
MiMo V2.5 Pro Thinking FP8	1.0M	$1.05/M	$3.15/M	$0.21/M	N/A	N/A
MiMo V2.6 Flash FP8	1.0M	$0.15/M	$0.29/M	$0.0029/M	1.4s	49 tps
MiMo V2.6 Pro FP8	1.0M	$0.45/M	$0.91/M	$0.0038/M	1.8s	23 tps
MiniMax M3 FP8	512k	$0.29/M	$1.16/M	$0.06/M	1.2s	18 tps
MiniMax M3 Thinking FP8	512k	$0.29/M	$1.16/M	$0.06/M	1.2s	18 tps
Nvidia Nemotron 3 Super 120B BF16	262k	$0.09/M	$0.42/M	N/A	2.4s	60 tps
Nvidia Nemotron 3 Super 120B Thinking BF16	262k	$0.09/M	$0.42/M	N/A	2.4s	60 tps
Nvidia Nemotron 3 Ultra 550B	256k	$0.53/M	$2.31/M	$0.11/M	N/A	N/A
Nvidia Nemotron 3 Ultra 550B Thinking	256k	$0.53/M	$2.31/M	$0.11/M	N/A	N/A
Nvidia Nemotron 3.5 Lightning	29k	$0.06/M	$0.17/M	$0.03/M	N/A	N/A
Nvidia Nemotron 3.5 Lightning Thinking	29k	$0.06/M	$0.17/M	$0.03/M	N/A	N/A
Qwen 2.5 72B Instruct FP8	131k	$0.38/M	$0.42/M	N/A	0.4s	22 tps
Qwen 3.6 27B FP8	260k	$0.34/M	$3.36/M	N/A	0.4s	40 tps
Qwen 3.6 27B Thinking FP8	260k	$0.34/M	$3.36/M	N/A	0.4s	40 tps
Qwen 3.6 35B A3B FP8	262k	$0.10/M	$1.00/M	$0.10/M	0.5s	140 tps
Qwen 3.6 35B A3B Thinking FP8	262k	$0.10/M	$1.00/M	$0.10/M	0.5s	140 tps
Qwen3 235B A22B FP8	262k	$0.09/M	$0.58/M	N/A	0.6s	14 tps
Qwen3 32B FP8	41k	$0.08/M	$0.29/M	N/A	0.4s	22 tps
Qwen3 Next 80B A3B Instruct FP8	256k	$0.09/M	$1.16/M	N/A	0.6s	43 tps
Qwen3.5 397B FP8	258k	$0.47/M	$3.15/M	$0.23/M	0.8s	43 tps
Qwen3.5 397B Thinking FP8	258k	$0.47/M	$3.15/M	$0.23/M	0.8s	43 tps
Qwen3.8 27B BF16	262k	$0.16/M	$1.97/M	$0.04/M	1.2s	34 tps
Qwen3.8 27B Thinking BF16	262k	$0.16/M	$1.97/M	$0.04/M	1.2s	34 tps
Qwen3.8 Max FP4	262k	$2.10/M	$6.30/M	$0.21/M	1.3s	94.5 tps
Qwen3.8 Max Thinking FP4	262k	$2.10/M	$6.30/M	$0.21/M	1.3s	94.5 tps

Prices are per million tokens. Selectable routes include the applicable provider-selection markup; fixed routes show the standard model price. Availability and pricing refresh continuously; each model page shows the live provider comparison.

Using DeepInfra via the API

For models with provider selection, append :deepinfra to the model ID, set "provider": "deepinfra" in the request body, or send an X-Provider: deepinfra header. Explicit provider selection adds a route-specific markup over that provider's base price; the prices in the table above already include it. Models without provider selection use the displayed model ID without a provider suffix or selection surcharge.

curl https://nano-gpt.com/api/v1/chat/completions \
  -H "Authorization: Bearer $NANOGPT_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "deepseek-ai/DeepSeek-R1-0528:deepinfra",
    "messages": [{"role": "user", "content": "Hello"}]
  }'

See the API documentation for provider preferences, price-aware routing, and error behavior.

DeepInfra terms of use DeepInfra privacy policy