Groq Serverless AI Token Pricing & API Rates
Verified RatesTier 3 LPU Inference DatacenterReal-time verified rates (Updated 2026)
Groq Serverless AI Token Pricing (5 Models)
| Model | Category | Cold Start | Context | Input ($/1M or Unit) | Output / 1M Tokens | Speed | Actions |
|---|---|---|---|---|---|---|---|
| Llama-3.1-8B-Instant | LLM | 0s Instant | 128K | $0.05 | $0.08 | 560 tps | API Docs |
| Gemma-2-9B-IT | LLM | 0s Instant | 8K | $0.20 | $0.20 | 420 tps | API Docs |
| Mixtral-8x7B-32768 | LLM | 0s Instant | 32K | $0.24 | $0.24 | 380 tps | API Docs |
| Llama-3.3-70B-Instruct | LLM | 0s Instant | 128K | $0.59 | $0.79 | 290 tps | API Docs |
| DeepSeek-R1-Distill-Llama-70B | LLM | 0s Instant | 128K | $0.59 | $0.79 | 280 tps | API Docs |
Simulate monthly input and output token volume on Groq and compare your savings against OpenAI GPT-4o and Claude 3.5.
Open Groq Cost CalculatorCompare alternative inference platforms like Groq, Together AI, and DeepInfra on token latency, context windows, and pricing.
View Alternatives ComparisonGroq Pricing FAQ & Cost Guide
How does serverless token billing work on Groq?
Groq meters exact input (prompt) and output (completion) tokens. You only pay for what your application generates. There is zero baseline server provisioning cost or ongoing hourly commitment.
Does Groq charge for stopped instances or idle storage?
No. Groq is a purely serverless platform. When your application receives zero traffic, your hourly billing is strictly $0.00. There are no persistent disk fees or stopped instance retention charges.
Are there hidden egress or bandwidth fees?
Egress on Groq is billed at Included.
What payment methods does Groq accept?
Groq accepts standard credit card billing and enterprise invoicing with verified business accounts.