crail
LLM Inference / Custom AI AcceleratorsOrganic listing

Groq

Ultra-fast LLM inference on custom LPU chips, delivered via a self-serve token-priced cloud API.

Last verified:

Groq designs custom Language Processing Units (LPUs) and runs GroqCloud, a self-serve inference API offering ultra-low-latency token generation for open models like Llama, GPT-OSS, and Qwen. Founded in 2016 in Mountain View, California by former Google TPU architect Jonathan Ross, Groq also offers GroqRack for on-premises deployment in regulated or air-gapped environments. The company has raised billions across multiple rounds, including a $640M Series D in 2024 at a $2.8B valuation, and a reported Series E in 2025.

Pricing

TierPriceKey features
Free$0/monthlyFree API key, no credit card required, Access to hosted OSS + Llama/Qwen models, Community support
Pay-As-You-Go (On Demand)CustomLlama 3.1 8B: $0.05/$0.08 per M input/output tokens, GPT OSS 120B: $0.15/$0.60 per M tokens, Llama 3.3 70B: $0.59/$0.79 per M tokens, Whisper speech-to-text: $0.04-$0.111/hour, TTS: $22-$40 per M characters, Batch API: 50% discount
EnterpriseCustomCustom/fine-tuned models, LoRA fine-tunes, Regional endpoint selection, Dedicated/scalable capacity, GroqRack on-prem deployment, Dedicated support

Source: https://groq.com/pricing

Agent-readiness

75/100
Discoverability
55/100
Machine-readable content
75/100
Programmatic access
90/100
MCP / agent support
80/100
Self-serve transactability
80/100
Transparency
70/100

Security & compliance

SOC 2HIPAAGDPR
SSO / SAML
Not publicly documented
Encryption at rest
Yes
Encryption in transit
Yes
Audit log
Not publicly documented
Pentest report
Not publicly documented

"Not publicly documented" means Crail found no public evidence either way — not a confirmed absence. See our methodology. Trust center: https://trust.groq.com.

FAQ

Does Groq have a free tier?

Yes, Groq offers a free tier or free trial.

Can you buy Groq without talking to sales?

Yes, Groq can be purchased self-serve without a sales call.

Does Groq have an official MCP (Model Context Protocol) server?

Yes, Groq publishes an official MCP server (https://github.com/groq/groq-mcp-server).

What compliance certifications does Groq hold?

Groq holds: SOC 2, HIPAA, GDPR.

Reviews

No reviews yet for Groq. Be the first to submit a verified review.

Submit a review

Reviews are manually verified before publishing (LinkedIn/corporate-email cross-check) — see our methodology. Submitting does not guarantee publication.

Methodology & disclosure

Data verified via agent crawled, last checked 2026-07-27. Agent-readiness methodology version crail-ar-v0.1. No vendor payment influences these scores — see our methodology page.