Best LLM Inference Providers

Vendor profileChecked Nov 8, 2026

Groq

Groq, Inc. (GroqCloud) · groq.com · Last checked:

  • Serverless per-token API
  • Custom inference hardware (LPU)

Company status

Active, privately held. On Dec 24, 2025 Groq announced a non-exclusive inference technology licensing agreement with Nvidia; Groq said it continues as an independent company and GroqCloud continues to operate.

Sources 1, 2, 3, 4, 5 · checked 2026-11-08

Capabilities

  • GroqCloud API for open-weight models on Groq LPU hardware, priced per 1M tokens in the docs
  • Mostly OpenAI-compatible API for existing OpenAI client libraries
  • By default does not retain customer data for inference requests; retention applies to batch jobs, fine-tuning and LoRAs, or reliability and abuse investigations
  • Batch processing, flex processing, and LoRA inference service tiers

Sources 1, 2, 3, 4, 5 · checked 2026-11-08

Who it tends to fit

  • Teams that want a per-token API on non-GPU inference hardware for supported open-weight models
  • Buyers that need SOC 2 Type II and HIPAA listed in a trust center

Sources 1, 2, 3, 4, 5 · checked 2026-11-08

Pricing

Published per-token pricing on https://console.groq.com/docs/models (for example, GPT OSS 120B listed at $0.15 per 1M input tokens and $0.60 per 1M output tokens). The former groq.com/pricing URL redirects to the homepage.

Sources 1, 2, 3, 4, 5 · checked 2026-11-08

Published certifications

  • SOC 2 Type II
  • GDPR
  • HIPAA

Listed as stated by the vendor. Scope can differ by product or subsidiary; request current reports.

Sources 1, 2, 3, 4, 5 · checked 2026-11-08

Limitations to check

  • Model list is limited to models Groq hosts; preview models may be discontinued at short notice
  • Bring-your-own-model is limited to LoRA inference on the pages checked
  • Region choice is not documented on the pages checked

Sources 1, 2, 3, 4, 5 · checked 2026-11-08

Sources

  1. Models page lists per-1M-token prices (GPT OSS 120B $0.15 input / $0.60 output)console.groq.com/docs/modelsChecked 2026-11-08
  2. Trust Center compliance: SOC 2 Type II, GDPR, HIPAA; SOC 2 Type II 2025 reporttrust.groq.comChecked 2026-11-08
  3. By default Groq does not retain customer data for inference; retained only for features like batch, fine-tuning and LoRAs, or reliability/abuseconsole.groq.com/docs/your-dataChecked 2026-11-08
  4. Groq API designed to be mostly compatible with OpenAI client librariesconsole.groq.com/docs/openaiChecked 2026-11-08
  5. Non-exclusive licensing agreement with Nvidia; Groq continues as independent company; GroqCloud continues without interruptiongroq.com/newsroom/groq-and-nvidia-enter-non-exclusive-inference-technology-licensing-agreement-to-accelerate-ai-inference-at-global-scaleChecked 2026-11-08

Report a correction: [email protected]. Facts are re-checked at least every 90 days.