What is Deepgram and what does its voice AI platform provide?
Updated
Deepgram is an enterprise voice AI platform that provides speech-to-text (STT), text-to-speech (TTS), a unified Voice Agent API, and Audio Intelligence. It is aimed at teams building real-time voice agents and other production voice applications that need accurate transcription, low-latency speech output, and a way to run the full conversation loop through one API. The platform is available in real time or batch, in the cloud or self-hosted.
Core products
Deepgram describes its platform as “one platform to power your entire voice AI stack,” organized around four capabilities:
| Product | What it does |
|---|---|
| Speech-to-Text | Real-time transcription with production accuracy |
| Text-to-Speech | Expressive voices with latency as low as 80ms |
| Voice Agent | Real-time conversation through one API call |
| Audio Intelligence | Extracts insight from every conversation |
The newest generation of models is branded Flux. Deepgram describes Flux as “the first conversation-aware speech platform,” built to natively understand turn-taking, handle interruptions, and carry conversational context. Flux STT listens; Flux TTS speaks.
Flux TTS
Flux TTS is positioned as text-to-speech built for live conversations — a voice model that “thinks before it speaks,” holding tone, expression, and continuity across an entire conversation. Deepgram lists a promotional offer on its site: spend $1 on Flux TTS and get $1 back, up to $500. It also states that Flux TTS can be built with free through September 12th, with up to 45 concurrent streaming connections in the US and 5 in the EU and AU. Those limits and dates are time- and region-specific, so confirm current terms before planning capacity around them.
The unified Voice Agent API
Rather than stitching together separate components, Deepgram unifies speech-to-text, text-to-speech, and LLM orchestration into a single API, which the company says reduces complexity, latency, and cost. The conversation flow works like this:
- User — a customer or end user speaks naturally.
- Audio input — a partner-provided transport layer bridges streamed audio into Deepgram’s APIs and plays back TTS audio to the user, including telephony partners via PSTN/SIP.
- Speech-to-text — conversational speech recognition detects end-of-turn and interruptions and streams transcripts in real time.
- LLM orchestration — coordinates context, memory, and AI reasoning. It maintains conversation history and system settings, adjusts role or behavior, refines instructions in real time, injects guidance or context, calls functions to execute actions or fetch data, and connects to language models via API for response generation.
- Text-to-speech — converts AI responses into natural-sounding speech.
- Business logic — your custom application logic executes domain-specific actions, integrates external APIs, or adds validation before results flow back into the agent.
- External systems — databases, APIs, and back-office systems the agent interacts with; results are fed back into the conversation context for grounding.
The practical takeaway: if you are building a voice agent, the orchestration layer that normally sits between STT, an LLM, and TTS is handled inside the API, and your application supplies transport, business logic, and system integrations.
Deployment and fit
Deepgram states the platform is available in real time or batch, in the cloud or self-hosted. That matters if you have data-residency or infrastructure requirements that rule out a fully hosted setup, or if you need batch processing for recorded audio alongside live conversations.
The platform is marketed to enterprises — the site says it is “trusted by the world’s top companies” and emphasizes solutions that scale. If your workload is a single prototype, the free trial and demo paths are the natural entry points; if you are productionizing a contact-center or telephony agent, the PSTN/SIP transport support and concurrency limits are the details to verify against your expected call volume.
How to evaluate it for your use case
- If you need a full voice agent stack: start with the Voice Agent API, since it bundles STT, TTS, and LLM orchestration and removes the work of integrating three vendors.
- If you only need transcription: Speech-to-Text covers real-time and batch use.
- If voice quality and latency drive your product: compare Flux TTS against your current provider, paying attention to the stated latency floor (as low as 80ms) and the concurrency caps during any promotional period.
- If you need conversation analytics: Audio Intelligence extracts insight from conversations without a separate pipeline.
Deepgram offers a free trial and a demo request on its site; use those to test accuracy on your own audio and to confirm current pricing, concurrency, and regional availability before committing.