← Back
AWS ML Blog

How Stretto built an AI voice agent with Amazon Nova 2 Sonic

•14 min read•
#llm#deployment
Level:Advanced
For:AI Engineers
✦TL;DR

Stretto created “Tara,” an AI voice agent that replaces web‑form bankruptcy intake with a phone‑based, speech‑to‑speech interview powered by Amazon Nova 2 Sonic, a foundation model available through Amazon Bedrock. By using a single model for both speech recognition and generation, the system reduces latency and delivers more natural, emotionally aware conversations while keeping data within AWS security controls. The agent extracts structured financial details in real time and applies attorney‑defined rules to qualify leads, enabling cost‑effective automation of a high‑value intake process.

⚡ Key Takeaways

  • Amazon Nova 2 Sonic is a speech‑to‑speech foundation model accessed via Amazon Bedrock.
  • The architecture eliminates separate speech‑to‑text, LLM, and text‑to‑speech components, lowering end‑to‑end latency.
  • Sensitive financial data stays on the AWS network using VPC endpoints (AWS PrivateLink) and IAM‑based access control.
  • Integration also includes Anthropic’s Claude through the same Bedrock managed service for any supplemental language tasks.
  • The solution requires no on‑prem model infrastructure, relying entirely on Bedrock’s managed offering.
💡 Why It Matters

Engineers can now build low‑latency, privacy‑focused voice agents for regulated domains without managing complex multi‑model pipelines, accelerating time‑to‑value while preserving compliance.

✅ Practical Steps

  1. Provision Amazon Bedrock access and enable the Nova 2 Sonic model via a VPC endpoint (AWS PrivateLink) in your AWS account.
  2. Configure IAM policies to grant your application permission to invoke Nova 2 Sonic (and Claude if needed) within the VPC.
  3. Replace any existing speech‑to‑text → LLM → text‑to‑speech workflow with a single call to the Nova 2 Sonic API for end‑to‑end speech processing.

Want the full story? Read the original article.

Read on AWS ML Blog ↗

More like this

Introducing workload recovery and expanded infrastructure checks on Amazon SageMaker HyperPod

AWS ML Blog•#deployment

Introducing Unity Gateway Insights

Databricks Blog•#deployment

Introducing Gemini 4 Neon

Google DeepMind•#llm

DaisyRose-27B: Pushing the Frontier of Post-Training Efficiency

Hugging Face Blog•#llm

EXPLORE AI NEWS

Daily hand-picked stories on LLMs, RAG, agents and production AI — curated for engineers who ship.

BROWSE NEWS

GET THE WEEKLY DIGEST

Join engineers getting the Monday signal-over-noise AI breakdown. No spam, unsubscribe anytime.

LEARN AI ENGINEERING

Curated courses, research papers, repos and tutorials built for engineers leveling up in AI.

START LEARNING