Engineering conversational AIArunank · Technical article series · July 2026← Portfolio series
Systems, speech and customer outcomes

Engineering
conversational AI.

From the first customer requirement to the last audible word. Twelve detailed articles drawing on Bolna and Pipecat delivery, speech-model experiments and the systems around a real telephone call.

12 articles30,002 words12 original figuresCode + multilingual scenarios

Start reading →   Read or print the complete series

Part 01

Conversational AI Design: the call is the product

From customer requirements to an audio, reasoning and business-action system.

Part 02

Why an 800 ms voice response is a systems problem

An explicit latency budget, turn detection, cancellation and playback correctness.

Part 03

A Bolna-based telephony agent, from connection to hangup

Call lifecycle, asynchronous queues, provider adapters and production boundaries.

Part 04

Designing a configurable voice platform with Pipecat

Frames, lifecycle, SEDA principles and interoperable cascade and native-audio paths.

Part 05

Choosing the speech and reasoning models for a voice agent

Provider trade-offs, native audio, language coverage and a workload-specific Pareto frontier.

Part 06

Self-hosted Whisper: streaming, scheduling and the concurrency trap

Rolling recognition, stable prefixes, GPU queues and a capacity calculation for real calls.

Part 07

Adapting a 2026 speech recognizer for English, Hindi, Singlish and Hinglish

A Qwen3-ASR reference experiment, plus an honest analysis of a completed Whisper Tiny run.

Part 08

Speech synthesis that can survive a real customer call

Pronunciation, phrase streaming, a self-hosted Indic TTS candidate and adaptation protocol.

Part 09

Context, memory and tools: where a voice agent becomes a business system

Conversation state, retrieval, streaming function calls, idempotency and interruption-safe actions.

Part 10

Running voice agents on AWS and GCP without losing the conversation

Cloud topology, Bedrock, GKE/EKS, GPU serving, admission control and graceful draining.

Part 11

Evaluating a voice agent: listen to the call, inspect the action

A practical evaluation system across audio, interaction, policy and verified business outcomes.

Part 12

What a voice agent changes for the business

Unit economics and business outcomes from the client platform and Zoice.

From customer calls to speech infrastructure. Start with the client platform built on Bolna and Zoice built on Pipecat. Then explore recognition, the separate 2026 local TTS experiments, cloud deployment, evaluation and the economics of completing a customer task.