--- title: "Voice AI & Conversational Agents — free course" description: "Design, build, test and launch voice agents with ElevenLabs, OpenAI Realtime and telephony, in English, Arabic and Urdu" url: https://optimizeall.com/learn/voice-ai-agents updated: 2026-10-05 --- AI · Intermediate · 461 minutes · free · updated Sep 2026 # Voice AI & Conversational Agents Design, build, test and launch voice agents with ElevenLabs, OpenAI Realtime and telephony, in English, Arabic and Urdu - **Lessons:** 17 in 7 modules - **Video lectures:** 17 lectures, 146 minutes - **Updated:** Sep 2026 ## Tools you'll use - ElevenLabs - ElevenAgents - OpenAI Realtime API - OpenAI Agents SDK - Gemini Live API - Twilio - LiveKit Agents - Pipecat - FastAPI [Start the course](https://optimizeall.com/learn/voice-ai-agents/how-voice-agents-work) ## About this course Voice agents now answer phones, book appointments, qualify leads and narrate content. This intermediate, hands-on course shows you how to build them properly. You will learn cascaded (ASR to LLM to TTS) and speech-to-speech architectures, latency budgets, turn-taking and barge-in; choose and design voices with ElevenLabs; build agents on ElevenAgents with tools, knowledge and tests; and use code-first options such as the OpenAI Realtime API, Gemini Live, LiveKit Agents and Pipecat. You will connect telephony with Twilio and SIP, design conversations and prompts for the ear, handle Urdu, Arabic and English code-switching, and apply consent, disclosure, recording and calling rules. Finally you will evaluate, monitor and cost voice agents, produce narration and course lectures, and build an appointment-booking agent as your capstone. ## What you will learn - Choose between cascaded and speech-to-speech voice architectures for a given use case - Budget and reduce voice-to-voice latency and tune turn-taking, barge-in and backchannels - Build a voice agent on ElevenAgents with webhook tools, knowledge base, workflows and tests - Build a browser voice agent with the OpenAI Realtime API and Agents SDK using ephemeral keys - Connect agents to phone networks via Twilio or SIP with warm transfers and voicemail handling - Design voice UX and prompts, including Urdu, Arabic and English code-switching - Apply voice cloning consent, AI disclosure, recording and outbound calling rules - Evaluate, monitor and cost voice agents and ship an appointment-booking agent ## Before you start - [AI Video & Voice Production: ElevenLabs, Veo, Runway and More](https://optimizeall.com/learn/ai-video-and-voice-production) ## Course content ### Voice agent foundations How modern voice agents work, the difference between cascaded and speech-to-speech architectures, and why latency and turn-taking decide whether callers stay on the line. - [How voice agents work: cascaded pipelines vs speech-to-speech](https://optimizeall.com/learn/voice-ai-agents/how-voice-agents-work): 15 min - [Latency budgets, turn-taking and barge-in](https://optimizeall.com/learn/voice-ai-agents/latency-and-turn-taking): 15 min ### Platforms and stacks ElevenLabs voices and TTS models, building agents on ElevenAgents, and code-first options: OpenAI Realtime, Gemini Live and open-source frameworks. - [ElevenLabs voices: TTS models, voice design and cloning](https://optimizeall.com/learn/voice-ai-agents/elevenlabs-voices-tts-and-voice-design): 15 min - [Building an agent with ElevenAgents](https://optimizeall.com/learn/voice-ai-agents/building-with-elevenagents): 18 min - [OpenAI Realtime API, Gemini Live and open-source stacks](https://optimizeall.com/learn/voice-ai-agents/openai-realtime-and-other-stacks): 16 min ### Telephony and deployment Connect voice agents to phone networks with Twilio and SIP, handle inbound and outbound calls, transfers, voicemail and keypad input. - [Telephony: phone numbers, SIP trunks and Twilio](https://optimizeall.com/learn/voice-ai-agents/telephony-sip-and-twilio): 17 min ### Designing voice conversations Voice UX, prompt design for spoken agents, tools and knowledge that work under latency, and multilingual design for Urdu, Arabic and English. - [Voice UX: designing conversations people enjoy](https://optimizeall.com/learn/voice-ai-agents/voice-ux-design): 15 min - [Prompt design for voice agents](https://optimizeall.com/learn/voice-ai-agents/prompting-for-voice-agents): 15 min - [Tools and knowledge in voice agents](https://optimizeall.com/learn/voice-ai-agents/tools-and-knowledge-in-voice-agents): 16 min - [Multilingual voice: Urdu, Arabic and English](https://optimizeall.com/learn/voice-ai-agents/multilingual-voice-urdu-arabic-english): 16 min ### Ethics, consent and the law Voice cloning consent and ethics, AI disclosure, recording consent, calling rules and data protection for voice agents across the EU, UK, US, Gulf and Pakistan. - [Voice cloning: consent, ethics and safeguards](https://optimizeall.com/learn/voice-ai-agents/voice-cloning-consent-and-ethics): 15 min - [AI disclosure, recording consent and calling rules](https://optimizeall.com/learn/voice-ai-agents/legal-disclosure-and-calling-rules): 16 min ### Quality, evaluation and operations Evaluate voice agents before and after launch, monitor them in production, control cost and scale safely. - [Evaluating and QA-testing voice agents](https://optimizeall.com/learn/voice-ai-agents/evaluating-voice-agents): 16 min - [Monitoring, cost control and scaling](https://optimizeall.com/learn/voice-ai-agents/monitoring-cost-and-scaling): 15 min ### Use cases and capstone Apply voice AI to sales qualification, support, bookings and produced audio such as narration, podcasts and course lectures, then build an appointment-booking agent end to end. - [Use cases: sales qualification, support and bookings](https://optimizeall.com/learn/voice-ai-agents/use-cases-sales-support-bookings): 15 min - [Produced audio: narration, podcasts and course lectures](https://optimizeall.com/learn/voice-ai-agents/narration-podcasts-and-course-lectures): 15 min - [Capstone: build an appointment-booking voice agent](https://optimizeall.com/learn/voice-ai-agents/capstone-appointment-booking-agent): 25 min ## Certificate: Certified Voice AI Agent Builder The holder can design, build, test and operate voice AI agents: choosing architectures, managing latency and turn-taking, building on ElevenAgents and realtime APIs, connecting telephony, designing multilingual conversations and prompts, applying consent, disclosure and calling rules, and evaluating, monitoring and costing agents in production. - **Final assessment:** 25 questions, 40 minutes - **Passing score:** 80%