Tutorials: Vision

A few years ago, building an AI voice agent took an entire team and a full codebase. Now, if you're a Python developer, it's a single-file problem. This tutorial builds a real-time voice agent with Python and WebRTC that you can talk to in your browser, and explains why transport, not the AI, is the hard part.

Build a voice shopping concierge for a multi-seller marketplace using Kimi K2.5, Deepgram STT, and Vision Agents. Runnable Python, function calling, Stream WebRTC.

Build a Python voice agent with Vision Agents that places an outbound call to a cardholder, reads back a suspicious transaction, and either clears it or freezes the card - using Deepgram, an LLM, Cartesia, and Twilio.

A step-by-step guide to building a real-time background removal tool with SAM 2, YOLO, and Vision Agents. Runs on a CPU, no GPU required.

The instrumental background music in the video below is AI-generated using Lyria 3 by Google DeepMind. Lyria 3 allows anyone to generate AI music from text and image prompts. The music demos in this article take it further by adding another input prompt modality, your voice. Let's proceed to generate your first music with Lyria

What You Will Build This tutorial demonstrates how to build an AI speech app with in-app voice cloning support. You can clone your favorite voice by supplying a reference audio of about 3 seconds. Here is a demo. Voice cloning example demonstrating reference and output voices Voice cloning example demonstrating reference and agent's output voices

Before You Start To begin, ensure that you meet these requirements and have the following credentials. Python 3.13 or a later version. An Apple Silicon Mac (recommended) or any modern laptop. Stream API credentials (for realtime audio and video communication). A HuggingFace Account and access token (HF_TOKEN). A Deepgram API key (for speech-to-text). A Google

When building voice AI applications, you have industry-leading cloud options for text-to-speech, such as Cartesia Sonic 3 and Grok TTS. For privacy and to avoid sharing your business's data with these commercial text-to-speech (TTS) providers, your team may want to use free, open-source solutions that run locally on mobile and desktop devices. Continue reading to