Engineering: AI

Apps like Slack and WhatsApp made team chat easy. The right AI features can make it better. Here's how to build them into community, collaboration, and team platforms to increase user satisfaction and speed up task completion.

Understanding rarely arrives through a single sense at a time, and neither should an agent. This guide breaks down how to design multimodal AI agent architecture for voice and video apps that hold up in production, using the architectural choices, transport options, and model constraints that matter most.

What we learned building a prescription-intake voice agent with Stream's Vision Agents SDK and AssemblyAI: five lessons for safety-critical AI agents.

A phone support voice AI needs to react in real time - start replying within 300ms, stop the moment a caller interrupts, and handle the telephony edge before the model sees the audio. This guide covers the full pipeline - streaming STT, TTS, turn detection, barge-in, and the latency budget that keeps calls feeling natural.

Warm transfer carries the conversation's context to the human agent - the summary, the intent, the caller's mood - so the human can pick up mid-story. Cold transfer carries only the audio, and the caller starts over. Building warm transfer in a real-time voice system means solving three problems when to escalate, how to generate structured context in parallel with the live call, and how to hand off the audio session without breaking it.

A vision agent watches a live video and audio stream and acts while things are still happening. Here is what a vision agent is, how it differs from batch vision pipelines and voice agents, and how to build one in about 18 lines with Vision Agents, the open-source Python framework from Stream.

TLDR: Agents these days are blind and not very engaging, so we decided to team up with Anam and Inworld to build an agent using Vision Agents that feels personal and aware of the world around you. Give it a try here. Most voice agents today are blind. They hear words, convert them to text,

It's been a busy period since our last release, and now it's time to share Vision Agents v0.5.0: a step toward making production-grade multimodal AI agents easy to build and deploy. While previous versions laid the groundwork for real-time voice, video, and Vision Agents, v0.5.0 focuses on stability at scale and even more expressive