Building Live Voice Agents: Deploying Real-Time Multimodal AI Systems to Production

Building Live Voice Agents: Deploying Real-Time Multimodal AI Systems to Production book cover

Building Live Voice Agents: Deploying Real-Time Multimodal AI Systems to Production

Author(s): Heiko Hotz (Author), Sokratis Kartakis (Author)

  • Publisher Finelybook 出版社: O’Reilly Media
  • Publication Date 出版日期: December 15, 2026
  • Edition 版本: 1st
  • Language 语言: English
  • Print length 页数: 561 pages
  • ASIN: B0H7HDZNHZ
  • ISBN-13: 9798341661127

Book Description

Create AI agents that listen, respond aloud, handle interruptions, and use visual context as a conversation unfolds. Building Live Voice Agents takes you from agent fundamentals to architecting live, multimodal, multi-agent systems, focusing on the difficult leap from proof of concept to production.

Start by working directly with foundation models to understand the core voice interaction loop, then use agent frameworks to structure tools, state, and coordination. Connect specialist agents and external tools through open interoperability protocols, and learn how architectural choices affect responsiveness, reliability, and user experience. Written by industry practitioners, this book combines examples and reference architectures with the evaluation, security, governance, and deployment practices needed to operate live agents at enterprise scale.

  • Build low-latency voice interactions with streaming audio, turn-taking, interruption handling, and visual context
  • Design clear boundaries between browser interfaces, backend services, tools, and specialist agents
  • Apply AgentOps practices to evaluate, test, secure, govern, and deploy live multimodal systems

Editorial Reviews

Editorial Reviews

About the Author

As a Generative AI Global Blackbelt at Google Cloud, Heiko Hotz operates at the cutting edge, driving multi-million dollar AI initiatives for global giants – achieving exponential, multi-fold growth in AI adoption for key clients – and shaping the future of human-AI interaction through projects like his widely-used developer guides and the real-time agent demos. Heiko’s journey through key roles at Amazon (Head of Data Science EU CS), AWS (Principal AI/ML Solutions Architect), and Google, combined with a Physics Master’s and an MBA from London Business School, provides an unparalleled perspective. He understands the algorithms, the business imperatives, and the practical hurdles of deploying AI agents at scale – knowledge demonstrated through impactful thought leadership (articles with tens of thousands of views, popular GitHub repos drawing hundreds of interactions) and direct influence on product development via detailed model feedback and bug identification. He has built complex evaluation frameworks for agents, automated prompt engineering pipelines, and directly enabled customers to become massive, strategic consumers of the latest AI models.

Dr Sokratis Kartakis is a generative AI global blackbelt at Google Cloud, partnering with enterprises to productionize secure, large-scale AI transformations. He holds a PhD in computing from Imperial College London and draws on deep industry and academic expertise shaped by roles at Yale University, Intel, Deloitte, and various startups, alongside pivotal positions at both Google Cloud and Amazon Web Services (AWS). Bridging advanced academic research with hyper-scale cloud engineering, he brings unmatched depth to the operationalization of modern AI systems–from traditional MLOps to GenAIOps and AgentOps. Working directly with executive and technical leaders to embed AI into their core operations, Dr. Kartakis has driven end-to-end transformations and architected foundational AI platforms for over 210 customers–ranging from digital natives to global organizations in retail, sports, and highly regulated environments such as finance, telecommunications, and energy–unlocking hundreds of millions of dollars in measurable value. An industry pioneer, he defines prescriptive standards that shape the market–establishing the blueprints for enterprise-grade security and pioneering the productionization of live, autonomous voice agents at scale.

View on Amazon

下载地址

EPUB, PDF(conv) | 32 MB | 2026-11-19
打赏
未经允许不得转载:finelybook » Building Live Voice Agents: Deploying Real-Time Multimodal AI Systems to Production

评论 抢沙发

觉得文章有用就打赏一下文章作者

您的打赏,我们将继续给力更多优质内容

支付宝扫一扫

微信扫一扫