ITPub博客

首页 > 人工智能 > 人工智能 > 工具:Gemini Live 音频

工具:Gemini Live 音频

人工智能 作者:ITPUB社群 时间:1970-01-01 08:33:46 0 删除 编辑

Google 今天发布了 Gemini 3.8 Live 和 3.8 Live Extended Thinking——两个新的语音到语音模型,形态与 OpenAI 的 GPT-Live 系列类似。

我把 GPT-6 Astra Extra High 指向了文档,让它为我构建了这个用于试用新模型的 Web UI。你可以选择模型和语音预设,输入可选的系统提示词,然后通过浏览器开始语音对话,包括在模型说话时打断它的能力。

Screenshot of a voice chat web interface with a transcript. Top buttons: Start session, End session, Mute mic, plus a Mic level meter and a timer showing 0:33. Status: Listening. Use headphones to reduce echo. Starting a session asks for microphone access. Transcript (with Download transcript and Clear buttons). Gemini: Yes, it's working perfectly. I can hear you clearly. How can I help you today? You: Okay, this is pretty good. Tell me some interesting facts about the California brown pelican. Gemini: They're famous for their spectacular plunge-dives to catch fish and have huge throat pouches that can hold up to three gallons of water and fish. They also made a great recovery after being endangered — marked as Interrupted. You: No, tell me different facts actually. Gemini: They nest in colonies on offshore islands and can hold up to three gallons of water in their throat pouches. At the bottom is a text input reading Or type a message… with a Send button, and the note: Sending a message interrupts the current response. Transcripts may include speech interrupted before playback.

该实现不使用任何库。它连接到 wss://generativelanguage.googleapis.com/ws/google.ai.generativelanguage.v1alpha.GenerativeService.BidiGenerateContent?key=... WebSocket 端点,并使用 Web Audio API(应用程序编程接口) 的 AudioContext 进行采集和播放。

这是 Gemini Live 教程,可帮助你开始使用该 WebSockets API。

转载声明:本文为转载整理,原文版权归原作者及原站点所有。

原文来源:Simon Willison

原创地址:https://simonwillison.net/2026/Sep/15/gemini-live/

原文作者:Simon Willison;如有侵权,请联系管理员删除。

请登录后发表评论 登录
全部评论

注册时间:2022-11-21

  • 博文量
    1090
  • 访问量
    546597