Show HN: React hook for Gemini Live API – real-time voice and screen sharing

1 point

5 months ago

I built a React hook that makes it easy to add real-time AI conversations with screen sharing to any app.

GitHub: https://github.com/loffloff/gemini-live-react

What it does: - Stream mic audio to Gemini, get voice responses back - Share your screen so AI can see what you're doing - Real-time transcripts for both sides - Tool calling support

Just added: useCapturedSurfaceControl hook for Chrome 124+ that lets you programmatically scroll/zoom a captured tab without injecting scripts.

Built this for deflectionrate.com (AI support that resolves issues before they become tickets), extracted the core into this package.

npm install gemini-live-react

Happy to answer questions.

Want me to tweak anything?