I've made this fun openAI WebRTC script to manipulate any webpage via voice. It runs locally on your browser. If you want to try it, you need an OpenAI key and be brave enough to run my code in your browser console.

I made this within 1h. It's basically the OPENAI guide (https://platform.openai.com/docs/guides/realtime-webrtc) plus function calling.

Here is a demo video (sorry the video didn't record what GPT said): https://www.youtube.com/watch?v=n1hhpFSb_fQ&ab_channel=J%C3%...