voicechat2

voicechat2

Open source voice chat infra that rivals GPT-4o

125 followers

AI voice chat infrastructure that uses WebSockets. It can achieve voice-to-voice latency as low as 300ms (what GPT-4o does) without a unified voice codec. Everything runs on a single high-end consumer GPU.

voicechat2 gallery image
voicechat2 gallery image
voicechat2 gallery image
voicechat2 gallery image
Free
Launch tags:
Developer ToolsGitHubAudio
Launch Team

What do you think? …

Chris Messina
Hunter
Launching soon!
📌
A fast, fully local AI voicechat app that runs WebSockets! Check it out! 🤓 git clone https://github.com/lhl/voicechat2
Tony Han
How would someone deploy this on the cloud? I assume you would need to rent GPUs on the cloud and run this?
Leonard
Tony Han
@lhl thanks!
Kyrylo Silin
Hey, I'm curious about the scalability. How many concurrent users can it support on a single GPU? Do you have any plans to develop a hosted version for those who might not want to set it up themselves? Congrats on the launch!
Leonard
@kyrylosilin thanks for the well wishes. if you do scalability testing, feel free to post that info, I'm sure others might curious about the answer as well. I have no plans for hosting this myself, but as this code is permissively licensed, anyone can adapt or deploy it how they want! (there are so many existing inferencing endpoints w/ cracked teams and deep pockets, its hard to recommend that as a smart business idea though)

Do you use voicechat2?