Subscribe
Sign in
Daily.co
p/dailyReal-time voice, video, and AI for developers
Start new thread
Kwindla Kramer

Daily Bots - Build voice-to-voice AI agents with any LLM with Open Source

by•

Build hosted AI agents on Daily Bots, the Open Source cloud for ultra low latency voice and video. Use commercial and open models. Incorporate tool use, telephony, vision, etc. If your needs evolve beyond Daily Bots, run your code anywhere that supports RTVI.

Add a comment

Replies

Best
Kwindla Kramer
Maker
📌
Hi Product Hunt! Today we’re sharing Daily Bots, a hosted platform for real-time voice and video AI bots. We built Daily Bots to help developers ship and scale voice and video agents, using Open Source SDKs and deployed on Daily’s global infrastructure. For the past 18 months, we've been experimenting with and building tools for voice-to-voice and real-time video AI. We've helped our customers ship games, meeting co-pilots, medical documentation systems, customer support agents, virtual interviewers, teaching assistants, low-code voice AI platforms, virtual avatar infrastructure, and much more. We love this new world of generative AI and we want to make real-time AI accessible to every hacker, maker, and product team. We've helped create two big Open Source toolkits for real-time AI. Pipecat enables server-side "orchestration" of multi-model, multi-modal AI workflows. And RTVI is an open standard for connecting clients to real-time voice and video inference backends. Daily Bots is built on Pipecat and RTVI. You can build a Daily Bots application using the Open Source RTVI SDKs for Web, iOS, and Android; ship fast and scale quickly on Daily's global WebRTC infrastructure; and retain the flexibility to move to a different platform or run your own infra if you want to in the future. With Daily Bots, you can create AI agents that talk naturally, with fast voice-to-voice response times, interruption support, and multi-turn context management. You can use both commercial and open models. We’ve partnered with Anthropic, Cartesia, Deepgram, and Together AI. (And you can use any other LLM that supports OpenAI-compatible APIs.) Finally, you can buy phone numbers from us and configure your bot to accept dial-in telephone calls. We're excited to see what you build. Let us know what you're thinking about making with Daily Bots. And if you just want to experiment with a few LLMs, prompts, and voices, check out this demo: https://demo.dailybots.ai/
Aarav Krishna
I love the flexibility this offers. How does it handle integrating with existing telephony systems?
Chad Bailey
Maker
@aarav_krishna We already have an integration in place that makes it pretty straightforward to use Twilio voice. If you're using a different service that speaks websockets, we could probably help you make the right connections in a Pipecat bot that runs on Daily Bots or on your own infra.
varun
Maker
@aarav_krishna We offer PSTN phone numbers from which you can dialout or receive dialin. Similarly, we offer SIP interconnect which means that you can connect any third-party like twilio, telnyx. For example if you have phone numbers on third-party, you can forward the twilio call to Daily's SIP Interconnect (sip_uri exposed for your domain) and everything should automatically work. See https://docs.dailybots.ai/api-re... for PSTN dialin, SIP would be similar, just skip step 1.
Kyrylo Silin
Hey, I'm wondering what some of the most interesting or unexpected use cases you've seen so far have been? For developers looking to get started, what would you say is the learning curve like for creating a basic voice bot using your platform? Congrats on the launch!
Kwindla Kramer
Maker
@kyrylosilin Daily Bots isn't a low-code tool. We're aiming at developers who want to build on Open Source and understand some of the architectural details. I think Vapi (https://vapi.ai/) has the best combination of powerful capabilities and gentle learning curve of any of the voice AI platforms. Having said that, a Daily Bots "hello world" voice app in JavaScript is less than 20 lines of code. I think the most surprising thing to me about the voice AI space is how many people are building their own private voice agents. It feels like a new frontier for personal project hacking. Build your own virtual assistant/co-pilot/therapist! I also think there's going to be a whole new generation of voice-enabled hardware that works really well and that we all take for granted within a few years.
Germán Merlo
Hey team! This is really awesome. As dev, but even more as maker, it's super cool and I can't wait to play with bots. Really congrats for this impressive job and wish you all the best here!
nina k
Maker
@german_merlo1 🙌 Thank you! It's really amazing to see how quickly this space is developing. Ping us if we can help with anything.
Quinn Favret
Wow- what an amazing launch! Incredible to see how Daily keeps pushing the boundaries on real-time interactions. Congratulations to the full team!
nina k
Maker
@quinn_favret Thank you, and we love working with the Tavus team! Congratulations on your amazing launch!
Elke
Wow, this is an exciting launch, @kwindla! Daily Bots really opens up a world of possibilities for developers working with voice and video AI. The combination of ultra low latency and Open Source SDKs is a game changer. I'm particularly intrigued by how Pipecat and RTVI facilitate the orchestration of AI workflows. It’s great to see a platform that not only supports commercial models but also fosters innovation through open-source tools. The potential for applications like medical documentation and virtual assistants is massive. Can't wait to see what the community builds with it! Upvoted! 🚀
Akhil
Maker
Thanks @elke_qin! We're excited about the potential too :)
Dini Aminarti
@kwindla good product,happy launch on your product ..and good luck 👏🚀
Akhil
Maker
Thanks for the support @andinii!
Alex
Awesome launch, @kwindla! Daily Bots seems like a game changer for developers looking to leverage real-time AI in voice and video. The integration with multiple models and the flexibility to run on various infrastructures is really impressive. Can't wait to see the creative applications that will come from this! Upvoted!
Akhil
Maker
Thanks @zanereed596!
Ghost Kitty
Comment Deleted
Akhil
Maker
@zulkarnaim Thank you - excited to see what you build!
Lionel
Found this tool through some forums, honestly, it feels kinda redundant compared to what Jasper or Jarvis offers, not sure why I'd switch from those, also running on RTVI is a cool feature but a bit niche, ever think about adding more integrations for popular dev tools?
Akhil
Maker
@blockdevninja hey Lionel - Daily Bots isn't an end-user copilot tool like ChatGPT or Jasper. We're focused on allowing developers to build, host, and scale new conversational AI experiences on Daily's cloud and leverage an open-source tech stack.
Bryan
Wow, this sounds amazing! Daily Bots could really change the way developers approach real-time AI applications. The ability to leverage open-source SDKs and integrate various AI models is a game changer. I'm also excited about the flexibility to run it anywhere that supports RTVI. Big shoutout to @kwindla and the team for putting so much thought into making this accessible for makers and hackers alike. Can't wait to dive into the demo and start exploring the potential!
nina k
Maker
@dance17219 Thank you! It's been really interesting swapping out the models!! Curious to hear from the community what models they're using.
Ema Elisi
This is an exciting launch, @kwindla! Daily Bots really seems to take the pain out of building real-time AI agents. The flexibility with Open Source SDKs and the ability to scale on Daily's infrastructure are huge advantages that developers will appreciate. I love how you've emphasized ease of use while still allowing for deep customization. Plus, the integration with commercial models opens up so many possibilities. Can’t wait to explore the potential this platform has for voice AI applications! Upvoting and looking forward to more innovations from you all.
nina k
Maker
@ema_elisi Thank you! Our team is really excited to ship this and hear from the community about this! 🍻
Mert Gerdan
The daily bots are crazy fast! Congrats for the entire Daily team on this launch, you are building something that should honestly be standardized when building multimodal agents.
Kwindla Kramer
Maker
@mert_gerdan Standardization is definitely a big part of the motivation for Daily Bots overall. - We want developers to be able to write code that they can use with a wide variety of real-time inference services. (Not just Daily.) - We think that standardization helps an ecosystem grow faster. - The more inference providers have really good real-time offerings, the more people will understand the nuances of low-level networking, how to optimize for low latency, etc. And that's the area we've always focused on building great tech for!
Prasenjit Mukherjee
So awesome! We've now built a whole demo on and that was a great experience. Looking forward to sussing out DailyBots before launch. One problem with pipecat was the scalability of the backend was a little wonky (literally just cloning python subprocesses). This feels like it's taken care of more elegantly here? Can someone confirm?
Kwindla Kramer
Maker
@pj_mukh Implementing scalability elegantly was one of our main goals for Daily Bots. We have a lot of experience running infrastructure, so I'm confident we can scale efficiently -- both so individual customers see fast bot joins and so we can charge low prices that enable a broad range of use cases. Having said that, forking Python processes is actually part of how we achieve fast join times. Avoiding the Python interpreter startup time is helpful! But we also have capacity routing via queues, autoscaling that leverages the cluster scaling we do for WebRTC at Daily, etc.
Robert Thomas
Great to see Daily Bots launching on PH! The focus on both open source and commercial models is impressive, and it’s exciting to witness the evolution of voice and video AI. The integration of multi-modal workflows and tools like Pipecat makes it super flexible for developers. Can’t wait to explore the demo and see how it can enhance different applications. Big shoutout to @kwindla for leading this initiative! Excited for what’s next in this space.
nina k
Maker
@robertthomas2 +1, it'll be really fun to see what makers do with this! Thank you, and it's nice to be back on PH :)
Patricia Harris
Looks interesting, @kwindla! The ability to run both commercial and open models on Daily Bots really opens up possibilities for various applications. I'm curious about the performance. How does the latency compare with other similar platforms, especially for real-time communication? Also, can you share any specific use cases or success stories from your early adopters? It would be great to see how teams leverage the Open Source SDKs you've developed. Lastly, how easy is it for developers to transition to a different platform if they choose to? The concept of flexibility sounds appealing, but I'd love to know more about the actual implementation. Thanks for sharing this on PH!
Kwindla Kramer
Maker
@patriciaharris Daily Bots can deliver voice-to-voice latency as low as 500ms, depending on the models you choose. This is substantially faster than most other voice apps. Typical latencies are 1.2 seconds or more. There are trade-offs: using larger and more capable LLMs tends to be slower than using smaller, faster models. However, we've partnered with Together to make it easy to use the Llama 3.1 models with Daily Bots and together has very fast "time to first token" metrics even with the largest (405B) Llama 3.1 model. Daily Bots is brand new. But we've worked closely with many partners who have built on Daily and Pipecat to create the pieces that Daily Bot brings together into a single platform. You may have seen Tavus' launch last week. Tavus was #1 product of the day last Thursday. If you're interested in the open standards that Daily Bots is built on, check out Pipecat and RTVI: - https://github.com/pipecat-ai/pi... - https://github.com/rtvi-ai
Antoine Gauthier
Great job @kwindla on launching Daily Bots! This platform looks super promising, especially with the real-time capabilities for voice and video AI. Love the versatility offered by the open source SDKs and how you incorporate various models. Excited to see how developers will leverage this for innovative applications in the AI space! Can’t wait to test out the demo too!
nina k
Maker
@antoine_gauthier_ Thank you! Love to hear what the LLM bots tell you!! 😂
Den Taylor
The global real-time infrastructure and support for both commercial and open models make Daily an excellent choice for developing cutting-edge AI solutions.
nina k
Maker
@den_taylor 💪🏼 🍻 Thank you!
Jarrick Lozada
Building AI agents for voice and video with minimal latency is a fantastic concept. I’m curious about how the open source and commercial models are integrated. Thanks for sharing this
Ramya Venkat
@jarrick_lozada We worked with our launch partner Together AI to integrate the LLama family of models and Anthropic to support Claude 3.5 Sonnet for LLM inference. That said, you can bring your own keys for other models!
varun
Maker
This is built on the pipecat.ai open-source, as new models appear, there can be a direct integration added to `pipecat` bots, i.e., the community can then use it. In addition, products like together.ai make it very easy to run any LLM and have a standard API that is already prebuilt into the bots. Ergo, several options are available for LLMs
Chad Bailey
Maker
This is John, a totally normal human person. https://x.com/chadbailey59/statu...