Generate speech, transcribe audio, isolate and change voices with a unified API that works with leading AI providers like OpenAI, ElevenLabs and AssemblyAI.
@haydenbleasel did it again!
The maker of Eververse, Roadmap UI, and next-forge just released a new, beautifully crafted open-source project — introducing Orate, an AI toolkit to help you create human-like speech and transcribe audio.
Orate currently works with 15 providers including @OpenAI, @ElevenLabs and @AssemblyAI, and is open to contributions. Read the docs here.
Enjoy!
Hey folks, super excited to share Orate with you!
Think of it as the Vercel AI SDK, but for speech. You can:
- 💬 Convert text into lifelike speech
- ✍️ Transform spoken words into meaningful text
- 👯 Change the voice of the speakers in your audio
- 🤫 Transform noisy recordings into clean, studio-quality speech
As Flo mentioned, we currently support 15 providers (14 AI + the native Web Speech API) and are always adding more. They share a unified interface so it's super easy to swap out models, voices and providers.
I hope this helps you build the next generation of AI influencers, audiobook apps, accessibility products, education platforms and more!
@sentry_co I built this for myself as one of my apps has audio transcriptions, but I’m hearing that people are finding jt useful for AI voice agents, accessibility plugins (dynamic TTS) and the like.
Since Orate is open-source, does it still require payments to third-party providers (such as OpenAI, ElevenLabs, or AssemblyAI) to use their services, or can it function without additional costs?
@ketanchavda It allows you to use these third-party providers for voice. So, you will need to use your own api keys for the provider you use and pay your bills for those api costs.
Sounds like a game-changer for anyone working with speech AI! The ability to switch between 15 providers with a unified interface makes it super flexible. Definitely excited to see how people use it for audiobooks, accessibility, and beyond!
Congratulations on the launch of Orate! This toolkit effectively addresses the diverse needs of users looking to enhance their speech-related projects.
How does Orate ensure seamless integration with multiple AI providers, and what specific capabilities does it offer for voice customization and manipulation?
Replies
AssemblyAI
Vercel
Ollie
Vercel
Vercel
Vitara AI
Product Hunt
Elisi : AI-powered Goal Management App