I met Thibault 3 years ago. He was just getting started with his vision of making communications between deaf & hearing people easier. The 1st project was a glove that would translate gestures into text, and today there's this app that can litterally change the life of 400 million deaf & hard-of-hearing people in the world 🙌
His story is incredible - he comes from a Deaf family - and I'd say this is a product that has been 25 years in the making.
Super excited to see them got this far. Would love @t_duchemin to explain his vision for this really unique product ;)
Thanks @adrienm for hunting us - this is one of these special moments we've been really looking forward to!
Hey guys!
Ava is an unusual product, and we're humbled to be here.
We just released the 1.0 on the Appstore and Playstore, and we'd love to get feedback & thoughts from all the community - it's our first time here (hi 👋!).
I grew up the only hearing person in a Deaf family.
When you get to be in the middle of these 2 worlds, you see a ton of issues.
We started Ava to solve what we believe to be the most essential problem today for 400M deaf & hard-of-hearing people: understanding and participating to group conversations.
Lunch, business meetings, hanging out with friends can become a nightmare to follow when you only rely on lip-reading. Only other solutions involve a professional interpreter/captioner and cost $100/hour. Talk about an expensive coffee meeting 👀.
Ava aims to make the crazy idea of a 24/7 accessibility to conversations, possible.
Ava connects the smartphones of a group of people who downloaded the app, and turns them into a smart microphone system. With some speech recognition & speaker identification magic✨, Ava can then show who says what in less than a second to the deaf person.
We use it everyday for meetings, standups, lunches. We have to: our cofounder & CTO is himself deaf.
But because it just needs smartphones, Ava is flexible, simple, and works in many other situations.
The most interesting thing was to realize the range of situations our early users decided to use Ava for and that we hadn't predicted.
Stargazing with friends because reading lips in the dark is impossible, communicating from the other ends of a house, understanding their doctor, captioning a parents/students meeting... And sometimes they even stretched to its extreme 😁 :)
While Ava isn't always getting what people say right, it's a definite leap from no accessibility at all. And it's just the beginning: Ava gets smarter as time goes, learning to distinguish your voice better everyday 🤓.
We're excited to share the 1.0 to the world today, and to announce a $1.8M seed round, led by visionary investors who support us in this vision of a truly 24/7 accessible world.
Our wish? To make Thanksgiving dinners actually great again for 15M deaf & hard-of-hearing Americans this year.
Learn more about it here: https://medium.com/@AvaScribe/in...
If you know a deaf/hard-of-hearing person, pass it around please: this little app might actually change the life of someone!
We'd love to hear what you think of Ava - we'll be here all day!
Cheers,
Thibault & the Ava Team
@t_duchemin This is so very awesome! I had a dream of building something like this 15 years ago when the tech didn't exist to make it happen! So great to see you make this a reality! Congrats!
Oww, awesome! My grandmother need this, she is deaf. I can't download it to my Moto G4 Plus, say "incompatible", why? Is there in portuguese too (because my grandmother is brazilian, speak portuguese)?
@mattbrian Thanks for your questions. The app requires a certain version of the Android operating system on your phone. It seems that your Moto G4 Plus is not updated enough. You can try doing a software update, otherwise I'm afraid it won't work for that device. Right now it's not available in Brazil yet. Feel free to leave your contact information behind on our website (www.ava.me), so that we can keep you posted on any updates. Thanks again!
Beautiful mission.
I've first heard about AVA and Thibaut last year, when my deaf Mum told me about it. She was friends of Thibault's Mum. I can thanks Thibault and his team enough for working on this issue that make life easier for 400M people, my mum included. This project needs support and visibility.
Don't hesitate to spread the word !!!! Wish you the best guys.
This is one of the most awesome products that I have seen on PH. Very humbling as we all take our senses for granted. And the beauty is that it leverages mainstream technologies to build a great product. Congratulations to the team for a perfect execution 👏🏽
@ravsydney It's been an amazing journey for us. We're learning a lot every day! While building Ava, we've gotten to understand the challenges, but also the beauties of deaf and hard of hearing cultures. In the end of the day, we're all the same human beings, and our 'different abilities' should not impact our social and professional opportunities. It is easy to take our every day for granted, and forget that we all have to make an effort together for equal access. Thanks a lot for recognizing this, and for your kind words!
This is awesome! Accessibility-UX matters. Reminds me of Be My Eyes (http://www.bemyeyes.org/)
Question: why is it important to have everyone download and opt-into the conversation? I bet it would improve quality in a crowded room / dinner table. But what about those ad hoc moments or when you're in a new group -- can you use voice-to-text from a single device and separate the different speakers algorithmically?
@hameto_ we love BeMyEyes too! that's exactly it for us as well: how using social dynamics in place to solve a problem together (our logo "&" reflects this thoughts of shared action).
Great question re: this important use case of a "networking" moment. One of the answers is that you'd diminish the accuracy by behaviorally putting the microphones too far from the speakers. So it's not that much the identification who is really the issue here.
The trade-off is: keeping accuracy at a high level or asking to the rest of the group to download an app. For now, Ava isn't optimal in these situations, but we have a few ideas we'll pursue on (& maybe come back here for!)
Excellent idea, I tested the app, it looks OK for its use-case, but I'll be critical.
I'm deaf, but I have a hard time talking with strangers, not with the people I know. I need a tool for a particular use-case – to talk with random strangers, not really for the conversations. When I had Android phone, I used Yandex.Talk application: https://github.com/yandex/deaf, which did exactly what I wanted, interpreted speech in real-time.
I used it for talking with random strangers, for example when ordering something in the restaurant, to be able to understand waiters, for example.
But it was atrocious with deciphering English speech. OK with Russian, even when I had Android phone with a bad microphone, so I used an external microphone, which is directed. But it does not have a version for iOS.
So, I was excited for Ava, when I read about it. I emigrated to New Zealand, and I need now the application that can decipher English, not Russian.
Tested and had some usability caveats:
1. When the system language is Russian, it transcribes speech only in the Russian. Surprisingly, it's good. Needed to turn the system language to the English so that the application can do what I need. Maybe you need to add language setup to the settings?
2. Not application related, but looks like the iPhone 5s's microphone is awful, so I still need an external microphone.
3. Crashes a lot.
4. It looks like for using this app for conversations everyone needs to install the application on their phones and talk directly into microphones. Sounds Good, but in practice isn't. I can't convince everyone to install it, and it adds inconvenience for everyone else, not just me.
I'll give it some more try with an external mic. I really need the application with the ability to interpret the speech...
Do it, make it big, I'm rooting for you.
@lonefur yes, we're starting for familiar conversations, with relatives/close people.
- The use case you describe (to random strangers) is a big one. Of course, we're not into asking the other to install the app then (unless it's an important/1 hour convo), but the way in the video Mando uses it for the doctor should work OK in quiet settings.
- iPhone 5S isn't great, also processing is very slow
- Crashes: on us. Sorry about this. 1.1 will be fixes :p
This is an awesome product, and an elegant take on a challenge that many startups have tried to solve, but ultimately they fail to understand.
I'm hard of hearing, and find myself rapidly trying to learn lip-reading and sign-language as my hearing continues to diminish. Since I'll likely always have some of my hearing, in person conversations haven't been too bad for me (yet), my friends, family and even co-workers know I'll just stare at their mouths or ask them to repeat themselves. But, what really gets the better of me is calls.
Online meetings, skype calls, and phone calls (they are the worst as there is no body language at all). I hope you guys have some sort of Windows and MacOS plugins on your radar to start to transcribe these types of conversations. That would be a life saver!
@adamscochran very much aware of it! let's say the mobile version is the first brick of the system . would love to discuss more about it - we have a few ideas around this.
This app looks really incredible! And the video does a great job of showing the benefits. Great job!
Any plans or timeline to bring this to app stores outside of the US?
@clemenslm Thanks for the question!
We're already available in a few English-speaking countries (AUS, UK, CA, South Africa).
The availability is limited by the different languages the speech recognition system supports. The more users in a country, the better.
Our wish? To have something ready for Christmas time in some countries where we're working with communities already, depending on bandwidth & how today goes ✨
I'm inspired by this team's commitment to solving problems faced by millions every day. I'd love to hear more about how you developed and tested the product during your beta.
@cecimetropolis great question!
first we had to learn how to communicate super effectively with about 40% of our early users, who were Deaf: we learnt ASL - it was easier for me than for Pieter, who self-taught in 3 months from scratch :)
we tend to have a few key principles we believe in, pick a few very important features we want to build, and try to really focus on nailing the experience.
key principles:
1. We go for distributed: because our system is made of everyone's devices, it forces us to want to design the most seamless way of connecting everyone with this constraint. For example, we have no account creation if you're hearing and join the first conversation, or that it takes a tap to connect 2 people on Ava already
2. Designing for very non-tech savvy people: there's all ages, deafness being sort of randomly distributed. We always have them in mind
3. Focus on the core functionality
Regarding the testing, we made a Slack community with deaf/hard-of-hearing users (so tech-savvy feedback) and kept testing also face to face with normal users, look at their behavior, etc.
We don't have a lot of features right now, but they should work well. For example, saving transcripts isn't something we do. We could, but what matters right now is to nail the actual following of the conversation :)
Hope this helps!
I'm hard-of-hearing and I've been lucky enough to back this product right from the start with their IndieGoGo and help out the Ava team with some little design things here and there. It has come a long, long way since that initial alpha release!
I'm so excited about where Ava can potentially go in the next few years as their team gets a little bit bigger (they're hunting for some great devs and data scientists) and their AI starts to get better and better.
If you do give the app a go, my 1 tip would be to try it more than once. It can sometimes be a little scrappy when dealing with a strange accent or picking up your own voice, but I've been super impressed at how it self-improves after a couple of calls.
For me, this is such a HUGE, huge thing, that I really hope all the guys manage to make this a big success. They've put an insane amount of work into the product for years and they totally deserve to make it happen. I know there's a ton of people in the Deaf community who'll find this absolutely life-changing if it manages to take off.
@jon_lay it's been a true honor to build Ava and get your feedback all the way. You & @wearehanno are also super inspiring us to build a great culture every day 😉
It's not working for me right now (Germany)but I've experienced a demo a while ago. Even back then I was amazed by the product, the tech and the team I was so fortunate to meet! I can only imagine how much better it is now. Great work guys! Keep it up 😁👏😘
@gknook Hey Guido, indeed, we're not available in Germany, but only English-speaking countries for now. Happy about it because our servers are being hit like crazy 😅
We'll give a timeline a bit later to open for the other countries.
I love this! I grew up with a sibling that is legally deaf, and talking in groups was always a problem. This seems like a really great idea to break down that barrier and make all conversations accessible!
Wow, this sounds amazing. Just the other day, I was watching The West Wing and during one scene where Joey Lucas, a deaf character, and her interpreter are witnessing two people talking over each other, I started to wonder how deaf and hard of hearing people (and interpreters) handle these situations. I never cease to be amazed by the way that technology can be applied to make life easier for those with accessibility needs.
I'm curious to know if there's a way people can help train your technology, for example by speaking and then verifying the accuracy of the transcription? I see in a previous comment that Thibault mentioned you guys want to expand to other English speaking territories -- I'd imagine accents and other speech variances will be the most challenging thing for you to deal with. I live in Ireland and in Dublin alone there are dozens of variances of accent.
Such a fascinating and important mission, I will be following you folks closely!
@streatstyle for sure, we use the principles of machine learning. The key is to make the way to improve our technology scalable & multi-linguistic. We'll unveil couple things about it in the future!
Great execution on a real problem. A team of passionate technologists putting their talent and heart at work to make people's life better. Congrats to Thibault and the Ava team.
Product Hunt