Which Frame?

Which Frame?

Search a video with AI magic. Which frame has X?

7 followers

Visit website
•
🧠 Search a video *semantically* powered by the CLIP neural network. ❓ Example: Which frame has a person with sunglasses and earphones?
Which Frame? gallery image
Which Frame? gallery image
Which Frame? gallery image
Which Frame? gallery image
Which Frame? gallery image
Free
Launch tags:
Web App•Productivity•Artificial Intelligence
Launch Team

What do you think? …

David Chuan-En Lin
Maker
Hi everyone! I made a simple (free) tool that lets you search a video *semantically* with machine learning. For example, try a natural language search query like "a person with sunglasses". ✨ You can try out the live web app at http://whichfra.me ✨ The querying is powered by OpenAI’s CLIP neural network for performing "zero-shot" image classification and the interface was built with Streamlit. Please share your interesting searches and let me know where I can improve. Thanks! :)
Eugene Hauptmann
@chuanenlin Wow, great job! Any plans for YouTube/Vimeo integration?
David Chuan-En Lin
Maker
@eugenehp Thanks, it currently supports YouTube integration (you can search a YouTube video instead of uploading a video yourself).
Eugene Hauptmann
Awesome!
Harsh Gelda
This tool is legendary!!
David Chuan-En Lin
Maker
@harsh_gelda Thanks, did you come across any interesting searches?
Harsh Gelda
@chuanenlin I live in India and most women in India wear this traditional clothing called "sarees" When I searched for this word "saree" in the video, i was amazed that it actually came up! I did try many other searches just to test out the tool. Works flawlessly! Great work :)
David Chuan-En Lin
Maker
@harsh_gelda Love the local example, thanks for sharing!
Aleks Bochkov
Looks like a great idea! Congrats! 🚀