Which Frame?

Search a video with AI magic. Which frame has X?

7 followers

Search a video with AI magic. Which frame has X?

7 followers

Visit website

Video editing

•

🧠 Search a video *semantically* powered by the CLIP neural network. ❓ Example: Which frame has a person with sunglasses and earphones?

Free

Launch tags:

Web App•Productivity•Artificial Intelligence

Launch Team

David Chuan-En Lin

Soundify

Maker

Hi everyone! I made a simple (free) tool that lets you search a video *semantically* with machine learning. For example, try a natural language search query like "a person with sunglasses". ✨ You can try out the live web app at http://whichfra.me ✨ The querying is powered by OpenAI’s CLIP neural network for performing "zero-shot" image classification and the interface was built with Streamlit. Please share your interesting searches and let me know where I can improve. Thanks! :)

Report

4yr ago

Eugene Hauptmann

LLC Toolkit

@chuanenlin Wow, great job! Any plans for YouTube/Vimeo integration?

Report

4yr ago

David Chuan-En Lin

Soundify

Maker

@eugenehp Thanks, it currently supports YouTube integration (you can search a YouTube video instead of uploading a video yourself).

Report

4yr ago

Eugene Hauptmann

LLC Toolkit

Awesome!

Report

4yr ago

Harsh Gelda

This tool is legendary!!

Report

4yr ago

David Chuan-En Lin

Soundify

Maker

@harsh_gelda Thanks, did you come across any interesting searches?

Report

4yr ago

Harsh Gelda

@chuanenlin I live in India and most women in India wear this traditional clothing called "sarees" When I searched for this word "saree" in the video, i was amazed that it actually came up! I did try many other searches just to test out the tool. Works flawlessly! Great work :)

Report

4yr ago

David Chuan-En Lin

Soundify

Maker

@harsh_gelda Love the local example, thanks for sharing!

Report

4yr ago