videoGPT - The AI chatbot that can watch videos

hey, as someone who consumes a ton of YouTube videos, i've always wanted something like videoGPT. when chatGPT with vision launched, i decided it's the right time. you can ask videoGPT questions about the video, and it will answer them while referring to the sources it used in the video. videoGPT will summarise the video in a paragraph by default as well there's a lot of apps & chrome extensions with a similar thing happening, but afaik this is the first and only to use GPT4-V to actually process the visual content of the video too. all others just analyse the subtitles / captions / descriptions. because of this, videoGPT does need some time to process to develop it's deeper understanding of the video there's a chrome extension coming soon. it's not mobile-friendly so use it on desktop for now please it's free but i'll be making a Pro plan soon, which will allow videos longer than 30 mins to be used, and will allow videos without subtitles to be processed it's powered by chatGPT, GPT-4V, CLIP & langchain /// coming soon /// chrome extension pro plan (with longer videos, and audio transcription) upload your own videos thanks! :) P.S: for devs ;0... the core aspect of videoGPT (and the code i'm most proud of) is the algorithm that understands the visual content of the video. doing this in a compute & cost efficient way is paramount, so i built a home-baked algorithm (in 800 lines of python ;) to collapse the video into a subset of key frames. these frames are then sent to GPT-4V to create a visual understanding of the video too.

Awesome! I will give it a try with some podcasts 😄 Congrats on the launch! 👏

Wow, videoGPT sounds like a game-changer! I'm curious to know how accurate the chatbot is in analyzing the key scenes of a video. Have you done any testing or received feedback from users? I think this could be incredibly useful for content creators and researchers. Looking forward to seeing the pro plan and exploring more features!

Wow, videoGPT sounds like a game-changer! I'm inquisitive to know how exact the chatbot is in analyzing the key scenes of a video. Have you done any testing or gotten input from clients? I think this can be unimaginably valuable for substance makers and analysts. Looking forward to seeing the professional arrange and investigating more highlights!

Eager to see VideoGPT's precision in analyzing video scenes, potential applications for creators and analysts seem vast! Any client feedback or further exploration planned? Congrats on the launch @gaurav_dewan

Congratulations on the launch!

Hey Gaurav! It's like having a virtual best friend or assistant. Great job on the creation.

Impressive product, @gaurav_dewan! Love how it leverages GPT-4V to process visual content, providing in-depth insights into YouTube videos. Excited for the upcoming Chrome extension.

Great

It's great. Can videoGPT answer questions about visual content in a video? And this feature can support user with language is Vietnamese ?

Love the concept. I tried to create an account to give it a try, but just got the spinning wheel of death:)

Congrats on your Launch. :)

Congratulations for the launch... Amazing product 😍😍

Good stuff. Tried some of the videos, loading time was too high. Can use faster whisper versions. Also the formatting of the text needs to be worked on. So you are looking at specific type of use-case or want to keep this open ended? I guess more value in the former. Will be great to see this working for skim-able content.

Congratulations on the launch. A much-needed product. It's exactly what I needed.