Control your Mac using your webcam 📷
Sup everyone
I'm working on a general-purpose app to control a Mac using a webcam. It replaces the mouse (and simple keyboard commands) with hand gestures.
> includes - precise scrolling, cursor movement, left click, tab forward/back, mission control, exit code
> working on adding - zoom, drag and drop
I'd love feedback on how you'd productize this. I made it for fun / as a proof-of-concept, but already heard feedback that this would be great in the Figma / CAD / video editing industries. Basically any use-case where the mouse is used far more than the keyboard.
End goal in my mind would be to create some VR/AR like experience
If you're in any of these industries (or just think this is cool) I'd love to hear from you
Appreciate it 🔥
@wilbert_potts at the moment I'm fleshing it out with voice commands - the idea is you should be able to use your entire laptop without touching the keyboard or mouse. you can DM me on X if you'd like to discuss more :) https://x.com/jbelevate
This is such a clever idea. I can see how it would be really helpful for anyone with accessibility needs.
@hazel_mathew thanks man - was actually inspired by seeing Neuralink's progress, and thinking about the next frontier of UX beyond the keyboard + mouse
this could be a win for accessibility! If you’ve explored that angle, I’d love to hear more.