James Bannon

Control your Mac using your webcam 📷

Sup everyone


I'm working on a general-purpose app to control a Mac using a webcam. It replaces the mouse (and simple keyboard commands) with hand gestures.


You can see a demo here


> includes - precise scrolling, cursor movement, left click, tab forward/back, mission control, exit code

> working on adding - zoom, drag and drop


I'd love feedback on how you'd productize this. I made it for fun / as a proof-of-concept, but already heard feedback that this would be great in the Figma / CAD / video editing industries. Basically any use-case where the mouse is used far more than the keyboard.


End goal in my mind would be to create some VR/AR like experience


If you're in any of these industries (or just think this is cool) I'd love to hear from you


Appreciate it 🔥



69 views

Add a comment

Replies

Best
Wilbert Potts

this could be a win for accessibility! If you’ve explored that angle, I’d love to hear more.

James Bannon

@wilbert_potts at the moment I'm fleshing it out with voice commands - the idea is you should be able to use your entire laptop without touching the keyboard or mouse. you can DM me on X if you'd like to discuss more :) https://x.com/jbelevate