Magic Sudoku - ARkit solves Sudoku puzzles using the magic of Augmented Reality! Built using Swift, ARKit, Vision, CoreML and some machine learning/neural networks
Hey all - I'm the developer of the app. Tried to come up with an ARKit app that wasn't just a "floating 3d model"
The app reads the camera data and passes it through Apple's Vision apis and into a CoreML model trained on recognizing Sudoku and then solves the puzzle and re-projects it out back into the scene.
Version 1 is mostly a tech demo and a "look what my phone can do now!" app. In V2 I hope to add a lot more useful features for actual players doing actual paper Sudoku puzzles.
@braddwyer Real cool! My use case would be to use it once I'm like: there's no way I'll be able to find the solution! Will with work with a failed sudoku attempt where some of the numbers are filled out? Rock on!
@aurorakb not yet! Definitely on the roadmap though. Need to train my neural network on more handwriting samples and then work on the UI. Coming soon :)
Between IKEA Place, the measuring apps, GIPHY, and now Magic Sudoku this has been a crazy week for AR. I cannot wait to see where this technology is in 2 - 3 years.
@yevgeniya_galich v1 is mostly a tech demo. Hoping people will want to show it off as a "look what my phone can do now!" feature.
In v2 we'll be adding features that make it actually useful for people who play paper sudokus. Stay tuned :)
@braddwyer Well, technically you could do a couple things, re-create the sudoku in the app itself and let me solve it from within the app - this would be more 2D. Or you can just let me solve it in AR somehow haha, so there's no handwriting involved.
Stack Roboflow