This is a fantastic demo. I've tried to build these type of prototypes for all Meta Headsets in the past but their very limited API/SDKs block you from doing anything meaningful with computer vision. They are too scared of devs getting access to the camera.

Hope that Apple Vision Pro gives a more robust api to developers and that forces Meta to open up.

I will use this approach for a poc I have in mind. Great job and thank you for open sourcing!