> IR dot-patterns will be its own problem. And I hope you never want to curl up on that couch to watch a movie with a blanket. :D
Speaking of which, notice how nobody who was relying on finger gestures (rather than a keyboard) was using menus, or doing anything mouse-like. Just scrolling and clicking.
You point to things by looking at it, which is very precise according to people who have tried it, like MKBHD. Clicking and dragging is done by finger pinching. So it works quite similar to a touchscreen or a mouse.
Yes apparently it is surprisingly precise. There might be an uncanny valley when the system is perhaps a little too good at predicting what your next move is. Are the goggles monitoring your facial expressions, looking not just for eye movement but also wrinkled noses, scrunched-up foreheads, etc. ? Will it be able to function as (for example) a lie detector ?
Speaking of which, notice how nobody who was relying on finger gestures (rather than a keyboard) was using menus, or doing anything mouse-like. Just scrolling and clicking.