Apple’s Vision Pro headset relies heavily on manual controls for control and user interactions. These features allow for a more realistic experience compared to other headsets that have their own controllers. Today, it appears that the Cupertino-based company is planning to extend hand gestures in the air not only to AR/VR glasses, but also to other devices such as the Apple TV box or MacBook.
Currently, Apple Vision Pro allows for eye and hand tracking through a combination of cameras and sensors. They are paired with advanced software algorithms to allow entries without a console. Apple’s latest patent filing indicates that the company will combine multiple devices to create a similar virtual experience.
Air gestures to control your Apple TV or MacBook
An image shows a user wearing an Apple Watch making mid-air hand gestures that can be read and recognized by an Apple TV with cameras and sensors. Also, it is likely that the smart watch will include additional components to accommodate different directions and position of the hand. All interactions on the user interface are then displayed on a TV or monitor.
Apple shows how the Vision Pro’s hand-tracking capabilities will work on the Apple TV, iPad, and MacBook. / © PatentlyApple
As with other apps, there are myriad ways manual tracking can come in handy aside from the basic controls. For example, a user can draw things or write a message in mid-air without the need for another external input accessory.
In addition to the Apple Watch and Apple TV, the patent also mentioned that this technology also works on the MacBook and Mac Desktop. It is also possible to use the Apple iPad as a display and tracker, since it is already equipped with cameras and sensors.
The idea of a patent seems very feasible in light of the technologies currently available. Therefore, we can expect that Apple’s idea is likely to be put into practice in the next few years.
Do you also think this concept is practical and useful? Tell us what you think in the comments below.
“Certified tv guru. Reader. Professional writer. Avid introvert. Extreme pop culture buff.”
More Stories
ARKit: This is how Apple's augmented reality technology works
Monport is revolutionizing DIY projects with fiber laser technology
This is how the technology agency Hotwire works in Munich