Google turns its face into a gaming mouse – t3n – Digital Pioneers

Lance Carr plays with his face. (screenshot: Youtube/t3n)

Google introduced what is called Project Gameface. This turns the face into a gaming mouse. This means that people can control the mouse cursor only through facial expressions.

Google explains the open source solution in one blog post more accurate. For example, users can raise their eyebrows to click and drag or open their mouths to move the cursor.

For this, the face is photographed by a webcam and then the images are analyzed and interpreted by AI. The technology is primarily intended for physically challenged players.

Inspired by streamer Lance Carr, who suffers from muscular dystrophy. This is a condition that gradually weakens the muscles of the body. Carr previously used a head-tracking mouse for cursor and game control.

However, one night his house burns down along with the expensive appliances of the technology. Google then wanted to help the gamer, which is why Carr helped develop the Gameface project. All he needs is a webcam to control his game.

Google tells its story and more about the project in a short YouTube video:

The Gameface project is currently in development. However, Google says that it is relatively cheap to develop and maintain, so it can help a lot of people.

Anyone wishing to participate in the development of an open source project is welcome to Github repository By Gameface drop it out.

Gameface users can adapt the software to their own needs. For example, with Gesture Size, you can set how clear a gesture should be to move the cursor. Especially in the beginning, it can be a good idea for users to move the cursor involuntarily, simply because they naturally make various gestures with their faces.