Anyone Can Use VTuber App “Kalidoface Lab” That Can Track Facial Expressions And Actions Using Only Webcam – GIGAZINE

To become a VTuber, you need a tracking device, software to read facial movements and expressions, and a 3D model. The difficulty, however, is that setting up a “3D model” and “tracking hardware and software” costs money. Google artificial intelligence researcherrich A free web app developed by Mr.Kaleidophas LaboratoryYou can easily become a VTuber by tracking facial expressions and body movements with just your webcam, so I actually tried to use it.

Kaleidophas Laboratory
https://lab.kalidoface.com/

When you access the Kalidoface Lab from the link above, a holographic avatar will be displayed on the screen. To perform webcam tracking, click the camera button on the right side of the screen.

When asked for permission to use the camera, tap Allow.

You can now mirror your movements on your 3D avatar by simply changing your expression or moving your face towards the webcam.

Here’s how to actually transfer your 3D avatar. In addition to moving the face left and right and rotating the neck, the opening and closing of the mouth, the opening and closing of the eyes, and the line of sight are also reproduced.

I Tried Using “Kalidoface Lab” That Can Become a VTuber With Just a Webcam – YouTube

It is also possible to change the position of the 3D avatar in Kaleidophas’ laboratory. To switch between modes, tap Preference at the top left of the screen, select Avatar, and tap Rest Mode.

Then the mode selection field will be displayed, so click on it.

Various modes such as “sitting” and “smart phone play” are available as candidates for selection. Try “sit” and click “done”.

The position of the 3D avatar has been changed according to the instructions.

Kalidoface Lab can also load VRM files and control your favorite 3D avatars. To upload the VRM file, click Upload at the top left of the screen.

When the file selection screen is displayed, select the VRM file you want to transfer. This time, the GIGAZINE anthropomorphic figuregigazin-chan (temporary)VRM file selected.

After waiting for a while, GIGAZINE-chan (temporary) was displayed on the screen. For some reason, the front and back are reversed, so swipe the screen to adjust the camera orientation.

I turned to.

Here’s how I tried to move GIGAZINE-chan (temporary). If you use Kalidoface Lab, you can animate your avatar in 3D without downloading the software, so it’s convenient to say ‘I made a 3D avatar but I don’t know how to move it’.

I tried to transfer GIGAZINE-chan (temporarily) using the free web app “Kalidoface Lab” – YouTube