Facial Capture Future

Video-based facial capture is speeding along...

Dev teams at Roblox, Meta and Digital Domain all demo'ed advancements to their motion capture technology this year.

While camera-based facial capture has been around for some time in many forms, the utility, quality, and ease have all drastically improved in the last 2 years alone.

On the consumer utility front, I am especially excited:

Imagine playing your favorite multiplayer video game and your precise facial expressions map 1-1 to your in-game character via a webcam.

Roblox, GTA, Fortnite, Apex, Valorant, Minecraft, and so many more games will instantly become more social and immersive.

Professional applications that depend on video game engines will benefit greatly as well... innovation like this will affect many industries.

A mainstream, video-driven facial capture future is certified.

Creators will shift their focus to what's increasingly being called The Avatar Economy, as soon as they choose to embody game characters.

Digital Domain published this video, saying "We present a hybrid facial capture pipeline that combines a regression-based, video-driven transfer technique, under partially controlled conditions, with a more robust, but slower, marker-based tracking approach."

"We thus achieve an overall pipeline that, without loss of quality, is faster and has less user intervention."

What do you think about mapping your face to a video game? Would you use this professionally? In Digital Domain's case, they'll use this to transform the film industry—imagine the licensing potential there?