Google's new mixed reality tech makes VR headsets invisible, sort of

Google's latest research aims to make mixed reality videos a little less alien

Google's latest research aims to make mixed reality videos a little less alien

The technology, developed by Google Research and Google Daydream Labs, uses a combination of machine learning, 3D computer vision and advanced rendering techniques to "remove" clunky VR headsets in order to allow onlookers to see a person's identity, focus and face in mixed reality.

While the technology does nothing for the real-world headset user, it dramatically improves the experience inside a VR or mixed reality world.

Virtual reality, and really even augmented reality, is a very personal experience in the sense that only the one wearing it can really appreciate what's happening.

By making the headset 'vanish, ' as it were, Google and the tech giant's partners hope to give VR demonstrations a bit more dignity and immerse watchers more fully in the experience, giving them a "complete picture" of the VR world, according to a Google blog post. With some age-old "green screen" Hollywood magic, some 3D modeling, and eye tracking, Google has devised a way to give viewers a better sense of the virtual world and, in a way, makes it actually easier to sell the idea of VR to them. Their face is then calibrated in under a minute and synchronized with a map database of textures.

The way the technology works is by creating a 3D dynamic model of the users face to accurately portray any facial expressions or emotions, and then layer it onto the front of the digital headset.

Michael Flynn unlikely to face charges for lying to Federal Bureau of Investigation , sources say
The president said that while Flynn was "just doing his job", he was "not happy" that the adviser had misled the vice president. Flynn was interviewed by the FBI around the same time , according to a USA official who was briefed on the investigation.

Finally, the composition is rendered and checked to make sure the model face is consistent with the content in the camera stream.

"If you're watching someone else use VR, it's hard to tell what's going on and what they're seeing".

"Headset removal is poised to enhance communication and social interaction in VR itself with diverse applications like VR video conference meetings, multiplayer VR gaming, and exploration with friends and family", the firm says.

Game publishers like Owlchemy Labs and Radial Games have done some of the most extensive work on mixed reality setups and have shared their findings with the greater VR game dev community.

The blank, robotic VR masks seen in mixed reality videos could soon receive a facial fix that's pretty cool but also kind of creepy, just like any good advancement in technology should be.

Recommended News

  • Dragon Quest Heroes 2 PC Version Announced, New Trailer Released To Celebrate

    Dragon Quest Heroes 2 PC Version Announced, New Trailer Released To Celebrate

    But they're not offering any simple Day One Edition; they're offering the new Dragon Quest Heroes 2 Explorer's Addition . Square Enix is simply overjoyed, overjoyed to announce that Dragon Quest Heroes 2 is now available for pre-order.
    Azerbaijan's leader names his wife as 1st vice president

    Azerbaijan's leader names his wife as 1st vice president

    Mehriban is an eye doctor by training and comes from one of Azerbaijan's wealthiest and most influential families. Aliyev, 54, has led the ex-Soviet country since his father, Heydar Aliyev, died after a decade in power in 2003.
    President of Iceland wants to ban pineapple on pizza

    President of Iceland wants to ban pineapple on pizza

    If Iceland's president had his way, no sweet chunks of tropical goodness would ever be found on a slice of savoury pie ever again. Jóhannesson said his favourite football team was Manchester United and he was "fundamentally opposed" to pineapple on pizzas.
  • Budapest to withdraw bid to host 2024 Summer Olympics

    Budapest to withdraw bid to host 2024 Summer Olympics

    Paris has hosted the games twice before, in 1900 and 1924, while LA is also a double-host, in 1932 and more recently in 1984. Rome pulled out of the bidding for the Games in October.

    New US environmental agency chief to address staff amid fears of cuts

    He understands that while farmers and ranchers make their living off the land, they are also its best stewards. During his confirmation hearing, he claimed he was unsure how much lead was safe for humans to consume.
    Philippines: ASEAN Hopes for Clear Picture on Trump Policies

    Philippines: ASEAN Hopes for Clear Picture on Trump Policies

    Yasay also said that Duterte government has never claimed its ownership over the contested islands as it had " no legal basis ".
  • Tigers play with drone like giant cat toy

    Tigers play with drone like giant cat toy

    The video below shows a big pack of Siberian tigers located in China's Heilongjiang Province roaming around in the snow. According to Chinese media, experts in the park were using the drone to help keep the tigers in the enclosure fit.
    Squee! Crowd-funded 'Mystery Science Theater 3000' has a Netflix release date

    Squee! Crowd-funded 'Mystery Science Theater 3000' has a Netflix release date

    Making the return of the show even sweeter was that Netflix picked it up for exclusive distribution on their streaming service. Original series creator Joel Hodgson is involved in the revival as well, but most of the cast will consist of newcomers.

    Earnhardt Jr., Keselowski deadlocked atop Daytona 500 odds

    Earnhardt hasn't won a Cup title, but has been named the sport's Most Popular Driver for the last 14 seasons. He started third past year , and missed half of the season due to a concussion.
  • Live pregnant giraffe cam briefly pulled offline for being

    Live pregnant giraffe cam briefly pulled offline for being "sexually explicit"

    A NY petting zoo is sharing the joy as they are expecting a baby giraffe to be born. This little blessing will weigh around 150 pounds and be about 6 feet tall at birth.
    United Kingdom  pledges $249M to South Sudan and Somalia in response to starvation

    United Kingdom pledges $249M to South Sudan and Somalia in response to starvation

    South Sudan has been receiving humanitarian and food assistance from worldwide relief organisations including the UN. How did it get to this point? Challiss McDonough is spokesperson for the World Food Program in East Africa.
    Aston Martin Vantage S Red Bull Racing Edition

    Aston Martin Vantage S Red Bull Racing Edition

    The latest limited edition Aston Martin Vantage to break cover shows that the company is quite literally bullish about the future. The interior has also been spruced up, with more carbon fiber and Red Bull Racing logos embroidered straight into the headrests.

We are pleased to provide this opportunity to share information, experiences and observations about what's in the news.
Some of the comments may be reprinted elsewhere in the site or in the newspaper.
Thank you for taking the time to offer your thoughts.