Tag Archives: Google AR & VR

Bringing more of Google’s productivity apps to Glass Enterprise

Imagine translating instructions into a colleague’s native language in real-time. Or instantly crossing off daily tasks as you complete them. That’s part of our vision for augmented reality (AR), which has the potential to transform how companies and their frontline workers access information and make informed decisions while collaborating with their teams. We’re working to create a more natural and intuitive way to seek, interact with, and use information in the real world through AR.

Today, we are revealing a new early access program focused on bringing more of Google’s productivity apps and collaboration tools to the Glass Enterprise platform. Companies interested in Glass Enterprise most often request AR features that help people communicate and complete tasks. Starting today, we're introducing the opportunity for Google Workspace enterprise customers to partner with us in testing features focused on task completion, communication, and collaboration.

A more connected and efficient workforce with Glass Enterprise

Since 2017, Glass Enterprise has helped companies utilize AR to help employees work smarter, faster and hands-free. Working with software publishers that create bespoke solutions for companies, Glass Enterprise has helped customers like DB Schenker increase warehouse efficiency by 10%. Wendy's used Glass Enterprise to support food safety, quality practices and oversight of suppliers and distribution centers, as well as remote training and education for restaurant team members.

In 2020, we announced Google Meet on Glass Enterprise to give teams a first-person view of the wearer’s perspective — enabling real-time collaboration and problem solving. Since we launched Meet on Glass, remote team members have stayed connected for more than 750,000 minutes. Meet on Glass is generally available to anyone with Glass Enterprise.

Testing new features within our early access program

As part of this program, we’re expanding our productivity and collaboration offerings to include three new features across Google Tasks, language capabilities and photos:

  1. See step-by-step instructions: Tasks capabilities on Glass Enterprise provide hands-free access to step-by-step instructions to ensure accuracy and efficiency. Using any supported device, a warehouse manager can create a workflow on Tasks and share it directly to a teammate preparing a shipment, who can see and cross-off tasks in real-time on the Glass Enterprise display.
  2. Enable natural communication: Language capabilities like translation and transcription on Glass Enterprise help a global workforce understand, train and collaborate, regardless of language. This feature currently supports 15 languages with plans to add more in the near future. With Glass Enterprise, an employee who doesn’t share a common language with their manager can see direct translations in their line-of-sight.
  3. Collaborate securely: Glass Enterprise can now save images directly to your Pixel phone so you can seamlessly capture photos and share them across teams with Google Photos. Wearers can easily back up and share images and videos to check inventory, audit for quality, or diagnose and review equipment while being hands-free.

These capabilities are made possible by a new phone-enabled platform that uses the computing power of Google Tensor silicon on Pixel. This platform delivers more powerful and unique AR graphics and features on the Glass Enterprise display. It’s controlled by the Glass Enterprise Companion App, making it easier for workers to set up and manage settings out of the box.

We look forward to expanding access as we learn alongside our partners in the coming months, and to the release of more helpful AR features in upcoming programs.

If you are a current Workspace customer interested in testing how these new AR tools can benefit your team, apply to join our Glass Enterprise early access program.

Building and testing helpful AR experiences

Augmented reality (AR) is opening up new ways to interact with the world around us. It can help us quickly and easily access the information we need — like understanding another language or knowing how best to get from point A to point B. For example, we recently shared an early AR prototype we’ve been testing in our labs that puts real-time translation and transcription directly in your line of sight.

However, testing only in a lab environment has its limitations. So starting next month, we plan to test AR prototypes in the real world. This will allow us to better understand how these devices can help people in their everyday lives. And as we develop experiences like AR navigation, it will help us take factors such as weather and busy intersections into account — which can be difficult, sometimes impossible, to fully recreate indoors.

We’ll begin small-scale testing in public settings with AR prototypes worn by a few dozen Googlers and select trusted testers. These prototypes will include in-lens displays, microphones and cameras — but they’ll have strict limitations on what they can do. For example, our AR prototypes don’t support photography and videography, though image data will be used to enable experiences like translating the menu in front of you or showing you directions to a nearby coffee shop.

It's early, and we want to get this right, so we’re taking it slow, with a strong focus on ensuring the privacy of the testers and those around them. You can read more details about our limited public testing efforts for AR prototypes in the Google Help Center. As we continue to explore and learn what’s possible with AR, we look forward to sharing more updates.

Source: The Keyword


Augmented reality brings fine art to life for International Museum Day

Have you ever dreamt of having your portrait taken by a world-famous artist? Or wished a painting would come to life before your eyes? This International Museum Day, we’re unveiling three new Art Filter options via the Google Arts & Culture app so that you can immerse yourself in iconic paintings by Vincent van Gogh, Grant Wood, and Fernando Botero.

Our 3D-modeled augmented reality filter for Starry Night is a creative new twist on our previous Art Filter options and reflects how we continue to innovate with technology. Responding to the evocative atmosphere of Van Gogh’s masterpiece, it lets you set the night sky’s swirling winds and dazzling stars in motion. These filters are possible thanks to our partners in New York, Bogotá, and around the world who make their astonishing collections available online via Google Arts & Culture.

In another first for Art Filter, we’ve introduced face-mirroring effects to Grant Wood’s definitive depiction of midwestern America. See the figures of this celebrated double-portrait in a new light by interacting with both simultaneously. Perhaps you’ll put a smile on their famously long faces? Fernando Botero’s La primera dama, by contrast, needs no cheering up. This voluminous figure captures the Columbian artist’s inimitable Boterismo style in all its vibrancy and humor. Each of our three new Art Filter options draws inspiration from the paintings themselves to make these extraordinary artworks fun and educational for everyone.

Museums exist to preserve and celebrate art and culture. Using immersive, interactive technology, we aim to make these vital institutions more accessible. More than 60 museums from over 15 countries have joined Google Arts & Culture in 2022, joining more than 2000 existing partners to share their new collections and stories.

You can flick through the history of manga, tune into Bob Marley’s positive vibrations, tour an Argentinian palace, and hear powerful oral histories from Black Britain. In addition to art-inspired Art Filter options, you can also explore space, air, and sea with Neil Armstrong’s space suit, Amelia Earhart’s Lockheed Vega 5B, or a deep-sea diving helmet.

The Google Arts & Culture app is available to download for Android or iOS. Tap the Camera icon to immerse yourself in Art Filter (g.co/artfilter), get creative with Art Transfer, find a pawfect match for your animal companion, and more. From the beauty of India’s celebrated crafts to terracotta toys for Greco-Roman children, we hope it will inspire you to explore and interact with incredible artifacts from around the globe and across history.

Step into the Meroë pyramids with Google

When you think of pyramids does your mind wander to the Pyramids of Giza in Egypt or the Mayan Temples of Guatemala? Great civilizations built each of these pyramids and inscribed their stories onto the walls of them, offering glimpses into their daily life.

The Pyramids of Meroë in Sudan, while lesser known, are no different. Today, you can explore these stunning pyramids, which are a UNESCO World Heritage site, on Google Arts & Culture.

Over 200 pyramids were constructed in Meroë, the third and final capital of the Kushite Kingdom, an ancient African civilization that ruled the lands of Nubia for over 3000 years. Now you can take a virtual walk through the Pyramids of Meroë and explore the inscriptions using Street View’s panoramic imagery. You can also learn more about the Kushite Kingdom, their royalty and the architecture behind the pyramids in an immersive web experience that’s available in a range of languages including Arabic, English, French, German and Spanish.

If you want to get even more up close and personal, you can visualize the pyramids using augmented reality — no matter where you are. You can also listen to acclaimed Sudanese-American poet Emi Mahmood share evocative rhymes that are a beautiful ode to her homeland and to this project that shares Sudan’s rich heritage with others.

We’ve also partnered with the United Nations Economic and Social Council (UNESCO) to bring you more information about Meroë, Gebel Barkal and Napatan region and Sudan’s Sanganeb Marine National Park.

Bringing new life to Swedish endangered animals using AR

According to the UN, more plants and animals are threatened with extinction now than in any other period of human history — approximately 1 million species globally. The accelerating pace of extinction is an urgent matter, and at this week’s UN biodiversity conference representatives from countries all over the world are coming together virtually to set out a plan for how to combat the challenge of better protecting our endangered ecological ecosystem.

Sweden, which is home to much of the iconic wildlife in the northern hemisphere — from moose and bears to reindeer and wolverines— currently has 2,249 threatened species, according to the IUCN Red List. Each of these animals plays a vital role in the ecosystem we are all a part of, yet according to a recent study by Kantar Sifo, 30% of Swedes don’t believe or know if there are animals currently at risk of becoming extinct in Sweden.

Meet five endangered species in 3D

Today, in collaboration with the Swedish Society for Nature Conservation, and in an effort to raise awareness of endangered animals, we are bringing five new Swedish endangered species to Search in augmented reality. Now, by simply searching for the lynx, arctic fox, white-backed woodpecker, harbour porpoise or moss carder bee in the Google App and tapping “View in 3D”, people from all over the world will be able to meet the animals up close in a life-size scale with movement and sound.

An image of augmented reality animals: a porpoise, a woodpecker, a lynx, an arctic fox and a flower with a bee

Experts from the Swedish Society for Nature Conservation have selected these specific animals for their varying types of reasons for endangerment in the country and relevance to certain types of habitats, based on the IUCN’s Red List. The white-backed woodpecker and the harbour porpoise (in the Baltic sea) are “critically” endangered, with only a few individuals left of each species. The arctic fox has an “endangered” threat status due to its decreasing population, and the lynx and the moss carder bee are considered “vulnerable” - meaning that their natural habitats need to be protected for these species to be able to continue to reproduce in the wild. These animals also exist in other regions and outside of the Nordics, with varying threat levels from none to urgent.

Reasons for endangerment

  • The white-backed woodpecker is affected by logging
  • The harbour porpoise is affected by toxins and noise pollution
  • The arctic fox’s habitat is at risk due to climate change
  • The lynx is affected by traffic and illegal hunting
  • The moss carder bee is contending with a decreasing number of flowers

Preserving endangered animals is a complex effort that requires collective action. Everyone can do something, and by launching this new Search experience we hope that we can help people in and outside of Sweden learn more about the issues at hand and experience some of nature's beloved creatures up close.

Whether you want to take a photo with the arctic fox or teach your family about the moss carder bee, the #Google3D animals are available for anyone to try out starting today through Google Search.

How machine learning revived long lost masterpieces by Klimt

Few artists enjoy such worldwide fame as Gustav Klimt. The new Google Arts & Culture online retrospective "Klimt vs. Klimt - The Man of Contradictions" puts the spotlight on the artist's eclectic work and life. A Machine Learning experiment recolored photographs of lost Klimt paintings, while a “Pocket Gallery” brings some of his most iconic works into your living room in augmented reality and 3D. Together with more than 120 stories about his art and personality, a virtual tour of his studio, and many more highlights from the collections of over 30 cultural institutions around the world, "Klimt vs. Klimt" forms one of the most comprehensive online experiences about the artist.

Klimt’s legacy poses many unsolved questions, not least due to the fact that approximately 20% of his artworks were lost over the course of history. Among the most prominent and painful losses are the so-called Faculty Paintings, created on behalf of the University of Vienna and rejected by the latter for being overly critical towards science. In 1945, only days before the Second World War ended, the paintings were lost to a fire at Immendorf Castle in Austria. What these major works looked like could only be guessed at from black and white photographs taken in the early 1900s, unable were they to convey the magic that makes Klimt’s artworks so captivating — the bold colours, the revolutionary approach to textures, the shocking directness of his figures. Until today.

Using the opportunities offered by machine learning, enhanced by the knowledge of internationally renowned Klimt expert and curator at the Belvedere, Dr. Franz Smola, the team at the Google Arts & Culture Lab was able to reconstruct the colours that Klimt might have used for the Faculty Paintings, thus restoring them to their fully colored beauty. For the first time in 70 years, people can experience his artworks in the colors he might have used.

Experience the art of Klimt in new ways online

The paintings are the true centerpiece of “Klimt vs. Klimt”. The retrospective brings together more than 120 of the artist’s most famous masterpieces, as well as lesser known works, and assembles an expertly curated selection in an immersive Pocket Gallery that you can experience in augmented reality on mobile or in 3D on web. This was made possible thanks to a collaboration between Google Arts & Culture and over 30 partners and institutions - with the Belvedere, the Albertina, the Klimt Foundation, the Neue Galerie New York and the Metropolitan Museum of Arts among them. Over 60 masterworks by Klimt have also been captured in ultra high resolution with Google’s Art Camera. Come in closer to see “The Kiss” like never before!

Klimt expert Dr. Franz Smola

Meet the expert — Dr. Franz Smola


While creating “Klimt vs. Klimt” the Google Arts & Culture team was advised and guided by Dr. Franz Smola, curator at the Belvedere and acknowledged around the world as one of the foremost Klimt experts. He shared some of his thoughts on working on the project:

Why are Klimt’s Faculty Paintings so important?

Klimt´s three Faculty Paintings were among the largest artworks Klimt ever created and in the field of Symbolist painting they represent Klimt’s masterpieces.

What do you think about the recolored versions?

The colors were essential for the overwhelming effect of these paintings, and they caused quite a stir among Klimt´s contemporaries. Therefore the reconstruction of the colors is synonymous with recognizing the true value and significance of these outstanding artworks.

Is there something the digital presentation adds to how Klimt and his artworks can be perceived?

I am deeply impressed by the fantastic images taken with Google’s Art Camera. They allow you to really explore a work of art, to jump into its texture and color application and to discover every detail in the easiest way possible. I also like how technology allows ideas to come to life that have always been merely hypothetical — I am thinking of the Pocket Gallery we created, which contains a highlight selection of Klimt’s paintings including some of which were lost.

If Klimt was still alive - how do you think he would engage with digital technologies?

Klimt was a highly visual figure. He rarely commented on his work, rather inviting people to look at the work alone and draw their own conclusions. The “Klimt vs. Klimt” project primarily uses visual, non-verbal tools to convey Klimt’s work, which is very much in line with Klimt’s character. Klimt liked to lead a rather secluded life within the walls of his studio, to which only a few had access. I am certain he would have liked the idea of jumping from this remote and quiet place into the World Wide Web, having access to millions of artworks and seeing his art distributed and communicated around the world.

To explore “Klimt vs. Klimt - The Man of Contradictions” visit g.co/klimtvsklimt or download the free Google Arts & Culture app for iOS or Android.

Bring iconic Japanese characters to life with AR in Search

We all need a bit of escapism sometimes, and there’s nothing like a blast from the pop-culture past to do the trick. Today, we’re bringing characters from classic Japanese anime, games and TV shows to life — from Pac-Man to Hello Kitty — with augmented reality (AR) in Search. 


Japan’s anime and video game culture emerged between the 1950s and the 1980s, as comic books, gaming arcades and home TVs and consoles boomed. But it wasn’t just a Japanese phenomenon. The most iconic characters caught people’s imaginations around the world, and they’re still hugely popular today. 


Which animated icon is most searched on Google? Pac-Man leads the pack by a long way: worldwide search interest in the hungry dot-gobbler is more than double the next most-searched character, Hello Kitty. What might surprise you is that the top country for search interest in Pac-Man over the past five years was...Peru. Hello Kitty is most searched in the Philippines. 


When it comes to the broader trends, anime wins out. It’s more popular than video games worldwide, with interest for anime climbing to its highest peak on record in the past month. That’s pretty amazing — and in fact, search interest for “anime sugoi” (or “anime is amazing”) has spiked 2,300% in the past five years globally.
An animated world map showing search interest in anime characters over the past five years

Now, you can have these characters do their cute thing right in front of your eyes. Take a break to watch ghosts chasing after Pac-Man or Gundam swoop in your living room! Characters that are viewable in AR include Evangelion, Hello Kitty, Gomora, Gundam, Pac-Man and Ultraman. (For die-hard otaku who can read Japanese, check out our Japanese blog with the full list.)

An animation showing how the Japanese anime characters will look in augmented reality on Google Search

How to access and share:

Search for one of the characters on Google using a mobile device and tap “View in 3D” to rotate or zoom in and see it up close. You can then bring the characters from outer space into your space with AR and turn up your volume to hear Hello Kitty deliver a cute message, or Pac-man's retro sound effects.

  • Android: Search for “Hello Kitty” or one of the 14 characters on the Google app or any Android browser and tap “View in 3D.” You can see 3D content on devices with Android 7 Plus and you can see AR content on ARCore-enabled devices.
  • iOS:  Search for “Hello Kitty” or one of the 14 characters on the Google app. 3D and AR content is available on iOS 11.0+ devices.
You can also create AR videos — or recreate your favorite scenes — with the recording option. Don’t forget to tag your photos and videos on social with #Google3D.

Source: Search