Author Archives: Peter Schottenfels

Ask a Techspert: How do satellite images work?

When flying, I am firmly a window seat person. (And I can’t wait to start flying again… or at least get out of my apartment.) Not because I’m annoyed by the beverage cart hitting my elbows (though I am), or because I like to blankly stare out at the endless sky (which I do), but because I enjoy looking down at the streets, buildings and skyline of my destination as we land. It’s thrilling to watch cars move, see skyscrapers cast shadows on the street or check out the reflection of the sun in a body of water. For most of human history, it was impossible to even imagine what Earth looked like from above, and only in the past century have we been able to capture it. 

Today, satellite imagery is one of the most popular features on Google Maps. Capturing the world from above is a huge undertaking, matching millions of images to precise locations. But how does satellite imagery actually work? How often are images updated? What are some of the biggest challenges to bringing satellite imagery to more than 1 billion users?

To answer these questions, I reached out to our satellite imagery techspert, Matt Manolides. Matt is Google’s Geo Data Strategist. He’s worked at Google for over 14 years and he gave me an aerial view (pun intended) of how satellite imagery works.

How do we accumulate the images used in Google Maps? Do we actually use satellites? 

The mosaic of satellite and aerial photographs you can see in Google Maps and Google Earth is sourced from many different providers, including state agencies, geological survey organizations and commercial imagery providers. These images are taken on different dates and under different lighting and weather conditions.

In fact, there’s an entire industry around doing aerial surveys. Companies cut holes in the bottom of planes, and cameras take pictures as they fly overhead. In many areas around the world, this is happening constantly. In parts of the world where there isn’t an established aerial survey market, we rely on satellites. With aerial surveys, we get very high-quality images that are sharp enough to create detailed maps. Satellites produce lower-quality imagery, but are still helpful because they provide global coverage. 

Today, you can explore 36 million square miles of high-resolution satellite images in Google Maps and Google Earth, which covers more than 98 percent of the entire population.

When do the images meet the map? 

“Google obtains commercially-available satellite imagery from a range of third parties, and our team stitches the images together to create a seamless map,” Matt tells me. This is a process called photogrammetry and, according to Matt, we’re increasingly able to automate our photogrammetry process using machine learning to help accurately place images and improve resolution. 

For aerial data, the images are delivered on hard disks and we upload them into Google Cloud. For satellite imagery, the data is uploaded directly from our providers to Google Cloud. The imagery is delivered in a raw format, meaning it’s not yet positioned on the ground and is separated into red, blue and green photos, as well as panchromatic images, which includes finer details. We then combine the jumble of images so they all line up and have an accurate placement in the real world, and generally look beautiful.  

Hard drives with satellite imagery in a room

Rooms full of hard drives, each one jam-packed with aerial images.

How often do you update satellite images? 

“We aim to update satellite imagery of the places that are changing the most,” Matt says. For instance, because big cities are always evolving, we try to update our satellite images every year. For medium-sized cities, we try to update images every two years, and it goes up to every three years for smaller cities. Overall our goal is to keep densely populated places refreshed on a regular basis and to keep up with a changing world, so we will refresh areas more frequently when we think there’s lots of building or road construction going on.

Why do we sometimes see mysterious objects on Maps? What are they? 

Matt explains that sometimes the way the images are collected can create optical illusions. One of the most common instances of this are “sunken ships,” which are actually regular, operating ships that might appear underwater due to the way the satellite imagery gets layered together. Other times, sunlight can reflect off something shiny, and it will look like a strange white object that some believe are haunted houses or other such spookiness.

sinking_ship.png

A spooky "sunken ship" illusion in London. 

Because the satellite cameras take multiple pictures at the same time, but in different color spectrums, a fast-moving object, like a plane, can look strange, like several identical but differently-colored planes flying over each other. 

"Rainbow" plane image

As for Matt, his favorite part is finding public events that are happening when the images are captured. From hydroplane races to car shows, it’s fascinating to see events in the overhead imagery. 


“When I was a kid growing up in Seattle, I always loved the hydroplane races that would happen each summer. It was a thrill to realize that we captured one from the air back in 2010,” Matt says. “The imagery isn’t visible in Google Maps anymore, but you can still see it using Google Earth Pro’s Historic Imagery feature, which lets you browse our full catalog of imagery.”

Hydroplane races

A hydroplane race on Lake Sammamish, Washington, on June 10, 2010. 

Source: Google LatLong


Ask a Techspert: How do satellite images work?

When flying, I am firmly a window seat person. (And I can’t wait to start flying again… or at least get out of my apartment.) Not because I’m annoyed by the beverage cart hitting my elbows (though I am), or because I like to blankly stare out at the endless sky (which I do), but because I enjoy looking down at the streets, buildings and skyline of my destination as we land. It’s thrilling to watch cars move, see skyscrapers cast shadows on the street or check out the reflection of the sun in a body of water. For most of human history, it was impossible to even imagine what Earth looked like from above, and only in the past century have we been able to capture it. 

Today, satellite imagery is one of the most popular features on Google Maps. Capturing the world from above is a huge undertaking, matching millions of images to precise locations. But how does satellite imagery actually work? How often are images updated? What are some of the biggest challenges to bringing satellite imagery to more than 1 billion users?

To answer these questions, I reached out to our satellite imagery techspert, Matt Manolides. Matt is Google’s Geo Data Strategist. He’s worked at Google for over 14 years and he gave me an aerial view (pun intended) of how satellite imagery works.

How do we accumulate the images used in Google Maps? Do we actually use satellites? 

The mosaic of satellite and aerial photographs you can see in Google Maps and Google Earth is sourced from many different providers, including state agencies, geological survey organizations and commercial imagery providers. These images are taken on different dates and under different lighting and weather conditions.

In fact, there’s an entire industry around doing aerial surveys. Companies cut holes in the bottom of planes, and cameras take pictures as they fly overhead. In many areas around the world, this is happening constantly. In parts of the world where there isn’t an established aerial survey market, we rely on satellites. With aerial surveys, we get very high-quality images that are sharp enough to create detailed maps. Satellites produce lower-quality imagery, but are still helpful because they provide global coverage. 

Today, you can explore 36 million square miles of high-resolution satellite images in Google Maps and Google Earth, which covers more than 98 percent of the entire population.

When do the images meet the map? 

“Google obtains commercially-available satellite imagery from a range of third parties, and our team stitches the images together to create a seamless map,” Matt tells me. This is a process called photogrammetry and, according to Matt, we’re increasingly able to automate our photogrammetry process using machine learning to help accurately place images and improve resolution. 

For aerial data, the images are delivered on hard disks and we upload them into Google Cloud. For satellite imagery, the data is uploaded directly from our providers to Google Cloud. The imagery is delivered in a raw format, meaning it’s not yet positioned on the ground and is separated into red, blue and green photos, as well as panchromatic images, which includes finer details. We then combine the jumble of images so they all line up and have an accurate placement in the real world, and generally look beautiful.  

Hard drives with satellite imagery in a room

Rooms full of hard drives, each one jam-packed with aerial images.

How often do you update satellite images? 

“We aim to update satellite imagery of the places that are changing the most,” Matt says. For instance, because big cities are always evolving, we try to update our satellite images every year. For medium-sized cities, we try to update images every two years, and it goes up to every three years for smaller cities. Overall our goal is to keep densely populated places refreshed on a regular basis and to keep up with a changing world, so we will refresh areas more frequently when we think there’s lots of building or road construction going on.

Why do we sometimes see mysterious objects on Maps? What are they? 

Matt explains that sometimes the way the images are collected can create optical illusions. One of the most common instances of this are “sunken ships,” which are actually regular, operating ships that might appear underwater due to the way the satellite imagery gets layered together. Other times, sunlight can reflect off something shiny, and it will look like a strange white object that some believe are haunted houses or other such spookiness.

sinking_ship.png

A spooky "sunken ship" illusion in London. 

Because the satellite cameras take multiple pictures at the same time, but in different color spectrums, a fast-moving object, like a plane, can look strange, like several identical but differently-colored planes flying over each other. 

"Rainbow" plane image

As for Matt, his favorite part is finding public events that are happening when the images are captured. From hydroplane races to car shows, it’s fascinating to see events in the overhead imagery. 


“When I was a kid growing up in Seattle, I always loved the hydroplane races that would happen each summer. It was a thrill to realize that we captured one from the air back in 2010,” Matt says. “The imagery isn’t visible in Google Maps anymore, but you can still see it using Google Earth Pro’s Historic Imagery feature, which lets you browse our full catalog of imagery.”

Hydroplane races

A hydroplane race on Lake Sammamish, Washington, on June 10, 2010. 

Source: Google LatLong


Ask a Techspert: How does motion sensing work?

Editor’s Note: Do you ever feel like a fish out of water? Try being a tech novice and talking to an engineer at a place like Google. Ask a Techspert is a series on the Keyword asking Googler experts to explain complicated technology for the rest of us. This isn’t meant to be comprehensive, but just enough to make you sound smart at a dinner party. 

Thanks to my allergies, I’ve never had a cat. They’re cute and cuddly for about five minutes—until the sneezing and itching set in. Still, I’m familiar enough with cats (and cat GIFs) to know that they always have a paw in the air, whether it’s batting at a toy or trying to get your attention. Whatever it is they’re trying to do, it often looks like they’re waving at us. So imagine my concern when I found out that you can now change songs, snooze alarms or silence your phone ringing on your Pixel 4 with the simple act of waving. What if precocious cats everywhere started unintentionally making us sleep late by waving their paws?

Fortunately, that’s not a problem. Google’s motion sensing radar technology—a feature called Motion Sense in the Pixel 4—is designed so that only human hands, as opposed to cat paws, can change the tracks on your favorite playlist. So how does this motion sensing actually work, and how did Google engineers design it to identify specific motions? 

To answer my questions, I found our resident expert on motion sensors, Brandon Barbello. Brandon is a product manager on our hardware team and he helped me unlock the mystery behind the motion sensors on your phone, and how they only work for humans. 

When I’m waving my hand in front of my screen, how can my phone sense something is there? 

Brandon tells me that your Pixel phone has a chip at the top with a series of antennas, some of which emit a radio signal and others that receive “bounce backs” of the same signal the other antenna emitted. “Those radio signals go out into the world, and then they hit things and bounce back. The receiver antennas read the signals as they bounce back and that’s how they’re able to sense something has happened. Your Pixel actually has four antennas: One that sends out signals, and three that receive.”

What happens after the antenna picks up the motion? 

According to Brandon, when the radio waves bounce back, the computer in your phone begins to process the information. “Essentially, the sensor picks up that you’re around, and that triggers your phone to keep an eye out for the relevant gestures,” he says.

How does the Pixel detect that a motion is a swipe and not something else? 

With the motion sensing functions on the Pixel, Brandon and his team use machine learning to determine what happened. “Those radio waves get analyzed and reduced into a series of numbers that can be fed into the machine learning models that detect if a reach or a swipe has just happened,” Brandon says. “We collected millions of motion samples to pre-train each phone to recognize intentional swipes. Specifically, we’ve trained the models to detect motions that look like they come from a human hand, and not, for instance, a coffee mug passing over the phone as you put it down on the table.”

What will motion sensors be capable of in the future? 

Brandon told me that he and his team plan to add more gestures to recognize beyond swiping, and that specific movements could be connected to more apps. “In the future, we want to create devices that can understand your body language, so they’re more intuitive to use and more helpful,” he tells me. 

At the moment, motion-sensing technology is focused on the practical, and there’s still improvements to be made and new ground to cover, but he says this technology can also be delightful and fun—like on the Pixel’s gesture-controlled Pokémon Live Wallpaper. Overall, motion sensing technology helps you use your devices in a whole new way, and that will keep changing as the tech advances. "We're just beginning to see the potential of motion sensing," Brandon says.

The High Five: prom gets cheesy, pollen makes you sneezy

Whether you’re on the hunt for a flower crown or a corsage, here’s what that ol’ internet has been up to this week …


People are searching for Coachella—specifically, “what is Coachella”? It’s a music festival in the middle of the desert in California where bandanas are worn, parasols are twirled and selfies are taken (other Coachella items trending on Search are dust masks and earplugs… not as cute.) If you’re looking to see “who is performing?” you’ll be pleased to learn that two of the top-searched artists at Coachella are Beyonce and Cardi B (but Cardi was searched 3,200 percent more than Bey this week).


For those who have to wait a few years to bask in the sweet sun of the Coachella Valley, the fluorescent light of a high school gym will have to suffice. That’s because it’s prom season, and the kids are wondering “is prom worth it?” and searching for creative promposals (prom + proposal) like “Fornite promposal” and “The Office promposal.” It’s not prom without a corsage and boutonniere (but who can spell that?). Amidst the prom-mania, “How to spell boutonniere” was a trending question this week.  


If you thought your prom was cheesy, it’s got nothing on the next trend. On Thursday, sandwich enthusiasts celebrated National Grilled Cheese Day, and they took to Google to learn new ways to make the delicious treat—searches for grilled cheese were up 300 percent. Trending types of grilled cheese were “Taco grilled cheese,” “Keto grilled cheese” and “garlic bread grilled cheese.”


Spring comes, snow melts, and people search for pollen. Is that the saying? Whatever. The next trend is pollen. Probably because there’s a lot of it in the air. People were more interested in “pollen allergy” than “food allergy” this week, and a top trending question was “how does pollen cause allergies?” ?


Illinois Senator Tammy Duckworth welcomed her second child into the world this week, making her the first U.S. Senator to give birth while in office. The announcement of her new baby had some people searching ”How old is Tammy Duckworth?” and brought up questions about maternity leave—“how long is maternity leave?” and “when to take maternity leave?” were trending questions this week.


Source: Search