Author Archives: Peter Schottenfels

Ask a Techspert: How does motion sensing work?

Editor’s Note: Do you ever feel like a fish out of water? Try being a tech novice and talking to an engineer at a place like Google. Ask a Techspert is a series on the Keyword asking Googler experts to explain complicated technology for the rest of us. This isn’t meant to be comprehensive, but just enough to make you sound smart at a dinner party. 

Thanks to my allergies, I’ve never had a cat. They’re cute and cuddly for about five minutes—until the sneezing and itching set in. Still, I’m familiar enough with cats (and cat GIFs) to know that they always have a paw in the air, whether it’s batting at a toy or trying to get your attention. Whatever it is they’re trying to do, it often looks like they’re waving at us. So imagine my concern when I found out that you can now change songs, snooze alarms or silence your phone ringing on your Pixel 4 with the simple act of waving. What if precocious cats everywhere started unintentionally making us sleep late by waving their paws?

Fortunately, that’s not a problem. Google’s motion sensing radar technology—a feature called Motion Sense in the Pixel 4—is designed so that only human hands, as opposed to cat paws, can change the tracks on your favorite playlist. So how does this motion sensing actually work, and how did Google engineers design it to identify specific motions? 

To answer my questions, I found our resident expert on motion sensors, Brandon Barbello. Brandon is a product manager on our hardware team and he helped me unlock the mystery behind the motion sensors on your phone, and how they only work for humans. 

When I’m waving my hand in front of my screen, how can my phone sense something is there? 

Brandon tells me that your Pixel phone has a chip at the top with a series of antennas, some of which emit a radio signal and others that receive “bounce backs” of the same signal the other antenna emitted. “Those radio signals go out into the world, and then they hit things and bounce back. The receiver antennas read the signals as they bounce back and that’s how they’re able to sense something has happened. Your Pixel actually has four antennas: One that sends out signals, and three that receive.”

What happens after the antenna picks up the motion? 

According to Brandon, when the radio waves bounce back, the computer in your phone begins to process the information. “Essentially, the sensor picks up that you’re around, and that triggers your phone to keep an eye out for the relevant gestures,” he says.

How does the Pixel detect that a motion is a swipe and not something else? 

With the motion sensing functions on the Pixel, Brandon and his team use machine learning to determine what happened. “Those radio waves get analyzed and reduced into a series of numbers that can be fed into the machine learning models that detect if a reach or a swipe has just happened,” Brandon says. “We collected millions of motion samples to pre-train each phone to recognize intentional swipes. Specifically, we’ve trained the models to detect motions that look like they come from a human hand, and not, for instance, a coffee mug passing over the phone as you put it down on the table.”

What will motion sensors be capable of in the future? 

Brandon told me that he and his team plan to add more gestures to recognize beyond swiping, and that specific movements could be connected to more apps. “In the future, we want to create devices that can understand your body language, so they’re more intuitive to use and more helpful,” he tells me. 

At the moment, motion-sensing technology is focused on the practical, and there’s still improvements to be made and new ground to cover, but he says this technology can also be delightful and fun—like on the Pixel’s gesture-controlled Pokémon Live Wallpaper. Overall, motion sensing technology helps you use your devices in a whole new way, and that will keep changing as the tech advances. "We're just beginning to see the potential of motion sensing," Brandon says.

The High Five: prom gets cheesy, pollen makes you sneezy

Whether you’re on the hunt for a flower crown or a corsage, here’s what that ol’ internet has been up to this week …


People are searching for Coachella—specifically, “what is Coachella”? It’s a music festival in the middle of the desert in California where bandanas are worn, parasols are twirled and selfies are taken (other Coachella items trending on Search are dust masks and earplugs… not as cute.) If you’re looking to see “who is performing?” you’ll be pleased to learn that two of the top-searched artists at Coachella are Beyonce and Cardi B (but Cardi was searched 3,200 percent more than Bey this week).


For those who have to wait a few years to bask in the sweet sun of the Coachella Valley, the fluorescent light of a high school gym will have to suffice. That’s because it’s prom season, and the kids are wondering “is prom worth it?” and searching for creative promposals (prom + proposal) like “Fornite promposal” and “The Office promposal.” It’s not prom without a corsage and boutonniere (but who can spell that?). Amidst the prom-mania, “How to spell boutonniere” was a trending question this week.  


If you thought your prom was cheesy, it’s got nothing on the next trend. On Thursday, sandwich enthusiasts celebrated National Grilled Cheese Day, and they took to Google to learn new ways to make the delicious treat—searches for grilled cheese were up 300 percent. Trending types of grilled cheese were “Taco grilled cheese,” “Keto grilled cheese” and “garlic bread grilled cheese.”


Spring comes, snow melts, and people search for pollen. Is that the saying? Whatever. The next trend is pollen. Probably because there’s a lot of it in the air. People were more interested in “pollen allergy” than “food allergy” this week, and a top trending question was “how does pollen cause allergies?” ?


Illinois Senator Tammy Duckworth welcomed her second child into the world this week, making her the first U.S. Senator to give birth while in office. The announcement of her new baby had some people searching ”How old is Tammy Duckworth?” and brought up questions about maternity leave—“how long is maternity leave?” and “when to take maternity leave?” were trending questions this week.


Source: Search