Author Archives: Yossi Matias

How we’re using AI to help address the climate crisis


Communities around the world are facing the effects of climate change — from devastating floods and wildfires to challenges around food security. As global leaders meet in Egypt for COP27, a key area of focus will be on how we can work together to address to climate change crisis and implement sustainable solutions. At Google, we’re investing in technologies that can help communities prepare for and respond to climate-related disasters and threats.

Tools to alert people and governments about immediate risks

Natural disasters are increasing in frequency and intensity due to climate change. As part of our Crisis Response efforts, we're working to bring trusted information to people in critical moments to keep them safe and informed. To do so, we rely on the research and development of our AI-powered technologies and longstanding partnerships with frontline emergency workers and organizations. Here’s a look at some of our crisis response efforts and new ways we’re expanding these tools.

  • Floods: Catastrophic damage from flooding affects more than 250 million people every year. In 2018, we launched our flood forecasting initiative that uses machine learning models to provide people with detailed alerts. In 2021, we sent 115 million flood alert notifications to 23 million people over Search and Maps, helping save countless lives. Today, we’re expanding our flood forecasts to river basins in 18 additional countries across Africa, Latin America and Southeast Asia. We’re also announcing the global launch of the new FloodHub, a platform that displays flood forecasts and shows when and where floods may occur to help people directly at risk and provide critical information to aid organizations and governments. This expansion in geographic coverage is possible thanks to our recent breakthroughs in AI-based flood forecasting models, and we’re committed to expanding to more countries.
An image of a FloodHub map showing areas where riverine floods my occur

The new Google FloodHub at g.co/floodhub shows forecasts for riverine floods. Forecasts are now available in 18 additional countries: Brazil, Colombia, Sri Lanka, Burkina Faso, Cameroon, Chad, Democratic Republic of Congo, Ivory Coast, Ghana, Guinea, Malawi, Nigeria, Sierra Leone, Angola, South Sudan, Namibia, Liberia, South Africa.

  • Wildfires: Wildfires affect hundreds of thousands of people each year, and are increasing in frequency and size. I experienced firsthand the need for accurate information when wildfires occur and this inspired our crisis response work. We detect wildfire boundaries using new AI models based on satellite imagery and show their real-time location in Search and Maps. Since July, we’ve covered more than 30 big wildfire events in the U.S. and Canada, helping inform people and firefighting teams with over 7 million views in Search and Maps. Today, wildfire detection is now available in the U.S., Canada, Mexico and parts of Australia.
Picture shows the location of the Pukatawagan fire in Manitoba, Canada.

The location of the Pukatawagan fire in Manitoba, Canada.

  • Hurricanes: Access to authoritative forecasts and safety information about hurricanes can be life-saving. In the days before a hurricane in North America or a typhoon in Japan, detailed forecasts from authoritative sources appear on SOS Alerts in Search and Maps to show a storm’s predicted trajectory. We're also using machine learning to analyze satellite imagery after disasters and identify which areas need help. When Hurricane Ian hit Florida in September, this technology was deployed in partnership with Google.org grantee GiveDirectly to quickly allocate aid to those most affected.

Managing current and future climate impacts

Climate change poses a threat to our world's natural resources and food security. We’re working with governments, organizations and communities to provide information and technologies to help adapt to these changes.

  • Keeping cities greener and healthier: Extreme temperatures and poor air quality are increasingly common in cities and can impact public health. To mitigate this, our Project Green Light uses AI to optimize traffic lights at intersections around the world with the aim to help minimize congestion and related pollution. Project Air View also brings detailed air quality maps to scientists, policymakers and communities. And we’re working to expand our Environmental Insights Explorer’s Tree Canopy Insights tool to hundreds of cities by the end of this year so they can use trees to lower street-level temperatures and improve quality of life.
  • Meeting the world’s growing demand for food: Mineral — a project from X, Alphabet’s moonshot factory — is working to build a more sustainable and productive food system. The team is joining diverse data sets in radically new ways — from soil and weather data to drone and satellite images — and using AI to reveal insights never before possible about what’s happening with crops. As part of our Startups For Sustainable Development program, we’re also supporting startups addressing food security. These include startups like OKO, which provides crop insurance to keep farmers in business in case of adverse weather events and has reached tens of thousands of farmers in Mali and Uganda.
  • Helping farmers protect their crops: Pest infestations can threaten entire crops and impact the livelihoods of millions. In collaboration with InstaDeep and the Food and Agriculture Organization of the United Nations, our team at the Google AI Center in Ghana is using AI to better detect locust outbreaks so that it's possible to implement control measures. In India, Google.org Fellows worked with Wadhwani AI to create an AI-powered app that helps identify and treat infestations of pests, resulting in a 20% reduction in pesticide sprays and a 26% increase in profit margins for farmers. Google Cloud is also working with agricultural technology companies to use machine learning and cloud services to improve crop yields.
  • Analyzing a changing planet: Using Google Cloud and Google Earth Engine, organizations and businesses can better assess and manage climate risks. For example, the U.S. Forest Service uses these tools to analyze land-cover changes to better respond to new wildfire threats and monitor the impacts of invasive insects, diseases and droughts. Similarly, the Bank of Montreal is integrating climate data — like precipitation trends — into its business strategy and risk management for clients.

AI already plays a critical role in addressing many urgent, climate-related challenges. It is important that we continue to invest in research and raise awareness about why we are doing this work. Google Arts and Culture has collaborated with artists on the Culture meets Climate collection so everyone can explore more perspectives on climate change. And at COP27 we hope to generate more awareness and engage in productive discussions about how to use AI, innovations, and shared data to help global communities address the changing climate.

Expanding our ML-based flood forecasting

In 2018 we began our flood forecasting initiative to help combat the catastrophic damage from floods each year by equipping those in harm’s way with accurate and detailed alerts. This work is a part of Google’s broader Crisis Response program which provides people access to trusted information and resources in critical moments. For over a decade, our Crisis Response team has been partnering with front line and emergency workers to develop technology and programs that help keep people safe, informed and out of harm’s way.

Expanding our forecasting reach

In the first three years, we expanded our program to cover much of India and Bangladesh, working in partnership with the Indian Central Water Commision and with the Bangladesh Water Development Board, covering an area with about 220 million people and sending out 40 million potentially life-saving alerts. And in 2021, our operational systems were further expanded to cover an area with over 360 million people. Thanks to better flood prediction technology, we sent out over 115 million alerts — that’s about triple the amount we previously sent out.

Coverage areas of our current operational flood forecasting systems.

Coverage areas of our current operational flood forecasting systems. In these areas, we use our models to help government alerts reach the right people. In some areas we have also increased lead time and spatial accuracy.

We’re hyper-focused on making alerts more local, accessible, actionable and accurate — the more information we can offer about upcoming floods, the better, more timely decisions people can make. Most global flood alerts only provide information on how much a river will rise (e.g. 30 cm), which doesn’t always mean people can know what that would mean for them and their village. Our flood alerts display inundation maps, which show the extent and depth of flooding right on top of Google Maps, so people can visualize this critical information more easily. Our new manifold inundation model and advances across all models allow us to scale up significantly and provide this information to many more people (and we’ll share more about this technology in the near future).

We recently launched the Google Flood Hub to make this flood data even more hyper-local. It allows you to zoom into our inundation maps where you can find information about the same flood, and focus on highly specific areas, such as a village. The Flood Hub provides the same depth and flood extent information in a more visual format that helps people to understand the current and forecasted flood situation in their area instantly. This site will be our primary resource for local, visual forecast information moving forward.

The Google Flood Hub user interface on a mobile device

The Google Flood Hub user interface on a mobile device

We’ve also partnered with multiple local aid organizations such as Federation of Red Cross and Red Crescent Societies, Indian Red Cross Society (IRCS), Bangladesh Red Crescent Society (BDRCS) and Yuganter to help get the alerts out even to people without smartphones or internet access. We worked closely with the organizations’ local teams who traveled between villages to train locals. The training included deeper explanations on how to read the Google alerts and flood maps, as well as how to act and notify others once an alert is issued.

Our flood forecasting system is now live in all of India and Bangladesh, and we are working to expand these life-saving alerts to countries in South Asia and South America. And eventually, we want them to be available everywhere.

A big step for flood forecasts in India and Bangladesh

For several years, the Google Flood Forecasting Initiative has been working with governments to develop systems that predict when and where flooding will occur—and keep people safe and informed. 

Much of this work is centered on India, where floods are a serious risk for hundreds of millions of people. Today, we’re providing an update on how we’re expanding and improving these efforts, as well as a new partnership we’ve formed with the International Federation of the Red Cross and Red Crescent Societies.

Expanding our forecasting reach

In recent months, we’ve been expanding our forecasting models and services in partnership with the Indian Central Water Commission. In June, just in time for the monsoon season, we reached an important milestone: our systems now extend to the whole of India, with Google technology being used to improve the targeting of every alert the government sends. This means we can help better protect more than 200 million people across more than 250,000 square kilometers—more than 20 times our coverage last year. To date, we’ve sent out around 30 million notifications to people in flood-affected areas. 

In addition to expanding in India, we’ve partnered with the Bangladesh Water Development Board to bring our warnings and services to Bangladesh, which experiences more flooding than any other country in the world. We currently cover more than 40 million people in Bangladesh, and we’re working to extend this to the whole country. 

Flood forecasting map

Coverage areas of our current operational flood forecasting systems. In these areas we use our models to help government alerts reach the right people. In some areas we have also increased lead time and spatial accuracy.

Better protection for vulnerable communities

In collaboration with Yale, we’ve been visiting flood-affected areas and doing research to better understand what information people need, how they use it to protect themselves, and what we can do to make that information more accessible. One survey we conducted found that 65 percent of people who receive flood warnings before the flooding begins take action to protect themselves or their assets (such as evacuating or moving their belongings). But we’ve also found there’s a lot more we could be doing to help—including getting alerts to people faster, and providing additional information about the severity of floods.

pasted image 0 (8).png

Checking how our flood warnings match conditions on the ground. This photo was taken during a field survey in Bihar during monsoon 2019.

This year, we’ve launched a new forecasting model that will allow us to double the lead time of many of our alerts—providing more notice to governments and giving tens of millions of people an extra day or so to prepare. 

We’re providing people with information about flood depth: when and how much flood waters are likely to rise. And in areas where we can produce depth maps throughout the floodplain, we’re sharing information about depth in the user’s village or area.

We’ve also overhauled the way our alerts look and function to make sure they’re useful and accessible for everyone. We now provide the information in different formats, so that people can both read their alerts and see them presented visually; we’ve added support for Hindi, Bengali and seven other local languages; we’ve made the alert more localized and accurate; and we now allow for easy changes to language or location.

flood forecasting alerts.png

Alerts for flood forecasting

Partnering for greater impact 

In addition to improving our alerts, Google.org has started a collaboration with the International Federation of Red Cross and Red Crescent Societies. This partnership aims to build local networks that can get disaster alert information to people who wouldn’t otherwise receive smartphone alerts directly. 

Of course, for all the progress we’ve made with alert technology, there are still a lot of challenges to overcome. With the flood season still in full swing in India and Bangladesh, COVID-19 has delayed critical infrastructure work, added to the immense pressure on first responders and medical authorities, and disrupted the in-person networks that many people still rely on for advance notice when a flood is on the way.

There’s much more work ahead to strengthen the systems that so many vulnerable people rely on—and expand them to reach more people in flood-affected areas. Along with our partners around the world, we will continue developing, maintaining and improving technologies and digital tools to help protect communities and save lives.

Mapping wildfires with the power of satellite data

Ten years ago, I was inside the Google office in Haifa, Israel when the devastating Carmel Mountain fire started blazing not far from us. The team started searching the web to learn more. And while we did find some details confirming what we already knew—a large fire was taking place outside of our door—we experienced a potentially life-impacting information gap. 

This kick-started our journey to build features in Google Search and other products that connect people with high-quality information during crises. A few hours after I took the photo below, we quickly launched a small feature in Search that made it easier for people to find the emergency hotline for the Carmel Mountain fire. Since then, we’ve continued to evolve and expand off this initial launch into the SOS alerts we launched in 2017.

Carmel Mountain Fire.jpg

Carmel Mountain Fire - Photo from Google Office in Haifa, Israel

Connecting people to critical information during active wildfires

Today we’re launching a new wildfire boundary map in Search and Maps SOS alerts in the U.S. to provide deeper insights for areas impacted by an ongoing wildfire. In moments like a growing wildfire, knowing exactly where a blaze is underway and how to avoid it is critical. Using satellite data to create a wildfire boundary map, people will now see the approximate size and location right on their phone or desktop. 

When people look for things like “wildfire in California” or a specific fire like “Kincade fire” in Search, they will be able to see a wildfire’s approximate boundary of the fire, name and location, as well as news articles and helpful resources from local emergency agencies in the SOS alert. 

On Google Maps, people will have access to the same details, including the fire boundary, and receive warnings if they’re approaching an active blaze. If someone is exploring an area near a wildfire on Google Maps, they’ll get an ambient alert that will point them to the latest information.

How we map fires to help keep people safe 

With satellite data from the National Oceanic and Atmospheric Administration’s (NOAA) GOES constellation of satellites and Google Earth Engine’s data analysis capabilities, we’re now able to show the size of a wildfire in near real time, with data being refreshed roughly every hour. NOAA’s satellites include infrared and optical sensors optimized for detecting “hot spots” or large wildfires on the Earth’s surface. We run computations on this data in Earth Engine to identify the affected area.
GOES Apple Fire Time Lapse.gif

Image series showing smoke from the recent Apple Fire in California, captured by GOES-17 satellite.

From there, we create a digital polygon—the red boundary shown on the map in Search and Google Maps—that represents the approximate wildfire impact area. If multiple large fires are active in the same region, people may see several polygons. You can learn more about how we gather, analyze and visualize wildfire data from satellites on our Medium blog.

Wildfire Detection Animation.gif

Using data from NOAA's GOES satellites and Google Earth Engine, we create a digital polygon to represent the approximate wildfire impact area on Search and Google Maps.

Putting this information to work 

This year the National Interagency Fire Center has predicted above normal fire risks for several areas across the U.S. Already, firefighters have confronted large blazes across Northern and Southern California, as well as the Grizzly Creek Fire in Colorado, which led to evacuations and burned thousands of acres. In these situations, having high-quality information at your fingertips matters.

For example, in the recent Apple, Pine Gulch, and Grizzly fires, we quickly identified that the wildfires were rapidly expanding, and dry conditions exacerbated the fire, putting thousands of people at risk. We were able to launch our SOS alerts, with the latest boundary map, on Search and Google Maps.

Wildfire_Mobile.gif


Last year, we piloted this feature in Search for major California wildfires to confirm it was a useful tool for first responders, emergency management personnel and the community. We collaborated with organizations, like the California Governor's Office of Emergency Services (Cal OES) and Boulder’s Office of Emergency Management, to gather expert recommendations on wildfire preparedness and response. Their feedback throughout our 2019 pilot helped identify what information is most useful during emergency situations.

Google works with local agencies to build features that provide critical, accurate information during wildfires.

Google has been involved in crisis response for many years, starting with the Carmel Mountain Fire in Israel in 2010. Since then, we've initiated Public and SOS alerts for hundreds of thousands of crises around the world. From wildfire mapping, to earthquake detection and alerts to flood forecasting, we continue to find new ways for technology to be helpful at the most critical times.

Source: Search


Easier access to web pages: Ask Google Assistant to read it aloud

Think about how much you read on your phone every day: catching up on the news, scanning a new blog, finally reading the article that everyone is talking about. This may require reading a lot of text, which can be a barrier for people with visual or reading difficulties, or who simply need a little help getting through meatier articles.

With Google Assistant, your browser can now read web articles out loud. Whenever a web article is displayed on your browser in your Android phone, you can say, “Hey Google, read it” or “Hey Google, read this page” it will immediately read aloud the content of the web page. To help you follow along, your browser will automatically scroll the page and highlight words as they're read aloud. You can also alter the reading speed and choose from multiple voices. Speaking of which, the web pages are read aloud in expressive and natural voices, aiming to use the same intonation and rhythm that you'd use if you were reading it aloud yourself. 

With Google Assistant, your browser can now read web articles out loud.

If the original content isn’t in your native language, Google Assistant can trigger your browser to read aloud in 42 languages. You can use the translation menu to select the desired language, and all pages will be automatically translated and read out in that language.

Websites don't need to do anything special to enable this functionality. Webmasters that prefer not to use this feature can  use the nopagereadaloud tag. If you’re a developer, you can add the ability for Google Assistant to read aloud content in your mobile app using Actions on Google.

With this new experience, we hope to remove language barriers and help a wide variety of people access information from the web more easily. 


Helping people in a crisis

In times of crisis, access to timely, actionable information is crucial. Working alongside trained responders and volunteers on the ground, technology plays a vital role in providing information to help keep you and loved ones safe and informed. SOS alerts is a new set of features in Google Search and Maps to help you quickly understand what’s going on and decide what to do during a crisis.

How SOS Alerts Work

During a crisis, you may see an SOS Alert at the top of search results when searching for the incident or location. You’ll see maps, top stories and—when available—authoritative local information such as emergency phone numbers, websites, and translations of useful phrases. Depending on how close you are to the affected area, you may also get a notification on your mobile device that directs you to this information.

If you’re outside of the affected area, you may still want information about the crisis. Searches for relevant terms (like the name of the event or the location) will also show an SOS Alert that provides a timely overview of the situation, in addition to features such as donation opportunities.

search-alert_1100px.gif

Google Maps on mobile can also show SOS Alerts. In Maps, you’ll see a specific icon on the map and a tappable card with more information about the crisis, such as helpful phone numbers and websites. The map will also include real-time updates, like road closures and traffic and transit updates.

maps-alert_1100px.gif

As we’ve developed our crisis response products, we’ve worked closely with organizations and government agencies that are on the front lines of relief efforts, including the Red Cross, the Federal Emergency Management Agency, the Philippine Atmospheric, Geophysical and Astronomical Services Administration and many others. “Radio and television were once the only channels to quickly provide information in an emergency, but the internet and mobile phones have become increasingly important,” said Robert Glenn, Director at FEMA.

In addition to SOS Alerts and other crisis response features—including Google Person Finder, Google Crisis Map and Google Public Alerts—our philanthropic arm Google.org provides grants and volunteers for communities impacted by crises. We hope you never need to use crisis response features, but if you do, they’re designed to help keep you, and those you love, safe and informed.

Helping people in a crisis

In times of crisis, access to timely, actionable information is crucial. Working alongside trained responders and volunteers on the ground, technology plays a vital role in providing information to help keep you and loved ones safe and informed. SOS alerts is a new set of features in Google Search and Maps to help you quickly understand what’s going on and decide what to do during a crisis.

How SOS Alerts Work

During a crisis, you may see an SOS Alert at the top of search results when searching for the incident or location. You’ll see maps, top stories and—when available—authoritative local information such as emergency phone numbers, websites, and translations of useful phrases. Depending on how close you are to the affected area, you may also get a notification on your mobile device that directs you to this information.

If you’re outside of the affected area, you may still want information about the crisis. Searches for relevant terms (like the name of the event or the location) will also show an SOS Alert that provides a timely overview of the situation, in addition to features such as donation opportunities.

sos

Google Maps on mobile can also show SOS Alerts. In Maps, you’ll see a specific icon on the map and a tappable card with more information about the crisis, such as helpful phone numbers and websites. The map will also include real-time updates, like road closures and traffic and transit updates.

sos-maps

As we’ve developed our crisis response products, we’ve worked closely with organizations and government agencies that are on the front lines of relief efforts, including the Red Cross, the Federal Emergency Management Agency, the Philippine Atmospheric, Geophysical and Astronomical Services Administration and many others. "Radio and television were once the only channels to quickly provide information in an emergency, but the internet and mobile phones have become increasingly important,” said Robert Glenn, Director at FEMA.

In addition to SOS Alerts and other crisis response features—including Google Person Finder, Google Crisis Map and Google Public Alerts—our philanthropic arm Google.org provides grants and volunteers for communities impacted by crises. We hope you never need to use crisis response features, but if you do, they’re designed to help keep you, and those you love, safe and informed.

Source: Search