As a part of the Webmaster Conference series, last fall we held a Product Summit at Google's headquarters in Mountain View, California. It was slightly different from our previous events, with a number of product managers and engineers from Google Search taking part. We recorded the talks held there, and are happy to be able to make these available to all of you now.

In the playlist you'll find:

• Web deduplication - How does Google recognize duplicate content across the web? What happens once a duplicate is found? How is a canonical URL selected? How does localization play a role?
• Google Images best practices - Take a look at how Google Images has evolved over the years, and learn about some of the best practices that you can implement on your site when it comes to images.
• Rendering - Find out more about rendering, and what it takes to do rendering of the web at scale. Take a look behind the scenes, and learn about some things a site owner could watch out for with regards to rendering.
• Titles, snippets, and result previews - What's the goal of titles, snippets, and previews in Search? How do Google's systems pick and generate a preview for a page? What are some of the elements that help users decide which page to click in Search?
• Googlebot & web hosting - Starting with a look at the popularity of different web servers, and the growth of HTTPS, you'll find out more about how Google's crawling for Search works, and what you can do to control it.
• Claim your Knowledge Panel - Knowledge Panels are a great way for people and organizations to be visible in Search. Find out more about the ways you can claim and update them for yourself or for your business.
• Improving Search over the years - Are dogs the same as cats? Should pages about New York be shown when searching for York? How could algorithms ever figure this out? How many ?'s does it take to get Google's attention? Google's Paul Haahr takes you on a tour of some changes in Search.

We hope you find these videos insightful, useful, and a bit entertaining! And if you are not subscribed to the Webmasters Youtube channel, here’s your chance!

Posted by John Mueller, Search Advocate, Google Switzerland

Due to the COVID-19 outbreak, many organizations and groups are publishing important coronavirus-related announcements that affect our everyday lives.

In response, we're introducing a new way for these special announcements to be highlighted on Google Search. Sites can add SpecialAnnouncement structured data to their web pages or submit a COVID-19 announcement in Search Console.

At first, we’re using this information to highlight announcements in Google Search from health and government agency sites, to cover important updates like school closures or stay-at-home directives.
We are actively developing this feature, and we hope to expand it to include more sites. While we might not immediately show announcements from other types of sites, seeing the markup will help us better understand how to expand this feature.

Please note: beyond special announcements, there are a range of other options that sites can use to highlight information such as canceled events or changes to business hours. You can learn more about these at the end of this post.

How COVID-19 announcements appear in Search 

When SpecialAnnouncement structured data is added to a page, that content can be eligible to appear with a COVID-19 announcement rich result, in addition to the page’s regular snippet description. A COVID-19 announcement rich result can contain a short summary that can be expanded to view more more. Please note that the format may change over time, and you may not see results in Google Search right away.

How to implement your COVID-19 announcements

There are two ways that you can implement your COVID-19 announcements.

RECOMMENDED: Add structured data to your web page

Structured data is a standardized format for providing information about a page and classifying the page content. We recommend using this method because it is the easiest way for us to take in this information, it enables reporting through Search Console in the future, and enables you to make updates. Learn how to add structured data to COVID-19 announcements.

ALTERNATIVE: Submit announcements in Search Console

If you don't have the technical ability or support to implement structured data, you can submit a COVID-19 announcement in Search Console. This tool is still in beta testing, and you may see changes.

This method is not preferred and is intended only as a short-term solution. With structured data, your announcement highlights can automatically update when your pages change. With the tool, you’ll have to manually update announcements. Also, announcements made this way cannot be monitored through special reporting that will be made available through Search Console in the future.

If you do need to submit this way, you'll need to first be verified in Search Console. Then you can submit a COVID-19 announcement:

More COVID-19 resources for sites from Google Search

Beyond special announcements markup, there are other ways you can highlight other types of activities that may be impacted because of COVID-19:

• Best practices for health and government sites: If you are a representative of a health or government website, and you have important information about coronavirus for the general public, here are some recommendations for how to make this information more visible on Google Search.
• Surface your common FAQs: If your site has common FAQs, adding FAQ markup can help Google Search surface your answers.
• Pausing your business online: See our blog post on how to pause your business online in a way that minimizes impacts with Google Search.
• Business hours & temporary closures: Review the guidance from Google My Business on how to change your business hours or indicate temporary closures or how to create COVID-19 posts.
• Events: If you hold events, look over the new properties for marking them virtual, postponed, or canceled.
• Knowledge Panels: Understand how to recommend changes to your Google knowledge panel (or how to claim it, if you haven’t already).
• Fix an overloaded server: Learn how to determine a server's bottleneck, quickly fix the bottleneck, improve server performance, and prevent regressions.

If you have any questions or comments, please let us know on Twitter.

Posted by Lizzi Harvey, Technical Writer, Search Relations, and Danny Sullivan, Public Liaison for Search

Health organizations are busier than ever providing information to help with the COVID-19 pandemic. To better assist them, Google has created a best practices article to guide health organizations to make COVID-19 information more accessible on Search. We’ve also created a new technical support group for eligible health organizations.

Best practices for search visibility

By default, Google tries to show the most relevant, authoritative information in response to any search. This process is more effective when content owners help Google understand their content in appropriate ways.

To better guide health-related organizations in this process (known as SEO, for "search engine optimization"), we have produced a new help center article with some important best practices, with emphasis on health information sites, including:

• How to help users access your content on the go
• The importance of good page content and titles
• Ways to check how your site appears for coronavirus-related queries
• How to analyze the top coronavirus related user queries
• How to add structured data for FAQ content

New support group for health organizations

In addition to our best practices help page, health organizations can take part in our new technical support group that's focused on helping health organizations who publish COVID-19 information with Search related questions.

We’ll be approving requests for access on a case-by-case basis. At first we’ll be accepting only domains under national health ministries and US state level agencies. We'll inform of future expansions here in this blog post, and on our Twitter account. You’ll need to register using either an email under those domains (e.g. [email protected]) or have access to the website Search Console account.

Fill this form to request access to the COVID-19 Google Search group 

The group was created to respond to the current needs of health organizations, and we intend to deprecate the group as soon as COVID-19 is no longer considered a Public Health Emergency by WHO or some similar deescalation is widely in place.

Everyone is welcome to use our existing webmaster help forum, and if you have any questions or comments, please let us know on Twitter.

Posted by Daniel Waisberg, Search Advocate & Ofir Roval, Search Console Lead PM

As the effects of the coronavirus grow, we've seen businesses around the world looking for ways to pause their activities online. With the outlook of coming back and being present for your customers, here's an overview of our recommendations of how to pause your business online and minimize impacts with Google Search. These recommendations are applicable to any business with an online presence, but particularly for those who have paused the selling of their products or services online. For more detailed information, also check our developer documentation.

Recommended: limit site functionality

If your situation is temporary and you plan to reopen your online business, we recommend keeping your site online and limiting the functionality. For example, you might mark items as out of stock, or restrict the cart and checkout process. This is the recommended approach since it minimizes any negative effects on your site's presence in Search. People can still find your products, read reviews, or add wishlists so they can purchase at a later time.

It's also a good practice to:

• Disable the cart functionality: Disabling the cart functionality is the simplest approach, and doesn't change anything for your site's visibility in Search.
  
• Tell your customers what's going on: Display a banner or popup div with appropriate information for your users, so that they're aware of the business's status. Mention any known and unusual delays, shipping times, pick-up or delivery options, etc. upfront, so that users continue with the right expectations. Make sure to follow our guidelines on popups and banners.
  
• Update your structured data: If your site uses structured data (such as Products, Books, Events), make sure to adjust it appropriately (reflecting the current product availability, or changing events to cancelled). If your business has a physical storefront, update Local Business structured data to reflect current opening hours.
  
• Check your Merchant Center feed: If you use Merchant Center, follow the best practices for the availability attribute.
  
• Tell Google about your updates: To ask Google to recrawl a limited number of pages (for example, the homepage), use Search Console. For a larger number of pages (for example, all of your product pages), use sitemaps.

For more information, check our developers documentation.

Not recommended: disabling the whole website

As a last resort, you may decide to disable the whole website. This is an extreme measure that should only be taken for a very short period of time (a few days at most), as it will otherwise have significant effects on the website in Search, even when implemented properly. That’s why it’s highly recommended to only limit your site's functionality instead. Keep in mind that your customers may also want to find information about your products, your services, and your company, even if you're not selling anything right now.

If you decide that you need to do this (again, which we don't recommend), here are some options:

• If you need to urgently disable the site for 1-2 days, then return an informational error page with a 503 HTTP result code instead of all content. Make sure to follow the best practices for disabling a site.
  
• If you need to disable the site for a longer time, then provide an indexable homepage as a placeholder for users to find in Search by using the 200 HTTP status code.
  
• If you quickly need to hide your site in Search while you consider the options, you can temporarily remove it from Search.

For more information, check our developers documentation.

Proceed with caution: To elaborate why we don't recommend disabling the whole website, here are some of the side effects:

• Your customers won't know what's happening with your business if they can't find your business online at all.
  
• Your customers can't find or read first-hand information about your business and its products & services. For example, reviews, specs, past orders, repair guides, or manuals won't be findable. Third-party information may not be as correct or comprehensive as what you can provide. This often also affects future purchase decisions.
  
• Knowledge Panels may lose information, like contact phone numbers and your site's logo.
  
• Search Console verification will fail, and you will lose all access to information about your business in Search. Aggregate reports in Search Console will lose data as pages are dropped from the index.
  
• Ramping back up after a prolonged period of time will be significantly harder if your website needs to be reindexed first. Additionally, it's uncertain how long this would take, and whether the site would appear similarly in Search afterwards.

Other things to consider

Beyond the operation of your web site, there are other actions you might want to take to pause your online business in Google Search:

• If you hold events, look over the new properties for making them virtual, postponed or canceled.
  
• Review the guidance from Google My Business on how to change your business hours or indicate temporary closures.
  
• Review the resources from Google for Small Business on how to communicate with customers and employees, for working remotely and modifying advertising campaigns.
  
• Understand how to recommend changes to your Google knowledge panel (or how to claim it, if you haven’t already).

Also be sure to keep up with the latest by following updates on Twitter from Google Webmasters at @GoogleWMC and Google My Business at @GoogleMyBiz.

FAQs

What if I only close the site for a few weeks?

Completely closing a site even for just a few weeks can have negative consequences on Google's indexing of your site. We recommend limiting the site functionality instead. Keep in mind that users may also want to find information about your products, your services, and your company, even if you're currently not selling anything.

What if I want to exclude all non-essential products?

That's fine. Make sure that people can't buy the non-essential products by limiting the site functionality.

Can I ask Google to crawl less during this time?

Yes, you can limit crawling with Search Console, though it's not recommended for most cases. This may have some impact on the freshness of your results in Search. For example, it may take longer for Search to reflect that all of your products are currently not available. On the other hand, if Googlebot's crawling causes critical server resource issues, this is a valid approach. We recommend setting a reminder for yourself to reset the crawl rate once you start planning to go back in business.

How do I get a page indexed or updated quickly?

To ask Google to recrawl a limited number of pages (for example, the homepage), use Search Console. For a larger number of pages (for example, all of your product pages), use sitemaps.

What if I block a specific region from accessing my site?

Google generally crawls from the US, so if you block the US, Google Search generally won't be able to access your site at all. We don't recommend that you block an entire region from temporarily accessing your site; instead, we recommend limiting your site's functionality for that region.

Should I use the Removals Tool to remove out-of-stock products?

No. People won't be able to find first-hand information about your products on Search, and there might still be third-party information for the product that may be incorrect or incomplete. It's better to still allow that page, and mark it out of stock. That way people can still understand what's going on, even if they can't purchase the item. If you remove the product from Search, people don't know why it's not there.

--------

We realize that any business closure is a big and stressful step, and not everyone will know what to do. If you notice afterwards that you could have done something differently, everything's not lost: we try to make our systems robust so that your site will be back in Search as quickly as possible. Like you, we're hoping that this crisis finds an end as soon as possible. We hope that with this information, you're able to have your online business up & running quickly when that time comes. Should you run into any problems or questions along the way, please don't hesitate to use our public channels to get help.

Posted by John Mueller, working from home in Zurich, Switzerland

In the current environment and status of COVID-19 around the world, many events are being canceled, postponed, or moved to an online-only format. Google wants to show users the latest, most accurate information about your events in this fast-changing environment, and so we've added some new, optional properties to our developer documentation to help. These properties apply to all regions and languages. This is one part of our overall efforts in schema updates to support publishers and users. Here are some important tips on keeping Google up to date on your events.

Update the status of the event

The schema.org eventStatus property sets the status of the event, particularly when the event has been canceled, postponed, or rescheduled. This information is helpful because it allows Google to show users the current status of an event, instead of dropping the event from the event search experience altogether.

• If the event has been canceled: Set the eventStatus property to EventCancelled and keep the original date in the startDate of the event.
• If the event has been postponed (but the date isn't known yet): Keep the original date in the startDate of the event until you know when the event will take place and update the eventStatus to EventPostponed. The startDate property is required to help identify the unique event, and we need the date original startDate until you know the new date. Once you know the new date information, change the eventStatus to EventRescheduled and update the startDate and endDate with the new date information.
• If the event has been rescheduled to a later date: Update the startDate and endDate with the relevant new dates. Optionally, you can also mark the eventStatus field as EventRescheduled and add the previousStartDate.
• If the event has moved from in-person to online-only: Optionally update the eventStatus field to indicate the change with EventMovedOnline. 

For more information on how to implement the eventStatus property, refer to the developer documentation.

Mark events as online only

More events are shifting to online only, and we're actively working on a way to show this information to people on Google Search. If your event is happening only online, make sure to use the following properties:

• Set the location to the VirtualLocation type.
• Set the eventAttendanceMode property to OnlineEventAttendanceMode.

For more information on how to implement the VirtualLocation type, refer to the developer documentation.
Note: You can start using VirtualLocation and eventAttendanceMode even though they are still under development on Schema.org.

Update Google when your event changes

After you make changes to your markup, make sure you update Google. We recommend that you make your sitemap available automatically through your server. This is the best way to make sure that your new and updated content is highlighted to search engines as quickly as possible.
If you have any questions, let us know through the Webmasters forum or on Twitter.
Posted by Emily Fifer, Event Search Product Manager

Last year we organized Webmaster Conference events in over 15 countries. The spirit of WMConf is reflected in that number: we want to reach regions that otherwise don't get much search conference love. Recently we have been monitoring the coronavirus (COVID-19) situation and its impact on planning this year's events.

To wit, with the growing concern around coronavirus and in line with the travel guidelines published by WHO, the CDC, and other organizations, we are postponing all Webmaster Conference events globally. While we're hoping to organize events later this year, we're also exploring other ways to reach targeted audiences.

We’re very sorry to delay the opportunity to connect in person, but we feel strongly that the safety and health of all attendees is the priority at this time. If you want to get notified about future events in your region, you can sign up to receive updates on the Webmaster Conference site. If you have questions or comments, catch us on Twitter!

Posted by Cherry Prommawin and Gary

It's been a few years now that Google started working on mobile-first indexing - Google's crawling of the web using a smartphone Googlebot. From our analysis, most sites shown in search results are good to go for mobile-first indexing, and 70% of those shown in our search results have already shifted over. To simplify, we'll be switching to mobile-first indexing for all websites starting September 2020. In the meantime, we'll continue moving sites to mobile-first indexing when our systems recognize that they're ready.

When we switch a domain to mobile-first indexing, it will see an increase in Googlebot's crawling, while we update our index to your site's mobile version. Depending on the domain, this change can take some time. Afterwards, we'll still occasionally crawl with the traditional desktop Googlebot, but most crawling for Search will be done with our mobile smartphone user-agent. The exact user-agent name used will match the Chromium version used for rendering.  

In Search Console, there are multiple ways to check for mobile-first indexing. The status is shown on the settings page, as well as in the URL Inspection Tool, when checking a specific URL with regards to its most recent crawling.

Our guidance on making all websites work well for mobile-first indexing continues to be relevant, for new and existing sites. In particular, we recommend making sure that the content shown is the same (including text, images, videos, links), and that meta data (titles and descriptions, robots meta tags) and all structured data is the same. It's good to double-check these when a website is launched or significantly redesigned. In the URL Testing Tools you can easily check both desktop and mobile versions directly. If you use other tools to analyze your website, such as crawlers or monitoring tools, use a mobile user-agent if you want to match what Google Search sees. 

While we continue to support various ways of making mobile websites, we recommend responsive web design for new websites. We suggest not using separate mobile URLs (often called "m-dot") because of issues and confusion we've seen over the years, both from search engines and users. 

Mobile-first indexing has come a long way. It's great to see how the web has evolved from desktop to mobile, and how webmasters have helped to allow crawling & indexing to match how users interact with the web! We appreciate all your work over the years, which has helped to make this transition fairly smooth. We’ll continue to monitor and evaluate these changes carefully. If you have any questions, please drop by our Webmaster forums or our public events.

Posted by John Mueller, Developer Advocate, Google Zurich

Having up-to-date information during large, public events is critical, as the landscape changes by the minute. This guide highlights some tools that news publishers can use to create a data rich and engaging experience for their users.

Add Article structured data to AMP pages

Adding Article structured data to your news, blog, and sports article AMP pages can make the content eligible for an enhanced appearance in Google Search results. Enhanced features may include placement in the Top stories carousel, host carousel, and Visual stories. Learn how to mark up your article.
You can now test and validate your AMP article markup in the Rich Results Test tool. Enter your page’s URL or a code snippet, and the Rich Result Test shows the AMP Articles that were found on the page (as well as other rich result types), and any errors or suggestions for your AMP Articles. You can also save the test history and share the test results.
We also recommend that you provide a publication date so that Google can expose this information in Search results, if this information is considered to be useful to the user.

Mark up your live-streaming video content

If you are live-streaming a video during an event, you can be eligible for a LIVE badge by marking your video with BroadcastEvent. We strongly recommend that you use the Indexing API to ensure that your live-streaming video content gets crawled and indexed in a timely way. The Indexing API allows any site owner to directly notify Google when certain types of pages are added or removed. This allows Google to schedule pages for a fresh crawl, which can lead to more relevant user traffic as your content is updated. For websites with many short-lived pages like livestream videos, the Indexing API keeps content fresh in search results. Learn how to get started with the Indexing API.

For AMP pages: Update the cache and use components

Use the following to ensure your AMP content is published and up-to-date the moment news breaks.

Update the cache

When people click an AMP page, the Google AMP Cache automatically requests updates to serve fresh content for the next person once the content has been cached. However, if you want to force an update to the cache in response to a change in the content on the origin domain, you can send an update request to the Google AMP Cache. This is useful if your pages are changing in response to a live news event.

Use news-related AMP components

• <amp-live-list>: Add live content to your article and have it updated based on a source document. This is a great choice if you just want content to reload easily, without having to set up or configure additional services on your backend. Learn how to implement <amp-live-list>.
• <amp-script>: Run your own JavaScript inside of AMP pages. This flexibility means that anything you are publishing on your desktop or non-AMP mobile pages, you can bring over to AMP. <amp-script> supports Websockets, interactive SVGs, and more. This allows you to create engaging news pages like election coverage maps, live graphs and polls etc. As a newer feature, the AMP team is actively soliciting feedback on it. If for some reason it doesn't work for your use case, let us know.

If you have any questions, let us know through the forum or on Twitter.

Posted by Patrick Kettner and Naina Raisinghani, AMP team

We have heard users ask for better download capabilities in Search Console loud and clear - so we’re happy to let you know that more and better data is available to export.

You’ll now be able to download the complete information you see in almost all Search Console reports (instead of just specific table views). We believe that this data will be much easier to read outside SC and store it for your future reference (if needed). You’ll find a section at the end of this post describing other ways to use your Search Console data outside the tool.

Enhancement reports and more 

When exporting data from a report, for example AMP status, you’ll now be able to export the data behind the charts, not only the details table (as previously). This means that in addition to the list of issues and their affected pages, you’ll also see a daily breakdown of your pages, their status, and impressions received by them on Google Search results. If you are exporting data from a specific drill-down view, you can see the details describing this view in the exported file.

If you choose Google Sheets or Excel (new!) you’ll get a spreadsheet with two tabs, and if you choose to download as csv, you’ll get a zip file with two csv files.

Here is a sample dataset downloaded from the AMP status report. We changed the titles of the spreadsheet to be descriptive for this post, but the original title includes the domain name, the report, and the date of the export.

Performance report 

When it comes to Performance data, we have two improvements:

1. You can now download the content of all tabs with one click. This means that you’ll now get the data on Queries, Pages, Countries, Devices, Search appearances and Dates, all together. The download output is the same as explained above, Google sheets or Excel spreadsheet with multiple tabs and csv files compressed in a zip file.
2. Along with the performance data, you’ll have an extra tab (or csv file) called “Filters”, which shows which filters were applied when the data was exported.

Here is a sample dataset downloaded from the Performance report.

Additional ways to use Search Console data outside the tool

Since we’re talking about exporting data, we thought we’d take the opportunity to talk about other ways you can currently use Search Console data outside the tool. You might want to do this if you have a specific use case that is important to your company, such as joining the data with another dataset, performing an advanced analysis, or visualizing the data in a different way.

There are two options, depending on the data you want and your technical level.

Search Console API

If you have a technical background, or a developer in your company can help you, you might consider using the Search Console API  to view, add, or remove properties and sitemaps, and to run advanced queries for Google Search results data.

We have plenty of documentation on the subject, but here are some links that might be useful to you if you’re starting now:

1. The Overview and prerequisites guide walks you through the things you should do before writing your first client application. You’ll also find more advanced guides in the sidebar of this section, for example a guide on how to query all your search data.
2. The reference section provides details on query parameters, usage limits and errors returned by the API.
3. The API samples provides links to sample code for several programming languages, a great way to get up and running.

Google Data Studio

Google Data Studio is a dashboarding solution that helps you unify data from different data sources, explore it, and tell impactful data stories. The tool provides a Search Console connector to import various metrics and dimensions into your dashboard. This can be valuable if you’d like to see Search Console data side-by-side with data from other tools.

If you’d like to give it a try, you can use this template to visualize your data - click “use template” at the top right corner of the page to connect to your data. To learn more about how to use the report and which insights you might find in it, check this step-by-step guide. If you just want to play with it, here’s a report based on that template with sample data.



 Let us know on Twitter if you have interesting use cases or comments about the new download capabilities, or about using Search Console data in general. And enjoy the enhanced data!

Posted by Sion Schori & Daniel Waisberg, Search Console team