Tag Archives: Google Assistant
Announcing OAuth-based App Flip for Actions
Posted by Toni Klopfenstein, Developer Advocate
Easy account linking helps create more helpful user experiences with Google Assistant and your products and services. Today, we are launching OAuth-based App Flip, a new feature to help you build a better mobile account linking experience. App Flip allows your users to seamlessly link their accounts to Google without having to re-enter their credentials if they have already signed in to your app on their device. This streamlined authorization flow helps minimize users dropping out of the account linking process, and makes it easier for users to integrate your smart devices into their smart homes. This feature is now available for all Smart Home Actions and is available in beta for other Conversational Actions.
When App Flip is implemented within your application, the Google Assistant or Google Home app automatically flips to your app when users initiate the account linking process. Once users consent to link their accounts, your app then requests an authorization code from your server, and Google handles the remainder of the account linking flow.

Account Linking Flows
By flipping directly to your local app, users can skip logging in again and can simply choose to link their accounts.
You can implement App Flip by enabling your app to accept a deep link that allows Google to connect. We also have test tools available for both Android and iOS to help you verify your app integration with App Flip.
For more details on how to use App Flip with your integration, check out the docs, or the sample Android and iOS apps. For Conversational Actions, please sign up for the Beta program.
We want to hear from you, so continue sharing your feedback with us, and engage with other Action developers in the /r/GoogleAssistantDev community. Follow @ActionsOnGoogle on Twitter for more of our team's updates, and tweet using #AoGDevs to share what you’re working on. We can’t wait to see what you build!
Source: Google Developers Blog
“Hey Google, make a group call” now on Nest Hub Max
One of the most popular ways people use Nest Hub Max is for video calling. Up until now, that meant one-on-one sessions with friends and family. Rolling out today in the U.S., you can make group video calls with Duo and Google Meet on your Hub Max. With just a simple voice command, Google Assistant can now help connect you with multiple people at once.
“Hey Google, make a group call”
With group video calling on Nest Hub Max, you can now bring the whole family together, spontaneously check in with your siblings or host a weekly happy hour with friends for up to 32 people. To get started, you can create groups in the Duo mobile app, and from there just ask your Hub Max, “Hey Google, make a group call,” and tap on the Duo group you want to connect with. And with auto-framing, you can freely move around your kitchen or living room during your Duo video call, while staying in view. In addition to Nest Hub Max, Duo group video calling is available on LG XBOOM AI ThinQ WK9 Smart Display, JBL Link View and Lenovo’s 8 inch and 10 inch Smart Displays.
“Hey Google, join my next meeting”
You can also try, “Hey Google, start a meeting” to connect with up to 100 people on Google Meet for fitness classes, book clubs, community gatherings or whatever else you’ve got planned. If you want to call into a meeting, say "Hey Google, join a meeting" then tap the "enter a meeting code" option and type it in to join. Or try asking, “Hey Google, join my next meeting” to instantly connect to the next call on your personal Google Calendar. Meet group video calling is launching first on Nest Hub Max.
We’re also rolling out beta support for G Suite accounts, so you can host work meetings on your personal Nest Hub Max. G Suite admins who would like to apply on behalf of their domains to join the beta program can sign up at g.co/gsuiteassistantbeta.
And if you’re looking to put your personal VIPs on “speed dial,” household contacts are starting to roll out today on Google Assistant-enabled smart speakers and Smart Displays in the U.S. Once set up, you (or other people in your household) can dial your cousin Cassandra by saying "Hey Google, call Cassandra” or by tapping on Cassandra’s name on your Smart Display's household contacts list.
Google Assistant and Nest have always made it easy to connect with friends and family—and now, the more the merrier.
Source: The Official Google Blog
“Hey Google, make a group call” now on Nest Hub Max
One of the most popular ways people use Nest Hub Max is for video calling. Up until now, that meant one-on-one sessions with friends and family. Rolling out today in the U.S., you can make group video calls with Duo and Google Meet on your Hub Max. With just a simple voice command, Google Assistant can now help connect you with multiple people at once.
“Hey Google, make a group call”
With group video calling on Nest Hub Max, you can now bring the whole family together, spontaneously check in with your siblings or host a weekly happy hour with friends for up to 32 people. To get started, you can create groups in the Duo mobile app, and from there just ask your Hub Max, “Hey Google, make a group call,” and tap on the Duo group you want to connect with. And with auto-framing, you can freely move around your kitchen or living room during your Duo video call, while staying in view. In addition to Nest Hub Max, Duo group video calling is available on LG XBOOM AI ThinQ WK9 Smart Display, JBL Link View and Lenovo’s 8 inch and 10 inch Smart Displays.
“Hey Google, join my next meeting”
You can also try, “Hey Google, start a meeting” to connect with up to 100 people on Google Meet for fitness classes, book clubs, community gatherings or whatever else you’ve got planned. If you want to call into a meeting, say "Hey Google, join a meeting" then tap the "enter a meeting code" option and type it in to join. Or try asking, “Hey Google, join my next meeting” to instantly connect to the next call on your personal Google Calendar. Meet group video calling is launching first on Nest Hub Max.
We’re also rolling out beta support for G Suite accounts, so you can host work meetings on your personal Nest Hub Max. G Suite admins who would like to apply on behalf of their domains to join the beta program can sign up at g.co/gsuiteassistantbeta.
And if you’re looking to put your personal VIPs on “speed dial,” household contacts are starting to roll out today on Google Assistant-enabled smart speakers and Smart Displays in the U.S. Once set up, you (or other people in your household) can dial your cousin Cassandra by saying "Hey Google, call Cassandra” or by tapping on Cassandra’s name on your Smart Display's household contacts list.
Google Assistant and Nest have always made it easy to connect with friends and family—and now, the more the merrier.
Source: The Official Google Blog
“Hey Google, make a group call” now on Nest Hub Max
One of the most popular ways people use Nest Hub Max is for video calling. Up until now, that meant one-on-one sessions with friends and family. Rolling out today in the U.S., you can make group video calls with Duo and Google Meet on your Hub Max. With just a simple voice command, Google Assistant can now help connect you with multiple people at once.
“Hey Google, make a group call”
With group video calling on Nest Hub Max, you can now bring the whole family together, spontaneously check in with your siblings or host a weekly happy hour with friends for up to 32 people. To get started, you can create groups in the Duo mobile app, and from there just ask your Hub Max, “Hey Google, make a group call,” and tap on the Duo group you want to connect with. And with auto-framing, you can freely move around your kitchen or living room during your Duo video call, while staying in view. In addition to Nest Hub Max, Duo group video calling is available on LG XBOOM AI ThinQ WK9 Smart Display, JBL Link View and Lenovo’s 8 inch and 10 inch Smart Displays.
“Hey Google, join my next meeting”
You can also try, “Hey Google, start a meeting” to connect with up to 100 people on Google Meet for fitness classes, book clubs, community gatherings or whatever else you’ve got planned. If you want to call into a meeting, say "Hey Google, join a meeting" then tap the "enter a meeting code" option and type it in to join. Or try asking, “Hey Google, join my next meeting” to instantly connect to the next call on your personal Google Calendar. Meet group video calling is launching first on Nest Hub Max.
We’re also rolling out beta support for G Suite accounts, so you can host work meetings on your personal Nest Hub Max. G Suite admins who would like to apply on behalf of their domains to join the beta program can sign up at g.co/gsuiteassistantbeta.
And if you’re looking to put your personal VIPs on “speed dial,” household contacts are starting to roll out today on Google Assistant-enabled smart speakers and Smart Displays in the U.S. Once set up, you (or other people in your household) can dial your cousin Cassandra by saying "Hey Google, call Cassandra” or by tapping on Cassandra’s name on your Smart Display's household contacts list.
Google Assistant and Nest have always made it easy to connect with friends and family—and now, the more the merrier.
Source: The Official Google Blog
Nest and Spotify are bringing you the sounds of summer
My favorite part of summertime is that it means music festival season is upon us. For me, there’s nothing better than getting together with all my friends and listening to our favorite bands on a warm, sunny day. This year, the festivals will have to wait, and while I’ll miss the jam-packed action of a live show, thankfully I have a back up system powered by Spotify, and Nest and Google Home smart speakers and displays.
Nest Mini, Nest Hub, Nest Hub Max and Google Home Max, to name a few, all work together to build a sound system that can cover your whole home. Plus, Spotify Premium users can ask Google Assistant to recommend some music and Google Assistant will offer multiple choices from artists and genres that they like, and others like them to choose from.
Obviously, I’m not the only one curating my own concerts at home: Here’s a look at how some of you have been listening to Spotify on Nest and Google Home devices.
Quarantine streams
Spotify shared how people have been listening to Spotify on Nest and Google Home smart speakers and displays between May 10 and June 10 of this year, in all parts of the world where both Spotify and our devices are available. Suffice it to say that quarantine apparently has many of us in our feelings, with Drake as the top-streamed artist on Nest devices. And given the stress of 2020, it's no surprise the top playlists are all related to sleep and relaxation. In fact, Google Trends backed up Spotify’s data , showing that searches for “insomnia” reached an all-time high in April of this year.

We also took a look at Google Trends to see which of the three top artists are being searched the most by country, which you can see below.

Songs of summer
Summer couldn’t come soon enough. According to Google Trends, searches for “summertime songs” spiked more than 1,150 percent and searches for “songs that remind you of summer” spiked more than 1,000 percent in the past 90 days worldwide. Thankfully, Spotify can help listeners land on a summer jam.
Spanning a variety of genres—from hip-hop to indie—Spotify’s Songs of Summer predictions are based on a number of factors like streaming numbers, current trajectory and future forecasting from their global curation team. This year, the team at Spotify predicts that “This is America” by Childish Gambino and “Alright” by Kendrick Lamar are likely to be mainstays during summer 2020. The resurgence of these older tracks is likely due to cultural conversations focused on supporting the Black community. In fact, global Google Trends searches for the meaning of “This is America,” by Childish Gambino spiked more than 700 percent over the past month.
In no particular order, here’s Spotify’s playlist of predictions for summer 2020, which you can stream on your Nest device by saying, “Hey Google, play Songs of Summer.” The playlist includes current hits like “ROCKSTAR” by DaBaby, featuring Roddy Ricch and “Watermelon Sugar” by Harry Styles.
Your Summer Rewind playlist from Spotify
This year, it feels especially important to relive the glory of summers past. To help, Spotify is re-introducing Your Summer Rewind, a personalized collection of your favorite summer jams from previous years. It will be available in all of Spotify’s Northern Hemisphere markets for both Free and Premium listeners on iOS and Android starting today. Make sure your Spotify account is linked in the Google Home app and say, “Hey Google, play Your Summer Rewind playlist on Spotify” to get started.
I’m sure I’m not the only one who will be missing music festivals this year, but Nest and Spotify will certainly help me party at home, and cure some of my quarantine woes this summer.
Source: The Official Google Blog
Nest and Spotify are bringing you the sounds of summer
My favorite part of summertime is that it means music festival season is upon us. For me, there’s nothing better than getting together with all my friends and listening to our favorite bands on a warm, sunny day. This year, the festivals will have to wait, and while I’ll miss the jam-packed action of a live show, thankfully I have a back up system powered by Spotify, and Nest and Google Home smart speakers and displays.
Nest Mini, Nest Hub, Nest Hub Max and Google Home Max, to name a few, all work together to build a sound system that can cover your whole home. Plus, Spotify Premium users can ask Google Assistant to recommend some music and Google Assistant will offer multiple choices from artists and genres that they like, and others like them to choose from.
Obviously, I’m not the only one curating my own concerts at home: Here’s a look at how some of you have been listening to Spotify on Nest and Google Home devices.
Quarantine streams
Spotify shared how people have been listening to Spotify on Nest and Google Home smart speakers and displays between May 10 and June 10 of this year, in all parts of the world where both Spotify and our devices are available. Suffice it to say that quarantine apparently has many of us in our feelings, with Drake as the top-streamed artist on Nest devices. And given the stress of 2020, it's no surprise the top playlists are all related to sleep and relaxation. In fact, Google Trends backed up Spotify’s data , showing that searches for “insomnia” reached an all-time high in April of this year.

We also took a look at Google Trends to see which of the three top artists are being searched the most by country, which you can see below.

Songs of summer
Summer couldn’t come soon enough. According to Google Trends, searches for “summertime songs” spiked more than 1,150 percent and searches for “songs that remind you of summer” spiked more than 1,000 percent in the past 90 days worldwide. Thankfully, Spotify can help listeners land on a summer jam.
Spanning a variety of genres—from hip-hop to indie—Spotify’s Songs of Summer predictions are based on a number of factors like streaming numbers, current trajectory and future forecasting from their global curation team. This year, the team at Spotify predicts that “This is America” by Childish Gambino and “Alright” by Kendrick Lamar are likely to be mainstays during summer 2020. The resurgence of these older tracks is likely due to cultural conversations focused on supporting the Black community. In fact, global Google Trends searches for the meaning of “This is America,” by Childish Gambino spiked more than 700 percent over the past month.
In no particular order, here’s Spotify’s playlist of predictions for summer 2020, which you can stream on your Nest device by saying, “Hey Google, play Songs of Summer.” The playlist includes current hits like “ROCKSTAR” by DaBaby, featuring Roddy Ricch and “Watermelon Sugar” by Harry Styles.
Your Summer Rewind playlist from Spotify
This year, it feels especially important to relive the glory of summers past. To help, Spotify is re-introducing Your Summer Rewind, a personalized collection of your favorite summer jams from previous years. It will be available in all of Spotify’s Northern Hemisphere markets for both Free and Premium listeners on iOS and Android starting today. Make sure your Spotify account is linked in the Google Home app and say, “Hey Google, play Your Summer Rewind playlist on Spotify” to get started.
I’m sure I’m not the only one who will be missing music festivals this year, but Nest and Spotify will certainly help me party at home, and cure some of my quarantine woes this summer.
Source: The Official Google Blog
Nest and Spotify are bringing you the sounds of summer
My favorite part of summertime is that it means music festival season is upon us. For me, there’s nothing better than getting together with all my friends and listening to our favorite bands on a warm, sunny day. This year, the festivals will have to wait, and while I’ll miss the jam-packed action of a live show, thankfully I have a back up system powered by Spotify, and Nest and Google Home smart speakers and displays.
Nest Mini, Nest Hub, Nest Hub Max and Google Home Max, to name a few, all work together to build a sound system that can cover your whole home. Plus, Spotify Premium users can ask Google Assistant to recommend some music and Google Assistant will offer multiple choices from artists and genres that they like, and others like them to choose from.
Obviously, I’m not the only one curating my own concerts at home: Here’s a look at how some of you have been listening to Spotify on Nest and Google Home devices.
Quarantine streams
Spotify shared how people have been listening to Spotify on Nest and Google Home smart speakers and displays between May 10 and June 10 of this year, in all parts of the world where both Spotify and our devices are available. Suffice it to say that quarantine apparently has many of us in our feelings, with Drake as the top-streamed artist on Nest devices. And given the stress of 2020, it's no surprise the top playlists are all related to sleep and relaxation. In fact, Google Trends backed up Spotify’s data , showing that searches for “insomnia” reached an all-time high in April of this year.

We also took a look at Google Trends to see which of the three top artists are being searched the most by country, which you can see below.

Songs of summer
Summer couldn’t come soon enough. According to Google Trends, searches for “summertime songs” spiked more than 1,150 percent and searches for “songs that remind you of summer” spiked more than 1,000 percent in the past 90 days worldwide. Thankfully, Spotify can help listeners land on a summer jam.
Spanning a variety of genres—from hip-hop to indie—Spotify’s Songs of Summer predictions are based on a number of factors like streaming numbers, current trajectory and future forecasting from their global curation team. This year, the team at Spotify predicts that “This is America” by Childish Gambino and “Alright” by Kendrick Lamar are likely to be mainstays during summer 2020. The resurgence of these older tracks is likely due to cultural conversations focused on supporting the Black community. In fact, global Google Trends searches for the meaning of “This is America,” by Childish Gambino spiked more than 700 percent over the past month.
In no particular order, here’s Spotify’s playlist of predictions for summer 2020, which you can stream on your Nest device by saying, “Hey Google, play Songs of Summer.” The playlist includes current hits like “ROCKSTAR” by DaBaby, featuring Roddy Ricch and “Watermelon Sugar” by Harry Styles.
Your Summer Rewind playlist from Spotify
This year, it feels especially important to relive the glory of summers past. To help, Spotify is re-introducing Your Summer Rewind, a personalized collection of your favorite summer jams from previous years. It will be available in all of Spotify’s Northern Hemisphere markets for both Free and Premium listeners on iOS and Android starting today. Make sure your Spotify account is linked in the Google Home app and say, “Hey Google, play Your Summer Rewind playlist on Spotify” to get started.
I’m sure I’m not the only one who will be missing music festivals this year, but Nest and Spotify will certainly help me party at home, and cure some of my quarantine woes this summer.
Source: The Official Google Blog
Voice Global 2020: New improvements to core platform and development tools for Google Assistant
Posted by Payam Shodjai, Director of Product Management, Google Assistant
Today at VOICE Global, we shared our vision for Google Assistant to truly be the best way to get things done - and the important role that developers play in that vision, especially as voice experiences continue to evolve.
Google Assistant helps more than 500 million people every month in over 30 languages across 90 countries get things done at home and on the go. What’s at the heart of this growth is the simple insight that people want a more natural way to get what they need. That’s why we’ve invested heavily in making sure Google Assistant works seamlessly across devices and services and offers quick and accurate help.
Over the last few months, we’ve seen people’s needs shifting, and this is reflected in how Google Assistant is being used and the role that it can play to help navigate these changes. For example, to help people get accurate information on Search and Maps - like modified store hours or information on pick-up and delivery - we have been using Duplex conversational technology to contact businesses and update over half a million business listings.
We’ve also been working with our partners to bring great educational experiences into the home, so that families can continue learning in a communal setting. Bamboo Learning is bringing their voice-forward education platform to Google Assistant, with fun, new ways to learn history, math, and reading. Our hand-washing songs continue to be popular. The songs leverage WaveNet's natural expressiveness – allowing us to train Google Assistant to sing across numerous generated voices users can pick from.
Building Google Assistant experiences gets easier
Great experiences are at the core of what makes Google Assistant truly helpful. To help existing and aspiring developers build new experiences with ease, we are making some major improvements to our core platform and development tools. Rather than needing to hop back and forth between Actions Console and Dialogflow to build an Action, wouldn’t it be great if there were one integrated platform for building on Google Assistant?
Starting today, we’re releasing Actions Builder, a new web-based IDE that provides a graphical interface to show the entire conversation flow. It allows you to manage Natural Language Understanding (NLU) training data and provides advanced debugging tools. And, it is fully integrated into the Actions Console so you can now build, debug, test, release, and analyze your Actions - all in one place.
If you prefer to work in your own tools, you can use the updated Actions SDK. For the first time, you’ll have a file based representation of your action and the ability to use a local IDE. The SDK not only enables local authoring of NLU and conversation schemas, but it also allows bulk import and export of training data to improve conversation quality. The Actions SDK is accompanied by a command line interface, so you can build and manage an action fully in code using your favorite source control and continuous integration tools.
With these two releases, we are also introducing a new conversation model and improvements to the runtime engine. Now, it’s easier to design and build conversations and users will get faster and more accurate responses. We’re very excited about this suite of products which replaces Dialogflow as the preferred way to develop conversational actions on Google Assistant.
New functionality to create interactive voice actions
Based on feedback from developers, we’re also adding new functionality to build more interactive experience on Google Assistant with Home Storage, updated Media API and Continuous Match Mode.
One of the exciting things about speakers and smart displays is that they’re communal. Home Storage is a new feature that provides a communal storage solution for devices connected on the home graph and allows developers to save context for all individual users, such as the last saved point from a puzzle game.
Our updated Media APIs now support longer-form media sessions and lets users resume playback of content across surfaces. For example, users can start playback from a specific moment or resume where they dropped out of their previous session.
Sometimes you want to build experiences that enable users to speak more naturally with your action, without waiting for a change in mic states. Rolling out in the next few months, Continuous Match Mode allows Assistant to respond immediately to a user’s speech for more fluid experiences by recognizing defined words and phrases set by you. This is done transparently so that before the mic opens, Assistant will announce the mic will stay open temporarily so users know they can speak freely without waiting for additional prompts. For example, CoolGames is launching a game in a few weeks called, “Guess The Drawing” that uses Continuous Match Mode to allow the user to continuously guess what the drawing is until they get it right. The game is also built with Interactive Canvas for a more visual and immersive experience on smart displays.
Bringing AMP to smart displays
In addition to making it easy for you to build new experiences for Google Assistant, we also want to bring the depth of great web content together with the simple and robust AMP framework to deliver new experiences on Smart Displays. AMP allows you to create compelling, smooth websites that have a great user experience. AMP compliant articles are coming to smart displays later this summer with News. Stay tuned for more updates in the coming months as we expand to enable more web content categories for Smart Displays.
With these tools, we want to empower developers to build helpful experiences of the future with Google Assistant, enabling people to get what they need more simply, while giving them time back to focus on what matters most.
Source: Google Developers Blog
Announcing Actions Builder & Actions SDK: New tools optimized for the Google Assistant
Posted by the Assistant Developer Platform team
Since the launch of the Google Assistant, our developer ecosystem has been instrumental in delivering compelling voice experiences to more than 500 million active users. Today, we’re taking a major step forward in helping you build these custom voice apps and services by introducing a suite of new and improved developer tools: Actions Builder and Actions SDK. These tools make building Conversational Actions for the Assistant easier and more streamlined than ever.
Better design and development tools
Actions Builder is a web-based IDE that lets you develop, test, and deploy directly in the Actions console. The graphical interface lets you visualize the conversational flow, manage Natural Language Understanding (NLU) training data, and debug with advanced tools.
For those of you who prefer local IDEs, the updated Actions SDK provides a file based representation of your Actions project. This lets you author NLU training data and conversational flows locally as well as bulk import and export training data. We've also updated the CLI that accompanies Actions SDK, so you can build and manage Actions projects completely with code, using your favorite source control and continuous integration tools.
Together, Actions Builder and Actions SDK create a seamless, consolidated development experience. No matter what tool you start with, you can switch between them based on what works best for your workflow. For example, you can use Actions Builder to lay out conversational flows and provide NLU training data, Actions SDK to write fulfillment code, and the CLI to synchronize the two. These tools create an environment where all team members can contribute effectively and focus on what they do best: design and code.
New interaction model
A new, powerful interaction model lets you design conversations quickly and efficiently. Intents and scenes let you define robust NLU training data and behavior for specific conversational contexts. Using scenes as building blocks, you define active intents, declare context specific error handling, collect data through slot filling, and respond with prompts.
Scenes also separate conversational flow definitions from fulfillment logic, so you can reuse the same flows across multiple conversations. Transitions between scenes let you define when one conversational context switches to another. All your scenes and transitions describe a full conversational flow and all possible dialog turns.
You can express the entire interaction model with either the Actions Builder or Actions SDK. A typical way to develop is to use Actions Builder to view and edit your scenes and then use Actions SDK to sync changes to your local file system. This lets you version control your project, modify your project files, and build fulfillment in your favorite development environment.
Faster and smarter runtime engine
Under the hood, we also made a lot of improvements that your users will appreciate. We sped up the Assistant runtime engine, so users get faster responses and a smoother experience. We’ve also made the runtime engine smarter, so your Actions can understand users better with the same amount of training data.
Production ready platform
We've worked with Pretzel Labs and Galinha Pintadinha to test the capabilities of the new platform and to refine the interaction model and runtime engine improvements.
Pretzel Labs built Kids Court with Actions Builder, creating a full conversational flow with no code and added fulfilment for advanced functionality.
"Having the combination of a visual layout with webhook blocks for code helps us collaborate clearly and more efficiently. Something I liked very much about this was the separation between the designer and the developers' parts, making it very intuitive to make design changes without affecting backend logic."
-- Adva Levin, founder of Pretzel Labs
Galinha Pintadinha runs one of the biggest YouTube channels and built one the most popular Conversational Actions in their country. Their development team migrated to the new platform to optimize their workflow and simplify future Action development. Galinha Pintadinha’s Actions now contain half the number of intents and have a radically simplified conversation tree. Using features like contextual error handling, they were able to improve the user experience and quality with little to no cost.
"Actions Builder is a robust and well designed toolbox for developing conversational apps. The concept of scenes and transitions helped us define the flow of our Action in a much more streamlined way."
-- Mário Neto, engineer at Galinha Pintadinha
Get started
To learn more about Actions Builder and SDK and to start developing your next Actions, check out our new developer resources. Our codelabs will walk you through using the new tooling and interaction model. Samples for all major features are also available, so you can start playing with code immediately. See the full set of documentation to start building today.
Stay tuned for more platform updates and happy coding!