Tag Archives: Gemini

Gemini in the side panel of Google Chat is now available

What’s changing

For the last few months, users with the Gemini for Google Workspace add-ons and Gemini Education add-ons have used Gemini in the side panel of Gmail, Docs, Sheets, Slides, and Drive to assist them with summarizing, analyzing, and generating content through insights gathered from their emails, documents, and more. Earlier this month, Gemini add-on subscribers began using Gemini in Google Chat for summaries of unread conversations in the home view. 

Today, we’re expanding Gemini in Chat to help users collaborate more effectively in their spaces, group messages and direct messages. With Gemini in the side panel of Chat, you can: 
  • Summarize a space or conversation. Examples include asking Gemini the following: 
    • "Summarize this conversation."
    • "What are the key takeaways in this conversation?” 
    • After an initial summary is generated, you can ask for a longer summary, "Give me a detailed summary of [topic] discussed in this space." 
  • Generate a list of action items from that space or conversation, such as: 
    • "What are the action items in this conversation?” 
    • “Are there any action items for me in this conversation?" 
    • “Summarize [person's] action items in this space” 
  • Answer specific questions about that space or conversation by asking: 
    • “What did [person] say about the timeline extension in this space?” 
    • “What’s the decision on the project discussed in this conversation?" 
gemini in the side panel of chat

Who’s impacted 

End users 


Why you’d use it 

Gemini in the side panel of Chat enables you to better collaborate with your team by helping you quickly catch up on missed conversations, capture action items, or search for key details that are easy to miss in a fast-moving space. 


Additional details 

At this time, Gemini in the side panel of Chat can summarize and analyze messages in the conversation that you are currently viewing. It will not summarize or analyze context across your entire Chat conversation history, your Gmail inbox or your Drive files. 


Getting started 


Rollout pace 


Availability 

Available for Google Workspace customers with a: 
  • Gemini Business and Enterprise add-on 
  • Gemini Education and Education Premium add-on 

Resources 

FedRAMP High authorization for Gemini for Workspace

What’s changing

As recently announced, we submitted our package to obtain FedRAMP High authorization for Gemini for Workspace, including the Gemini app. A FedRAMP High certification assures federal agencies in the United States that a cloud service provides the highest level of protection for their most sensitive data, enabling them to confidently leverage cloud technologies for critical operations.


Additional details

  • Our current FedRAMP submission does not include Data Location. We’re targeting FedRAMP High with Data Location at a later date.
  • The package is pending review by the Joint Authorization Board (JAB), who does not provide guidance on review timelines. Refer to the FedRAMP compliance page to view a copy of our submission. 

Getting started

Availability

Available for Google Workspace customers with these add-ons:
  • Gemini Business
  • Gemini Enterprise
  • Gemini Education
  • Gemini Education Premium

Available for Google Workspace customers accessing the Gemini app as a core service with these editions:
  • Business Starter, Business Standard, Business Plus
  • Enterprise Starter, Enterprise Standard, Enterprise Plus
  • Frontline Starter, Frontline Standard
  • Essentials, Enterprise Essentials, Enterprise Essentials Plus
  • Google Workspace for Nonprofits
  • Education Standard, Education Plus

Refine emails faster with updates to the “Polish” shortcut in Gmail

What’s changing

In August, we announced Help me write and Refine my draft shortcuts on mobile devices. Today, we’re excited to expand the Help me write shortcut to web and introduce a Polish shortcut on web and mobile that helps you refine emails even faster. 

  • On web, the Help me write shortcut will now appear in the body of the email when an email draft is empty. The Polish shortcut will appear for drafts with 12+ words, and pressing the shortcut text or typing Ctrl+H will automatically show a polished email output. 
polish shortcut Gmail on web

  • On mobile, the Help me write shortcut will continue to appear in the body of the email when an email draft is empty. The Polish shortcut will now appear for drafts with 12+ words. Swiping on the shortcut text will automatically show a polished email output. From there, users can tap a refinement chip (Formalize, Elaborate or Shorten) to edit the draft in place. 

polish shortcut on mobile
Getting started 


Rollout pace 

Web: 
Android & iOS: 

Availability 

Available for Google Workspace customers with: 
  • Gemini Business and Enterprise add-on 
  • Gemini Education and Education Premium add-on
  • Google One AI Premium 

Resources


The Gemini app is now a core service with enterprise-grade data protection for more Google Workspace editions

What’s changing

As we recently announced, driven by our belief that generative AI can be transformative for every user, the standalone Gemini app (gemini.google.com) will now be included as part of most Google Workspace editions. With enterprise-grade data protections built in, users can now save time and deliver higher quality work — securely and compliantly — with an AI-powered assistant at work.

Beginning today, the Gemini app is now available as a core service with enterprise-grade data protection for Google Workspace users with the following editions:

  • Business Starter, Business Standard, Business Plus
  • Enterprise Starter, Enterprise Standard, Enterprise Plus
  • Frontline Starter, Frontline Standard
  • Essentials, Enterprise Essentials, Enterprise Essentials Plus
  • Education Standard, Education Plus 
  • Google Workspace for Nonprofits

Additional details

As a core service, the Gemini app will be covered under your existing Google Workspace or Google Workspace for Education agreement and will include the same technical support as other Workspace services. Gemini prompts, data, or generated responses won’t be reviewed by human reviewers or otherwise used to improve generative AI models without permission. More information on how we’re protecting your Google Workspace data in the era of generative AI can be found here.

Note: For Education customers, added data protection is available in the Gemini app as either a core or additional service.

Admin console service settings update
As part of this launch, we will be streamlining the Gemini app service settings in the Admin console. Specifically, we will be transitioning to a single checkbox for the user access setting:

The updated Gemini service setting (Admin console > Generative AI > Gemini app > User Access)



When the setting is unchecked (default state for most customers), the Gemini app as a core service with enterprise-grade data protection will be enabled only for:

  • Gemini for Workspace licensed users
  • Users with a qualifying Workspace edition


When the setting is checked, the Gemini app will be enabled for all users, specifically:

  • Gemini for Workspace licensed users
  • Users with a qualifying Workspace edition
  • Users without a qualifying Workspace edition can access the Gemini app as an additional service

Broader availability of Workspace extensions in Gemini
Expanding the Gemini app as a core service also allows these Workspace editions to leverage Google Workspace extensions in Gemini, which are currently available in open beta for users 18 and older. Once enabled by an admin, extensions allow Gemini to cross reference various Google Workspace apps, like Gmail, Drive, Docs, Calendar, Keep and Tasks, as data sources to better inform its responses. Visit the Help Center to learn more about turning Google Workspace extensions on or off for your organization. 


Getting started

  • Admins: 
    • For new Google Workspace Business, Enterprise, and Frontline customers: Access to the Gemini app as a core service with enterprise-grade data protection will be ON by default. 
    • For new Workspace for Education customers: Access to the Gemini app will be OFF by default for Primary and Secondary (K12) customers, and ON by default for Higher Education customers.
    • Visit the Help Center to learn more about turning the Gemini app on or off for users.

  • End users: Visit the Help Center to learn more about using the Gemini app.


Rollout pace



Availability

This update is applicable for Google Workspace:
  • Business Starter, Business Standard, Business Plus
  • Enterprise Starter, Enterprise Standard, Enterprise Plus
  • Frontline Starter, Frontline Standard
  • Essentials, Enterprise Essentials, Enterprise Essentials Plus
  • Google Workspace for Nonprofits edition
  • Education Standard, Education Plus

Resources


Expanding Google Workspace extensions available in open beta for the Gemini app

What’s changing

Earlier this year, we launched Google Workspace extensions for Gmail, Google Drive and Google Docs in open beta for the Gemini app. Beginning today, we’re pleased to announce that Google Calendar, Google Keep and Google Tasks are also available as Workspace extensions in the Gemini app.

Who’s impacted

Admins and end users

Why you’d use it

Extensions allow the Gemini app to interact with other Google apps and services, helping to provide more contextual and relevant responses to your prompts and take certain actions across apps. For example, you can use extensions to:

Calendar
  • Create an event in Google Calendar based on specific details or based on your conversation with the Gemini app
  • Find events for a specific day, date range, or based on event details
  • Edit or cancel events in Calendar

Tasks
  • Add reminders and tasks, including those based on your conversation with the Gemini app
  • View a list of your tasks and update your tasks

Keep
  • Create notes and lists, including those based on your conversation with the Gemini app
  • Add an item to your existing list
  • Find content from your notes and lists
  • Reference your notes and lists in your conversation with the Gemini app

Additional details

  • If your prompt includes multiple actions that require separate apps or services, but one or more of the required services are not enabled, neither of the actions will be completed. For example, if you prompt Gemini to create an event on your calendar and a reminder for that event but the Tasks extension is not enabled, the event will not be added to your calendar and you will not get a reminder.
  • As a reminder, during the open beta period, Context-Aware Access (CAA) for Gmail, Drive, Docs, Calendar, Keep and Tasks isn’t supported with Google Workspace extensions. Context-Aware Access gives you control over which apps a user can access based on their context, such as whether their device complies with your IT policy. Learn more about Context-Aware Access.
  • Google Workspace extensions is not available to Google Workspace users accessing Gemini as an additional Google service.
  • Note that Google Workspace personal content the Gemini app gets from extensions is not reviewed by anyone to improve AI models, not used to train AI models, and not shared with other users or institutions.

Getting started

  • Admins: 
    • Google Workspace extensions in Gemini are OFF by default and can be enabled at the OU or Group level.
      • If Google Workspace extensions are already enabled, then the Workspace extensions for Calendar, Keep and Tasks will show up automatically for your users.
    • Visit the Help Center to learn more about turning Google Workspace extensions on or off for your organization. 

  • End users: If enabled by your admin, connecting Google Workspace allows users to summarize, get quick answers, and find information from Calendar, Keep and Tasks in addition to Gmail, Docs, and Drive directly in Gemini. Visit the Help Center to learn more about using Google Workspace extensions.

Rollout pace


Availability

Available for Google Workspace customers with these add-ons:
  • Gemini Business
  • Gemini Enterprise
  • Gemini Education
  • Gemini Education Premium


Resources


Preview summaries of unread conversations in the Google Chat home view with the help of Gemini

What’s changing 

We’re excited to announce Gemini in Google Chat can now help you catch up on unread conversations in the Chat home view with summaries. 

Upon navigating to an unread conversation in home, click the “Summarize” button to see a quick, bulleted synopsis of the message content. This enables you to quickly review recent activity across all active conversations to determine where best to focus your time and attention. 

Summarize conversations in Google Chat on web

Who’s impacted 

End users 


Why it matters

Since introducing a more streamlined user experience in Chat to help you find what you need much faster, we’re adding more ways to help you prioritize the most important conversations. This new summaries in home feature does just that by helping you catch up more quickly. 

Summarize conversations in Google Chat on mobile

Additional details 

Summaries in the home view are available for any group conversation, space, or thread in home that contain unread messages. 


Getting started 

Rollout pace 

Web,  Android & iOS:

Availability

Available for Google Workspace customers with these add-ons:
  • Gemini Business, Enterprise, Education, Education Premium 
  • AI Meetings & Messaging 

Resources 

Available in alpha: use Gemini in the side panel of Workspace apps in seven additional languages

What’s changing

You can now use Gemini in the side panel of Google Docs, Google Sheets, Gmail, and Google Drive in seven additional languages:

  • German
  • Italian
  • Japanese
  • Korean
  • Portuguese
  • Spanish
  • French 

The additional languages are available in alpha for Workspace customers with a Gemini Business, Gemini Enterprise, Gemini Education, and Gemini Education Premium add-on. Admins can use our Help Center to learn more about turning access to Gemini for Google Workspace Alpha features on for your users.

With Gemini in the side panel of your Workspace apps, you can get help summarizing, analyzing, and generating content by utilizing insights gathered from your emails, documents, and more—all without switching applications or tabs. For more information, please refer to our original announcements for Gemini in the side panel of Docs, Sheets, and Drive, as well as Gmail respectively.

Getting started



Gmail Q&A now available on iOS devices

What’s changing

Last month, we introduced a new way of searching your inbox with Gemini on Android devices. Starting today, this feature is also available on iOS devices, enabling you to ask Gemini questions about your inbox. Gmail Q&A can help you answer specific questions about your emails, show you unread messages or messages from a specific sender, summarize emails about a topic in your inbox, and even answer general questions from search, all without having to leave your inbox.
Gmail Q&A now available on iOS devices

Who’s impacted 

End users 

Why it matters

We are excited to help users supercharge their productivity with the help of Gemini in Gmail. Users now have even more capabilities from Gemini to help users get more done during their day at their desks and now, on the go. 

Getting started

  • Admins: To access Gmail Q&A on Android, users need to have smart features and personalization turned on. Admins can turn on default personalization setting for their users in the Admin console. 
  • End users: 
    • Open Gemini in the Gmail app via the black Gemini star at the top right of your app or from a “summarize this email” chip. To start, Gmail Q&A can find information from your inbox. In the future, it will be able to find information from your Drive as well
    • Note: Gmail Q&A is currently available in English only.

Rollout pace 

Availability 

Available for Google Workspace customers with these add-ons: 
  • Gemini Business, Enterprise, Education, Education Premium 
  • Google One AI Premium 

Resources 

New Watermarking in Google Meet Helps Protect Your Meeting Content

What’s changing 

Google Workspace customers with a Gemini add-on can now watermark presented content and video feeds in Google Meet. Watermarking in Google Meet will appear as a subtle text overlay that displays the meeting code and the email address of the viewer over the shared content and video feeds of participants. Using a watermark can help discourage unauthorized copying and sharing, protecting both users’ video images and content shared during meetings. Hosts and co-hosts can turn on watermarking at any time in the meeting. Once watermarking is turned on, it shows on all participants’ screens.



Additional details

Watermarking is available  to meeting participants signed into a Google account using the latest Chrome browser, Android or iOS apps, or Google Meet hardware devices. Only participants using supported browsers and apps will see video feeds when watermarking is turned on. 

Additionally, watermarking cannot be used when recording a meeting or live streaming a meeting. If you turn on a recording during a meeting, you’ll see a dialog box notifying you that watermarking stops when recording starts.

Getting started

  • Admins: There is no admin control for this feature.
  • End users: To turn watermarking, go to Host controls > Add a watermark. Visit the Help Center to learn more about how to apply watermarks to your meeting.
Host controls > Add a watermark


Rollout pace


Availability

Available for Google Workspace customers with these add-ons: 

  • Gemini Enterprise 
  • Gemini Education Premium 
  • AI Security 
  • AI Meetings & Messaging 

Resources


Gemini API in action: showcase of innovative Android apps

Posted by Thomas Ezan, Sr Developer Relation Engineer

With the advent of Generative AI, Android developers now have access to capabilities that were previously out of reach. For instance, you can now easily add image captioning to your app without any computer vision knowledge.

With the upcoming launch of the stable version of VertexAI in Firebase in a few weeks (available in Beta Since Google I/O), you'll be able to effortlessly incorporate the capabilities of Gemini 1.5 Flash and Gemini 1.5 Pro into your app. The inference runs on Google's servers, making these capabilities accessible to any device with an internet connection.

Several Android developers have already begun leveraging this technology. Let's explore some of their creations.


Generate your meals for the week

The team behind Meal Planner, a meal planner and shopping list management app, is leveraging Gemini 1.5 Flash to create original meal plans. Based on the user’s diet, the number of people you are cooking for and any food allergies or intolerances, the app automatically creates a meal plan for the selected week.

For each dish, the model lists ingredients and quantities, taking into account the number of portions. It also provides instructions on how to prepare it. The app automatically generates a shopping list for the week based on the ingredient list for each meal.

moving image of Meal Planner app user experience

To enable reliable processing of the model’s response and to integrate it in the app, the team leveraged Gemini's JSON mode. They specified responseMimeType = "application/json" in the model configuration and defined the expected JSON response schema in the prompt (see API documentation).

Following the launch of the meal generation feature, Meal Planner received overwhelmingly positive feedback. The feature simplified meal planning for users with dietary restrictions and helped reduce food waste. In the months after its introduction, Meal Planner experienced a 17% surge in premium users.


Journaling while chatting with Leo

A few months ago, the team behind the journal app Life wanted to provide an innovative way to let their users log entries. They created "Leo", an AI diary assistant chatting with users and converting conversations into a journal entry.

To modify the behavior of the model and the tone of its responses, the team used system instructions to define the chatbot persona. This allows the user to set the behavior and tone of the assistant: Pick “Professional and formal” and the model will keep the conversation strict, select “Friendly and cheerful” and it will lighten up the dialogue with lots of emojis!

moving image of Leo app user experience

The team saw an increase of user engagement following the launch of the feature.

And if you want to know more about how the Life developers used Gemini API in their app, we had a great conversation with Jomin from the team. This conversation is part of a new Android podcast series called Android Build Time, that you can also watch on YouTube.


Create a nickname on the fly

The HiiKER app provides offline hiking maps. The app also fosters a community by letting users rating trails and leaving comments. But users signing up don’t always add a username to their profile. To avoid the risk of lowering the conversion rate by making username selection mandatory at signup time, the team decided to use the Gemini API to suggest unique usernames based on the user’s country or area.

moving image of HiiKER app user experience

To generate original usernames, the team set a high temperature value and played with the top-K and top-P values to increase the creativity of the model.

This AI-assisted feature led to a significant lift in the percentage of users with "complete" profiles contributing to a positive impact on engagement and retention.

It’s time to build!

Generative AI is still a very new space and we are just starting to have easy access to these capabilities for Android. From enabling advanced personalization, creating delightful interactive experiences or simplifying signup, you might have unique challenges that you are trying to solve as an Android app developer. It is a great time to start looking at these challenges as opportunities that generative AI can help you tackle!


You can learn more about the advanced features of the Gemini Cloud models, find an introduction to generative AI for Android developers, and get started with Vertex AI in Firebase documentation.

To learn more about AI on Android, check out other resources we have available during AI in Android Spotlight Week.

Use #AndroidAI hashtag to share your creations or feedback on social media, and join us at the forefront of the AI revolution!