Chrome Beta for Android Update

Ladies and gentlemen, behold!  Chrome Beta 64 (64.0.3282.116) for Android has been released and is available in Google Play.  A partial list of the changes in this build is available in the Git log. Details on new features is available on the Chromium blog, and developers should check out our updates related to the web platform here.

If you find a new issue, please let us know by filing a bug. More information about Chrome for Android is available on the Chrome site.

Estelle Yomba
Google Chrome

Dev Channel Update for Chrome OS

The Dev channel has been updated to 65.0.3325.9 (Platform version: 10323.1.0) for most Chrome OS devices. This build contains a number of bug fixes, security updates and feature enhancements. 

If you find new issues, please let us know by visiting our forum or filing a bug. Interested in switching channels? Find out how. You can submit feedback using ‘Report an issue...’ in the Chrome menu (3 vertical dots in the upper right corner of the browser). 


Bernie Thompson
Google Chrome

“Ok Google, read my book”… Introducing audiobooks for Google Assistant devices with Google Play

“Read more.” Every year it’s one of the more popular New Year’s resolutions. But with all the time spent battling traffic, working out, or picking up groceries, there often doesn’t seem to be a minute to simply sit down with a book.

With audiobooks on Google Play, rolling out today in Australia and around the world in nine languages, you can get stuck into a page-turner without lifting a finger.

Find your next great read at an affordable price, and enjoy it across devices that include the Google Assistant – like Google Home and many others – as well as Android, iOS and the web with Google Play Books. Here’s what you need to know:



Enjoy your audiobook with your Google Assistant


Just say “Ok Google, read my book” to listen to your favorite audiobook hands free with the Google Assistant on your Google Home device, smartphone or speaker. Try “Ok Google, who is the author?” if you need a refresher, or “Ok Google, stop playing in 20 minutes” to set a timer for bedtime reading. The Google Assistant integration with audiobooks is available on Android and smart speakers in Australia.


Listen without a subscription


On Google Play, you can buy a single audiobook at an affordable price, with no commitments. You can also get a free preview of the book to make sure you’re hooked by the story and enjoy listening to the narrator’s voice.


Weave reading into your day across multiple devices


Start your morning by listening to “Ready Player One” with the Assistant on Google Home, and continue listening with the Google Play Books app on your Pixel. You can pick up where you left off no matter what device you're using, with the Assistant or the Google Play Books app—on Android, iOS, Chromecast, Android Wear, Android Auto or even your laptop. And share your favorite audiobook with everyone in the family through Family Library for no additional fee—even if they’re using a different device.


Now, when you want to curl up to Australian classics like May Gibbs’ Snugglepot and Cuddlepie, learn Astrophysics For People In A Hurry from Neil Degrasse Tyson or spend a Sunday with Love your Sister by Samuel and Connie Johnson, all you have to do is say “Ok Google, read me my book….” to settle into the sounds of your new favorite audiobook.

“Ok Google, read my book”… Introducing audiobooks for Google Assistant devices with Google Play

“Read more.” Every year it’s one of the more popular New Year’s resolutions. But with all the time spent battling traffic, working out, or picking up groceries, there often doesn’t seem to be a minute to simply sit down with a book.

With audiobooks on Google Play, rolling out today in Australia and around the world in nine languages, you can get stuck into a page-turner without lifting a finger.

Find your next great read at an affordable price, and enjoy it across devices that include the Google Assistant – like Google Home and many others – as well as Android, iOS and the web with Google Play Books. Here’s what you need to know:



Enjoy your audiobook with your Google Assistant


Just say “Ok Google, read my book” to listen to your favorite audiobook hands free with the Google Assistant on your Google Home device, smartphone or speaker. Try “Ok Google, who is the author?” if you need a refresher, or “Ok Google, stop playing in 20 minutes” to set a timer for bedtime reading. The Google Assistant integration with audiobooks is available on Android and smart speakers in Australia.


Listen without a subscription


On Google Play, you can buy a single audiobook at an affordable price, with no commitments. You can also get a free preview of the book to make sure you’re hooked by the story and enjoy listening to the narrator’s voice.


Weave reading into your day across multiple devices


Start your morning by listening to “Ready Player One” with the Assistant on Google Home, and continue listening with the Google Play Books app on your Pixel. You can pick up where you left off no matter what device you're using, with the Assistant or the Google Play Books app—on Android, iOS, Chromecast, Android Wear, Android Auto or even your laptop. And share your favorite audiobook with everyone in the family through Family Library for no additional fee—even if they’re using a different device.


Now, when you want to curl up to Australian classics like May Gibbs’ Snugglepot and Cuddlepie, learn Astrophysics For People In A Hurry from Neil Degrasse Tyson or spend a Sunday with Love your Sister by Samuel and Connie Johnson, all you have to do is say “Ok Google, read me my book….” to settle into the sounds of your new favorite audiobook.

A new year for Chrome video

Forbes-RotateToFullscreen-BlogPost-Optimized.gif

Every day, people watch 30,000 years worth of video in Chrome. That’s a lot of video! Watch time grew significantly over the last year—not only because of viral YouTube hits, but also because of the creation of new video experiences around the world.

For example, Jio Cinema and Forbes give people high-quality video without requiring them to install an app. In India, Voot Go allows bus riders to watch web video on their devices without an internet connection. And sites like WITHIN let people explore 360-degree videos not just from their mobile device or laptop, but also in virtual reality.

voot.gif

Web videos are pretty amazing, and there’s a lot going on behind the scenes in Chrome to make them pop. For example, Chrome’s Data Saver helps you enjoy high quality video without racking up a huge bill—last year alone, it saved people more than 200 petabytes of mobile video data, enough to store 1,000 copies of all the books ever written, in every language. These data savings let you watch high-quality video, even on poor networks. And we’re going to save even more — Google as part of the Alliance for Open Media is working on a new way to deliver even higher quality video while using less data.

Because people are using Chrome to watch videos in new formats and in new places, they need an easy way to hit play or pause, rewind or fast forward. That’s why last year, we added picture-in-picture playback to Chrome on Android, and better video and audio controls from both the lock screen and notifications. These changes let you enjoy your media while doing other things, makes it easier to know what’s playing, and helps resolve the “Where’s the stop button!?” panic when you forget to plug in your headphones at the library. Chrome also now helps you avoid unwanted noises by letting you mute sites, and later this year, we’ll give you even more control by letting you choose which sites can autoplay.

chrome_mediasession_lockscreen.png

Looking forward, to support the next generation of video experiences, we’ve begun adding support for High Dynamic Range (HDR). This means you can get vibrant colors, darker blacks, and brighter whites from the latest HDR displays. HDR support is now available on Windows 10, and more platforms are coming soon. Also coming soon is the official release of VR on the web, and after enjoying the first immersive web experiments we’re looking forward to what sites do in the coming year.

The Chrome media team’s mission is to help the world enjoy the best quality video experience on the web, and 2017 was a big year for us. We have even more exciting improvements in the works for 2018, and we can’t wait for you to try them out!

New Official Artist Channels provide a single destination for artists and fans to connect

If you’re a music fan, one of the best things about YouTube is that you can find much more than just the official version of a song. Across the platform, you can find music videos, lyric videos, covers, unplugged sets, live performances, backstage footage of your favorite artist and more.

We launched Official Artist Channels last year to help make it easier for fans to find content from their favorite artists by uniting their full body of work (from official videos to live performances, to individual songs and albums) under one channel.

Today, we’re simplifying things even more by bringing together an artist’s subscribers under their Official Artist Channel. Uniting subscribers under one channel means you’ll be able to go deeper and explore all of the content from the artists you love. For fans looking for music from the artists they love, finding the Official Artist Channel for an artist will soon be as simple as searching for their name on YouTube. You can also identify the Official Artist Channel by looking for the artist icon (the musical note) in YouTube search and on the channel page.



If you're currently subscribed to an unofficial artist channel, you will soon be subscribed to their Official Artist Channel and your subscription to any unofficial artist channels will become inactive. The Official Artist Channel is a single destination that gives you access to an artist’s full body of work, so you’ll now receive notifications solely from the Official Artist Channel whenever new videos are uploaded or when an artist wants to send a message to their fans.

For artists, uniting your subscribers under one channel means you have more reach to promote your latest releases. It also gives you (and your team if you’ve got one) control over your presence and the opportunity to engage directly with your fans through YouTube features like Community Posts, Mobile Live and Ticketing.

We will be expanding the roll-out of the new Official Artist Channels to artists on the platform over the coming weeks. Artists looking for more information on their Official Artist Channels can read more on the Help Center. Fans looking for more information on how to manage their channel subscriptions, notifications and search for channels can visit this Help Center article and view the informational video.

- YouTube Music Team

Source: YouTube Blog


Tools for every school: G Suite for Education updates

Editor's note:This week our Google for Education team will be joining thousands of educators at the BETT educational technology conference in London. Follow along on The Keyword and Twitter for the latest news and updates.

Education is evolving, and G Suite for Education is too. Today, we’re announcing two exciting updates: a new set of free features designed to strengthen security for all G Suite for Education users, as well as a new edition called G Suite Enterprise for Education. The tools in this new edition offer large educational institutions some of the same capabilities used by enterprises to meet their more complex technology needs.

New security features coming to G Suite for Education

These new features will bring valuable security tools to the 80 million teachers and students who rely on G Suite for Education, at no additional cost:

  • Data Loss Prevention (DLP) for Drive and Gmail gives admins greater control and visibility in protecting their sensitive school data, and the ability to protect users from accidentally sharing confidential information externally. G Suite’s DLP protections include a library of predefined content detections to make setup easy and advanced capabilities such as OCR recognition of content stored in images. 
  • Security key management and enforcement offers an additional layer of security for user accounts by requiring a physical key. Admins can now require their institution to log in using security keys to further secure the organization against phishing attacks. Security Keys plug directly into a laptop or pair with a mobile device using Bluetooth or NFC, instead of receiving a code via text. Admins will also be able to manage the deployment of Security Keys and view usage reports, keeping data security all in one place.
  • Hosted Gmail S/MIMEgives institutions working with sensitive information an option to digitally sign and encrypt emails. It’s easy to manage for administrators and seamless for end users. It also adds verifiable account-level signatures authentication to better protect against email spoofing. And with Hosted S/MIME, incoming encrypted mail still benefits from Gmail’s extensive protections against spam/phishing/malware.

Smart_Scan.gif

Meet G Suite Enterprise for Education

We’ve heard from dozens of large institutions—from private and public colleges and universities, to school districts across the country— that they want access to more advanced tools to meet their technology needs. Whether it’s advanced data and device controls or enterprise-grade communication capabilities, we are excited to be offering an entirely new solution for these customers. G Suite Enterprise for Education will offer many of the same capabilities available to G Suite business customers in addition to future features geared towards the specific needs of educational institutions.

Here’s a closer look at the capabilities available in G Suite Enterprise for Education. Over time, we expect to add more tools that are geared towards the needs of larger institutions:

  • Advanced mobile device managementhelps large organizations enable proactive management of mobile BYOD devices. With new device rules for Mobile Management, G Suite admins can now define custom rules that trigger on device events, like device updates or ownership changes, and have associated actions. Additionally, admins can review audits and reports of activities on these devices, as well as securely managework apps on a user’s device while leaving personal apps under the user’s control.
  • Cloud Searchprovides a unified search experience across G Suite, helping users spend less time searching for information and more time deriving insights. Powered by machine intelligence, Cloud Search surfaces personalized information that helps users stay on top of important work, prepare for upcoming meetings or even suggest files that need attention.
  • Gmail logs analysis in BigQuerycontain information that can help education administrators diagnose issues or unlock insights. Admins will be able to run sophisticated, high-performing custom queries and build custom dashboards. With Admin reports in BigQuery, they can also analyze their domains’ data to understand product adoption and usage.
  • Security center for G Suite brings together security analytics, actionable insights and best practice recommendations from Google so that admins can protect their organization, data and users. Admins now have access to a unified security dashboard and can reduce risk to their organization by adopting security health recommendations from Google.
  • Record meetings and save them to Drive.For schools wanting to capture faculty meetings or online lectures, Hangouts Meet can be used to record them and save them directly to Drive making them readily accessible for those that weren’t able to attend.
  • Hangouts Meet supports up to 50 participants. The ability to bring together people across large districts or remote campuses saves time. With this edition, teams can connect up to fifty participants on a single video and phone conference.
  • The dial-in feature in Meetallows users to seamlessly connect to meetings via a phone. Whether working from their mobile device or if they don’t have a reliable Wi-Fi connection, users can join via a conferencing bridge that’s automatically added to every meeting. Additionally, it’s now available in more than two dozen countries, making it easy for educators to connect if their institution has a footprint around the globe.

G_Suite_Security_Center.gif

Clay County, which has been piloting G Suite Enterprise for Education, is spread out over 601 square miles in northeastern Florida. According to Jeremy Bunkley, Director of Information Technology, “G Suite Enterprise for Education has improved our ability to address critical IT needs that stem from being a large district. The advanced tools in Hangouts Meet have allowed us to reduce costs and save time."

G Suite Enterprise for Education will be a paid product for schools and you can learn more about the affordable pricing on our Help Center. This will not affect the pricing for G Suite for Education, which will remain free to schools. We’ll continue to add new features to G Suite for Education at no additional cost, starting with the added security features we announced today. Below is a quick snapshot of the features included in each edition:

slide_layout (4).png

We’ve been working with colleges and school districts to pilot both the new free features and enterprise tools, and we’ll be making them widely available in the coming months. Submit this form if you’re interested in getting more information about G Suite Enterprise for Education. You can learn more about the edition on our website and Help Center.

Source: Google Cloud


“Ok Google, read my book”… Introducing audiobooks on Google Play

"Read more." Every year it’s one of the most popular New Year’s resolutions. But with all the time spent battling traffic, working out, or picking up groceries, there often doesn’t seem to be a minute to simply sit down with a book.


With audiobooks on Google Play, rolling out today in 45 countries and nine languages, you can turn your time stuck in traffic, on the treadmill, or waiting in line into reading time. Find your next great read at an affordable price, and enjoy it across Android, iOS and the web with Google Play Books, as well as on devices that include the Google Assistant, like Google Home and many others. Here’s what you need to know:


  • Listen without a subscription. On Google Play, you can buy a single audiobook at an affordable price, with no commitments. You can also get a free preview of the book to make sure you’re hooked by the story and enjoy listening to the narrator’s voice. And share your favorite audiobook with everyone in the family through Family Library for no additional fee—even if they’re using a different device.
  • Enjoy your audiobook with your Google Assistant.Just say “Ok Google, read my book” to listen to your favorite audiobook hands free with the Google Assistant on your phone or speaker, like Google Home. Try “Ok Google, who is the author?” if you need a refresher, or “Ok Google, stop playing in 20 minutes” to set a timer for bedtime reading. For now, the Google Assistant integration with audiobooks is available on Android phones and smart speakers globally in English. It will be coming soon to the Assistant on Android Auto in the U.S.
xx
  • Weave reading into your day across multiple devices. Start your morning by listening to “Ready Player One” with the Assistant on Google Home, and continue listening with the Google Play Books app on your Pixel. You can pick up where you left off no matter what device you're using, with the Assistant or the Google Play Books app—on Android, iOS, Chromecast, Android Wear, Android Auto or even your laptop. 
Now when you want to solve the mystery with “Magpie Murders,” learn “Astrophysics For People In A Hurry” from Neil Degrasse Tyson or spend a Sunday with Oprah Winfrey, Eckhart Tolle and friends in “The Wisdom of Sundays,” all you have to do is select and settle into the sounds of your new favorite book.

Meet the winners of Google’s Pay It Forward Challenge!

In honor of Hispanic Heritage Month, Google hosted its third annual Pay it Forward Challenge as a way to recognize students and professionals who are demonstrating a commitment to expanding access and opportunities to the Latinx community and beyond. We’re excited to share the work of our four winners!


Adan Gonzalez




Adan Gonzalez grew up in South Oak Cliff—a predominantly Mexican-American, low-income community in inner-city Dallas. Despite going to a school with high dropout and violence rates, Adan worked hard to prove to his parents that their sacrifices and hard work were worth it, and ultimately obtained a B.A. from Georgetown University and a M.Ed from Harvard.


In 2012, motivated by his family and by his community, Adan founded Puede Network, which helps transform students into scholars, and scholars into community leaders. Their Higher Education on Wheels campaign connect parents, teachers, and students to resources such as scholarships and financial aid. Puede also holds conferences with C-Suite executives to provide comprehensive college services, volunteer opportunities, and mentorship to underprivileged students in Dallas public schools.


Since 2012, Puede Network has grown beyond community events and now engages more than 100,000 students and parents in 15 states through presentations, blogs, and radio shows.


How can you help?

If you are interested in getting involved with Puede Network, you can express your interest here.


Brianna Silva




Brianna Silva is a proud Mexican-American and an active advocate for Hispanic students at her high school and within her community. During her freshman year she noticed that the ELL (English Language Learners) students in her class all sat in the back of the classroom, confused and forgotten.


In turn, Brianna began to meet with the school administration to address the issues affecting Hispanic students at her high school. As the president of the Minority Student Achievement Network at her school, she assists in planning student-teacher forums and continues to empower ELL and Hispanic students, speaking to her local civil rights committee about the unique obstacles that Latino scholars might face.


Recognizing the dire need for financial support for college, Brianna also founded The Hope Scholarship, a fund dedicated to financially assist low-income Hispanic students with their dream to attend college. Brianna hopes to continue working passionately to empower Latino students in college and beyond. Her next goal is to host a Hispanic Student Conference where students from all over the country can come together to address issues that Latino students might face.


How can you help?

If anyone is interested in collaborating with Brianna or assisting her with her projects and goals, you can reach out via email at givebackwithbrianna@gmail.com.


Brittany Amano



Brittany Amano is a sophomore at Duke University and the founder of The Future Isn’t Hungry. As someone who experienced food insecurity throughout her childhood, Brittany believes it is important to not think of hunger as something that only happens in developing countries—it might be happening in the town next to yours.


Many students rely on the free meals they receive when school is in session, but have to go home to an empty fridge on Friday night. The Future Isn’t Hungry provides healthy food bags to impoverished youth for their weekends. Every bag contains a weekend’s worth of food for 2 ½ people (containing fruits, vegetables, grains, and protein sources that can be too expensive for low-income families to afford), as well as healthy recipes using low-cost food items to help children learn how to prepare wholesome, balanced meals.


The idea for The Future Isn’t Hungry began when Brittany hosted her first food drive as a fourth grader. Since then, the initiative has been able to provide over 770,000 meals and raise over $4.6 million worth in food.


How can you help?
Get involved! Get some friends together to join the fight against childhood food insecurity — start your own healthy food bag initiative and use the #FutureisntHungry hashtag to share your work.


Brittany encourages you to submit your own big idea to LEAD360!



Katiuska Pimentel




Katiuska Pimentel migrated to the United States at a young age and struggled with economic and social stability, as her undocumented status made finding a job difficult. Despite the hardships she faced, her family taught her that education is a tool to achieve opportunities and social change. Since high school, Katiuska has been an active leader for the immigrant community. She supported state and local pro-immigrant policies and she advocated to expand the access of undocumented students to higher education. She also worked on the #health4all movement — expanding health rights to undocumented minors.

Katiuska is currently a community organizer at SIREN (Services, Immigrant Rights and Education Network), where she works closely with community members on immigration advocacy and reform. She delivers "Know your rights" presentations, teaching community members how to execute their constitutional rights if they are in contact with immigration authorities.


As someone who has experienced major injustices, Katiuska wants to fight for the rights of the many people who, like her, come from underserved backgrounds. In the future, she hopes to continue advocating for undocumented, underserved communities as an immigration lawyer.


How can you help?

Katiuska would appreciate donations to SIREN, so that the organization can expand its deportation defense services.



Thanks to all our winners! Keep up with us on social to hear more about our initiatives.

How we built a serverless digital archive with machine learning APIs, Cloud Pub/Sub and Cloud Functions



[Editor’s note: Today we hear from Incentro, a digital service provider and Google partner, which recently built a digital asset management solution on top of GCP. It combines machine learning services like Cloud Vision and Speech APIs to easily find and tag digital assets, plus Cloud Pub/Sub and Cloud Functions for an automated, serverless solution. Read on to learn how they did it.]

Here at Incentro, we have a large customer base among media and publishing companies. Recently, we noticed that our customers struggle with storing and searching for digital media assets in their archives. It’s a cumbersome process that involves a lot of manual tagging. As a result, the videos are often stored without being properly tagged, making it nearly impossible to find and reuse these assets afterwards.

To eliminate this sort of manual labour and to generate more business value from these expensive video assets, we sought to create a solution that would take care of mundane tasks like tagging photos and videos. This solution is called Segona Media (https://segona.io/media), and lets our customers store assets and tag and index their digital assets automatically.

Segona Media management features


Segona Media currently supports images, video and audio assets. For each of these asset types, Google Cloud provides specific managed APIs to extract relevant content from the asset without customers having to tag them manually or transcribe them.

  • For images, Cloud Vision API extracts most of the content we need: labels, landmarks, text and image properties are all extracted and can be used to find an image.
  • For audio, Cloud Speech API showed us tremendous results in transcribing an audio track. After extracting the audio into speech, we also use Google Cloud Natural Language API to discover sentiment and categories in the transcription. This way, users can search for spoken text, but also search for categories of text and even sentiment.
  • For video, we typically use a combination of audio and image analysis. Cloud Video Intelligence API extracts labels and timeframes, and detects explicit content. On top of that, we process the audio track from a video the same way we process audio assets (see above). This way users can search content from the video as well as from spoken text in the video.

Segona Media architecture


The traditional way for developing a solution like this involves getting hardware running, determining and installing application servers, databases, storage nodes, etc. After developing and getting the solution into production you may then come across a variety of familiar challenges: the operating system needs to be updated or upgraded or databases don't scale to cope with unexpected production data. We didn't want any of this, so after careful consideration, decided on a completely managed solution and serverless architecture. That way we’d have no servers to maintain, we could leverage Google’s ongoing API improvements and our solution could scale to handle the largest archives we could find.

We wanted Segona Media to also be able to easily connect to common tools in the media and publishing industries. Adobe InDesign, Premiere, Photoshop and Digital Asset Management solutions must all be able to easily store and retrieve assets from Segona Media. We solved this by using GCP APIs that were already in place for storing assets in Google Cloud Storage and just take it from there. We retrieve assets using the managed Elasticsearch API that runs on GCP.

Each action that Segona Media performs is a separate Google Cloud Function, usually triggered mostly by a Cloud Pub/Sub queue. Using a Pub/Sub queue to trigger a Cloud Function is an easy and scalable way to publish new actions.

Here’s a high-level architecture view of Segona Media:

High Level Architecture

And here's how the assets flow through Segona Media:

  1. An asset is uploaded/stored to a Cloud Storage bucket
  2. This event triggers a Cloud Function, which generates a unique ID, extracts metadata from the file object, moves it to the appropriate bucket (with lifecycle management) and creates the asset in the Elasticsearch index (we run Elastic Cloud hosted on GCP).
  3. This queues up multiple asset processors in Google Cloud Pub/Sub that are specific for an asset type and that extract relevant content from assets using Google APIs.


Media asset management


Now, let's see how Segona Media handles different types of media assets.

Images

Images have a lot of features on which you can search, which we do via a dedicated microservice processor.

  • We use ImageMagick to extract metadata from the image object itself. We extract all XMP and EXIF metadata that's embedded in the file itself. This information is then added to the Elastic index and makes the image searchable by, for example, copyright info or resolution. 
  • Cloud Vision API extracts labels in the image, landmarks, text and image properties. This takes away manual tagging of objects in the image and makes a picture searchable for its contents.
  • Segona Media offers customers to create custom labels. For example, a television manufacturer might want to know the specific model of a television set in a picture. We’ve implemented custom predictions by building our own Tensorflow models trained on custom data, and we train and run predictions on Cloud ML Engine.
  • For easier serving of all assets, we also create a low resolution thumbnail of every image.

Audio


Processing audio is pretty straightforward. We want to be able to search for spoken text in audio files, and we use Cloud Speech API to extract text from the audio. We then feed the transcription into the Elasticsearch index, making the audio file searchable by every word.

Video


Video is basically the combination of everything we do with images and audio files. There are some minor differences though, so let's see what microservices we invoke for these assets:

  • First of all, we create a thumbnail so we can serve up a low-res image of the video. We take a thumbnail at 50% of the video. We do this by combining FFmpeg and FFprobe in Cloud Functions, and store this thumbnail alongside the video asset. Creating a thumbnail with Cloud Functions and FFmpeg is easy! Check out this code snippet: https://bitbucket.org/snippets/keesvanbemmel/keAkqe 
  • Using the same FFmpeg architecture, we extract the audio stream from the video. This audio stream is then processed like any other audio file: We extract the text from spoken text in the audio stream and add it to the Elastic index so the video itself can also be found by searching for every word that's spoken. We extract the audio stream from the video in a single channel FLAC format as this gives us the best results. 
  • We also extract relevant information from the video contents itself using Cloud Video Intelligence. We extract labels that are in the video as well as the timestamps for when the labels were created. This way, we know which objects are at what point in the video. Knowing the timestamps for a given label is a fantastic way to point a user to not only a video, but the exact moment in the video that contains the object they're looking for.

There you have it—a summary of how to do smart media tagging in a completely serverless fashion, without all the OS updates when scaling up or out, or of course, the infrastructure maintenance and support! This way we can focus on what we care about: bringing an innovative, scalable solution to our end customers. Any questions? Let us know! We love to talk about this stuff ;) Leave a comment below, email me at kees.vanbemmel@incentro.com, or find us on Twitter at @incentro_.