Keeping fake traffic that originates from infected computers (aka “botnets”) out of our ads systems has been a priority since we launched, and over the years we've worked hard to put in place extensive technology checks and filters to safeguard against this type of traffic.

Today we're further reinforcing our existing botnet defenses across our ad systems through a new feature that automates the filtering of traffic from three of the top ad fraud botnets, amongst those we are monitoring and defending against. One of the key benefits of this new feature is that it is resilient to possible changes to the malware that generates this botnet traffic.

This move boosts our defenses against invalid traffic generated by some nasty ad fraud malware, including Bedep and two other malware families that we have code-named Beetal and Changthangi. Together these three botnets are comprised of over 500,000 infected user machines.

Today we’d like to take this opportunity to take a deeper look at ad fraud botnets.

Ad fraud botnets: a menace to the advertising ecosystem

Ad fraud botnets are armies of malware-infected computers that are controlled by malicious fraudsters intent on generating large amounts of non-human ad traffic volume, typically for unscrupulous publishers. As a result, ad fraud botnets are a major threat to the budgets of advertisers, the reputation of publishers, and the safety of consumers. And this threat is considerable, given that hundreds of thousands of computers around the globe are infected with malware used specifically for ad fraud.

Botnet traffic is difficult to consistently filter in advertising platforms because malware authors try to make their fraudulent traffic look as human as possible so that it resembles legitimate traffic. For example, botnet traffic has many of the same characteristics as real traffic, including the use of common browsers, and typical user behavior on a web page (e.g., scrolling, clicking, and mouse movement).

Our move to consistently and confidently cut out the traffic from these botnets, despite any changes in the malware on which they’re based, represents a significant milestone in the defense of our advertising ecosystem.

The art and science of protecting against botnets at scale

Identifying ad fraud malware and protecting ad platforms against botnets is a sophisticated effort that requires deep technical knowledge, diligence, and the ability to think several steps ahead. It’s a game of chess against an opponent that is constantly changing the rules.

In addition, it takes robust and extensive infrastructure to properly analyze malware threats at scale. For example, there are millions of malware programs out in the wild, although not all of this malware is associated with ad fraud botnets. This scenario represents a considerable technical challenge, since the malware, along with a vast amount of botnet traffic, needs to be continuously analyzed. To compound the challenge, there are hundreds of thousands of new malware programs produced each day that our systems need to analyze as well.

Our team has expanded its expertise by working to gain a deep understanding of the Bedep, Beetal, and Changthangi malware families. Subsequently, we have expanded the capability to significantly protect our systems against traffic generated by this malware through an automated, scalable, and seamless filter. This filter is already available to all marketers on DoubleClick Bid Manager and Google Display Network (GDN).

A bold move, but there’s more to come

We believe in fighting the good fight in order to stop malicious actors in the advertising ecosystem. We also know that our success is not based solely on sophisticated algorithms or robust, highly-scalable infrastructure. Our success also relies on a team of warrior scientists that combines art and science to innovate and cultivate, relying on creativity and collective wisdom to effect change in unique ways.

This is a really exciting start to the year for us, yet we know that our work is not done yet. We will continue to be vigilant, working hard to protect our systems from fraudsters in 2016 and beyond. Stay tuned.

Posted by Andres Ferrate Chief Advocate, Google Ad Traffic Quality

When ads are good, they connect you to products or services you’re interested in and make it easier to get stuff you want. They also keep a lot of what you love about the web—like news sites or mobile apps—free.

But some ads are just plain bad—like ads that carry malware, cover up content you’re trying to see, or promote fake goods. Bad ads can ruin your entire online experience, a problem we take very seriously. That’s why we have a strict set of policies for the kinds of ads businesses can run with Google—and why we’ve invested in sophisticated technology and a global team of 1,000+ people dedicated to fighting bad ads. Last year alone we disabled more than 780 million ads for violating our policies—a number that's increased over the years thanks to new protections we've put in place. If you spent one second looking at each of these ads, it’d take you nearly 25 years to see them all!

Here are some of the top areas we focused on in our fight against bad ads in 2015:

Busting bad ads

Some bad ads, like those for products that falsely claim to help with weight loss, mislead people. Others help fraudsters carry out scams, like those that lead to “phishing” sites that trick people into handing over personal information. Through a combination of computer algorithms and people at Google reviewing ads, we’re able to block the vast majority of these bad ads before they ever get shown. Here are some types of bad ads we busted in 2015:

We suspended more than 10,000 sites and 18,000 accounts for attempting to sell counterfeit goods (like imitation designer watches).

We blocked more than 12.5 million ads that violated our healthcare and medicines policy, such as ads for pharmaceuticals that weren’t approved for use or that made misleading claims to be as effective as prescription drugs.

Weight loss scams, like ads for supplements promising impossible-to-achieve weight loss without diet or exercise, were one of the top user complaints in 2015. We responded by suspending more than 30,000 sites for misleading claims.

In 2015, we stepped up our efforts to fight phishing sites, blocking nearly 7,000 sites as a result.

Unwanted software can slow your devices down or unexpectedly change your homepage and keep you from changing it back. With powerful new protections, we disabled more than 10,000 sites offering unwanted software, and reduced unwanted downloads via Google ads by more than 99 percent.

We got even tougher on ads that mislead or trick people into interacting with them—like ads designed to look like system warnings from your computer. In 2015 alone we rejected more than 17 million.

Creating a better experience

Sometimes even ads that offer helpful and relevant information behave in ways that can be really annoying—covering up what you’re trying to see or sending you to an advertiser’s site when you didn’t intend to go there. In 2015, we disabled or banned the worst offenders.

We’ve all been there. You’re swiping through a slideshow of the best moments from the Presidential debate when an ad redirects you even though you didn’t mean to click on it. We’re working to end that. We've developed technology to determine when clicks on mobile ads are accidental. Instead of sending you off to an advertiser page you didn't mean to visit, we let you continue enjoying your slideshow (and the advertiser doesn't get charged).

In 2015, we stopped showing ads on more than 25,000 mobile apps because the developers didn’t follow our policies. More than two-thirds of these violations were for practices like mobile ads placed very close to buttons, causing someone to accidentally click the ad. There are also some sites and apps that we choose not to work with because they don’t follow our policies. We also reject applications from sites and mobile apps that want to show Google ads but don't follow our policies. In 2015 alone, we rejected more than 1.4 million applications.

Putting you in control

We also give you tools to control the type of ads you see. You can always let us know when you believe an ad might be violating our policies.

Maybe you’ve just seen way too many car ads recently. “Mute This Ad” lets you click an “X” at the top on many of the ads we show and Google will stop showing you that ad and others like it from that advertiser. You can also tell us why. The 4+ billion pieces of feedback we received in 2015 are helping us show better ads and shape our policies.

In 2015, we rolled out a new design for our Ads Settings where you can manage your ads experience. You can update your interests to make the ads you see more relevant, or block specific advertisers all together.

Looking ahead to 2016

We’re always updating our technology and our policies based on your feedback—and working to stay one step ahead of the fraudsters. In 2016, we’re planning updates like further restricting what can be advertised as effective for weight loss, and adding new protections against malware and bots. We want to make sure all the ads you see are helpful and welcome and we’ll keep fighting to make that a reality.

Posted by Sridhar Ramaswamy SVP, Ads & Commerce