ie8 fix
madison

Zero Day

Ryan Naraine, Emil Protalinski and Dancho Danchev

Spam coming from free email providers increasing

By | July 18, 2008, 1:16pm PDT

Summary: After analyzing three weeks of spam data between June 13 to July 3, 2008, Roaring Penguin Software Inc. found evidence that spam originating from the top three free email providers (Gmail, Yahoo Mail and Hotmail) is increasing, with spammers in favor of abusing Gmail’s privacy preserving feature of not including the sender’s original IP in [...]

After analyzing three weeks of spam data between June 13 to July 3, 2008, Roaring Penguin Software Inc. foundSpam coming from free email providers increasing evidence that spam originating from the top three free email providers (Gmail, Yahoo Mail and Hotmail) is increasing, with spammers in favor of abusing Gmail’s privacy preserving feature of not including the sender’s original IP in outgoing emails :

“Spammers are increasingly using free e-mail providers to avoid IP address-based reputation systems. These systems track mail sent by various IP addresses and assign each IP address a rating. Some anti-spam software operates largely or exclusively on the basis of the IP address rating.

Roaring Penguin’s data shows that over the three weeks from June 13 to July 3, 2008, the percentage of US-originated spam originating from the top 3 free e-mail providers (Yahoo, Google and Hotmail) rose from about 2% to almost 4%. Roaring Penguin believes that spammers are using Google’s service in particular to send spam, relying on the fact that blacklisting Google’s servers is impractical for most organizations. According to their data, the probability that an e-mail originating from a Google server is spam rose from 6.8% on June 13 to a whopping 27% on July 3.”

Spammers and phishers are not just interested in the clean IP reputation of free email providers, they are also interested in taking advantage of the trust they have established among themselves through the use of DomainKeys and Sender ID Frameworks, and by abusing this through the bogus accounts that they’ve automatically registered by breaking the CAPTCHA based authentication, reach the widest possible audience and ensure the successful receipt of their spam/scam.

How are they managing to efficiently abuse these services, and is CAPTCHA breaking for the purpose of automatically registered bogus accounts to blame? The broken CAPTCHAs are only part of the problem. It all starts from the basics, in this case, the companies themselves admitting there’s a problem and how committed they are in not just fighting incoming spam, but also, outgoing spam.

The whole quality and assurance process applied by spammers is nothing new, in fact phishers and malware authors have been putting more efforts into coming up with easier ways to measure the return on investment (ROI) for themselves, and to present clear performance data to those taking advantage of their services. Just because someone has successfully sent several million spam emails, doesn’t mean that the messages didn’t got filtered, and when they did, what number exactly. Coming up with in-depth spam campaign metrics, and processes for verification of delivery, are becoming a top priority for everyone involved in this underground ecosystem.

The problem of spam and phishing coming from free email providers, has had its peaks in the past two years, prompting popular spam blacklists such as SORBS and Spamcop to blacklist entire Gmail servers due to their inability to obtain the real sender’s IP. It’s a signal from the anti spam community, and since Gmail will continue not revealing the real sender’s IP, something they’ve received a lot of criticism from anti spam vendor, but a lot of applause from privacy fighters, the best they can do is balance their incoming VS outgoing spam fighting strategy. Here’s a comment from an anti-spam vendor commenting on the problem back in 2006 :

“Gmail has taken an extreme position on privacy that inhibits the antispam community from doing their job, and it’s ticking people off,” says Tom Gilles, co-founder of IronPort. Some 10% to 15% of the spam IronPort sees comes from free Web-mail accounts, too big a slice to turn a blind eye to. “From time to time, Gmail mail is getting blocked because spam is leaking out of their service,” Gilles says. “Sometimes the babies get thrown out with the bath water, and that is the rub.

It’s difficult to gauge how widespread the problem of missing Gmail is, since no blocking records are available, though experts worry it’s growing along with the Gmail service. Gmail had 6.7 million visitors in February, up 4.1 million from a year ago, according to measurement firm comScore Networks, a jump that suggests lost email has yet to hurt the service’s growth. Yahoo Mail is still nearly 10 times bigger, hosting 64.6 million visitors last month, and AOL and Hotmail are also orders of magnitude larger. The situation reveals again how the studiously iconoclastic search engine is wrangling with where to draw the line on Internet privacy. As in other recent cases, Google is taking a harder line than its peers.”

Moreover, the abuse of the authentication at these free email providers, by either breaking the CAPTCHA images automatically, or outsourcing the process to human CAPTCHA breakers who earn cents to authenticate the registration process for the spammers to abuse, is clearly making an impact. For instance, underground services offering hundreds of thousands of pre-registered bogus accounts are popping up like mushrooms these days, and their maturity into a customer-tailored proposition offering everyone the possibility to pre-register bogus accounts at services and web sites that they are not currently targeting, speaks for the confidence they’ve built into their ability to deliver the goods. The most recent one which I covered in a previous post is continuing to automatically pre-register accounts with its inventory emptying and filling itself automatically in between the customer’s feedback indicating the quality of the service. Here’s a sample of their inventory as of the last five minutes :

  • Yahoo.com - 270,565 pre-registered accounts
  • Hotmail.com - 167,013 pre-registered accounts
  • Gmail.com - 159,892 pre-registered accounts

These is just the tip of the iceberg, with many other such services offering different inventories and using different tactics in the registration process. And while the companies themselves are keeping track of the latest developments in this ongoing abuse of their services, it’s all a matter of drawing the line at a particular moment of time. For instance, a known to be malware infected IP that has repeatedly attempted to send hundreds of thousands of phishing and spam emails on behalf ot the botnet its participates in, shouldn’t be trusted in any authentication or registration attempts if you’re to take the radical approach, or have the end user warned about what’s going on and why is she not allowed to use the site’s services unless action is taken. The point is that, preventing automatic authentication abuse as a process is very similar to preventing click fraud, and fighting spam in general with the only different in the shift of perimeters from applying the techniques on incoming emails, to the authentication process in general.

Most of the human CAPTCHA breakers, and the automated programs will either abuse malware infected hosts as open proxies, or use open proxy lists in order to change their IP on every several registrations. Considering that the majority of malicious activity comes from well known bad parties are often blocked by default at the email gateway without even bothering to inspect the content in email messages coming from their networks/IPs, the same approach, activity from malware infected hosts should be challenged more aggressively than it is for the time being.

The increasing spam and phishing emails originating from legitimate email service providers is prone to increase, and fighting incoming spam should be balanced with fighting outgoing spam. Moreover, email spam is so Web 1.0, that the possibilities for abusing the joys offered by Web 2.0 services are slowly starting to materialize, with spammers being a step ahead of the filtering solutions.

Kick off your day with ZDNet's daily e-mail newsletter. It's the freshest tech news and opinion, served hot. Get it.

Topics

Dancho Danchev is an independent security consultant and cyber threats analyst, with extensive experience in open source intelligence gathering, malware and cybercrime incident response.

Disclosure

Dancho Danchev

More details on Dancho Danchev's current and past professional affiliations, can be found in his LinkedIn profile.

Biography

Dancho Danchev

Dancho Danchev is an independent security consultant and cyber threats analyst, with extensive experience in open source intelligence gathering, and cybercrime incident response. He's been an active security blogger since 2007, and maintains a popular security blog sharing real-time threats intelligence data with the rest of the community on a daily basis. More details on Dancho Danchev's current and past professional affiliations, can be found in his LinkedIn profile. You can also follow him on Twitter

Related Discussions on TechRepublic

Did you know you can take part in these discussions with your ZDNet membership?
40
Comments

Join the conversation!

Just In

RE: Spam coming from free email providers increasing
saintcroix 22nd Jun
I think ZDNet is in fact one of the spammers, I get between 6 to 8 dumb emails a day with supposed breaking news headlines that I really do not want.
0 Votes
+ -
Spam
Monosdeja 18th Jul 2008
it is a problem, when recieve spam the TO: has additional accounts on my free email. there should be a way for the free email t block those sending to the same free email. it's CRAZY
for keeping their mail system clean. These networks are so large that it is impossible to manage them by an actual person. And every technology based solution will be hacked. G-mail, Yahoo, MSN and every other mail provider need to bear the same responsibility as the actual spammer. If they are not able to manage their networks they need to get out of the business.

This issue was inevitable. It is impossible to manage networks of this size. These providers need to be black listed just like any other spammer.
0 Votes
+ -
"for keeping their mail system clean."

Quite correct. How do you propose that be done?


"These providers need to be black listed just like any other spammer."

Exactly what good is that going to do? Yes it will stop the spam from getting through, along with a HUGE amount of legitimate e-mail. This is the problem with blocking sites such as Google and Yahoo, etc. The answer has been given elsewhere, TRACK THE MONEY, and shut down the source of it. That will stop the spam. Using reactive methods such as blocking entire domains, blacklisting email addresses, helps to a certain degree, but in the end it fails, simply because it is not the best way to go.

As an email user, I have accounts with both Google and Yahoo. I use Yahoo for all my public facing mail because their spam filtering is so efficient. What I call a bad month, spamwise, is more than 10 SPAMS in my INBOX for the month. I haven't had a bad month now for over 2 years (touch wood). Google is only used for private communications to a very select group of people.

I would not be pleased to find that all my mail is being classed as spam simply because Google or Yahoo mail has been blacklisted as a spammer.
0 Votes
+ -
SORBS = Conceited B*$t*rd$
PMC-CON 21st Jul 2008
SORBS blocked gmail.com recently, and when I tried to complain, I was amazed at the ATTITIUDE I saw throughout the site. I sent a note to the maintainer, and he opped a worse attitude to me, so I called him on it. I consider people like him to be worse than spammers.
SORBS didn't block gmail.

SORBS LISTED gmail, and YOUR ISP, the one you pay money to, BLOCKED gmail based on the fact that SORBS listed them.

Your ISP chose to use SORBS. You chose to use your ISP. Nowhere in this relationship does SORBS owe you anything whatsoever.

You got attitude because you complained to the wrong people. SORBS isn't making you use their block list. Don't use it if you don't like it.

Spammers are organized criminals. They are involved in highly organized and sophisticated criminal operations. Many of the spams you receive are sent by people with links to drugs, child pornography, and illegal weapons.

If you honestly think some volunteer from SORBS who didn't let you railroad him is worse than the criminal scum who are responsible for the spamming problem to begin with, you have seriously warped priorities.
0 Votes
+ -
I had an employer who arbitrarily blocked everything from my Yahoo email account. So, when I had a group of digital photos to send to them regarding a construction project, I had to ask one of my managers for his personal email account outside of the corporate email system because they did not allow attachments in their internal email system (my photos) nor would they accept email from my Yahoo account, where I could attach those photographs.

In the end, by blacklisting my Yahoo mail and by blocking all attachments internally, they made modern communication almost impossible, I see this as an example of the kind of over-reaction that is happening.

I think Yahoo, Gmail, and the other free email providers bear some responsibility in this. They could make it more difficult to use their systems for sending SPAM. One way they might slow down the spammers could be to limit the number of addresses in the TO;, CC:, and BCC: fields. They might also look for one sender sending identical messages to many groups of addresses (one way a spammer might get around an upper limit in the number of addresses per message). Sending identical messages repetitively should be limited. I think the free email providers may have to ability to spot email abuse now, and prevent the spreading of SPAM messages in any quantity. They just need to think a bit about where they should set their limits.
You'd not be pleased, but so what? Nobody is obligated to accept your email.

Having your email accepted is NOT a right, it's a privilege. A privilege that can be denied for any reason, or for no reason whatsoever.

If someone wants to block all IP addresses that have a 13 in them because they're superstitious, they have the right to do so. Stupid? Sure, but still their right.

If you use Yahoo or Gmail for critical personal business, then you're going to get burned sooner or later. You have to decide if the benefits outweigh the risks, but you don't get to decide for others what they must allow on their servers.
0 Votes
+ -
SPAM is all about money. Spammers do what they do
because somebody somewhere is paying them to do it.
The present practices for eliminating SPAM is reacting to
an event that has already happened. Instead we should be
proactive and act before the problem occurs. Instead of
trying to track/find who's sending the SPAM, find out who's
funding the scammer and prosecute them. The message
will get across that this is not a viable or intelligent
method of marketing their product and they'll stop paying
the spammers. When this happens, most of the SPAM we
experience every day will go away. It won't go away using
any other method.
0 Votes
+ -
Not likely
Hallowed are the Ori 19th Jul 2008
Instead of trying to track/find who's sending the SPAM, find out who's funding the scammer and prosecute them.

Uh-huh... And when that starts, watch the spammers move offshore and the clients begin to use front companies overseas to shield themselves from legal repercussions of being scumbags.
0 Votes
+ -
Alot of it
Kaiwai 20th Jul 2008
Alot of the problems come from the whole referral system where by a good many aren't working in the capacity of being paid by the company - instead, using the referral schemes and generating their own money off that.

There was a statistic that for something like every 1000 emails sent out, there is something like 30 people who will go and purchase the product. So think about it; if you sent out 100,000 emails, and 3,000 reply - then assume you make $10 off each sale; that is $30,000 in the hand for not much work.
0 Votes
+ -
Spam Response Rate
cgarrett@... 21st Jul 2008
Yeah...that's with legitimate advertising. I would put my guess that for every 1,000,000 mails that go out, maybe 30 buy the product. And even that's conservatively large. It doesn't matter - when you're using botnets and gmail to send out your spam, it costs only pennies to send out 10's of millions of emails.
0 Votes
+ -
RE: Spam coming from free email providers increasing
Rafal.Los (RX8volution) 19th Jul 2008
We seem to be trying to solve a problem which essentially has no resolution - simply because of the weighing facts. 1) Providing privacy to email senders (GMail), 2) automated registration defense (CAPTCHAs) are breakable either by humans or technology, 3) SPAM == $, people will buy this crap so they'll never stop, 4) if you blacklist GMail and Hotmail, Yahoo! ... many of us will be screwed since we rely on these mail servers every day for inbound/outbound mail... legitimately.

So what's the solution? I fear it's less obvious than the problem, and will continue that way for the forseeable future.
0 Votes
+ -
My solution - I have blacklisted all foreign country domains. By doing so, I have cut the amount of Spam mail from 275+ a day down to about 30. I would love to blacklist Yahoo, but this would cut off 40% or so of our members.
0 Votes
+ -
Spams are from fake sources
joemartn 21st Jul 2008
My scrutiny reveals that all the spams are from fake accounts, pretenting to be whatever: gmail, yahoo, hotmail, whatever. To understand where they are comming, you need to look at the sender's IP address as well as email servers, etc.

I don't consider people sending me emails from gmail as spam since they don't belong to the category of "BULK" mails! Spams are bulk mails!
0 Votes
+ -
Gmail
aulax@... 21st Jul 2008
Google is the only provider that I know of, which still allows FREE POP access. Using programs freely available, you can send 100,000+ emails through them a day.

At least Yahoo, and I believe, Hotmail, require you to pay for POP access, which I think iss why spammers are moving to Gmail.

We got so tired of all of the spam, we now have blacklisted Yahoo, Google, Hotmail, and AOL.
0 Votes
+ -
So, along with the spam, all legitimate emails from them get thrown out as well.
0 Votes
+ -
The FIX is quite SIMPLE !!
tosh382 21st Jul 2008
Only allow emails to arrive in the inbox where it matches the name and/or address of a contact in their addressbook.
0 Votes
+ -
That's a severe remedy
Telexer 21st Jul 2008
Your old buddy from school will never be able to get past your spam filter to reconnect with you -- even if he/she got your email from a friend.

And when your bank sends you that overdue payment notice, you never know what email address it will come from (ex id=billing, accounting, whatever). But not to worry, the eviction notice will come via snail mail.

Not to be snarky but it just defeats one of the key benefits of email.
0 Votes
+ -
That fixes nothing
bmerc 22nd Jul 2008
Spammers already fake the sender information, and it's quite common for them to fake the sender to look like it comes from the same domain as the recipient.

There is no silver bullet. There is no magic solution.
As long as we have countries who don't have good antispam laws, or don't enforce their laws, spam will continue to be the vast majority of email traffic.
0 Votes
+ -
POP access would allow you to *receive* 100,000+ spam messages a day, not send.
0 Votes
+ -
the number of emails a user can send in a month? If you are sending over say a thousand emails in a month, you are either a real business or a spammer. And the real business should not be relying on a free email account to do mass mailings anyway.

That should make these free services unattractive as spam platforms. Of course, all the free services would have to agree to do this. Or the one still offers unlimited email will use it as marketing hype to differentiate their service from the competition.
0 Votes
+ -
Re: Telexer,

Even better, why not flag those accounts that are sending more than, say, 500 messages per week--the top 5% or so of volume senders and make them further authenticate their legitimacy (or explicitly agree to expose their IP) before sending any more mail. This way, the providers are not blocking legitimate high-volume users, just asking them to explain their volume needs.
0 Votes
+ -
I use gmail and made the mistake of
signing up for some free stuff (my stupidity). The spam really started then. Never again.
I think the email providers should be doing something to curb the volume of emails. Ya think there could be some sort of analyzing program that would look at the email address and the text of the body and with pre-set parameters, be able to tell whats a legit email and what isn't. I've seen so many email addresses and text in the body of the message that are a name with a bunch of gibberish characters or just a bunch of garbage characters with a URL link in the text of the body in the message for every spam mail I get. Ya think this program could analyze some of this and help filter it out. However if the email providers are getting paid to let it go, why would they wanna filter it. This is email, run a muck. And it should be controlled a little better then it has been. I feel both providers and customers should be actively taking part in trying to prevent it. People need to wise up and stop buying crap in spam mail and research what there looking at before clicking BUY NOW. Providers should be doing more to figure out and stop large volumes of emails going thru. Take everyones help.
i use gmail and do not know from where the spam i get every day originates, however i get almost zero spam as legitimate email and almost legitimate email caught as spam. gmail's spam filter is almost 100% efficient in catching the incoming stuff.
if they cannot keep senders from using their service at least they keep the users of gmail protected.
0 Votes
+ -
Responsible Parties
forestrj 21st Jul 2008
People sending Spam should be held accountable to the point of creating a new set of laws strictly for spammers/phishers/etc; Mandatory 2 to 5 years Federal Prison, 250,000.00 fine for individuals and 1,000,000.00 fines for companies/company officers that engage in or contract Spamers, plus loss of ability to operate any PC that has so much as a Phone Jack, let alone WiFi or a NIC.

I am not talking the so called annoying crap you get from your family and friends, I call them chain emails, another good waste of Internet connectivity. I am talking about that garbage that you get form so called Wal-Mart, Dieting, Scholarships and oh yeah my bank/ebay/paypal saying my account has been jacked. PLEASE!

I hate getting 30 emails, and 24 of them are Spam or news letters I never signed up for. Also, I gave up on clicking that remove me, because I found out they sell your information to some other dirt bag.

Dirt Bag Spamers us the most lame email addresses, you know they are Spam just by looking at them...

KAPLAN.UNIVERSITY.OPPORTUNITIES@str299whirl.com
Scholarships for moms [Remington@crimemaleolpae.com]
Seen on Oprah [noreply@inequitableocean.net] Anything with the Words Seen on Oprah or simply Oprah/Opra are immediately considered spam in my Outlook.

I mean it, these people are out of control, and need to be stopped. Start by making laws geared to punish them harshly! Over all we waste more time deleting, creating rules and so on, than we do most other activities we do. Spam is a serious problem, and should be dealt with HARSHLY, short of shooting the human trash that propagate Spam.

Forest
0 Votes
+ -
Spam always has some goal -- to get you to buy
something or to click something put forth by an advertiser.
So it would seem that if you went after the advertiser,
rather than those the advertiser pays to send spam, you'd
cut the head off the snake.

For example, if ViagraRUs.com is the subject of millions of
e-mails, the provider of their services could shut them
down or tell them they have 72 hours to stop spamming,
just as an example.
0 Votes
+ -
Two problems...
bmerc 22nd Jul 2008
First, spammers have changed their focus. Spam is now just as likely to be about phishing attempts and malware distribution as it is about any sort of marketing.
Second, the people who are "advertising" via spam are CRIMINALS.

Half the time the web sites being advertised are hosted on a hijacked server. The other half of the time, the ISP is in on the scam.
0 Votes
+ -
RE: Two problems
fatman65535 1st Oct 2008
Quote: Half the time the web sites being advertised are hosted on a hijacked server. The other half of the time, the ISP is in on the scam.

(emphasis mine)

You would not be referring to Intercage, now would you????
0 Votes
+ -
RE: Spam coming from free email providers increasing
MooMooMooMooMoo Updated - 21st Jul 2008
I've had a solution for years: get the big 4 credit card providers to agree to stop accepting any payments for known spammers. No profit, no problem!

Unfortunately there's lots of profit in spam for "legit" corporations.
0 Votes
+ -
Total Agreement
itanalyst2@... 21st Jul 2008
My Gmail spam folder in four days can go up to 1500 spam mails, it's ridiculous, and I have gmail accounts that I have never used that get spam as well....just find the spammers and jail them.
My gmail account presently has 16 valid emails and 1348
spam emails on it, The spam is separated out by google
reasonably accurately and the few that do get through are
toasted by me. I don't look at them anymore and google
deletes them automatically. Invalid addresses on most of
them point to a strange situation of " Hi there, I'd like you
to buy this but I can't tell you who or where I am." The only
solution I can think of is for an email sender to send an
email available request to my ISP. My ISP responds to the
sender's address and the email is then sent to me. It
probably wouldn't work for some reason except phony
email addresses wouldn't be able to send any emails thus
lightening the load.
0 Votes
+ -
What about pop-up from Internet Explorer, while I was browsing on the IE a pop-up comes on as big as the window screen and it is supported by IE, you cannot block it of any software. How can we stop this?
0 Votes
+ -
Yahoo has always been the top spam provider! Been getting pounded with the "Hello Dear" and "Mumbamo Bimyasi" and all the other "Fund Givers and dead relatives etc. Sometimes I reply and tell the to stick it but that probably entices even more junk!

Tom
I not only think these large email providers are accountable, but I'm suspicious of their ability to manage what they're doing. Recently sbc yahoo implemented a major upgrade to their personal sites and email, adding functions similiar to Outlook. I tested out their Betas several times over the last year and noted a significant increase in spam coming through each time I switched to the new format. Consequently I refuse to move to the new email format even though it has some nice features.
0 Votes
+ -
I quit using the "free email services long ago as I did not wnt to send advertisements to my friends. I hate getting them. Most of my contacts have also given up the free services. I do have one cousin that still uses aohell.
0 Votes
+ -
my ISP would give me one chance to clean it up or shut me down. Google should be dealt with the same way. If they can't manage their network they need to be shut down.
0 Votes
+ -
A simple fix is to limit the number of outgoing mail from a free mail server. This limit can be such that legitimate users will not be impacted. A limit of say, a few hundred per month would be sufficient. More than that would require a paying of fee and disclosure of a verifiable IP address.
Possibilities: Levels of service.
(Scheme 1) Users who have not validated a phone number go out through the "low" server (the one likely to be blacklisted occasionally), OR get their IP address added to e-mails, OR both.
(Scheme 2) Users who are paid customers (paid for some service, or paid a token gift or "retainer") get the "high" service; others get the "low" service.
I think ZDNet is in fact one of the spammers, I get between 6 to 8 dumb emails a day with supposed breaking news headlines that I really do not want.

Join the conversation!

Formatting +
BB Codes - Note: HTML is not supported in forums
  • [b] Bold [/b]
  • [i] Italic [/i]
  • [u] Underline [/u]
  • [s] Strikethrough [/s]
  • [q] "Quote" [/q]
  • [ol][*] 1. Ordered List [/ol]
  • [ul][*] · Unordered List [/ul]
  • [pre] Preformat [/pre]
  • [quote] "Blockquote" [/quote]
ie8 fix
Click Here
ie8 fix

The best of ZDNet, delivered

ZDNet Newsletters

Get the best of ZDNet delivered straight to your inbox

Facebook Activity

White Papers, Webcasts, & Resources
ie8 fix
ie8 fix