ie8 fix
madison

Zero Day

Ryan Naraine, Emil Protalinski and Dancho Danchev

Study: IE8's SmartScreen leads in malware protection

By | March 24, 2009, 9:22am PDT

Summary: A recently released NSS Labs study, claims that Internet Explorer 8 greatly outperforms competing browsers in terms of protecting users against web based malware. According to the study based upon a modest sample of 492 URLs, not only is IE8’s SmartScreen Filter achieving a leading position against the rest of the popular browsers, but also, it [...]

A recently released NSS Labs study, claims that Internet Explorer 8 greatly outperforms competing browsers in terms of protecting users against web based malware.

According to the study based upon a modest sample of 492 URLs, not only is IE8’s SmartScreen Filter achieving a leading position against the rest of the popular browsers, but also, it also outperforms them in terms of the average time it takes to block known and already tested malicious sites. Among the key conclusions is that Opera 9.64 and Internet Explorer 7 provide “practically no protection against malware”.

Here’s how the study ranks the browsers:

  • Microsoft Internet Explorer v8 (RC1) achieved 69% block rate
  • Mozilla Firefox v3.07 achieved just over 30% block rate
  • Apple Safari v3 achieved 24% block rate
  • Google Chrome 1.0.154 achieved 16% block rate
  • Opera 9.64 achieved 5% block rate
  • Microsoft Internet Explorer v7 achieved 4% block rate

The study’s methodology is however, greatly flawed at several key points, making its conclusions open to interpretation which should be the case when making such comparative tests.

For starters, NSS Labs undertook a rather minimalistic approach towards the definition of web malware. In this study, the malware URLs they’re using are basically “links that directly lead to a download that delivers a malicious payload“, a decision that directly undermines the statement of “block rate” in times when client-side vulnerabilities are massively abused courtesy of web malware exploitation kits. And since no live exploit URLs were taken into consideration, the DEP/NX Memory Protection feature within IE8 was naturally not benchmarked against known exploits-serving sites, or at least wasn’t mentioned in the report.

Moreover, the competing browsers’ use of SafeBrowsing’s API, a combination of automatic (honey clients) and community-driven efforts to analyze a web site in a much broader “malicious” sense has a higher potential to maintain a more comprehensive database of known badware sites. It also comes as a surprise that Firefox, Safari and Chrome have such a varying block rates given that the browsers take advantage of the SafeBrowsing project’s database. Basically, having a set of ten malicious URLs and running it against the browsers is supposed to return identical results due to the centralized database of known badware sites.

Interestingly, the study used Apple Safari v3 in order to come up with the 24% block rate, which excludes the built-in anti-phishing and anti-malware features introduced in Safari v4. The report is released prior ot IE8’s debut, but even if NSS’s study is in fact relevant in a real-life attack scenario, does it really matter that IE8’s outperforms the rest of the browsers in times when IE8 users are downgrading to IE7? That very same IE7 which according to the study is offering “practically no protection against malware”?

Anyway, consider going through the report, with a salt shaker in hand.

Kick off your day with ZDNet's daily e-mail newsletter. It's the freshest tech news and opinion, served hot. Get it.

Topics

Dancho Danchev is an independent security consultant and cyber threats analyst, with extensive experience in open source intelligence gathering, malware and cybercrime incident response.

Disclosure

Dancho Danchev

More details on Dancho Danchev's current and past professional affiliations, can be found in his LinkedIn profile.

Biography

Dancho Danchev

Dancho Danchev is an independent security consultant and cyber threats analyst, with extensive experience in open source intelligence gathering, and cybercrime incident response. He's been an active security blogger since 2007, and maintains a popular security blog sharing real-time threats intelligence data with the rest of the community on a daily basis. More details on Dancho Danchev's current and past professional affiliations, can be found in his LinkedIn profile. You can also follow him on Twitter
34
Comments

Join the conversation!

Just In

RE: Study: IE8's SmartScreen leads in malware protection
lovedong 13th Sep
I very much enjoyed this article. replica watches
0 Votes
+ -
Whaaaaat?
honeymonster 24th Mar 2009
"does it really matter that IE8?s
outperforms the rest of the browsers in times
when IE8 users are downgrading to IE7?"

So, IE8 quickly picked up adoption throughout
the week-end and suddently on monday it drops.

I would expect that from Informationweek (who
are actually behind this stupidity).

But I'm really disappointed that you just
repeat such obvious stupidity as gospel.

What happens on monday mornings? Bingo! People
go back to work. Wanna bet how many workplaces
have upgraded to IE8 by now?

Wanna bet what happens come friday aftenoon?

Geez.
I very much enjoyed this article. replica watches
hahahaha this is so funny.... I think NSS
labs is a MS Partner
0 Votes
+ -
Right....
TylerM89 24th Mar 2009
http://nsslabs.com/
http://nsslabs.com/general/partners.html

Hahahaha.... wouldn't that be great? To be able to say Microsoft somehow skewed the results... ah well you could only hope. Too bad
0 Votes
+ -
Again, Microsoft achieves greatness! I upgraded to IE8 on all my computers the day it came out and I couldn't be happier. I thought the accelerators and web slices were great, but knowing that IE8 tops the malware protection charts makes it that much better.
0 Votes
+ -
Um....
ejhonda 24th Mar 2009
69% isn't "greatness". It's abject failure, albeit less so than the others. But hey, keep that cheerleading handy when the first browser is able to hit in the high 90 percentile. Then it's time to pop a cork or 2.
0 Votes
+ -
So you are saying
Qbt 24th Mar 2009
So you are saying that he should not use IE8 because it only got 69%?

Since malware protection is important to him, what are the alternatives then?

Firefox that scored less than half?
That security disaster that is Safari?

Hmmmm...?
0 Votes
+ -
I'll take a 31% failure rate
AllKnowingAllSeeing 24th Mar 2009
ove a 95% failure rate any day of the week.
0 Votes
+ -
Defender
LiquidLearner Updated - 24th Mar 2009
feeds an awful lot of information back on malware attacks I would suspect. I'd say that gives Microsoft an edge in building a safe surfing database, although ideally they'd all work together and create one, open database. But that probably won't happen.

I agree with honey though. IE8 would only logically be upgraded faster at home than at the office. So a drop from the weekend into a Monday shouldn't be surprising at all, and the fact that anyone would act like that is some sort of evidence of people uninstalling the browser is amusing. If the study is bogus then the article that was linked about IE8 dropping is down right perposterous.

- meant to reply to story, oh well.
0 Votes
+ -
How ideology can't stand facts
tonymcs@... 24th Mar 2009
I mean how twisted do you need to get to spin an IE convincing win into a loss?

I also have another reason as to why there was a short blip in IE8 takeup. That was all the ABMers downloading the new IE8, realising it blew the other browsers away and then uninstalling it as it disagrees with their ideology.

Don't like that explanation? - then make up your own. It has as much validity as the author's fantasizing.

Put IE8 on all my business's computers yesterday - no complaints, quite a few compliments.
0 Votes
+ -
HAHHAHAHA...lol
xunil skcor 24th Mar 2009
How pathetic. The safest way you can browse the web is to just use Firefox on Linux. Then you dont need malware protection because the OS is secure by itself. Microsoft's constant disregard for true security has lead to entire industries such as this one to pick up the slack.
0 Votes
+ -
Safer maybe
ditkazbearz 24th Mar 2009
But Linux being basicly useless doesn't make that possible for most people. Don't even bother responding how great it is noone uses it.
0 Votes
+ -
What a load of bollox!
Richard Turpin 25th Mar 2009
Who the hell wants Linux? what the friggin hell has that to do with the discussion.Get real...less that point two of one percent use the bloody operating system world wide..when we talk business OS we talk MS or MAC. Just for once stick your Linux where the monkey stuffs his nuts....politley that is.
0 Votes
+ -
You're wrong.
ZetaZeta 30th Jun 2009
Linux is a force in the server market, and is a legitimate replacement for Windows on a desktop PC for home/casual use, in addition to powerful development and some business use.
The market share of linux is probably closer to 8% considering the figures people use for linux are paid deployments. Even Microsoft agrees Linux has a larger home PC OS market share than Apple:
http://www.qwik-solutions.com/blog/?p=24
(take a look at that graph, tehe.)

I have rarely if ever heard of someone deploying Macintosh for business. My school uses linux and Microsoft OSes on their machines, in addition to Solaris. I see unix and linux used lots of places. I have never seen Apple machines when we talk business.

tl;dr: You're simply wrong.
I treid ie8,I do not know much about malware,but I had a few problems with IE8 so I uninstalled IE8,problem solved.
0 Votes
+ -
Problems
Tagamasid 24th Mar 2009
Would you care to share what those problems are? Maybe somebody here can shed light on your issues.
0 Votes
+ -
I read the report
eMJayy 24th Mar 2009
The study only tested the browsers against sites that use social engineering rather than clickjacking or drive-by downloading. In fact, they went out of their way to exclude the latter two. One of the main reasons why i stopped using IE was because of the drive-by downloading that it was allowing. Since socially engineered malware distribution doesn't work on me, this report has no value for me.




0 Votes
+ -
IE8's smartscreen blocks drive-by downloading
qmlscycrajg Updated - 25th Mar 2009
if you visit a known dangerous site, IE8 will block that page and any download from that site, so drive-by downloading is blocked.
don't even come close.
Check out the results.


http://blogs.zdnet.com/security/?p=2981
0 Votes
+ -
We at NSS Labs clearly stated this is a study of socially engineered malware, and not exploits. It was the title of the report, and defined therein; perhaps it got overlooked accidentally by some readers. See:
http://nsslabs.com/anti-malware/browser-security
The points about DEP and memory randomization etc are good and important to protect against client exploits; but they don't apply to the scope of this test. That is the subject of a different test. The complexities of doing exploit, malware and phishing testing all in one harness together are simply problematic from an automation standpoint.

I understand the expectation of SafeBrowsing. As proponents of opensource products, we use them every day, and had high expectations. But the data is correct. We went through extensive validation. This is why testing is important: should is. Now that there is an independent benchmark against live malware sites, developers across the board have more information which they can use to improve. We expect and hope that all of them will. And we'd be happy to assist.

Safari 4 beta came out after we had locked in the test harness, validated the stability etc. And we excluded beta software from this test across the board. This is a completely fair practice as it?s beta for a reason. We're happy to evaluate products at any stage, but each test project has its parameters and cannot be changed in mid-flight.

The sample size is the largest sample of live, validated web-based malware tested ever AFAIK. Our focus was freshness, so sites were fed into the system in 2hr after detection. Actually the total sample was 4x that, but we were conservative on the validation. Thus it was not ?minimalistic.?

More questions: no problem. We're giving an in-depth view of how we did the testing on this webinar. http://nsslabs.com/events/webinar-web-browser-protection-against-web-malware.html

sincerely,
Rick Moy, NSS Labs
0 Votes
+ -
The headline was wrong
Greenknight_z 25th Mar 2009
This piece should have been titled "Study: IE8's SmartScreen leads in phishing protection", not "malware protection". It is a good thing, though; since IE is the browser most likely to be used by the clueless, it's very important that IE have good phishing protection.

It's not a reason I would use it, however.
0 Votes
+ -
IE8's smartscreen checks for malware
qmlscycrajg Updated - 25th Mar 2009
IE8's smartscreen checks for sites hosting malware too
0 Votes
+ -
downgrading to IE- 7, Prove that to me????
hantoyo1@... 25th Mar 2009
I may well downgrade to XP x64 but that doesn't mean in any way that I would settle for IE 7. I've only been using FireFox for maybe 5 months now, after over a decade of experience with IE in various forms. So far I haven't seen anything wrong with IE-8 but only have been working with since it the RTM became available. Why would anyone, especially a supposed tech savvy blogger think we are all downgrading to IE-7. Blows my mind. So far in my 5 months or so fo experience with FireFox ( updated constantly since Firefox 3.0 inclusive ), the browser has only warned me of a malicious site ONE time. Since I browse close to 16 hours a day every day and I go to many different web sites ( if you know what I mean ), I don't consider one warning to be an extremely good record for the warning abilities of FireFox.
So I doubt many if any people are downgrading to IE-7, most people are not the dummies some would have us believe we are. If anything I think many are doing much the same as I am, testing and evaluating the benefits and problems inherent in the new browsers made available recently. So in reality, I think most people are upgrading, especially from IE-7, even if it is only to IE-8.
I think the reality is that there are to many browsers available now and a lot of people would rather there not be so many taunting them with new, hard to learn features. I can't say I blame them..
0 Votes
+ -
I agree I upgraded during the initial beta and besides having to use compatibility mode for some sites I have had no problems. It is far better than IE7, and I don't care for firefox at all.
Same here, protected from malware because it didnt work, "program not responding" on 9 out of 10 websites. Downgrading back to IE 7 solved all my problems
0 Votes
+ -
There are newer versions of Chrome and Safari then the ones you have listed on your test site. Granted they are public beta releases, but they are stable, functional, and wristwatch timeable faster than Internet Explorer V8...
is the list of sites that were used in the test available for the public to use? If so, where can it be found?
0 Votes
+ -
You say:
"In this study, the malware URLs they?re using are basically ?links that directly lead to a download that delivers a malicious payload"

Why would results on those URL's not be representative of results in general. Do you expect filters doing poor on the most basic of threats to improve on even complexer attack vectors ?
0 Votes
+ -
IE8 marketshare still rising
IE9 26th Mar 2009
Strange you are claiming that the IE8 users are downgrading as the marketshare is rising by the day
http://marketshare.hitslink.com/report.aspx?qprid=43&qpcustom=Microsoft+Internet+Explorer+8.0&sample=34

Last evening IE8 marketshare reached a peak of 2.89% and in the next few days it will pass 3%.
And I know that a lot of FF users also have installed IE8 even if they are not using it as their primary browser so the installbase will be well beyond those usage numbers even
The IEteam yesterday confirmed that even if the vunerability exists the exploit used at CanSecWest Pwn2own does not affect IE8 final

From the IE team chat:
"Q: Has the exploit used in the recent Pwn2Own been patched?
A: We are investigating the Pwn2Own issue that was responsibly provided to us by TippingPoint. While we can't comment on the specifics of the investigation at this time, we can say that the attack as demonstrated in Pwn2Own at CanSecWest will not succeed on the RTW build released on March 19 due to changes that can block the ASLR+DEP .NET bypass demonstrated by Dowd and Sotirov at BlackHat in 2008. "

See also:
http://blogs.technet.com/srd/archive/2009/03/23/released-build-of-internet-explorer-8-blocks-dowd-sotirov-aslr-dep-net-bypass.aspx
0 Votes
+ -
Geez, talk about locked minds.
The_Curmudgeon 29th Mar 2009
On BOTH sides of the argument.
Why can't people accept that MS sometimes puts out good software, and sometimes it doesn't.
As much as I like to bash MS for their interface (I HATE Vista) I will admit it is more secure than XP, OSX and some Linux distros.

The anti-malware software I have on my XP PC gets triggered under Firefox and Opera, but not using IE8 or Chrome browsing certain sites.
From this highly unscientific experience I conclude that MAYBE IE8 and Chrome are more secure in SOME cases.

I still don't like the interfaces of most browsers including Safari, Firefox, Chrome, IE7 and 8 or Opera, and use an older insecure browser, not IE, along with the anti-malware software instead.

No one has yet made a browser that is secure AND sufficiently customizable to please everyone, and probably no one ever will.
Make your choice(s) and stop bashing/defending them blindly.

0 Votes
+ -
A Positive Voice
cole.parker 1st Apr 2009
I've never been an IE fan; I've been on firefox for a very long time, but I'm very happy to hear that I.E. 8.0 and I.E. in general are improving... for two very good reasons.

1) There are a lot of people who use IE, so while I'd prefer my browser of choice to be the safest, every browser being safe if better for us all, scams and fraud roll down hill.

2) Because if IE isn't improving then Chrome,Firefox, Safari, etc, won't either. Competition is good, unchecked dominance, even by the "good guy" is bad.

Cole Parker
0 Votes
+ -
Well done! Thank you very much for professional templates and community edition
seslisohbet seslichat

Join the conversation!

Formatting +
BB Codes - Note: HTML is not supported in forums
  • [b] Bold [/b]
  • [i] Italic [/i]
  • [u] Underline [/u]
  • [s] Strikethrough [/s]
  • [q] "Quote" [/q]
  • [ol][*] 1. Ordered List [/ol]
  • [ul][*] · Unordered List [/ul]
  • [pre] Preformat [/pre]
  • [quote] "Blockquote" [/quote]
ie8 fix
Click Here
ie8 fix

The best of ZDNet, delivered

ZDNet Newsletters

Get the best of ZDNet delivered straight to your inbox

Facebook Activity

White Papers, Webcasts, & Resources
ie8 fix
ie8 fix