Microsoft's IE9 standards tests vs. reality
Wednesday, March 17, 2010 1:15:35 PM

The good news is that Internet Explorer 9 supports SVG!
The bad news is that Microsoft's standards support table could mislead people into thinking that IE9 is more standards compliant than other browsers.
Since I'm already talking about SVG, let's look at that as an example. If you read the description on their page, you will notice that it doesn't actually show SVG compliance as such. It shows how each browser does when running the 31 tests Microsoft created, when even the SVG 1.1 Tiny test suite has more than 150 different tests.
CodeDread has a published list detailing SVG support in different browsers. As you can see, IE9 still does poorly compared to other browsers. So while Microsoft's own page would give you the impression that IE9 has excellent SVG support, that is not the reality.
It's great that IE9 will support SVG, but I think Microsoft's page is rather misleading. Let's hope they are planning to make use of the full test suite at some point.
In conclusion: Microsoft should update the page to make it more obvious what it actually shows. It currently gives the false impression that IE9 beats all other browsers at standards compliance.
Not cool, Microsoft. Not cool.


1 2 Next »
eliotcougar # Wednesday, March 17, 2010 1:30:55 PM
Daniel Aleksandersendaniel # Wednesday, March 17, 2010 1:43:19 PM
Krio LythKriolyth # Wednesday, March 17, 2010 1:58:18 PM
However, if we assume that their tests stick to standards, it's "clean" marketing - no lying while presenting good sides and concealing ugly ones.
FransFrenzie # Wednesday, March 17, 2010 2:12:37 PM
Brian HuismanGreyWyvern # Wednesday, March 17, 2010 2:46:06 PM
FransFrenzie # Wednesday, March 17, 2010 2:51:37 PM
Originally posted by Brian Huisman:
Assuming they are correct. I recall seeing one or two wrong CSS2.1 tests when I looked over those Microsoft-submitted testcases and I only randomly clicked through a few.
Rijk # Wednesday, March 17, 2010 3:31:10 PM
BTW, IE9 does pass all the test in the automatic Selectors text, which is very nice.
sirnh1 # Wednesday, March 17, 2010 4:04:00 PM
Originally posted by haavard:
It's Microsoft, what else did you expect?
(I would really like to see test results, from test not done by microsoft, because all I have is windows XP and that one doesn't support IE9
Plazzmex # Wednesday, March 17, 2010 4:40:43 PM
Luchio # Wednesday, March 17, 2010 6:57:19 PM
prd3 # Wednesday, March 17, 2010 8:21:24 PM
Originally posted by Luchio:
The official testsuite already does that. Also, Microsoft's tests contain several errors. So no, Microsoft's tests are not useful. If they had bothered to let other people check them first, perhaps. But right now it's just wrong marketing garbage.
Cutting Spoonhellspork # Wednesday, March 17, 2010 9:31:58 PM
...or that's the message *I* took away from it.
http://ie.microsoft.com/testdrive/Default.html
Opera 10.51 RC1 handles most of that crap easily. On an N280 netbook running XP, in Power-Saver settings, with 10.10 running more than a hundred tabs in the background. They've got a ways to go.
d4rkn1ght # Wednesday, March 17, 2010 9:48:10 PM
Originally posted by mgillespie:
And don't forget that some people still swear by that serious flawed company. They love to put down on Opera, Apple, Linux, or any other company that truly had innovated.
masterofopera # Wednesday, March 17, 2010 10:32:37 PM
At the first moment I saw the chart, I was shocked,
but I thought later, this this can not be true, Opera "was"
the the browser with the best SVG support.
Now I feel reassured.
Some things seems to never change at Micro$oft.
Edit: I hope the people will spread it.
Daniel HendrycksDanielHendrycks # Wednesday, March 17, 2010 10:55:05 PM
AtTheOpera # Thursday, March 18, 2010 1:12:10 AM
David BruantDavidBruant # Thursday, March 18, 2010 1:26:55 AM
Their dark green "100% line" is a very efficient communication idea.
Daniel HendrycksDanielHendrycks # Thursday, March 18, 2010 1:47:30 AM
Originally posted by AtTheOpera:
He is informing people that Microsoft is lying.
Originally posted by AtTheOpera:
True, but they should not lie about it.
AtTheOpera # Thursday, March 18, 2010 2:03:08 AM
Note the emphasis on "tests we submitted". It doesn't claim to be all tests or the best tests, but ones that MS submitted.
Daniel HendrycksDanielHendrycks # Thursday, March 18, 2010 2:16:46 AM
Originally posted by AtTheOpera:
But, it certainly was quite a diminuendo. Don't worry, Haavard was just disliking the fact that they used tests created by themselves to make it look 5x better than what it is. Kinda like Chrome and the V8 benchmark. And, obviously, he did not like that they did not implement Theora.
Cutting Spoonhellspork # Thursday, March 18, 2010 2:37:04 AM
Originally posted by AtTheOpera:
Oddly, your typo makes your statement "correct". There was NOT real emphasis on the submission component, at a glance it looks like the inclusive listing of all important tests. Why? Well, most people seem not to even know what a "browser" is...
Pity that Apple's flawed xServe comparison page is no longer up.
prd3 # Thursday, March 18, 2010 10:44:52 AM
Originally posted by AtTheOpera:
So it's OK for Microsoft to post misleading claims, but not to point out when they do so?
If Microsoft is making such positive strides, why can't they do it without lying?
What good do positive strides to if they are going to keep lying to people?
It's like one step forward, two steps back.
You know as well as everyone else that the page is blatantly misleading, and now lots of people think IE9 has better support for open standards than other browsers.
Why are you defending liars and attacking people who expose liars?
prd3 # Thursday, March 18, 2010 10:46:47 AM
Originally posted by AtTheOpera:
Never mind the fact that there are huge errors in their tests... If Microsoft had been honest, they would have run browsers through the full existing testsuites instead of cherry-picking a tiny amount of tests they optimized IE for.
Why didn't they optimize IE for the existing tests instead? Why did they have to write their own (with multiple errors)?
We both know the answer to that.
FransFrenzie # Thursday, March 18, 2010 10:53:40 AM
Originally posted by AtTheOpera:
Complaining that Opera didn't support border-radius while it supported much more useful CSS3 selectors near-perfectly for ages is chopping down. Pointing out that Microsoft is making misleading statements is chopping down? Hah!
Originally posted by AtTheOpera:
It's more like the small print than "the emphasis."
By the way, those CSS3 selector tests (and various others) are very inaccessible behind iframes etc. so frankly I can't be bothered to look at them. However, I'm quite inclined to agree that at least some of them are probably nonsense as prd3 says (I assume he checked them or some such? prd3?). Like I said, a bunch of those CSS2.1 ones sure were.
z@h3kZAHEK # Thursday, March 18, 2010 11:03:49 AM
Charles SchlossChas4 # Thursday, March 18, 2010 12:55:40 PM
Tho I wonder how they maintain 4 different versions of IE at the same time? 5 tru 8
Luchio # Thursday, March 18, 2010 2:04:53 PM
Originally posted by prd3:
For SVG, yes, but there are other subjects such as CSS that are tested there.
Originally posted by prd3:
Not trying to defend Microsoft here, but could you give specifics? Or do you just assume that the tests are wrong because they come from the MS Factory?
FransFrenzie # Thursday, March 18, 2010 2:09:15 PM
Oh, and this one?
icare # Thursday, March 18, 2010 6:15:47 PM
Now, if I'm not wrong the first one refers to chapter 5.3, yet the official test, on the w3.org website seems to work pretty well.
The second one seems to refer to chapter 11.4 and yet the official test seems to work pretty well again.
Now, I don't know a lot about this coding stuff so maybe I'm all wrong, maybe I didn't see something but I'd like someone more experimented to tell me if I'm wrong or Microsoft did "forgot" something in their tests.
FransFrenzie # Thursday, March 18, 2010 6:39:45 PM
I think the second one is more related to pathLength here? http://www.w3.org/TR/SVG11/paths.html#PathElement
FransFrenzie # Thursday, March 18, 2010 8:48:14 PM
Someone took a look at some of the CSS tests.
Daniel HendrycksDanielHendrycks # Thursday, March 18, 2010 9:34:52 PM
Originally posted by Luchio:
Coding errors. There are invalid pages according to the W3C Validator.
FransFrenzie # Thursday, March 18, 2010 9:36:43 PM
Originally posted by Daniel James Hendrycks:
I thought they took the SVG Validator down?
AgentCROCODILE # Friday, March 19, 2010 1:28:52 AM
Originally posted by AtTheOpera:
Positive strides such as making fraudulent "standards tests" and lying and producing porkies, as well as making their products a lot more bloated and slow than they should be?
Cutting Spoonhellspork # Friday, March 19, 2010 6:48:03 AM
Keldian.-Keldian # Saturday, March 20, 2010 12:51:26 AM
Personal memo: Don't be too enthusiastic with new IE release announcements, ever again.
FransFrenzie # Saturday, March 20, 2010 8:53:38 AM
Originally posted by Keldian.-:
In all fairness, they are improving leaps and bounds. I just wish they wouldn't lie about how much they improved.
Kirilljarinkirill # Saturday, March 20, 2010 9:11:19 AM
FransFrenzie # Saturday, March 20, 2010 9:16:42 AM
Cutting Spoonhellspork # Saturday, March 20, 2010 9:19:43 AM
FransFrenzie # Saturday, March 20, 2010 9:25:12 AM
icare # Saturday, March 20, 2010 7:00:31 PM
Originally posted by Frenzie:
The microsoft URL contain the words "/chapter_05.3.svg" and "/chapter_11.4.svg" at the end. That's why I thought it was refering to this and this (plus the word "stroke-linecap" in the second test). But you're probably right, if Fx and Chrome pass the test, it must be something in Opera...
Thanks for your attention.
PozsonyiMarkCsendesMark # Saturday, March 20, 2010 11:33:35 PM
Failsoft?
They can't hide the truth from the experts
Quadunit404 # Sunday, March 21, 2010 2:06:42 AM
Originally posted by codedread:
coolfigaro # Monday, March 22, 2010 9:16:40 PM
In fact, I think Haavard's inclusion of his doctored screenshot is far worse. He removed the other browsers, the relative standards the tables were referring to, AND the column that indicates these were MS submitted tests. His inclusion of that image misrepresents the situation far worse than MS's original page.
The page has good text describing how these were specific ambiguities that MS wanted to clarify in the specs. Their preview is intended for developers. When a developer takes a look at a page describing standards (or really anything technical for that matter), he or she should know better than to just look at the graphics. I sincerely hope you don't take that approach to reading the standards themselves. That's how you end up with crap like this: http://imgur.com/oMgGG.png
Bottom line: if you really like web standards, then you should be encouraging the work they're doing to catch up and to clarify/improve the standards.
Cutting Spoonhellspork # Monday, March 22, 2010 9:40:38 PM
2) A cropped graph? Not nearly so bad as Shankland's manipulated graphs on cNet a while ago. (Cut the first 300 out of one, showed only Dromaeo DOM for Dromaeo total)
FransFrenzie # Monday, March 22, 2010 10:36:25 PM
Originally posted by coolfigaro:
Yeah, the original page showed other browsers doing far worse than Opera. He didn't capture quite what kind of an incorrect image the table gives. As I already said, saying "we pass our own tests" is either a clever marketing ploy (misleading without really saying anything untrue) or lack of thought.
Originally posted by coolfigaro:
What about crap like this? What about Opera's DOM compliance compared to IE's? It's nice that they're moving forward, but the notion that IE is better in anything but a few meager details is ludicrous.
prd3 # Tuesday, March 23, 2010 7:29:59 AM
Originally posted by coolfigaro:
How does the illustration image attached to the blog post misrepresent the situation?
It doesn't, and of course you know that, but you couldn't resist attacking the messenger, could you?
The fact is that the page falsely gives the impression
You are dishonestly relying on people to read the fine print to understand what the page is all about, but the proof is in the pudding: Hardly anyone got it, which is why "IE9 is more standards compliant than other browsers" was spreading across the web.
It had a wall of text, a fine print, that most people didn't bother to read. And Microsoft knows this.
If only they could stop lying.
Jimtoyotabedzrock # Friday, March 26, 2010 2:26:56 PM
Originally posted by Frenzie:
The same way banks come up with there own tests. It's literaly like telling a college student to write the questions for there own test.
beritaku # Wednesday, April 14, 2010 1:30:37 AM