Why is Net Applications (Hitslink) changing its browser stats after publishing them?
Thursday, September 4, 2008 7:13:29 PM
I was curious to see how the uptake of Google's Chrome browser would be, considering that they were promoting it on their front page. I looked it up on a special page set up by Net Applications to track Chrome usage before I left for work. It seemed to do pretty well, as it climbed above 1%, passing Opera's alleged market share. Not really surprising considering the massive media coverage it was getting.
When I got back later and reloaded the page, I noticed that it had gone down to 0.5% or so the last few hours. I still left the page open, and returned a little later. To my surprise, the page was no longer showing the same numbers for the same time. It's as if it had never shown 0.5%.
I tried to get my hands on a cached copy of the page to make sure that it wasn't just a mistake on my part, and indeed, it was not. Apparently Net Applications decided to change the numbers after they had been published.
When I got back later and reloaded the page, I noticed that it had gone down to 0.5% or so the last few hours. I still left the page open, and returned a little later. To my surprise, the page was no longer showing the same numbers for the same time. It's as if it had never shown 0.5%.
I tried to get my hands on a cached copy of the page to make sure that it wasn't just a mistake on my part, and indeed, it was not. Apparently Net Applications decided to change the numbers after they had been published.
Edit: It looks like the original image has been removed from the server, so I uploaded both of them here instead:
Original graph:
Current graph: 
The numbers are 0.56% and 1.18% respectively for 9/4/2008 11:00:00 AM (EDT).
See the full images in my Net Applications/Chrome stats photo album.
This is not the first or even second time the numbers published by Net Applications have "mysteriously" changed from one day to the next. A few years ago, Opera showed up with up to 5% in their stats. Apparently they figured that this was too high, so the numbers were slashed. Then, last year, Opera for Desktop was climbing above 1%, and Opera Mini was up to 0,6% or so, and climbing fast. Overnight, the figures changed completely, and Opera Mini was down to 0.1% or so, while desktop was at about 0.5%.
Now, what is the reason for this apparent tampering with the stats? I really don't know. It could have a perfectly valid explanation (even though I can't think of one at the top of my head), but Net Applications seems to stay quite tight-lipped about how their stats are measured. For example, they claim that theirs are "global stats", but aren't their customers mainly located in the United States?
In any case, this highlights just how unreliable browser statistics are. While one browser might re-fetch resources from the server fairly often, another browser might use the cache more aggressively, and thus cause fewer "hits", and show up lower in the statistics. This depends on how the stats are measured, of course, but many stats companies refuse to share their actual methodology.
And when their numbers are seemingly manipulated without any explanation what so ever, this raises serious questions about how reliable they are, and whether they should be quoted at all when discussing browser usage.


João EirasxErath # Thursday, September 4, 2008 10:37:55 PM
At 7 PM UTC, Chrome had 0.78%, later at 8PM when I checked again, all percentages from the last hours were all above 1%.
It's normal that chrome will loose market share. Most people only used it for a quick spin or some testing.
**digged: http://digg.com/software/Why_is_Net_Applications_changing_its_browser_stats
FavDjiXas # Friday, September 5, 2008 7:45:24 AM
Haavardhaavard # Friday, September 5, 2008 8:19:11 AM
Other data from before the overnight change:
August 2007:
- Opera Mini: 0.27%
- Opera Desktop: 0.88%
July 2007:- Opera Mini: 0.24%
- Opera Desktop: 0.89%
June 2007:- Opera Mini: 0.21%
- Opera Desktop: 0.91%
May 2007:- Opera Mini: 0.16%
- Opera Desktop: 0.74%
April 2007:And just before the sudden change:
October 2007:
November 2007:
It's worth noting that the old stats (percentage growth) for 2006 and 2007 seem to make more sense, since the number of Opera users has doubled since 2006. As you can see, Opera Desktop grew by 67% in 2006 and 45% in 2007, according to the old statistics. That confirms the number from the press release.
In other words, it would seem that the numbers from Net Applications today are less accurate than they were before, which is interesting indeed.
FavDjiXas # Friday, September 5, 2008 12:20:44 PM
You could be right though
Haavardhaavard # Friday, September 5, 2008 2:32:26 PM
FavDjiXas # Friday, September 5, 2008 3:37:45 PM
Have a nice weekend
Khaled KhalilKhaled-Khalil # Saturday, September 6, 2008 3:40:24 AM
thought, i don't defend them, i don't even trust them, just look at this stat of OS market share, note that iphone has 0.30% of the market share, does this means that for every 1000 computer have access to them 3 of them are iphones (or have iphone software installed somehow, or even are sniffing as iphone OS) ? i really doubt.
p.s. i already know hitslink is an opera partner, i am sorry, but that was just my personal opinion
Haavardhaavard # Saturday, September 6, 2008 10:10:56 AM
This site is currently using Hitslink, but considering their strange and unreliable stats, I hope we will be looking elsewhere for a better solution.
Anonymous # Thursday, October 2, 2008 9:46:24 AM
Anonymous # Thursday, October 2, 2008 9:55:36 AM
Anonymous # Friday, October 3, 2008 10:04:58 AM
deadHarlequin # Wednesday, October 8, 2008 10:22:40 PM
I wonder how difficult would be to build your own counter and statistics code? you built a complete forum engine, and you cant build your own statistics code? I really dont get it.
Haavardhaavard # Thursday, October 9, 2008 10:02:11 AM
As for doing everything in-house, that is not always the best solution. Just like all phone manufacturers may not want to build their own browsers and contact Opera instead to license one because it might be cheaper, easier and better than building your own.
Daniel Aleksandersendaniel # Thursday, December 4, 2008 8:07:35 AM
I wonder whether Opera would have a larger share if it had not been for the Content blocking feature. I, for one, block web metrics such as Hitslink because I feel it is a waste of bandwidth. (I am old school: Go HTTP server access logs for metrics! Woho!)
Anonymous # Thursday, December 4, 2008 10:55:46 AM
Cutting Spoonhellspork # Friday, January 9, 2009 8:05:55 PM
Ask the browser how many pageloads it's executed. Ask for an estimate of the data volume covered. If someone uses the Opera Mail client, is it possible to report that as traffic to email providers? Mail client reporting is godawful in itelf.
But for example, the download client uTorrent has a floating bank of aggregate use statistics. It lists how often and for how long it's been run, how much it's sent and received...I would hope that these numbers are already being anonymously reported to vendors by their install base.
It would be nice to see a report on traffic saved due to page caching, or any number of other statistics that are much more valid than say, how many people are visiting one small company's limited client base.
I have no need to hear what a site thinks it's being viewed by. I want to know how many people are using each viewer and how many pages they're looking at. If a news provider's IE hits land on the main page 90% of the time, but Opera hits only land there 40% of the time, this may be due to a difference in browser behavior AND NOT Internet Explorer users fleeing deadly words/non-pornographic images. Capice?
PS: User-Agent spoofing isn't much of a concern to me. By sheer metric of volume growth among Opera users, the majority of them have new-enough copies to rule out any weighting in the statistics. Or is Opera to this day failing to represent itself? If Opera is still spoofing, then the slim number of reported hits come from sites that have taken extra effort to correctly identify the browser. Maybe I'm low on sleep, but I can't seem to find raw numbers on that Net Applications graph. I'd like to see how many total hits they've indicated.
For laughs, the current results of the "best browser" survey pane on their site are:
Firefox: 63.17%
Opera: 15.74%
Safari: 11.34%
Internet Explorer: 9.76%
So either there's a lot of unreported Opera users or they're 15.5 times as vocal as your average Safari user. For that matter Firefox users voted at three times their respective market share.
JoeGoJoeGo # Friday, January 9, 2009 11:55:11 PM
Originally posted by hellspork:
Actually Opera identifies as itself by default, but it needs to spoof as other browser for lots of major sites. And it needs to apply JS patches for several hundred sites as well. Check out the documentation on Browser JS.
Cutting Spoonhellspork # Monday, February 16, 2009 6:42:13 PM
Anthony LPGusatonycuba # Wednesday, January 6, 2010 1:08:19 AM
Google have a simple a easy way to promoted their "products", in other hand they are investing millions in FF.