jasoncalacanis’s posterous

 
« Back to blog

More on Why comScore is the suck and Quantcast is the rocks!

A friend just sent me this slide showing why b.s. sample based metrics
suck and Quantcat rocks. COMScore is now trying to shake down startups
to correct their bogus data when folks like Quantcast are giving away
*real* tracking for *free*. I'm so disgusted by these guys.... they
actually offered to give me a free correction to their bogus data so I
could convince you--my fellow entrepreneurs--to give your money to
them.
 
I've got a message to comscore: not in this lifetime!
 
Like the DEMO conference which abuses startup companies, comScore must
die!!! Don't give money to comscore people.... don't feed the trolls!

Loading mentions Retweet

Comments (8)

Aug 05, 2009
informed viewer said...
Make sure you know who you're praising though.. quantcast isn't exactly accurate either. They use techniques that can miss a LOT of data collection. Further, numbers they provide such as demographics aren't much better than random guesses.

Stats are pretty much lies all around the board.

Aug 05, 2009
Jason Calacanis said...
1. since you're using "informed viewer" i'm guessing your work at Comscore.

2. we use Google Analytics and ComScore and I would say they are within 2-10% (mainly because we load QuantCast last on the page and Analytics earlier since we get more from it).

sample based data = bad.
real tracking pixel data = good

that simple

Aug 05, 2009
informed viewer said...
My point was all of those techniques aren't really that great or accurate.

No I definitely don't work at comscore or any other analytics company. I've just dealt with them all for a very long time and understand how they work behind the scenes. I wouldn't put a whole lot of faith in any of the numbers anyone gives you.

Aug 05, 2009
Dossy Shiobara said...
This is also why Alexa and Technorati numbers are totally worthless, too.
Aug 05, 2009
Ted Tschopp said...
informed viewer,
Can you give specifics regarding the problems you are aware of? You can't make decisions with generalities which is what you have given us. This is the point Jason is making. Generalities suck, and when you pay for em, they suck even more.
Aug 05, 2009
Tom said...
Some reasons why Comscore struggles:

It only has a US panel, so international traffic is ignored
Panels skew heavily towards home users, so work traffic is generally underrepresented
It's sample based and extrapolations are always a guesstimate, particularly where low volumes limit statistical significance.
- These issues alone would easily explain the PV variances above.

Some reasons why Quantcast struggles:

I'm not familiar with Quantcast, but it seems to use the same tag based method as most Web Analytics vendors, so it is essentially measuring cookies and javascript - it isn't perfect, but it's about as good as it gets for most sites. Page views should be relatively accurate (compared to unique visitors for example)

I'm a bit dubious about their claims re measuring demographic and lifestyle etc. Any JavaScript based method won't have this so it will presumably be extrapolation based, so subject to the same issues as above.

Aug 05, 2009
Tom said...
so, what makes quantcast special?
Aug 06, 2009
What makes quantcast special? You mean besides Calacanis being on the board?

IMO, it's that they post their numbers publicly.

Leave a comment...

 
Got an account with one of these? Login here, or just enter your comment below.
Posterous-login    Connect    twitter