<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
		>
<channel>
	<title>Comments on: Google Analytics &#8211; oh, the controversy</title>
	<atom:link href="http://www.trendingupward.net/2008/11/google-analytics-controversy/feed/" rel="self" type="application/rss+xml" />
	<link>http://www.trendingupward.net/2008/11/google-analytics-controversy/?utm_source=subscriber&#038;utm_medium=rss&#038;utm_campaign=rss</link>
	<description>Web analytics for higher education.</description>
	<lastBuildDate>Sat, 04 Feb 2012 18:19:09 +0000</lastBuildDate>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.org/?v=3.3.1</generator>
<xhtml:meta xmlns:xhtml="http://www.w3.org/1999/xhtml" name="robots" content="noindex" />
	<item>
		<title>By: Brian Clifton</title>
		<link>http://www.trendingupward.net/2008/11/google-analytics-controversy/#comment-365</link>
		<dc:creator>Brian Clifton</dc:creator>
		<pubDate>Wed, 14 Jan 2009 14:40:59 +0000</pubDate>
		<guid isPermaLink="false">http://www.trendingupward.net/?p=996#comment-365</guid>
		<description>Brandt - I don&#039;t come to the same conclusion as you to Elisabeth&#039;s email (Google&#039;s PR dept.). There is no mention of how time-on-site is calculated. Its a polite email saying thank you for your input and we have listened to feedback.

I have no interest in proving the point any further. However, for further peer review, you may want to add your thoughts to the original post on this by Anivash.</description>
		<content:encoded><![CDATA[<p>Brandt &#8211; I don&#8217;t come to the same conclusion as you to Elisabeth&#8217;s email (Google&#8217;s PR dept.). There is no mention of how time-on-site is calculated. Its a polite email saying thank you for your input and we have listened to feedback.</p>
<p>I have no interest in proving the point any further. However, for further peer review, you may want to add your thoughts to the original post on this by Anivash.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Brandt Dainow</title>
		<link>http://www.trendingupward.net/2008/11/google-analytics-controversy/#comment-363</link>
		<dc:creator>Brandt Dainow</dc:creator>
		<pubDate>Wed, 14 Jan 2009 13:53:43 +0000</pubDate>
		<guid isPermaLink="false">http://www.trendingupward.net/?p=996#comment-363</guid>
		<description>Well, this is getting pointless.  Google say explicitly I am correct, and Brian says I&#039;m wrong and he knows this because he used to work for Google (though not in a technical capacity).

The answer&#039;s simple - if you&#039;re correct, Brian, show me the code.</description>
		<content:encoded><![CDATA[<p>Well, this is getting pointless.  Google say explicitly I am correct, and Brian says I&#8217;m wrong and he knows this because he used to work for Google (though not in a technical capacity).</p>
<p>The answer&#8217;s simple &#8211; if you&#8217;re correct, Brian, show me the code.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Brian Clifton</title>
		<link>http://www.trendingupward.net/2008/11/google-analytics-controversy/#comment-361</link>
		<dc:creator>Brian Clifton</dc:creator>
		<pubDate>Wed, 14 Jan 2009 00:39:32 +0000</pubDate>
		<guid isPermaLink="false">http://www.trendingupward.net/?p=996#comment-361</guid>
		<description>replying to Brandt and then switching off from this discussion (sorry but its started to get a little silly...)

As others have pointed out, the Brandt methodology looks good. However, your headline &quot;The disturbing inaccuracy behind Google Analytics&quot; is not true and sensationalist at best.

The simple fact is that GA calculates time on site as described by Avinash here: http://www.kaushik.net/avinash/2008/01/standard-metrics-revisited-time-on-page-and-time-on-site.html

That was correct at the time he wrote it (Jan 2008), was correct as far I was concerned before that, and remains correct today. I cannot say if it changed or not in 200x but is that relevant? Vendors update their products all the time...

How do I know this?

Well, I would describe myself as fairly technical having begun my Internet career as a web developer (perl, php, javascript).
My company was the first UK partner for Urchin (the product/company Google acquired in 2005 to become GA) and we remain a leading Google Analytics Authorised Consultant.
I was Head of Web Analytics for Google EMEA (2005-8) and I wrote the book Advanced Web Metrics with Google Analytics.

So I am saying I have the connections, know-how and experience to back up Avinash&#039;s post, who of course is now part of the GA team.

As an aside, this is another article written by Brandt Dainow in 2007. Its very odd when you compare it to the content of his latest one...
http://www.imediaconnection.com//content//15823.asp</description>
		<content:encoded><![CDATA[<p>replying to Brandt and then switching off from this discussion (sorry but its started to get a little silly&#8230;)</p>
<p>As others have pointed out, the Brandt methodology looks good. However, your headline &#8220;The disturbing inaccuracy behind Google Analytics&#8221; is not true and sensationalist at best.</p>
<p>The simple fact is that GA calculates time on site as described by Avinash here: <a href="http://www.kaushik.net/avinash/2008/01/standard-metrics-revisited-time-on-page-and-time-on-site.html" rel="nofollow">http://www.kaushik.net/avinash/2008/01/standard-metrics-revisited-time-on-page-and-time-on-site.html</a></p>
<p>That was correct at the time he wrote it (Jan 2008), was correct as far I was concerned before that, and remains correct today. I cannot say if it changed or not in 200x but is that relevant? Vendors update their products all the time&#8230;</p>
<p>How do I know this?</p>
<p>Well, I would describe myself as fairly technical having begun my Internet career as a web developer (perl, php, javascript).<br />
My company was the first UK partner for Urchin (the product/company Google acquired in 2005 to become GA) and we remain a leading Google Analytics Authorised Consultant.<br />
I was Head of Web Analytics for Google EMEA (2005-8) and I wrote the book Advanced Web Metrics with Google Analytics.</p>
<p>So I am saying I have the connections, know-how and experience to back up Avinash&#8217;s post, who of course is now part of the GA team.</p>
<p>As an aside, this is another article written by Brandt Dainow in 2007. Its very odd when you compare it to the content of his latest one&#8230;<br />
<a href="http://www.imediaconnection.com//content//15823.asp" rel="nofollow">http://www.imediaconnection.com//content//15823.asp</a></p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Shelby Thayer</title>
		<link>http://www.trendingupward.net/2008/11/google-analytics-controversy/#comment-328</link>
		<dc:creator>Shelby Thayer</dc:creator>
		<pubDate>Mon, 15 Dec 2008 02:26:26 +0000</pubDate>
		<guid isPermaLink="false">http://www.trendingupward.net/?p=996#comment-328</guid>
		<description>Brandt - thank you so much for the comment. I guess at least now with advanced segmentation it&#039;s easy to work around.

My big issue with *all* analytics vendors is that they don&#039;t disclose issues like this up front. No matter if the analytics tool includes or excludes bounces in time on site calculations, the calculation isn&#039;t correct anyway (because it drops the last page). That just makes it  *more* inaccurate. 

Maybe I&#039;m a little naive here, but I don&#039;t understand why they don&#039;t disclose this issue and provide a workaround (like onunload in the js) up front. 

I know we all understand that these numbers aren&#039;t precise and we need to be looking at trends, but if I run a blog and Ts is one of my KPIs, that could be a huge issue.</description>
		<content:encoded><![CDATA[<p>Brandt &#8211; thank you so much for the comment. I guess at least now with advanced segmentation it&#8217;s easy to work around.</p>
<p>My big issue with *all* analytics vendors is that they don&#8217;t disclose issues like this up front. No matter if the analytics tool includes or excludes bounces in time on site calculations, the calculation isn&#8217;t correct anyway (because it drops the last page). That just makes it  *more* inaccurate. </p>
<p>Maybe I&#8217;m a little naive here, but I don&#8217;t understand why they don&#8217;t disclose this issue and provide a workaround (like onunload in the js) up front. </p>
<p>I know we all understand that these numbers aren&#8217;t precise and we need to be looking at trends, but if I run a blog and Ts is one of my KPIs, that could be a huge issue.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Brandt Dainow</title>
		<link>http://www.trendingupward.net/2008/11/google-analytics-controversy/#comment-317</link>
		<dc:creator>Brandt Dainow</dc:creator>
		<pubDate>Wed, 10 Dec 2008 23:36:00 +0000</pubDate>
		<guid isPermaLink="false">http://www.trendingupward.net/?p=996#comment-317</guid>
		<description>While Brian states I am factually incorrect, I have an email direct from Google themselves confirming my statements, and explaining why they did this.  It is easy for people to say how Google COULD do it, but if you want to accuse me of inaccuracy, you need to provide proof.  I have proof that I am correct from Google itself. I could also quote the original email conversation I had with Google Analytics support when they did it, but I think the more recent email says it all.  The following is from Elisabeth Diana, Global Communications &amp; Public Affairs, Google, Inc.:

&quot;I wanted to follow up with you over email: regarding your piece in iMedia, you bring up some points that we think we can provide further insight into. Additionally, one of our latest features could help you address your concerns around time-on-site metrics.

In terms of our methodology, we really tried to listen to what the majority of our users were saying, because they are the ones who live and breathe the tool. The GA team had heard different opinions about average time-on-site and visit calculations from our users, and while there were some different schools of thought on the issue, most GA users who provided feedback wanted bounces included in the visits and time on site metrics. 

If users prefer the time-on-site and overall visit calculations you outline in your article, we now have a way to address their preferences. We wanted to point you to our latest feature, Advanced Segmentation. Creating a segment that includes page depth greater than 1 (or greater than or equal to 2: eg. Time on Site &amp; Visits &amp; Conversions excluding Bounces) will yield site-wide averages and visit numbers that are in alignment with your ideas.

I hope this has helped to give you further insight into how we gather methodology feedback from our users, and if you have any questions regarding segment creation (or any other questions, for that matter), please don&#039;t hesitate to use us as a resource for information moving forward.

Thank you,
Elisabeth
-- 
Elisabeth Diana &#124; Global Communications &amp; Public Affairs &#124; Google, Inc.&quot;

So - if I&#039;m wrong, why does the data match my assessment?  And why did Google confirm my statements?  If you still think I&#039;m wrong, Brian, prove it.</description>
		<content:encoded><![CDATA[<p>While Brian states I am factually incorrect, I have an email direct from Google themselves confirming my statements, and explaining why they did this.  It is easy for people to say how Google COULD do it, but if you want to accuse me of inaccuracy, you need to provide proof.  I have proof that I am correct from Google itself. I could also quote the original email conversation I had with Google Analytics support when they did it, but I think the more recent email says it all.  The following is from Elisabeth Diana, Global Communications &amp; Public Affairs, Google, Inc.:</p>
<p>&#8220;I wanted to follow up with you over email: regarding your piece in iMedia, you bring up some points that we think we can provide further insight into. Additionally, one of our latest features could help you address your concerns around time-on-site metrics.</p>
<p>In terms of our methodology, we really tried to listen to what the majority of our users were saying, because they are the ones who live and breathe the tool. The GA team had heard different opinions about average time-on-site and visit calculations from our users, and while there were some different schools of thought on the issue, most GA users who provided feedback wanted bounces included in the visits and time on site metrics. </p>
<p>If users prefer the time-on-site and overall visit calculations you outline in your article, we now have a way to address their preferences. We wanted to point you to our latest feature, Advanced Segmentation. Creating a segment that includes page depth greater than 1 (or greater than or equal to 2: eg. Time on Site &amp; Visits &amp; Conversions excluding Bounces) will yield site-wide averages and visit numbers that are in alignment with your ideas.</p>
<p>I hope this has helped to give you further insight into how we gather methodology feedback from our users, and if you have any questions regarding segment creation (or any other questions, for that matter), please don&#8217;t hesitate to use us as a resource for information moving forward.</p>
<p>Thank you,<br />
Elisabeth<br />
&#8211;<br />
Elisabeth Diana | Global Communications &amp; Public Affairs | Google, Inc.&#8221;</p>
<p>So &#8211; if I&#8217;m wrong, why does the data match my assessment?  And why did Google confirm my statements?  If you still think I&#8217;m wrong, Brian, prove it.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Google News 17 Nov 2008 - 24 Nov 2008 &#124; WeGoSe Media</title>
		<link>http://www.trendingupward.net/2008/11/google-analytics-controversy/#comment-310</link>
		<dc:creator>Google News 17 Nov 2008 - 24 Nov 2008 &#124; WeGoSe Media</dc:creator>
		<pubDate>Wed, 03 Dec 2008 23:34:39 +0000</pubDate>
		<guid isPermaLink="false">http://www.trendingupward.net/?p=996#comment-310</guid>
		<description>[...] Google Analytics - Oh, the controversy By Shelby Thayer This past week was Google Analytics week for some reason. It was in the news and all over the blogs. Controversy *and* good stuff. I, of course, am going to focus on the controversy for this post. Nothing new here, but worth mentioning. &#8230; [...]</description>
		<content:encoded><![CDATA[<p>[...] Google Analytics &#8211; Oh, the controversy By Shelby Thayer This past week was Google Analytics week for some reason. It was in the news and all over the blogs. Controversy *and* good stuff. I, of course, am going to focus on the controversy for this post. Nothing new here, but worth mentioning. &#8230; [...]</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Brian Clifton</title>
		<link>http://www.trendingupward.net/2008/11/google-analytics-controversy/#comment-295</link>
		<dc:creator>Brian Clifton</dc:creator>
		<pubDate>Tue, 25 Nov 2008 07:34:47 +0000</pubDate>
		<guid isPermaLink="false">http://www.trendingupward.net/?p=996#comment-295</guid>
		<description>Shelby - that sounds like an interesting A/B test - time metrics without the last page included v those with the last page included. Are you able to compare two different sections of your site at the same time (to limit seasonal fluctuations)?

I would certainly be interested in the outcome of that. Nothing like that covered in the book unfortunately :(

Best regards, Brian</description>
		<content:encoded><![CDATA[<p>Shelby &#8211; that sounds like an interesting A/B test &#8211; time metrics without the last page included v those with the last page included. Are you able to compare two different sections of your site at the same time (to limit seasonal fluctuations)?</p>
<p>I would certainly be interested in the outcome of that. Nothing like that covered in the book unfortunately <img src='http://www.trendingupward.net/wp-includes/images/smilies/icon_sad.gif' alt=':(' class='wp-smiley' /> </p>
<p>Best regards, Brian</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Shelby Thayer</title>
		<link>http://www.trendingupward.net/2008/11/google-analytics-controversy/#comment-294</link>
		<dc:creator>Shelby Thayer</dc:creator>
		<pubDate>Mon, 24 Nov 2008 21:16:37 +0000</pubDate>
		<guid isPermaLink="false">http://www.trendingupward.net/?p=996#comment-294</guid>
		<description>Brian - Thanks so much for your comment. It absolutely makes sense. I appreciate you clarifying what Brandt was stating. That actually makes me feel better. Even, though his statement was factually wrong (which most of the readers who commented on his post stated, thank goodness!), I&#039;m glad he wasn&#039;t recommending that bounces shouldn&#039;t count as visits. [I will update my post to add your comments.]

I am aware of the time-on-site discrepancy and am looking to use the method that Avanish mentions in his time-on-site post (page unload event). I know this method is not GA-specific, but I&#039;m wondering if you touch upon it in your book. I just bought it and am excited to start using it.

I actually just downloaded your whitepaper over the weekend (when I read Brandt&#039;s post). I haven&#039;t read through the whole thing yet, but I will definitely give my comments on your blog.

Thanks again. I appreciate your time.</description>
		<content:encoded><![CDATA[<p>Brian &#8211; Thanks so much for your comment. It absolutely makes sense. I appreciate you clarifying what Brandt was stating. That actually makes me feel better. Even, though his statement was factually wrong (which most of the readers who commented on his post stated, thank goodness!), I&#8217;m glad he wasn&#8217;t recommending that bounces shouldn&#8217;t count as visits. [I will update my post to add your comments.]</p>
<p>I am aware of the time-on-site discrepancy and am looking to use the method that Avanish mentions in his time-on-site post (page unload event). I know this method is not GA-specific, but I&#8217;m wondering if you touch upon it in your book. I just bought it and am excited to start using it.</p>
<p>I actually just downloaded your whitepaper over the weekend (when I read Brandt&#8217;s post). I haven&#8217;t read through the whole thing yet, but I will definitely give my comments on your blog.</p>
<p>Thanks again. I appreciate your time.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Brian Clifton</title>
		<link>http://www.trendingupward.net/2008/11/google-analytics-controversy/#comment-293</link>
		<dc:creator>Brian Clifton</dc:creator>
		<pubDate>Mon, 24 Nov 2008 20:00:21 +0000</pubDate>
		<guid isPermaLink="false">http://www.trendingupward.net/?p=996#comment-293</guid>
		<description>Hello Shelby - yes, the article by Brandt Dainow is factually incorrect. I wish he had reached out to those with a stronger connection to Google Analytics before taking such a strong (inaccurate) stance. Unfortunately, these days writing those type of headlines is a sure fire way of generating traffic, which was probably the intention...

To clarify what he is claiming, he is stating that for metrics such as time on page and time on site, that GA includes single page visits. The unwritten standard in the field of web analytics is to exclude single page (bounced) visits and the last page of a visit for such calculations.

The reason is that time spent on the last page is so inaccurate to measure. For example, say I visit two pages on your web site each lasting one minute, then I get distracted on the third page and leave my browser open. GA will close my session from a tracking point of view after 30 mins of inactivity. That is also an unwritten industry standard and can be adjusted if required.

Calculating the time on site for my visit will be horribly skewed if page 3 is included:
60+60+1800 = 1920 seconds

The reality is better calculated by omitting the last very inaccurate measurement:
60+60 = 120 seconds

So most web analytics tools omit the last page visited for these types of calculations. And if the visit is only one page then then the entire session is omitted. A single page visit is still tracked as a visitor, just excluded from time metrics.

Clearly that still is not 100% accurate, but it is a much better situation than including it. Please do have a look at the accuracy whitepaper I wrote on this subject as I would be interested in your comments: http://www.advanced-web-metrics.com/accuracy-whitepaper

Hope that makes sense.

Best regards, Brian</description>
		<content:encoded><![CDATA[<p>Hello Shelby &#8211; yes, the article by Brandt Dainow is factually incorrect. I wish he had reached out to those with a stronger connection to Google Analytics before taking such a strong (inaccurate) stance. Unfortunately, these days writing those type of headlines is a sure fire way of generating traffic, which was probably the intention&#8230;</p>
<p>To clarify what he is claiming, he is stating that for metrics such as time on page and time on site, that GA includes single page visits. The unwritten standard in the field of web analytics is to exclude single page (bounced) visits and the last page of a visit for such calculations.</p>
<p>The reason is that time spent on the last page is so inaccurate to measure. For example, say I visit two pages on your web site each lasting one minute, then I get distracted on the third page and leave my browser open. GA will close my session from a tracking point of view after 30 mins of inactivity. That is also an unwritten industry standard and can be adjusted if required.</p>
<p>Calculating the time on site for my visit will be horribly skewed if page 3 is included:<br />
60+60+1800 = 1920 seconds</p>
<p>The reality is better calculated by omitting the last very inaccurate measurement:<br />
60+60 = 120 seconds</p>
<p>So most web analytics tools omit the last page visited for these types of calculations. And if the visit is only one page then then the entire session is omitted. A single page visit is still tracked as a visitor, just excluded from time metrics.</p>
<p>Clearly that still is not 100% accurate, but it is a much better situation than including it. Please do have a look at the accuracy whitepaper I wrote on this subject as I would be interested in your comments: <a href="http://www.advanced-web-metrics.com/accuracy-whitepaper" rel="nofollow">http://www.advanced-web-metrics.com/accuracy-whitepaper</a></p>
<p>Hope that makes sense.</p>
<p>Best regards, Brian</p>
]]></content:encoded>
	</item>
</channel>
</rss>

