Measuring the mobile web performance

Traditional methods commonly used to measure websites often don’t work for mobile sites, because of differences among mobile platforms and devices. The biggest obstacles seem so far are lack of support on mobile devices for Cookies, JavaScript, Flash and client IP addresses.

The Wikipedia article on Mobile Web Analytics provides a succinct introduction to these and other challenges — see the section on “Problems with tracking visitors, visits and clickpaths in the Mobile Web”. Because of these limitations, the tagging methods used by traditional Web analytics tools do not work on most mobile devices.

There is an excellent blog by Michael Notté, Kaizen Analytics.  Michael provides a useful overview — see Mobile Analytics: vertical-specific vs. traditional Web Analytics solutions. Michael points out that there are other ways to collect data about mobile Web sites. He outlines four solution approaches, illustrating each with a helpful diagram, reproduced below:

Mobile analytics: log-server based solution
Mobile analytics: packet sniffing based solution
Mobile analytics: tag-based solution
Mobile analytics: server script solution
  • Server log-based: Process the raw data coming from your web server. Michael recommends ignoring this one unless you are a geek with spare time on your hands.
  • Packet sniffing: A device is added between your server and the Web. It listens and analyzes requests sent and received by the server. This method does not require adding any tags to the page content, but does involve installing additional hardware and/or software in (all) datacenter(s) serving content to be tracked. This may present scalability challenges for large sites.
  • Image tag-based: Each time a page is rendered, the client device sends tracking data to a collector server using an image request that has parameters in the querystring. These tracking parameters can be set dynamically by the server when the content is generated. This method is easy to implement, but has limitations, and can not be used for event tracking.
  • Server-side script: A script is added on server side that sends data directly to a collector server when requests are processed. By extracting data from requests and content received at the server, this method avoids the complications of sending tracking data from diverse mobile device platforms. According to Michael, this solution is gaining popularity among traditional Web Analytics vendors.

Will performance and analytics tools converge?Performance management tools have traditionally been regarded as a separate market segment from from Web Analytics tools, because they were purchased by different people — namely IT staff and Marketing/Business Management respectively. But as business becomes increasingly mobile, and tool vendors continue to merge and expand their portfolios, I expect to see these two separate segments evolve and become closer.

Both tool segments face a similar–in some cases, identical–challenge of needing to collect and consolidate data about customers in a networked world. And while site performance and customer behavior are different issues, which focus on different metrics, the ultimate reasons for tracking those metrics are closely related. I have written about that here before, see The Dimensions of Usability.

In preparation for his Webinar (and a report on performance management tools), Peter will be surveying tools vendors. I am interested to find out whether Peter sees any signs of performance management and analytics tools converging.