Monitoring of Ads andThird-Party Content

Using the Virtual Pages Monitoring Feature In

Transaction Perspective

©2009 Keynote Systems, Inc. Keynote & Client Confidential.

October 22, 2009

Who Benefits from Monitoring Third-Party Content?

� Web/IT Operations� Measure 3rd party content separately to determine whose problem it is

� Configure alerts and only manage content that the company controls

� Set separate alarms for “your” content versus third-party content

� Fewer alerts sent to NOC (since 3rd party content alarms may go elsewhere)

� Faster time to resolution because alarms are more targeted

� Online Business Units/Managers� More easily manage and track ongoing performance of ALL content

� Specific tracking and reporting by application: search, cart, log-in, etc.

� Configure alerts, monitor content controlled by different internal teams

� Make third-party content providers liable for poor performance with evidence to collect rebates

� Development and QA Groups� Understand impact of 3rd content on performance during design and testing

phase

� Perform targeted measurements of content identified for potential performance optimizations

� Isolate specific code to improve visibility and feedback on new software releases

2©2009 Keynote Systems, Inc. Keynote & Client Confidential.

Monitoring 3rd Party Content With Virtual Pages

� Feature provided with Transaction Perspective

� Uses a real Internet Explorer 7 browser to playback measurement

scripts

� Provides accurate measurement of each download Web page element

� Virtual pages allows users to

� Monitoring of ads and other third-party content

� Perform content exclusion from any Web page to measure only specific

content of interest

� Results from virtual pages appear in MyKeynote

� Virtual pages are treated the same as any other Web pages

� Can report and alert on performance/availability of virtual pages

3©2009 Keynote Systems, Inc. Keynote & Client Confidential.

Monitoring 3rd Party Content With Virtual Pages

� “Third-party” content can be considered any particular content filtered

from a Web page

� Content served by ads or other third-party content providers

� Any content of interest that is developed by other internal teams

4©2009 Keynote Systems, Inc. Keynote & Client Confidential.

Web Page Filter Virtual Page

Physical Page Filters Virtual Pages

Ads

CDN

Hosted

Partner

Delivered

Multiple Virtual Pages Can Be Created Per Web Page

� Users can define alarms and reports for

virtual pages� Alerts and reports can be sent to “owners” of particular

content

� Alerts help to monitor third-party content provider’s

adherence to performance SLAs

� Track ongoing performance of specific content of interest

5©2009 Keynote Systems, Inc. Keynote & Client Confidential.

Example: Google Search – Physical Page

6©2009 Keynote Systems, Inc. Keynote & Client Confidential.

Example: Google Search – Physical Page

7©2009 Keynote Systems, Inc. Keynote & Client Confidential.

AdsAds

Example: Google Search – Google Content Virtual Page

8©2009 Keynote Systems, Inc. Keynote & Client Confidential.

Example: Google Search – Ads Virtual Page

9©2009 Keynote Systems, Inc. Keynote & Client Confidential.

Using Virtual Pages: Content Filter Definitions

� Configured using KITE

(http://kite.keynote.com)

� Defined using content filters within

the measurement script

� Content filters (“Match Page

Elements”) can be inserted following

a physical page

� Physical pages can contain filters to

perform content exclusion

� Various filtering options are available

(URL Match is most commonly used)

10©2009 Keynote Systems, Inc. Keynote & Client Confidential.

Use Case Example

� Ads and other third-party content can sometimes Web sites

to appear to load slowly

� Virtual pages allow users to quickly identify of particular content is the cause of slower performance

� Example transaction:

� Go to online retail site (i.e, the “Publisher”)

� Execute a search for “ipod touch 8gb”

� Filter third-party content from publisher content on search results

page

11©2009 Keynote Systems, Inc. Keynote & Client Confidential.

Use Case Example

� Third-party content contributed to performance spike

� Publisher content performance remained relatively flat� No need to trigger performance alarm in the NOC

12©2009 Keynote Systems, Inc. Keynote & Client Confidential.

Use Case Example

� Drilling down on the performance spike clearly shows that

delays were caused by third-party ads content

� Waterfall graph shows a slow “ad.yieldmanager.com” call

13©2009 Keynote Systems, Inc. Keynote & Client Confidential.

Summary: Advantages of Virtual Pages

� Allows users to filter specific content from Web pages and

measure it separately

� Facilitates identification of poorly performing Web page components

� Reduces time to triage and troubleshoot performance issues

� Users can define alarms and reports for virtual pages

� Alerts and reports can be sent to “owners” of particular content

� Alerts help to monitor third-party performance and content provider’s

adherence to SLAs

� Track ongoing performance of specific content of interest

� Saves time and effort!

14©2009 Keynote Systems, Inc. Keynote & Client Confidential.

Appendix

Virtual Pages Response Time Computation

©2009 Keynote Systems, Inc. Keynote & Client Confidential. 15

Virtual Pages Response Time Computation� Virtual page response time only reports network times (i.e., “Total Time” in MyKeynote)

� Virtual page response time = (sum of network times for included page elements) – “gap” times

16©2009 Keynote Systems, Inc. Keynote & Client Confidential.

Virtual Pages Response Time Computation� Gaps occur when there is no network activity

� Gaps = Time between the end of any network activity to the beginning of the next set of activity

17©2009 Keynote Systems, Inc. Keynote & Client Confidential.

Gaps

1s

3s

1.5s

Virtual Pages Response Time Computation

� Example: Response time for virtual page below = 1+3+1.5 = 5.5s

18©2009 Keynote Systems, Inc. Keynote & Client Confidential.

1s

3s

1.5s

Gaps Removed