Reading Between the Lines: Get the Most Out of Your Results Page

#opticon2015

Khattaab KhanStrategy Consultant, Optimizely

@khattaabkhankhattaab@optimizely.com

Undergraduate-LevelResults Analysis

Undergraduate-Level Results Analysis

Performance Summary Audience Segmentation

Statistics

Undergraduate-Level Results Analysis Performance Summary

1. How many unique visitors ran through my experiment?

2. How long did it run? 3. Did any variations achieve statistically

significant conversion lift?

Questions you should be able to answer in a glance

Undergraduate-Level Results Analysis Audience Segmentation

1. Did any segments show conversion trends drastically different than the total sample?

2. Are my custom segments capturing a meaningful volume of traffic?

Questions you should be able to answer in a glance

Undergraduate-Level Results Analysis Statistics

1. What is the value of 2-tailed analysis 2. Does the demonstrated lift

improvement exceed my pre-determined MDE (Opportunity Costs)

3. What is the Difference Interval range?

Questions you should be able to answer in a glance

What Sets Apart Basic Results Analysis from

Advanced?

Organization

Organize Test Plans + Results to Maximize Reach of Testing

Program

Roadmap Summarizes Test Plan + Results Detailed Assessment

Roadmap Visualization

Roadmunk Software

Shared Variation Design Archive

Shared Variation Design Archive

Shared Variation Design Archive

Let’s Get More Organizedwithin Optimizely

#ExperimentLabels

#ExperimentLabels

#ExperimentLabels

Extract More Value Out ofOptimizely Event Tracking

Alternate Metric Axes

Alternate Metrics

Consider Correlation Between Traffic Waves

and Variation Performance

Traffic Volume

Chart Annotation

Provide Visibility intoExternal Influences

Chart Annotation

Organize data to effectively communicate results; implement analytics integrations

Takeaways

Leverage advanced results page features to distill metrics that matter to your organization

Maximize reach of results sharing

#opticon2015

Q&A

Khattaab KhanStrategy Consultant, Optimizely

@khattaabkhankhattaab@optimizely.com