Date post: | 20-Aug-2015 |
Category: |
Technology |
Upload: | soasta |
View: | 544 times |
Download: | 0 times |
Best Practices in Performance Testing Webinar Series
In This Webinar:!Here come the holidays!
I. The Top 5 Keys to Web & Mobile Performance Readiness II. Real World CloudTest Case Studies with the SOASTA Performance
Team III. Discussion & Q&A
TODAY’S PRESENTERS
Dan Bartow: VP Product Management, Evangelist Amit Patel: Sr. Performance Engineer Brad Johnson: VP Product Marketing
Questions: Submit in the question box during event
#1 - Use The Cloud for Realistic Results!Low cost, unlimited scale & global availability deliver…
Testing on your schedule
Meaningful scale & appropriate concurrency
Most accurate models of real user behavior
Control to start, stop & modify tests without delays
#2 Measure across the entire application !Measuring user response time may indicate a problem!
User Experience
Web Applications
Constrained Load Scenarios
! slow
#2 Measure across the entire application !Measuring everything captures the source of delays !
User Experience
Complex Web Applications : AJAX, HTML5, video, mobile, web services
Accurate Scale Load & Business Flows
Deployment Infrastructure
(Internal)
Deployment Infrastructure
(External) Network
Application Component &
Code
Why Slow?
#3 Correlate in real-time during test execution!Drill down into the cause while issues are occurring
#4 Compress Test Build & Execution!More tests, less time, high coverage = less risk
Traditional Approaches
TIME
Cloud Test
#5 Test for Failure!Broaden the scope of coverage to worst cases
Failover Scenarios
Chaos Monkeys
Success Disasters
SOASTA Case Studies
Dan Bartow and Amit Patel
- Current Engagements – - Fresh Data –
- Leading Companies -
CloudTest Live!Production Testing Veterans, Year Round
Company Profile Company Retailer
Size Top 10 Retailer
Project Profile Environment Stage and Production
Application Java, ATG, Oracle
Location Multiple Dedicated Private Data Centers
Objective 150,000 Concurrent
Project Length Year Round
CloudTest Live!Production Testing Veterans, Year Round
• Comprehensive Test Cases
• Two Datacenters, Thousands of Servers
• Mobile App Testing
• Geographically Relevant Load Generation
• Near Daily Production Testing Across 7 Properties
• The CDN is a Big Player
Discipline and Rigor
CloudTest Live!Success Through Constant Testing and Improvement
CloudTest Live!Comprehensive Testing Plan
Company Profile Company Toy Manufacturer
Size Fortune 500
Project Profile Environment Production
Location Hosted Private Data Center
Objective Test Multiple Web Properties
Project Length < 1 Month
CloudTest Live!Comprehensive Test Plan
• Fairly High Level Test Cases
• One Datacenter, Handful of Servers
• Baseline, Spike, Failover, Stress
• Flex Based Apps, Browser Based Games
• Cloud Based Load Generation
• Executed in About Three Weeks
• The CDN is a Big Player
Thorough Coverage
CloudTest Live!Thorough Coverage – Great Results
CloudTest Live!Large Testing Initiative
Company Profile Company Retailer
Size Fortune 50
Project Profile Environment Stage and Production
Application Java, Oracle
Location Multiple Dedicated Private Data Centers
Objective 30,000 Concurrent
Project Length Ten Months
CloudTest Live!Large Testing Initiative
• Two Work Load Models
• Two Environments
• Infrastructure Testing
• Application Testing
• 24/7 Testing
Testing, Testing, Testing!!!!
CloudTest Live!Large Testing Initiative
Success!
CloudTest Live!Real-world Issue Resolution
Company Profile Company Music Retailer
Size Fortune 1000
Project Profile Environment Stage
Location Hosted Private Data Centers
Objective Test Multiple Web Properties
Project Length < 1 Month
CloudTest Live!Real-world Issue Resolution
• Scaling Issues • High Response Times • Timeout Errors
Q&A
Contact SOASTA: www.soasta.com/cloudtest/
[email protected] 866.344.8766
Follow us:
About SOASTA • Founded in 2006, privately held • Silicon Valley HQ: EMEA & N/A offices • 1 Platform: 6 CloudTest Editions:
– Lite: Free performance testing at any stage – Mobile: Mobile performance testing – Standard: Internal performance testing – Pro: External & internal testing to any scale – Enterprise: Multi-division solution
– On-Demand: Complete testing service