Downloaded 40 times
Uploaded byFred Beringer
The Cloud: A game changer to test, at scale and in production, SOA based web and mobile applications.
The document summarizes how cloud testing has revolutionized web performance testing. It discusses how cloud testing enables testing at scale, with real-time analysis, and at an affordable cost. Traditional performance testing methods are no longer sufficient. Cloud testing allows testing across teams, time periods, and scales to identify issues throughout the development and deployment process. It provides examples of how cloud testing helped companies identify various performance issues in their applications.
More Related Content
Similar to The Cloud: A game changer to test, at scale and in production, SOA based web and mobile applications.
![Governance, Deployment & Methodologies for Agentic Automation [2/3]](https://cdn.slidesharecdn.com/ss_thumbnails/agenticcommunityseries-day2-251112135038-a386476d-thumbnail.jpg?width=640&height=640&fit=bounds)
The Cloud: A game changer to test, at scale and in production, SOA based web and mobile applications.
- 1. The Cloud A gamechanger to test, at scale and in production, SOA based web and mobile applications. Fred Beringer – VP Business Development Europe – SOASTA International SOA Conference 2011- Rome
- 2. PERFORMANCE matters more thanever before
- 3. #1 highly viral Social media is and drives massive amount of traffic.
- 4. 500 million activeusers spending 700 billion minutes per month
- 5. 13 million hoursuploaded in 2010 2 billion video viewed per day
- 6. 106 million accounts 10billion tweets in 2010
- 7.
- 8. #2 Web Architecture iscomplex
- 9. Inside and outsidethe firewall Analytics Switch Ad Server Databases Search Session Info CDN Content CMS Content Shopping Cart Media Server Application servers Load balancers Payment Server
- 10.
- 11.
- 12.
- 13.
- 14.
- 15.
- 16. Different performance on each device
- 17.
- 18. 39% of consumers say speed is more important than functionality Source: Forrester Research
- 19. 47% Expect a web page to load in two seconds or less Source: Forrester Research
- 20. Will abandon aweb page if it 40% takes more than three seconds to load Source: Forrester Research
- 21. #6 Low performance andunreliability brings MASSIVE BUSINESS IMPACT
- 22. PayPal down 45minutes in 2009 $45 Millions lost revenue
- 23. Amazon loses 1%of their sales for each 100ms of latency
- 24. Google loses 20%of search traffic every 500ms of additional latency
- 27. 60% of companies admit that they do not have any performance management processes in place or what they have is ineffective. DynaTrace study- 2009
- 28. Of companies having performance management 50% processes admit that they are doing it only in reactive way when problem occurs. DynaTrace study- 2009
- 29. 50% of application problems are found in production – when those problems have impacted end users and are most expensive to resolve. DynaTrace study- 2009
- 30. What is requiredtoday to test effectively performance of web applications?
- 31.
- 32. #2 Real time analysis of performance data
- 33.
- 34.
- 35. Ready for somepain?
- 36. Traditional Performance Testing doesn’t work anymore
- 37.
- 38.
- 39. Cloud Testing The massiveresources of the cloud have changed the game for performance testing. Cloud Testing enables organizations to test their consumer facing Web and mobile applications fast, affordably and at scale. There’s now no excuse for the type of Web site disasters we’ve seen in the past that cost businesses millions in revenues and perhaps more in reputation. Tom Lounibos CEO SOASTA
- 40. What does itbring us?
- 41. #1 Affordable platform forinfinite load
- 42. Billions possible pointsof failure The new testing challenge
- 43.
- 44. #3 Global and realistictraffic
- 45. #4 Where is theneedle?
- 46.
- 47.
- 48.
- 49. Extending Performance Beyondthe Lab Discovering Issues across teams, time and scale Latency between systems Network Network configuration & Ops Network bandwidth CDN file placement Conflict with other apps DNS routing Load Balancer configuration Stage / Team Firewall max capacity Auto-scaling failures Unbalanced web servers Release & Deploy Max sockets exceeded s Global latency variance Security bottlenecks Slow third-party plug-ins Default configuration settings Search technology limits Inadequate server resources Garbage collection Memory leaks Memory leaks Database thread counts Dev & Test Slow pages Inefficient database queries Method-level tuning Test Lab (<10k Vus) Staging (10-100k) Production (> 100k) Scale of Test
- 50. CloudTest Live Real-world Issue Resolution Company Profile Project Profile Company Toy Manufacturer Environment Lab and Staging Size Fortune 500 Application Drupal (Apache, PHP, MySQL) Location Private Hosted Cloud Objective Identify Breaking Points Project Length Five Days (non-consecutive) Lab Staging
- 51. CloudTest Live Lab Real-world Issue Resolution • First test cycle in the lab • Some servers hitting 100% CPU • 239 hits per second • Bottleneck in throughput • 40.5 MBit/second bandwidth
- 52. CloudTest Live Lab Real-world Issue Resolution • Second test cycle in the lab • Some servers hitting 100% CPU • Higher concurrency target • Performance problem over time • Bandwidth stayed the same • Load balancer flapping servers
- 53. CloudTest Live Staging Real-world Issue Resolution • Bandwidth (238Mbits/s) – ouch! • CPU at 100%
- 54. CloudTest Live Staging Real-world Issue Resolution • 767 Home pages served at 650 megs total transfer. • That’s an 850kb page weight! Yikes!
- 55. CloudTest Live Real-world Issue Resolution • Poor throughput on the initial tests Lab • CPU hits 100% • Bandwidth cap identified in the lab • Database connections leaking over time • Load balancer dropping servers Staging • Massive page weight on the home page • Application unresponsive at ~2000 users • Customer happy with the breaking point identified • Optimized web assets in the home page • Offloaded assets to the CDN • Load balancer algorithm optimizations
- 56. CloudTest Live Real-world Issue Resolution Company Profile Project Profile Company Advanced Technology Environment Production Size Fortune 50 Application Java (Struts), Oracle Multiple Hosted Private Location Data Centers Objective 172,000 Concurrent Project Length Two Months Production
- 57. CloudTest Live Production Real-world Issue Resolution Recurring error pattern during scenario completion
- 58. CloudTest Live Real-world Issue Resolution Awesome outcome in Production!
- 59. CloudTest Live Real-world Issue Resolution Production • Load balancer firmware bug with 2048 bit cert • Database issues with the login process • Worked with hardware LB manufacturer on a fix • Really low error rate • Successful launch!
- 60. Fit for an #5 AGILE WORLD
- 61.
- 64.
- 65. Cloud Testing helpscompanies
- 66. • Every day at noon is a holiday spike in traffic. • Pages must render to the user in under 1 second. • 50% of all revenue from Gilt sales comes in less than 1 hour after sale starts.
- 67. Cloud Testing helpsdolls
- 68. Cloud Testing helpstaxes
- 69. Cloud Testing helpsphones
- 70. Testing SOA inthe cloud CHALLENGES
- 71.
- 72.
- 73.
- 74.
- 75. Same challenges • Serviceswith no user interface • Data driven • Services outside the organization/cloud • End-to-end scenario • Test ownership Same Bottom-up performance testing approach • Individual services • Set (integration) of services • End-to-end Deal with Cloud unpredictability • Varying performance encourage continuous performance testing/monitoring. • Infrastructure upgrade could impact performance. • Expect to baseline on premise application and run benchmark in the cloud after migration. • Test the full bottom-up cycle for increased confidence.
- 76. Let’s see howthis website performs!
- 77.
- 78. The Cloud A gamechanger for web performance testing twitter.com/fredberinger [email protected] http://www.fredberinger.com
- 79. Photos Credits: Slide 2:http://www.sxc.hu/photo/1219246 Slide 18, 19, 20: http://www.sxc.hu/photo/1267744 Slide 21: http://www.sxc.hu/photo/1181194 Slide 22,23,24: http://www.sxc.hu/photo/396185 Slide 25: http://www.flickr.com/photos/tsoumplekas/4495778365/ Slide 32: http://www.sxc.hu/photo/1160562 Slide 34: http://www.sxc.hu/photo/1331143 Slide 46: http://www.sxc.hu/photo/995000 Slide 48: http://www.sxc.hu/photo/560250 Slide 54: http://www.sxc.hu/photo/561622 Slide 59: http://www.flickr.com/photos/caitlinator/4006198703/ Slide 60: http://www.sxc.hu/photo/1221951 Slide 62: http://www.sxc.hu/photo/1019388