SlideShare a Scribd company logo
Excellence in Cloud
Performance




             Performance and Success
               Key Elements to Consider in the
               Cloud


              Craig Wesely Irwin
              Craig.Irwin@apicasystems.com
The Cloud - Fact or Fiction?

 The Cloud = ā€œIt Just Worksā€


 All applications behave and scale the same way


 Theoretical analysis works when capacity planning for the cloud


 Texas Style - Bigger is better


 If my web or mobile app crashes, then that’s a good thing.




                                                                    2
Today’s Situation

 Web & Mobile Apps Continue to
  Crash
 Slow Response Times
 Why?




                                  3
So you’re now in the cloud, how will you
prepare for the unexpected?...




                                           4
So you’re now in the cloud, so how do you
respond to the expected?




                                            5
The Peak Load Challenge

                      Load               Server & Cloud
   Rapid Load Ramp-Up          Fixed Capacity
                                Scalability
   Snowball Effect             Application Transparency




                                                            6
Tips & Suggestions
  #1 For peak and high load
     Have backup ā€œminimalistic start/landing pagesā€œ
     Small is Fast


  #2 Extensive use of Front End Cache systems
     Optimize the cache solution, consider Varnish
     Less traffic is less problem, no direct DB access


  #3 Implement Scaling & Queuing System
     Redirect excess traffic using Load Balancer
     Create Informative ā€Waitā€ pages


  Bottom Line: Like a good boy scout
     Always be prepared : Test the solution before launch



                                                             7
Why Run A Performance Load Test ?




  Is the site stable?
  When does it crash?
  How can I make it faster?
  Can my application scale?
                                    8
Capacity
           vs.
                 Load




                  9
Test
Environment



              vs.



                     Production
                    Environment
                           10
Load Test 1 to 1
 Load Maximum                      Throughput
                                                    Point of collapse
   – How many users can we
     handle?
   – What is a good result?                                             Complete
                                                                        failure

                                                                          Nr of
                                                                          users
 Behavior in the ā€Danger
  Zoneā€
   – Does the application become    Response time
                                                                 āˆž
     unstable above load maximum?


 Problem Analysis
   – Where are the bottlenecks?
                                                                           Nr of
   – How to fix them?                                                      users




                                                                           11
Do you have
Performance Targets?

              Examples

                 Stable beyond 100,000 Concurrent users
                 Able handle 100,000 page views per hour
                 < 4 second average response time
                 Top 5 in our industry
                 Our peak time response time shall be better
                  then competition’s
                 95% of our users shall make a travel
                  selection for purchase in less then 30
                  seconds




                                                                12
LoadTest Findings

  #1 Identify the Backend Calls
     Database calls don’t kill your application
     Lack of caching does!


  #2 Check the delivery of static Content
     Optimize the cache solution, consider Varnish
     Consider using a CDN, if needed


  #3 Web Infrastructure
       Load Balancer
       Server model
       Bandwidth
       Scaling & Failover




                                                      13
Know Your Numbers - Not all Web & Mobile Apps are
equal




                                                    14
Numbers Don’t Lie – Eliminate
 Subjectivity
 Establish a baseline
 My start page | Login | Book a flight
 Response Time – Average 3.2 sec
 Typical Values – Median                 2.5 sec
 Standard Deviation            2.8 sec
 SLA 99.9%
 95% is better than 11.8 sec




                                                    15
WebPerformance Monitoring for the
Cloud
1      UP/Down        2      Browser        3   Application    4   Correlation




     Basic Monitor        Browser          Analytics         Inside
     Alerting             Scenarios        Trend
                                                                   monitoring
                                                                Vital Signs
     Up – down            Analytics        Complex
     Basic SLA            Response time
                                                Application     Drill Down
                                             SLA on            Root cause
                                                applications    Consolidation
                                                                   with other
                                                                   system




                                                                                 16
End User Performance Monitoring – What’s the
value?




                                               17
Tips & Suggestions

  #1 Set Goals
     Uptime
     Performance



  #2 Hate the average
     Work with the exceptions
     Remove the 10 Worst transactions
      every month


  #3 Fire drill
     Help identifying problems
     Correlation of data




                                         18
Cliff Notes

•   Performance Testing will help
    you discover the weakest link
    in advance…
    •   Saving you time and $$$

•   Check your numbers...Know
    your application
    •   They don’t lie

•   Plan for the unexpected...
    •   It happens everyday

             All systems have a weak spot – what is   19

             yours ?
Excellence in Cloud
Performance




            Thank You!
Contact Apica


 Web
   – www.apicasystems.com
 Twitter
   – @apicasystems
 Email
   – Craig.irwin@apicasystems.com
   – Scott.Goddard@apicasystems.com


 Phone
   – 1-800-701-5721




                                      21

More Related Content

PPTX
Apica - Performance Does Matter: Five Key Elements to Consider in the Cloud
RightScale
Ā 
PDF
Site Reliability Engineering (SRE) - Tech Talk by Keet Sugathadasa
Keet Sugathadasa
Ā 
PDF
Overview of Site Reliability Engineering (SRE) & best practices
Ashutosh Agarwal
Ā 
PPTX
Site reliability engineering
Jason Loeffler
Ā 
PDF
How to SRE when you have no SRE
Squadcast Inc
Ā 
PPTX
Stranded on Infosec Island: Defending the Enterprise with Nothing but Windows...
Adrian Sanabria
Ā 
PPT
DR Planning and Testing
Jason Dea
Ā 
PDF
Managing software projects & teams effectively
Ashutosh Agarwal
Ā 
Apica - Performance Does Matter: Five Key Elements to Consider in the Cloud
RightScale
Ā 
Site Reliability Engineering (SRE) - Tech Talk by Keet Sugathadasa
Keet Sugathadasa
Ā 
Overview of Site Reliability Engineering (SRE) & best practices
Ashutosh Agarwal
Ā 
Site reliability engineering
Jason Loeffler
Ā 
How to SRE when you have no SRE
Squadcast Inc
Ā 
Stranded on Infosec Island: Defending the Enterprise with Nothing but Windows...
Adrian Sanabria
Ā 
DR Planning and Testing
Jason Dea
Ā 
Managing software projects & teams effectively
Ashutosh Agarwal
Ā 

What's hot (10)

PDF
When down is not good enough. SRE On Azure - PolarConf
Rene Van Osnabrugge
Ā 
PDF
zNextGen Project Opening and Keynote at SHARE in Seattle 2010: Lessons Learne...
Sam Knutson
Ā 
PDF
Incident Management in the Age of DevOps and SRE
Rundeck
Ā 
PDF
Bandwidth Management and Control – Who Cares? BW Is Cheap.
Savvius, Inc
Ā 
PPTX
Site (Service) Reliability Engineering
Mark Underwood
Ā 
PDF
Agile Incident Response and Resolution in the Wold of Devops
Atlassian
Ā 
PDF
Chaos Engineering - The Art of Breaking Things in Production
Keet Sugathadasa
Ā 
PPTX
Site reliability engineering - Lightning Talk
Michae Blakeney
Ā 
PPTX
Building a slack bot
Jason Loeffler
Ā 
PPTX
2009 06 01 The Lean Startup Texas Edition
Eric Ries
Ā 
When down is not good enough. SRE On Azure - PolarConf
Rene Van Osnabrugge
Ā 
zNextGen Project Opening and Keynote at SHARE in Seattle 2010: Lessons Learne...
Sam Knutson
Ā 
Incident Management in the Age of DevOps and SRE
Rundeck
Ā 
Bandwidth Management and Control – Who Cares? BW Is Cheap.
Savvius, Inc
Ā 
Site (Service) Reliability Engineering
Mark Underwood
Ā 
Agile Incident Response and Resolution in the Wold of Devops
Atlassian
Ā 
Chaos Engineering - The Art of Breaking Things in Production
Keet Sugathadasa
Ā 
Site reliability engineering - Lightning Talk
Michae Blakeney
Ā 
Building a slack bot
Jason Loeffler
Ā 
2009 06 01 The Lean Startup Texas Edition
Eric Ries
Ā 
Ad

Viewers also liked (6)

PPT
Amaze & Toyota, Content Management Theatre, Internet World 2012
IWexpo
Ā 
PPTX
Open Source CDNs | LAWebSpeed April 29th 2014
Justin Dorfman
Ā 
PPTX
Apica presentation, Cloud & Hosting Theatre
IWexpo
Ā 
PDF
One millions users vs your web application mega testing cloud applications pr...
Justin Dorfman
Ā 
PDF
7 Common Questions About a Cloud Management Platform
RightScale
Ā 
PDF
SlideShare 101
Amit Ranjan
Ā 
Amaze & Toyota, Content Management Theatre, Internet World 2012
IWexpo
Ā 
Open Source CDNs | LAWebSpeed April 29th 2014
Justin Dorfman
Ā 
Apica presentation, Cloud & Hosting Theatre
IWexpo
Ā 
One millions users vs your web application mega testing cloud applications pr...
Justin Dorfman
Ā 
7 Common Questions About a Cloud Management Platform
RightScale
Ā 
SlideShare 101
Amit Ranjan
Ā 
Ad

Similar to Performance and Success: Key Elements to Consider in the Cloud (20)

PDF
The Cloud: A game changer to test, at scale and in production, SOA based web...
Fred Beringer
Ā 
PDF
Performance Testing
Codelattice
Ā 
PPTX
What does performance mean in the cloud
Michael Kopp
Ā 
PPTX
Webinar issues we_find_slideshare
SOASTA
Ā 
PPTX
Releasing fast code - The DevOps approach
Michael Kopp
Ā 
PPTX
Capacity Planning and Modelling
Anthony Dehnashi
Ā 
PDF
Best Practices To Fix 5 Common Web Application Problems: Web Performance Moni...
Compuware APM
Ā 
PDF
Real User Experience Insight
ruiruitang
Ā 
PDF
Real User Experience Insight
ruiruitang
Ā 
PDF
Real User Experience Insight
ruiruitang
Ā 
PDF
Performance Engineering Case Study V1.0
sambitgarnaik
Ā 
KEY
Scaling Teams, Processes and Architectures
Lorenzo Alberton
Ā 
PPTX
App Dynamics & SOASTA Testing & Monitoring Converge, March 2012
SOASTA
Ā 
PDF
Faster apps. faster time to market. faster mean time to repair
Compuware ASEAN
Ā 
PPT
Performance and load testing
sonukalpana
Ā 
PDF
Adding Performance Testing to a Software Development Project
Cris Holdorph
Ā 
PDF
Gigamon U - Web Performance Monitoring
Grant Swanson
Ā 
PPTX
Building a highly scalable and available cloud application
Noam Sheffer
Ā 
PPT
Coradiant
gigamon
Ā 
PDF
Acquia Managed Cloud: Highly Available Architecture for Highly Unpredictable ...
Acquia
Ā 
The Cloud: A game changer to test, at scale and in production, SOA based web...
Fred Beringer
Ā 
Performance Testing
Codelattice
Ā 
What does performance mean in the cloud
Michael Kopp
Ā 
Webinar issues we_find_slideshare
SOASTA
Ā 
Releasing fast code - The DevOps approach
Michael Kopp
Ā 
Capacity Planning and Modelling
Anthony Dehnashi
Ā 
Best Practices To Fix 5 Common Web Application Problems: Web Performance Moni...
Compuware APM
Ā 
Real User Experience Insight
ruiruitang
Ā 
Real User Experience Insight
ruiruitang
Ā 
Real User Experience Insight
ruiruitang
Ā 
Performance Engineering Case Study V1.0
sambitgarnaik
Ā 
Scaling Teams, Processes and Architectures
Lorenzo Alberton
Ā 
App Dynamics & SOASTA Testing & Monitoring Converge, March 2012
SOASTA
Ā 
Faster apps. faster time to market. faster mean time to repair
Compuware ASEAN
Ā 
Performance and load testing
sonukalpana
Ā 
Adding Performance Testing to a Software Development Project
Cris Holdorph
Ā 
Gigamon U - Web Performance Monitoring
Grant Swanson
Ā 
Building a highly scalable and available cloud application
Noam Sheffer
Ā 
Coradiant
gigamon
Ā 
Acquia Managed Cloud: Highly Available Architecture for Highly Unpredictable ...
Acquia
Ā 

More from RightScale (20)

PDF
10 Must-Have Automated Cloud Policies for IT Governance
RightScale
Ā 
PDF
Kubernetes and Terraform in the Cloud: How RightScale Does DevOps
RightScale
Ā 
PDF
Optimize Software, SaaS, and Cloud with Flexera and RightScale
RightScale
Ā 
PDF
Prepare Your Enterprise Cloud Strategy for 2019: 7 Things to Think About Now
RightScale
Ā 
PDF
How to Set Up a Cloud Cost Optimization Process for your Enterprise
RightScale
Ā 
PDF
Multi-Cloud Management with RightScale CMP (Demo)
RightScale
Ā 
PDF
Comparing Cloud VM Types and Prices: AWS vs Azure vs Google vs IBM
RightScale
Ā 
PDF
How to Allocate and Report Cloud Costs with RightScale Optima
RightScale
Ā 
PDF
Should You Move Between AWS, Azure, or Google Clouds? Considerations, Pros an...
RightScale
Ā 
PDF
Using RightScale CMP with Cloud Provider Tools
RightScale
Ā 
PDF
Best Practices for Multi-Cloud Security and Compliance
RightScale
Ā 
PDF
Automating Multi-Cloud Policies for AWS, Azure, Google, and More
RightScale
Ā 
PDF
The 5 Stages of Cloud Management for Enterprises
RightScale
Ā 
PDF
9 Ways to Reduce Cloud Storage Costs
RightScale
Ā 
PDF
Serverless Comparison: AWS vs Azure vs Google vs IBM
RightScale
Ā 
PDF
Best Practices for Cloud Managed Services Providers: The Path to CMP Success
RightScale
Ā 
PDF
Cloud Storage Comparison: AWS vs Azure vs Google vs IBM
RightScale
Ā 
PDF
2018 Cloud Trends: RightScale State of the Cloud Report
RightScale
Ā 
PDF
Got a Multi-Cloud Strategy? How RightScale CMP Helps
RightScale
Ā 
PDF
How to Manage Cloud Costs with RightScale Optima
RightScale
Ā 
10 Must-Have Automated Cloud Policies for IT Governance
RightScale
Ā 
Kubernetes and Terraform in the Cloud: How RightScale Does DevOps
RightScale
Ā 
Optimize Software, SaaS, and Cloud with Flexera and RightScale
RightScale
Ā 
Prepare Your Enterprise Cloud Strategy for 2019: 7 Things to Think About Now
RightScale
Ā 
How to Set Up a Cloud Cost Optimization Process for your Enterprise
RightScale
Ā 
Multi-Cloud Management with RightScale CMP (Demo)
RightScale
Ā 
Comparing Cloud VM Types and Prices: AWS vs Azure vs Google vs IBM
RightScale
Ā 
How to Allocate and Report Cloud Costs with RightScale Optima
RightScale
Ā 
Should You Move Between AWS, Azure, or Google Clouds? Considerations, Pros an...
RightScale
Ā 
Using RightScale CMP with Cloud Provider Tools
RightScale
Ā 
Best Practices for Multi-Cloud Security and Compliance
RightScale
Ā 
Automating Multi-Cloud Policies for AWS, Azure, Google, and More
RightScale
Ā 
The 5 Stages of Cloud Management for Enterprises
RightScale
Ā 
9 Ways to Reduce Cloud Storage Costs
RightScale
Ā 
Serverless Comparison: AWS vs Azure vs Google vs IBM
RightScale
Ā 
Best Practices for Cloud Managed Services Providers: The Path to CMP Success
RightScale
Ā 
Cloud Storage Comparison: AWS vs Azure vs Google vs IBM
RightScale
Ā 
2018 Cloud Trends: RightScale State of the Cloud Report
RightScale
Ā 
Got a Multi-Cloud Strategy? How RightScale CMP Helps
RightScale
Ā 
How to Manage Cloud Costs with RightScale Optima
RightScale
Ā 

Recently uploaded (20)

PDF
DevOps & Developer Experience Summer BBQ
AUGNYC
Ā 
PDF
Using Anchore and DefectDojo to Stand Up Your DevSecOps Function
Anchore
Ā 
PDF
Software Development Company | KodekX
KodekX
Ā 
PDF
Tea4chat - another LLM Project by Kerem Atam
a0m0rajab1
Ā 
PPTX
AI and Robotics for Human Well-being.pptx
JAYMIN SUTHAR
Ā 
PDF
AI Unleashed - Shaping the Future -Starting Today - AIOUG Yatra 2025 - For Co...
Sandesh Rao
Ā 
PDF
Cloud-Migration-Best-Practices-A-Practical-Guide-to-AWS-Azure-and-Google-Clou...
Artjoker Software Development Company
Ā 
PDF
Best ERP System for Manufacturing in India | Elite Mindz
Elite Mindz
Ā 
PDF
SparkLabs Primer on Artificial Intelligence 2025
SparkLabs Group
Ā 
PDF
Data_Analytics_vs_Data_Science_vs_BI_by_CA_Suvidha_Chaplot.pdf
CA Suvidha Chaplot
Ā 
PDF
Presentation about Hardware and Software in Computer
snehamodhawadiya
Ā 
PDF
Accelerating Oracle Database 23ai Troubleshooting with Oracle AHF Fleet Insig...
Sandesh Rao
Ā 
PPTX
Coupa-Overview _Assumptions presentation
annapureddyn
Ā 
PDF
Building High-Performance Oracle Teams: Strategic Staffing for Database Manag...
SMACT Works
Ā 
PDF
Advances in Ultra High Voltage (UHV) Transmission and Distribution Systems.pdf
Nabajyoti Banik
Ā 
PPTX
What-is-the-World-Wide-Web -- Introduction
tonifi9488
Ā 
PDF
Structs to JSON: How Go Powers REST APIs
Emily Achieng
Ā 
PPTX
Smart Infrastructure and Automation through IoT Sensors
Rejig Digital
Ā 
PDF
Security features in Dell, HP, and Lenovo PC systems: A research-based compar...
Principled Technologies
Ā 
PPTX
ChatGPT's Deck on The Enduring Legacy of Fax Machines
Greg Swan
Ā 
DevOps & Developer Experience Summer BBQ
AUGNYC
Ā 
Using Anchore and DefectDojo to Stand Up Your DevSecOps Function
Anchore
Ā 
Software Development Company | KodekX
KodekX
Ā 
Tea4chat - another LLM Project by Kerem Atam
a0m0rajab1
Ā 
AI and Robotics for Human Well-being.pptx
JAYMIN SUTHAR
Ā 
AI Unleashed - Shaping the Future -Starting Today - AIOUG Yatra 2025 - For Co...
Sandesh Rao
Ā 
Cloud-Migration-Best-Practices-A-Practical-Guide-to-AWS-Azure-and-Google-Clou...
Artjoker Software Development Company
Ā 
Best ERP System for Manufacturing in India | Elite Mindz
Elite Mindz
Ā 
SparkLabs Primer on Artificial Intelligence 2025
SparkLabs Group
Ā 
Data_Analytics_vs_Data_Science_vs_BI_by_CA_Suvidha_Chaplot.pdf
CA Suvidha Chaplot
Ā 
Presentation about Hardware and Software in Computer
snehamodhawadiya
Ā 
Accelerating Oracle Database 23ai Troubleshooting with Oracle AHF Fleet Insig...
Sandesh Rao
Ā 
Coupa-Overview _Assumptions presentation
annapureddyn
Ā 
Building High-Performance Oracle Teams: Strategic Staffing for Database Manag...
SMACT Works
Ā 
Advances in Ultra High Voltage (UHV) Transmission and Distribution Systems.pdf
Nabajyoti Banik
Ā 
What-is-the-World-Wide-Web -- Introduction
tonifi9488
Ā 
Structs to JSON: How Go Powers REST APIs
Emily Achieng
Ā 
Smart Infrastructure and Automation through IoT Sensors
Rejig Digital
Ā 
Security features in Dell, HP, and Lenovo PC systems: A research-based compar...
Principled Technologies
Ā 
ChatGPT's Deck on The Enduring Legacy of Fax Machines
Greg Swan
Ā 

Performance and Success: Key Elements to Consider in the Cloud

  • 1. Excellence in Cloud Performance Performance and Success Key Elements to Consider in the Cloud Craig Wesely Irwin [email protected]
  • 2. The Cloud - Fact or Fiction?  The Cloud = ā€œIt Just Worksā€  All applications behave and scale the same way  Theoretical analysis works when capacity planning for the cloud  Texas Style - Bigger is better  If my web or mobile app crashes, then that’s a good thing. 2
  • 3. Today’s Situation  Web & Mobile Apps Continue to Crash  Slow Response Times  Why? 3
  • 4. So you’re now in the cloud, how will you prepare for the unexpected?... 4
  • 5. So you’re now in the cloud, so how do you respond to the expected? 5
  • 6. The Peak Load Challenge Load Server & Cloud  Rapid Load Ramp-Up  Fixed Capacity  Scalability  Snowball Effect  Application Transparency 6
  • 7. Tips & Suggestions  #1 For peak and high load  Have backup ā€œminimalistic start/landing pagesā€œ  Small is Fast  #2 Extensive use of Front End Cache systems  Optimize the cache solution, consider Varnish  Less traffic is less problem, no direct DB access  #3 Implement Scaling & Queuing System  Redirect excess traffic using Load Balancer  Create Informative ā€Waitā€ pages  Bottom Line: Like a good boy scout  Always be prepared : Test the solution before launch 7
  • 8. Why Run A Performance Load Test ? Is the site stable? When does it crash? How can I make it faster? Can my application scale? 8
  • 9. Capacity vs. Load 9
  • 10. Test Environment vs. Production Environment 10
  • 11. Load Test 1 to 1  Load Maximum Throughput Point of collapse – How many users can we handle? – What is a good result? Complete failure Nr of users  Behavior in the ā€Danger Zoneā€ – Does the application become Response time āˆž unstable above load maximum?  Problem Analysis – Where are the bottlenecks? Nr of – How to fix them? users 11
  • 12. Do you have Performance Targets? Examples  Stable beyond 100,000 Concurrent users  Able handle 100,000 page views per hour  < 4 second average response time  Top 5 in our industry  Our peak time response time shall be better then competition’s  95% of our users shall make a travel selection for purchase in less then 30 seconds 12
  • 13. LoadTest Findings  #1 Identify the Backend Calls  Database calls don’t kill your application  Lack of caching does!  #2 Check the delivery of static Content  Optimize the cache solution, consider Varnish  Consider using a CDN, if needed  #3 Web Infrastructure  Load Balancer  Server model  Bandwidth  Scaling & Failover 13
  • 14. Know Your Numbers - Not all Web & Mobile Apps are equal 14
  • 15. Numbers Don’t Lie – Eliminate Subjectivity  Establish a baseline  My start page | Login | Book a flight  Response Time – Average 3.2 sec  Typical Values – Median 2.5 sec  Standard Deviation 2.8 sec  SLA 99.9%  95% is better than 11.8 sec 15
  • 16. WebPerformance Monitoring for the Cloud 1 UP/Down 2 Browser 3 Application 4 Correlation  Basic Monitor  Browser  Analytics  Inside  Alerting  Scenarios  Trend monitoring  Vital Signs  Up – down  Analytics  Complex  Basic SLA  Response time Application  Drill Down  SLA on  Root cause applications  Consolidation with other system 16
  • 17. End User Performance Monitoring – What’s the value? 17
  • 18. Tips & Suggestions  #1 Set Goals  Uptime  Performance  #2 Hate the average  Work with the exceptions  Remove the 10 Worst transactions every month  #3 Fire drill  Help identifying problems  Correlation of data 18
  • 19. Cliff Notes • Performance Testing will help you discover the weakest link in advance… • Saving you time and $$$ • Check your numbers...Know your application • They don’t lie • Plan for the unexpected... • It happens everyday All systems have a weak spot – what is 19 yours ?
  • 21. Contact Apica  Web – www.apicasystems.com  Twitter – @apicasystems  Email – [email protected] – [email protected]  Phone – 1-800-701-5721 21

Editor's Notes