Performance Testingatthe EdgeAlois Reitbauer, dynaTrace Software
3,000,000,00010,500,000,000
The Classical Approach
Waterfallsarepretty
But mightgetscary
The dynaTrace Approach
ManyplatformsDifferent usagescenariosHigh numberofconfigurationsNo easy waytopatchsoftware
8OurArchitectureDYNATRACE CLIENT DYNATRACE SERVERDYNATRACE COLLECTOR(OPTIONAL)DYNATRACE COLLECTOR(OPTIONAL)WANJava Server.NET ServerDatabase Web ServerAPPLICATION
Lessonslearned
Profiling was not enoughGoodforfindingproblemsResultcomparisonhardOnly valid untilnextcheck-inToomuchwork
The Life of a Log StatementEnterthecodepublicvoidfoo (){   … // do something  bar ();}publicvoid bar (){  … // do somethingelse Logger.log (“executiontook“ + time);}
The Life of a Log StatementSomebodychangessomethingpublicvoidfoo (){   … // do somethingif (condition)     bar ();elseotherBar ();}publicvoid bar (){  … // do somethingelse Logger.log (“executiontook“ + time);}
The Life of a Log StatementYourcodegetsdeprecatedpublicvoidfoo (){   … // do somethingnewBar ();}publicvoid bar (){  … // do somethingelse Logger.log (“executiontook“ + time);}
Methodology
DefiningourstrategyStartearlyBreak in piecesTest Continuously
Frequency vs.GranularityJUnit-basedTests (2x day)Total SystemTestsLong-runningStabiltiy Tests(2 w duration)GranularityFrequency
GranularityComparabilityComplexityQuality
Avoid Re-RunsWhatcould happen?Whichinformation do youwant?Whatdescribesyoursystem?Whatis different fromthe last run?
Aim high …… test50%more
Create Instability.. addingsomevolatilityincreasesthelikelynesstodiscoverproblems …“
„Last MileTesting“
Measurements
Stabilityof Tests
UseDedicated HardwareComparabilityStability Efficiency
Trends in Unstable Tests
TestingscalabilityBig DumpOperationsSmall DumpOperations
UnderstandyourmeasurementsResponse Time and GCResponse Time only
BeSpecific on whattotestThroughputResponse TimeMemory ConsumptionOther KPI …
Beyond Response TimeKPI Chart: Server Throughput  Over Time
Motivateyourteam
Howtomakedeveloperswritetests#1 Heroism#2 Boomerang#3 The otherguy#4 Bug me not#5 Feedback#6 Code vs. Wine#7 Newb vs. Noob
Test Case ComplexityFirstStart dynaTrace infrastructureWhenreadyStart n WebSphereinstances on servers … WhenreadyStart LoadtestagainstWebSphereserversAfter loadteststartExecute testcase
Making complexthings easy    @DtdRemoteSud(            host = "lab2",            name = "WAS7.0",            startupPriority = 1,            postStartClosure = WaitForWebSphereSudIsUp.class    )    private SudInterfacewebSphereSud;
FindingtheresponsiblecodeVersion ControlHistory Lookup
AlwaysavailableContinuous Integration Reports
E-Mail Notification
alois.reitbauer@dynatrace.com        Mailblog.dynatrace.com        BlogAloisReitbauerTwitter

More Related Content

PDF
NYAN Conference: Debugging asynchronous scenarios in .net
PPT
Inside the JVM - Performance & Garbage Collector Tuning in JAVA
ODP
How to unit test your React/Redux app
PPTX
Ob1k presentation at Java.IL
PPTX
Kotlin Coroutines and Rx
PDF
OB1K - New, Better, Faster, Devops Friendly Java container by Outbrain
PPT
ZON Dev Days 2013
NYAN Conference: Debugging asynchronous scenarios in .net
Inside the JVM - Performance & Garbage Collector Tuning in JAVA
How to unit test your React/Redux app
Ob1k presentation at Java.IL
Kotlin Coroutines and Rx
OB1K - New, Better, Faster, Devops Friendly Java container by Outbrain
ZON Dev Days 2013

What's hot (20)

PDF
JCache / JSR107 shortcomings
PDF
cache2k, Java Caching, Turbo Charged, FOSDEM 2015
PPT
clj http
PDF
Debugging your varnish instance
PDF
Reactive by example - at Reversim Summit 2015
PDF
Dropwizard
PDF
RxJava on Android
PDF
Intro to RxJava/RxAndroid - GDG Munich Android
PDF
JDKs 10 to 14 (and beyond)
PDF
Java agents are watching your ByteCode
PDF
Stranger in These Parts. A Hired Gun in the JS Corral (JSConf US 2012)
 
PPTX
Performance is a feature! - Developer South Coast - part 2
PDF
Automated testing with Openshift
PDF
Make Your Own Developement Board @ 2014.4.21 JuluOSDev
PPTX
Testing Django APIs
PPTX
UJUG 2013 Architecture Roundup with Lucid Software
PPTX
Go bei der 4Com GmbH & Co. KG
RTF
R snippet
PDF
Performance tests with gatling
ODP
Java 10 - Updates
JCache / JSR107 shortcomings
cache2k, Java Caching, Turbo Charged, FOSDEM 2015
clj http
Debugging your varnish instance
Reactive by example - at Reversim Summit 2015
Dropwizard
RxJava on Android
Intro to RxJava/RxAndroid - GDG Munich Android
JDKs 10 to 14 (and beyond)
Java agents are watching your ByteCode
Stranger in These Parts. A Hired Gun in the JS Corral (JSConf US 2012)
 
Performance is a feature! - Developer South Coast - part 2
Automated testing with Openshift
Make Your Own Developement Board @ 2014.4.21 JuluOSDev
Testing Django APIs
UJUG 2013 Architecture Roundup with Lucid Software
Go bei der 4Com GmbH & Co. KG
R snippet
Performance tests with gatling
Java 10 - Updates

Similar to Q Con Performance Testing At The Edge (20)

PPTX
The secret art of agile performance testing
PDF
Performance Metrics for your Delivery Pipeline - Wolfgang Gottesheim
PPTX
QA&test 2016 (Bilbao) Pros and Cons of Doing Performance Testing Along with D...
PPTX
DevOps Days Toronto: From 6 Months Waterfall to 1 hour Code Deploys
PDF
Become a Performance Diagnostics Hero
PDF
Neotys PAC 2018 - Gayatree Nalwadad
PPTX
Alexander Podelko - Context-Driven Performance Testing
PPTX
Performance Metrics Driven CI/CD - Introduction to Continuous Innovation and ...
PPTX
SDET approach for Agile Testing
ODP
Workshop BI/DWH AGILE TESTING SNS Bank English
PPTX
Software Characterization & Performance Testing - Beat Your Software with a S...
PPS
Performance Test Slideshow R E C E N T
PPS
Performance Test Slideshow Recent
PPT
Testing Types And Models
PPTX
Context-Driven Performance Testing
PPTX
Reinventing Performance Testing, CMG imPACt 2016 slides
PDF
Continuous Testing through Service Virtualization
PPTX
Continuous Performance Testing and Monitoring in Agile Development
 
PPTX
Lunch and Learn and Sneakers
PDF
Better Software East 2016: Evolving Automated to Continuous
The secret art of agile performance testing
Performance Metrics for your Delivery Pipeline - Wolfgang Gottesheim
QA&test 2016 (Bilbao) Pros and Cons of Doing Performance Testing Along with D...
DevOps Days Toronto: From 6 Months Waterfall to 1 hour Code Deploys
Become a Performance Diagnostics Hero
Neotys PAC 2018 - Gayatree Nalwadad
Alexander Podelko - Context-Driven Performance Testing
Performance Metrics Driven CI/CD - Introduction to Continuous Innovation and ...
SDET approach for Agile Testing
Workshop BI/DWH AGILE TESTING SNS Bank English
Software Characterization & Performance Testing - Beat Your Software with a S...
Performance Test Slideshow R E C E N T
Performance Test Slideshow Recent
Testing Types And Models
Context-Driven Performance Testing
Reinventing Performance Testing, CMG imPACt 2016 slides
Continuous Testing through Service Virtualization
Continuous Performance Testing and Monitoring in Agile Development
 
Lunch and Learn and Sneakers
Better Software East 2016: Evolving Automated to Continuous

More from Alois Reitbauer (20)

PPTX
Monitoring large scale Docker production environments
PPTX
Can a monitoring tool pass the turing test
PPTX
Monitoring Docker Application in Production
PPTX
The definition of normal - An introduction and guide to anomaly detection.
PPTX
Monitoring without alerts
PPTX
Ruxit - How we launched a global monitoring platform on AWS in 80 days.
PPTX
Microservice, Micro Deployments and DevOps
PPTX
The Dark Art of Production Alerting
PPTX
W3C Web Performance - A detailed overview
PPTX
The Dark of Building an Production Incident Syste
PPTX
The High Performance Web Application Lifecycle
PPTX
Monitoring and Managing Java Applications
PPTX
What it means to be fast in your industry
PPTX
Measuring User Experience in the Browser
PPTX
Measuring User Experience
PPTX
Web Performance Optimzation
PPTX
What it means to deliver exceptional performance
PPTX
Why you have less than a second to deliver exceptional performance
PPTX
Measuring Performance in the Browser
PPTX
Performance Forensics - Understanding Application Performance
Monitoring large scale Docker production environments
Can a monitoring tool pass the turing test
Monitoring Docker Application in Production
The definition of normal - An introduction and guide to anomaly detection.
Monitoring without alerts
Ruxit - How we launched a global monitoring platform on AWS in 80 days.
Microservice, Micro Deployments and DevOps
The Dark Art of Production Alerting
W3C Web Performance - A detailed overview
The Dark of Building an Production Incident Syste
The High Performance Web Application Lifecycle
Monitoring and Managing Java Applications
What it means to be fast in your industry
Measuring User Experience in the Browser
Measuring User Experience
Web Performance Optimzation
What it means to deliver exceptional performance
Why you have less than a second to deliver exceptional performance
Measuring Performance in the Browser
Performance Forensics - Understanding Application Performance

Recently uploaded (20)

PDF
CEH Module 2 Footprinting CEH V13, concepts
PDF
NewMind AI Journal Monthly Chronicles - August 2025
PDF
The AI Revolution in Customer Service - 2025
PPTX
Strategic Picks — Prioritising the Right Agentic Use Cases [2/6]
PDF
Secure Java Applications against Quantum Threats
PPTX
maintenance powerrpoint for adaprive and preventive
PDF
Be ready for tomorrow’s needs with a longer-lasting, higher-performing PC
PPTX
Information-Technology-in-Human-Society.pptx
PDF
Examining Bias in AI Generated News Content.pdf
PDF
Ebook - The Future of AI A Comprehensive Guide.pdf
PDF
Domain-specific knowledge and context in large language models: challenges, c...
PDF
“Introduction to Designing with AI Agents,” a Presentation from Amazon Web Se...
PPT
Overviiew on Intellectual property right
PPTX
Presentation - Principles of Instructional Design.pptx
PDF
Altius execution marketplace concept.pdf
PPTX
How to use fields_get method in Odoo 18
PDF
Addressing the challenges of harmonizing law and artificial intelligence tech...
PDF
Uncertainty-aware contextual multi-armed bandits for recommendations in e-com...
PDF
Streamline Vulnerability Management From Minimal Images to SBOMs
PDF
GDG Cloud Southlake #45: Patrick Debois: The Impact of GenAI on Development a...
CEH Module 2 Footprinting CEH V13, concepts
NewMind AI Journal Monthly Chronicles - August 2025
The AI Revolution in Customer Service - 2025
Strategic Picks — Prioritising the Right Agentic Use Cases [2/6]
Secure Java Applications against Quantum Threats
maintenance powerrpoint for adaprive and preventive
Be ready for tomorrow’s needs with a longer-lasting, higher-performing PC
Information-Technology-in-Human-Society.pptx
Examining Bias in AI Generated News Content.pdf
Ebook - The Future of AI A Comprehensive Guide.pdf
Domain-specific knowledge and context in large language models: challenges, c...
“Introduction to Designing with AI Agents,” a Presentation from Amazon Web Se...
Overviiew on Intellectual property right
Presentation - Principles of Instructional Design.pptx
Altius execution marketplace concept.pdf
How to use fields_get method in Odoo 18
Addressing the challenges of harmonizing law and artificial intelligence tech...
Uncertainty-aware contextual multi-armed bandits for recommendations in e-com...
Streamline Vulnerability Management From Minimal Images to SBOMs
GDG Cloud Southlake #45: Patrick Debois: The Impact of GenAI on Development a...

Q Con Performance Testing At The Edge