SlideShare a Scribd company logo
High Performance
Architecture Patterns
Celso Crivelaro
@celsocrivelaro
$ whoami > Celso Crivelaro
- Engineer and MSc in Computer Engineering
- Dev Ruby / Python / Java
@celsocrivelaro
http://crivelaro.me
High Performance Architecture Patterns
High Performance Architecture Patterns
SMTP Locaweb
- Transaction email platform
- Fast and high quality email sending
- Live reports
- Integration by SMTP Protocol and HTTP API
- 2,5 Millions of messages per day
- + 2 years
High Performance Architecture Patterns
Platforms
High Performance Architecture Patterns
High Performance Architecture Patterns
High Performance Architecture Patterns
High Performance Architecture Patterns
High Availability
Resource Consumption
High Performance Architecture Patterns
Disk
Memory
Band-
width
Processor
time
Logs
GC
Open
Connections
Deadlocks
Stop all disk activities
Swap
Slowness
Services stop
responding
Queues Amount
Workers
Slowness
Integrations
Integrations always
fails!
Integration Fails always
Internal
External
DB API Storage Network
API ISP HopCloud
Map hidden
integrations
E.g. DNS
Fail Fast
Failing Fast reduces
transient errors
Timeouts
Never trust in
default timeouts
Threads Timeouts to get rid of deadlocls
Internal Little timeout
External Depends: The least possible
Retry
1 2 3 5 8 n
Fibonacci Proportion
...
Isolate Critical
Components
Panel / API
Painel Web Internal API - HTTP
Resources
Connection
Pool
App Server
Business
Rules
Integrations
App Internal APIApp Panel
Painel Web API - HTTP
Resources
Conn.
Pool
App
Server
Business
Rules
Integrations
Resources
Conn.
Pool
App
Server
Business
Rules
Integrations
Less Components
==
Less Problems
High Performance Architecture Patterns
Redundancy
Health Check
High Performance Architecture Patterns
High Performance Architecture Patterns
Scalability
CAP Theorem
Availability
Consistency
Tolerance
to network
partition
Availability
Consistency
Partition
Tolerance
to network
partition
whether system is
available or not
Availability
Consistency
Tolerance
to network
partition
Same data in all nodes
Availability
Consistency
Tolerance
to network
partition
Tolerante when a network
fails
Availability
Consistency
Partition
Tolerance
Postgres
Availability
Consistency
Partition
Tolerance
DNS
Availability
Consistency
Partition
Tolerance
Protocols
Evaluate which one is
acceptable to your
platform
Pool of Resources
App
Connection
Resource
Connection
Connection
Connection
Connection
Controlled Timeouts
Controlled Resource Consumption
Avoid opening/closing connections
overhead
Cache
Make your data closer
to your app
When use cache
App API
DB
Default Cache Strategy
App
Cache
Source
1
2
3
Hot Cache Strategy
App Cache Source
2 1
Load Balacing
LB
App
App
App
App
Load Balance Strategy
matters!
Decoupled
Architecture
Slow Processing
Fast processing
Asynchronous Processing
Authentication
Message
Transformation
MTA ProvidersUser
Message
Persistence
Consolidation
Background jobs
Messaging frameworks
How to discover
bottlenecks?
Test your limits...
Load Test
Stress Test
Peak Test
Telemetry
High Performance Architecture Patterns
Grafana + InfluxDB
Other scalabity
patterns
Indexes
Sharding
References
High Performance Architecture Patterns
High Performance Architecture Patterns
High Performance Architecture Patterns
http://use-the-index-luke.com
High Performance Architecture Patterns
Thank you!
Celso Crivelaro
@celsocrivelaro
celsocrivelaro@gmail.com

More Related Content

What's hot (18)

PPTX
ChronoLogic Tools Demo: 6/12/18
ChronoLogic
 
PPTX
HTTP/2 Prioritization
Patrick Meenan
 
PPTX
Extending the Yahoo Streaming Benchmark
Jamie Grier
 
PPTX
Deploy secure, scalable, and highly available web apps with Azure Front Door ...
Stamo Petkov
 
ODP
Choosing a Web Architecture for Perl
Perrin Harkins
 
PDF
Serverless architectures
Hyderabad Scalability Meetup
 
PDF
Using Communication and Messaging API in the HTML5 World
Gil Fink
 
PDF
Care and feeding notes
Perrin Harkins
 
PDF
Mobile Api and Caching
New Relic
 
PPTX
Measure() or die()
Tamar Duvshani Hermel
 
PDF
HTTP Request Smuggling via higher HTTP versions
neexemil
 
PDF
Designing an API for Mobile
SocialRadar
 
PPTX
Building Scalable .NET Web Applications
Buu Nguyen
 
PPTX
Hugs instead of Bugs: Dreaming of Quality Tools for Devs and Testers
Andreas Grabner
 
PDF
Getting a Grip on CDN Performance - Why and How
Aaron Peters
 
PDF
What's Inside Cloudflare Mobile SDK
Meghan Weinreich
 
PPTX
Resource loading, prioritization, HTTP/2 - oh my!
Patrick Meenan
 
PPTX
Flink. Pure Streaming
Indizen Technologies
 
ChronoLogic Tools Demo: 6/12/18
ChronoLogic
 
HTTP/2 Prioritization
Patrick Meenan
 
Extending the Yahoo Streaming Benchmark
Jamie Grier
 
Deploy secure, scalable, and highly available web apps with Azure Front Door ...
Stamo Petkov
 
Choosing a Web Architecture for Perl
Perrin Harkins
 
Serverless architectures
Hyderabad Scalability Meetup
 
Using Communication and Messaging API in the HTML5 World
Gil Fink
 
Care and feeding notes
Perrin Harkins
 
Mobile Api and Caching
New Relic
 
Measure() or die()
Tamar Duvshani Hermel
 
HTTP Request Smuggling via higher HTTP versions
neexemil
 
Designing an API for Mobile
SocialRadar
 
Building Scalable .NET Web Applications
Buu Nguyen
 
Hugs instead of Bugs: Dreaming of Quality Tools for Devs and Testers
Andreas Grabner
 
Getting a Grip on CDN Performance - Why and How
Aaron Peters
 
What's Inside Cloudflare Mobile SDK
Meghan Weinreich
 
Resource loading, prioritization, HTTP/2 - oh my!
Patrick Meenan
 
Flink. Pure Streaming
Indizen Technologies
 

Similar to High Performance Architecture Patterns (20)

PDF
Software Architecture for Cloud Infrastructure
Tapio Rautonen
 
PDF
Reliability and Resilience Patterns
Dmitry Chornyi
 
PPTX
Azure architecture design patterns - proven solutions to common challenges
Ivo Andreev
 
PDF
Service Mesh Talk for CTO Forum
Rick Hightower
 
PDF
QConSF2016-JoshEvans-MasteringChaosANetflixGuidetoMicroservices-compressed.pdf
SimranjyotSuri
 
PDF
Software Architecture Anti-Patterns
Eduards Sizovs
 
PDF
Cloud application architecture with Microsoft Azure
Guillermo Zepeda Selman
 
PPTX
Mastering Chaos - A Netflix Guide to Microservices
Josh Evans
 
PPTX
Architecting SaaS: Doing It Right the First Time
Serhiy (Serge) Haziyev
 
PDF
iSAQB gathering 2021 keynote - Architectural patterns for rapid, reliable, fr...
Chris Richardson
 
PDF
Architecting for Failures in micro services: patterns and lessons learned
Bhakti Mehta
 
PPTX
Service Mesh CTO Forum (Draft 3)
Rick Hightower
 
PDF
Melbourne Jan 2019 - Microservices adoption anti-patterns: Obstacles to decom...
Chris Richardson
 
PPTX
Serhiy Kalinets "Embracing architectural challenges in the modern .NET world"
Fwdays
 
PDF
Intro to Microservices
Vladimir Korolev
 
PPTX
Tech Talks Microservices
Mauricio Ferreyra
 
PDF
Devoxx2017
Bhakti Mehta
 
PPTX
Developer To Architect
Anurag Yadav
 
PDF
Resilient Design 101 (JeeConf 2017)
Avishai Ish-Shalom
 
PPTX
Alex Thissen (Xpirit) - Een verschuiving in architectuur: op weg naar microse...
AFAS Software
 
Software Architecture for Cloud Infrastructure
Tapio Rautonen
 
Reliability and Resilience Patterns
Dmitry Chornyi
 
Azure architecture design patterns - proven solutions to common challenges
Ivo Andreev
 
Service Mesh Talk for CTO Forum
Rick Hightower
 
QConSF2016-JoshEvans-MasteringChaosANetflixGuidetoMicroservices-compressed.pdf
SimranjyotSuri
 
Software Architecture Anti-Patterns
Eduards Sizovs
 
Cloud application architecture with Microsoft Azure
Guillermo Zepeda Selman
 
Mastering Chaos - A Netflix Guide to Microservices
Josh Evans
 
Architecting SaaS: Doing It Right the First Time
Serhiy (Serge) Haziyev
 
iSAQB gathering 2021 keynote - Architectural patterns for rapid, reliable, fr...
Chris Richardson
 
Architecting for Failures in micro services: patterns and lessons learned
Bhakti Mehta
 
Service Mesh CTO Forum (Draft 3)
Rick Hightower
 
Melbourne Jan 2019 - Microservices adoption anti-patterns: Obstacles to decom...
Chris Richardson
 
Serhiy Kalinets "Embracing architectural challenges in the modern .NET world"
Fwdays
 
Intro to Microservices
Vladimir Korolev
 
Tech Talks Microservices
Mauricio Ferreyra
 
Devoxx2017
Bhakti Mehta
 
Developer To Architect
Anurag Yadav
 
Resilient Design 101 (JeeConf 2017)
Avishai Ish-Shalom
 
Alex Thissen (Xpirit) - Een verschuiving in architectuur: op weg naar microse...
AFAS Software
 
Ad

More from Celso Crivelaro (16)

PDF
Testing Network Conditions with ToxiProxy
Celso Crivelaro
 
PDF
Actor model in Ruby
Celso Crivelaro
 
PDF
Banco temporal Influxdb + Grafana: Operando sua Plataforma
Celso Crivelaro
 
PDF
Separando a regra de negócios do Rails
Celso Crivelaro
 
PDF
What devs should know about email
Celso Crivelaro
 
PPT
O que devs precisam saber sobre email
Celso Crivelaro
 
PDF
Escalando uma plataforma de e-mail transacional- aprendizado das trincheiras
Celso Crivelaro
 
PDF
High Performance Architecture Patterns
Celso Crivelaro
 
PPTX
Apresentação GOLD
Celso Crivelaro
 
PPTX
Treinamento apresentação
Celso Crivelaro
 
PPTX
WTA 2012 - Proposta de Modelo Adaptativo para Geração de Contextos na Recom...
Celso Crivelaro
 
PPTX
WTA2012 - Proposta de Modelo Adaptativo para Geração de Contextos na Recome...
Celso Crivelaro
 
PPTX
Primeiro step
Celso Crivelaro
 
PPTX
Formas decontratação
Celso Crivelaro
 
PPTX
Negociação
Celso Crivelaro
 
Testing Network Conditions with ToxiProxy
Celso Crivelaro
 
Actor model in Ruby
Celso Crivelaro
 
Banco temporal Influxdb + Grafana: Operando sua Plataforma
Celso Crivelaro
 
Separando a regra de negócios do Rails
Celso Crivelaro
 
What devs should know about email
Celso Crivelaro
 
O que devs precisam saber sobre email
Celso Crivelaro
 
Escalando uma plataforma de e-mail transacional- aprendizado das trincheiras
Celso Crivelaro
 
High Performance Architecture Patterns
Celso Crivelaro
 
Apresentação GOLD
Celso Crivelaro
 
Treinamento apresentação
Celso Crivelaro
 
WTA 2012 - Proposta de Modelo Adaptativo para Geração de Contextos na Recom...
Celso Crivelaro
 
WTA2012 - Proposta de Modelo Adaptativo para Geração de Contextos na Recome...
Celso Crivelaro
 
Primeiro step
Celso Crivelaro
 
Formas decontratação
Celso Crivelaro
 
Negociação
Celso Crivelaro
 
Ad

Recently uploaded (20)

PPTX
IT Runs Better with ThousandEyes AI-driven Assurance
ThousandEyes
 
PPTX
The Future of AI & Machine Learning.pptx
pritsen4700
 
PDF
The Future of Artificial Intelligence (AI)
Mukul
 
PPTX
Introduction to Flutter by Ayush Desai.pptx
ayushdesai204
 
PDF
Structs to JSON: How Go Powers REST APIs
Emily Achieng
 
PDF
OFFOFFBOX™ – A New Era for African Film | Startup Presentation
ambaicciwalkerbrian
 
PDF
Peak of Data & AI Encore - Real-Time Insights & Scalable Editing with ArcGIS
Safe Software
 
PDF
Researching The Best Chat SDK Providers in 2025
Ray Fields
 
PDF
Market Insight : ETH Dominance Returns
CIFDAQ
 
PDF
Google I/O Extended 2025 Baku - all ppts
HusseinMalikMammadli
 
PDF
CIFDAQ's Market Wrap : Bears Back in Control?
CIFDAQ
 
PDF
Economic Impact of Data Centres to the Malaysian Economy
flintglobalapac
 
PDF
Make GenAI investments go further with the Dell AI Factory
Principled Technologies
 
PDF
How ETL Control Logic Keeps Your Pipelines Safe and Reliable.pdf
Stryv Solutions Pvt. Ltd.
 
PDF
AI Unleashed - Shaping the Future -Starting Today - AIOUG Yatra 2025 - For Co...
Sandesh Rao
 
PPTX
AI and Robotics for Human Well-being.pptx
JAYMIN SUTHAR
 
PDF
State-Dependent Conformal Perception Bounds for Neuro-Symbolic Verification
Ivan Ruchkin
 
PDF
Data_Analytics_vs_Data_Science_vs_BI_by_CA_Suvidha_Chaplot.pdf
CA Suvidha Chaplot
 
PDF
TrustArc Webinar - Navigating Data Privacy in LATAM: Laws, Trends, and Compli...
TrustArc
 
PDF
Build with AI and GDG Cloud Bydgoszcz- ADK .pdf
jaroslawgajewski1
 
IT Runs Better with ThousandEyes AI-driven Assurance
ThousandEyes
 
The Future of AI & Machine Learning.pptx
pritsen4700
 
The Future of Artificial Intelligence (AI)
Mukul
 
Introduction to Flutter by Ayush Desai.pptx
ayushdesai204
 
Structs to JSON: How Go Powers REST APIs
Emily Achieng
 
OFFOFFBOX™ – A New Era for African Film | Startup Presentation
ambaicciwalkerbrian
 
Peak of Data & AI Encore - Real-Time Insights & Scalable Editing with ArcGIS
Safe Software
 
Researching The Best Chat SDK Providers in 2025
Ray Fields
 
Market Insight : ETH Dominance Returns
CIFDAQ
 
Google I/O Extended 2025 Baku - all ppts
HusseinMalikMammadli
 
CIFDAQ's Market Wrap : Bears Back in Control?
CIFDAQ
 
Economic Impact of Data Centres to the Malaysian Economy
flintglobalapac
 
Make GenAI investments go further with the Dell AI Factory
Principled Technologies
 
How ETL Control Logic Keeps Your Pipelines Safe and Reliable.pdf
Stryv Solutions Pvt. Ltd.
 
AI Unleashed - Shaping the Future -Starting Today - AIOUG Yatra 2025 - For Co...
Sandesh Rao
 
AI and Robotics for Human Well-being.pptx
JAYMIN SUTHAR
 
State-Dependent Conformal Perception Bounds for Neuro-Symbolic Verification
Ivan Ruchkin
 
Data_Analytics_vs_Data_Science_vs_BI_by_CA_Suvidha_Chaplot.pdf
CA Suvidha Chaplot
 
TrustArc Webinar - Navigating Data Privacy in LATAM: Laws, Trends, and Compli...
TrustArc
 
Build with AI and GDG Cloud Bydgoszcz- ADK .pdf
jaroslawgajewski1
 

High Performance Architecture Patterns