Internet Scale Service
charsyam@naver.com
About Me
•KakaoStory Backend Engineer
•Redis Contributor
•Apache Tajo Committer
Internet Scale Service
High Scale Service
Mass Traffic
Huge Users
Many IDCs
Build
Internet Scale Service
Paper
https://www.usenix.org/legacy/event/lisa07/tech/full_pape
rs/hamilton/hamilton_html/
Check List
https://gist.github.com/acolyer/95ef23
802803cb8b4eb5
What should be
considered?
Your Service is Elastic?
Sharding
Shared Nothing
Shared Nothing
Stateless
Stateless
Load Balancer
Storage Layer
API
Servers
API
Servers
API
Servers
API
Servers
Stateless
Load Balancer
Storage Layer
API
Servers
API
Servers
API
Servers
API
Servers
Need Log Collector
Sharding
Database Partitioning
Vertical Partitioning
Horizontal Partitioning
Sharding = Horizontal
Partitioning
But Not only DB
Searching Key
Range
User #1
User #10
User #1000000
User #1000001
User #1000100
User #2000000
User #2000001
User #2000200
User #3000000
User #1000005
Moduler
User #1
User #4
User #7
User #2
User #5
User #8
User #3
User #6
User #9
User #0
#0 / 3 = 0
Indexed
User #5000 Index Server
User #1
User #2000
User #1000000
User #2
User #2001
User #10000
User #3
User #6
User #5000
#5000 is in Server2
Searching Key
with
Coordinator
Clustering
Don’t need
Search Key
Hbase
Cassandra
MongoDB
etc
Mature
But
Not Mature
Cache Solution
Memcached/Redis
Memcached
Chunk
Slab Algorithm
Redis
Collections
Replication
Redis is Single Threaded
Redis
150,000 TPS
In commodity server
Redis
Must manage
Redis Memory(RSS)
Redis
Don’t execute long-time
Spend Commands.
Cache is Storage
Server
Cache #1
Cache #2
Cache #3
Cache #4
Searching Key
Client Side Load Balancing
Server
Cache #1
Cache #2
Cache #3
Cache #4
Searching Key
Cache #1
Cache #2
Cache #3
Cache #4
Coordinator
Server Side Load Balancing
proxy
Cache #1
Cache #2
Cache #3
Cache #4
Searching Key
Server
Circuit Breaker
Internet scaleservice
How many API Calls?
If one call fails?
Fast FailBack
and Background Check
Netflix Hystrix
Using Coordinator
Zookeeper
Consul
Etcd
Get Configuration
From Coordinator
Servers List
Feature Flags
Failover
VIP
Dynamic DNS
VIP
Server
DB Master
192.168.0.10
DB Slave
192.168.0.11
VIP 192.168.0.12
VIP
Server
DB Master
192.168.0.10
DB Slave
192.168.0.11
VIP 192.168.0.12
Dynamic DNS
Server
DB Master
192.168.0.10
DB Slave
192.168.0.11
db1-master.a.com
Dynamic DNS
Server
DB Master
192.168.0.10
DB Slave
192.168.0.11
db1-master.a.com
Must Check
Environments
For Dynamic DNS
JVM DNS Cache Issue
Latency #1
Latency #1
IDC 1 IDC 2
API Server DB Server
Latency 50ms
What Happen?
Latency #1
IDC 1 IDC 2
API Server DB Server
Select * from posts where id=123;
results
Select member from members
where id=poster.group;
results
Latency #1
IDC 1 IDC 2
API Server
DB Server
getMembersList()
results
Logic Server
Latency #2
Internet scaleservice
Internet scaleservice
QnA
Thanks

More Related Content

PDF
Redis acl
PDF
Scaling Twitter
PDF
Digdag Updates 2020 July
PDF
re:dash is awesome
PDF
"High-load is at the intersection of DevOps and PHP development",
PDF
Scripting Embulk Plugins
PDF
Altitude SF 2017: Advanced VCL: Shielding and Clustering
PPTX
Scalable Event Analytics with MongoDB & Ruby on Rails
Redis acl
Scaling Twitter
Digdag Updates 2020 July
re:dash is awesome
"High-load is at the intersection of DevOps and PHP development",
Scripting Embulk Plugins
Altitude SF 2017: Advanced VCL: Shielding and Clustering
Scalable Event Analytics with MongoDB & Ruby on Rails

What's hot (20)

PPTX
Embulk and Machine Learning infrastructure
PDF
Counting image views using redis cluster
PDF
Spilo, отказоустойчивый PostgreSQL кластер / Oleksii Kliukin (Zalando SE)
PDF
Altitude SF 2017: Optimizing your hit rate
PDF
Single tenant software to multi-tenant SaaS using K8S
PDF
Wordpress optimization
PPTX
RedisConf17- Using Redis at scale @ Twitter
PDF
Troubleshooting redis
PDF
Happy Browser, Happy User! WordSesh 2019
PDF
State of the CLI- Kat Marchan
PDF
How Percolate uses CFEngine to Manage AWS Stateless Infrastructure
PDF
GoSF Summerfest - Why Go at Apcera
PPTX
HighLoad Solutions On MySQL / Xiaobin Lin (Alibaba)
PPTX
Capacity Planning
PDF
Running Cloud Foundry for 12 months - An experience report | anynines
PPTX
Altitude SF 2017: Reddit - How we built and scaled r/place
PPTX
Automating aws infrastructure and code deployments using Ansible @WebEngage
PDF
Whats wrong with postgres | PGConf EU 2019 | Craig Kerstiens
PDF
AWS Summit Milan - AWS RDS for your data (and your sleep)
PDF
Apcera Case Study: The selection of the Go language
Embulk and Machine Learning infrastructure
Counting image views using redis cluster
Spilo, отказоустойчивый PostgreSQL кластер / Oleksii Kliukin (Zalando SE)
Altitude SF 2017: Optimizing your hit rate
Single tenant software to multi-tenant SaaS using K8S
Wordpress optimization
RedisConf17- Using Redis at scale @ Twitter
Troubleshooting redis
Happy Browser, Happy User! WordSesh 2019
State of the CLI- Kat Marchan
How Percolate uses CFEngine to Manage AWS Stateless Infrastructure
GoSF Summerfest - Why Go at Apcera
HighLoad Solutions On MySQL / Xiaobin Lin (Alibaba)
Capacity Planning
Running Cloud Foundry for 12 months - An experience report | anynines
Altitude SF 2017: Reddit - How we built and scaled r/place
Automating aws infrastructure and code deployments using Ansible @WebEngage
Whats wrong with postgres | PGConf EU 2019 | Craig Kerstiens
AWS Summit Milan - AWS RDS for your data (and your sleep)
Apcera Case Study: The selection of the Go language
Ad

Viewers also liked (20)

PDF
Better softwareengineer han
PDF
Opensource sw day
PDF
Redis trouble shooting_eng
PDF
Random 111203223949-phpapp02
PDF
Redis trouble shooting
PDF
Soscon lt 1
PDF
Open source oss
PDF
OpenSource Contributor
PDF
Redis on AWS
PDF
2015 SW마에스트로 100+ 컨퍼런스_카카오 플랫폼과 Elastic Web Service
PDF
Elastic webservice
PDF
聊聊我接触的集群管理
PDF
Redis as a Main Database, Scaling and HA
PPTX
大话redis设计实现
PDF
Redis acc 2015
PDF
Redis edu 4
PDF
오픈소스 그리고 기회
PPTX
Raft
PDF
Redis edu 5
PDF
대규모서비스를지탱하는기술 7
Better softwareengineer han
Opensource sw day
Redis trouble shooting_eng
Random 111203223949-phpapp02
Redis trouble shooting
Soscon lt 1
Open source oss
OpenSource Contributor
Redis on AWS
2015 SW마에스트로 100+ 컨퍼런스_카카오 플랫폼과 Elastic Web Service
Elastic webservice
聊聊我接触的集群管理
Redis as a Main Database, Scaling and HA
大话redis设计实现
Redis acc 2015
Redis edu 4
오픈소스 그리고 기회
Raft
Redis edu 5
대규모서비스를지탱하는기술 7
Ad

Similar to Internet scaleservice (20)

PDF
"Choosing proper type of scaling", Olena Syrota
PPTX
Scalable service architectures @ VDB16
PPTX
Scaling Box-Search: Gearing up for Petabyte Scale - Shubhro Roy & Anthony Urb...
PPTX
Scalable service architectures @ BWS16
PDF
Scaling Integration
PDF
Cost to Serve of large scale Online Systems - final
PDF
Escalando hasta sus primeros 10 millones de usuarios
PDF
Acing The System Design Interview 1st Edition Zhiyong Tan
PDF
Mike Krieger - A Brief, Rapid History of Scaling Instagram (with a tiny team)
PDF
Escalando hasta sus primeros 10 millones de usuarios
PPTX
Designing Fault Tolerant Microservices
PPT
MongoDB Sharding Webinar 2014
PDF
89025069 mike-krieger-instagram-at-the-airbnb-tech-talk-on-scaling-instagram
PPTX
Microservices & Streaming Data
PPTX
Webinar How to Achieve True Scalability in SaaS Applications
PPTX
Handling Data in Mega Scale Systems
PDF
Petabytes and Nanoseconds
PDF
How a Small Team Scales Instagram
PDF
Managing microservices with istio on OpenShift - Meetup
PDF
2021_1006-DAT_Slide-Deck.pdf
"Choosing proper type of scaling", Olena Syrota
Scalable service architectures @ VDB16
Scaling Box-Search: Gearing up for Petabyte Scale - Shubhro Roy & Anthony Urb...
Scalable service architectures @ BWS16
Scaling Integration
Cost to Serve of large scale Online Systems - final
Escalando hasta sus primeros 10 millones de usuarios
Acing The System Design Interview 1st Edition Zhiyong Tan
Mike Krieger - A Brief, Rapid History of Scaling Instagram (with a tiny team)
Escalando hasta sus primeros 10 millones de usuarios
Designing Fault Tolerant Microservices
MongoDB Sharding Webinar 2014
89025069 mike-krieger-instagram-at-the-airbnb-tech-talk-on-scaling-instagram
Microservices & Streaming Data
Webinar How to Achieve True Scalability in SaaS Applications
Handling Data in Mega Scale Systems
Petabytes and Nanoseconds
How a Small Team Scales Instagram
Managing microservices with istio on OpenShift - Meetup
2021_1006-DAT_Slide-Deck.pdf

More from DaeMyung Kang (20)

PPTX
Count min sketch
PDF
PDF
Ansible
PDF
Why GUID is needed
PDF
How to use redis well
PPTX
The easiest consistent hashing
PDF
How to name a cache key
PDF
Integration between Filebeat and logstash
PDF
How to build massive service for advance
PDF
Massive service basic
PDF
Data Engineering 101
PDF
How To Become Better Engineer
PPTX
Kafka timestamp offset_final
PPTX
Kafka timestamp offset
PPTX
Data pipeline and data lake
PDF
Coffee store
PDF
Scalable webservice
PDF
Number system
PDF
webservice scaling for newbie
PDF
Internet Scale Service Arichitecture
Count min sketch
Ansible
Why GUID is needed
How to use redis well
The easiest consistent hashing
How to name a cache key
Integration between Filebeat and logstash
How to build massive service for advance
Massive service basic
Data Engineering 101
How To Become Better Engineer
Kafka timestamp offset_final
Kafka timestamp offset
Data pipeline and data lake
Coffee store
Scalable webservice
Number system
webservice scaling for newbie
Internet Scale Service Arichitecture

Recently uploaded (20)

PDF
Beginners-Guide-to-Artificial-Intelligence.pdf
PPTX
MAD Unit - 3 User Interface and Data Management (Diploma IT)
PDF
Research on ultrasonic sensor for TTU.pdf
PDF
Unit1 - AIML Chapter 1 concept and ethics
PDF
electrical machines course file-anna university
PPTX
Environmental studies, Moudle 3-Environmental Pollution.pptx
PDF
Present and Future of Systems Engineering: Air Combat Systems
PDF
Computer System Architecture 3rd Edition-M Morris Mano.pdf
PDF
VSL-Strand-Post-tensioning-Systems-Technical-Catalogue_2019-01.pdf
PPTX
CNS - Unit 1 (Introduction To Computer Networks) - PPT (2).pptx
PPTX
Agentic Artificial Intelligence (Agentic AI).pptx
PPTX
CT Generations and Image Reconstruction methods
PPTX
WN UNIT-II CH4_MKaruna_BapatlaEngineeringCollege.pptx
PPTX
Micro1New.ppt.pptx the mai themes of micfrobiology
PDF
VTU IOT LAB MANUAL (BCS701) Computer science and Engineering
PPTX
Principal presentation for NAAC (1).pptx
PDF
Mechanics of materials week 2 rajeshwari
PPTX
CS6006 - CLOUD COMPUTING - Module - 1.pptx
PPTX
Module1.pptxrjkeieuekwkwoowkemehehehrjrjrj
PDF
20250617 - IR - Global Guide for HR - 51 pages.pdf
Beginners-Guide-to-Artificial-Intelligence.pdf
MAD Unit - 3 User Interface and Data Management (Diploma IT)
Research on ultrasonic sensor for TTU.pdf
Unit1 - AIML Chapter 1 concept and ethics
electrical machines course file-anna university
Environmental studies, Moudle 3-Environmental Pollution.pptx
Present and Future of Systems Engineering: Air Combat Systems
Computer System Architecture 3rd Edition-M Morris Mano.pdf
VSL-Strand-Post-tensioning-Systems-Technical-Catalogue_2019-01.pdf
CNS - Unit 1 (Introduction To Computer Networks) - PPT (2).pptx
Agentic Artificial Intelligence (Agentic AI).pptx
CT Generations and Image Reconstruction methods
WN UNIT-II CH4_MKaruna_BapatlaEngineeringCollege.pptx
Micro1New.ppt.pptx the mai themes of micfrobiology
VTU IOT LAB MANUAL (BCS701) Computer science and Engineering
Principal presentation for NAAC (1).pptx
Mechanics of materials week 2 rajeshwari
CS6006 - CLOUD COMPUTING - Module - 1.pptx
Module1.pptxrjkeieuekwkwoowkemehehehrjrjrj
20250617 - IR - Global Guide for HR - 51 pages.pdf

Internet scaleservice