SlideShare a Scribd company logo
1YugaByte Confidential © 2018 All rights reserved.
YugaByte DB on K8S
Karthik Ranganathan
Co-Founder & CTO
June 2018
2© 2018 All rights reserved.
Not Portable
Not Portable
Open Source
Not Portable
Open Source
Open Source
High Performance, Transactional, Planet-Scale High Performance, Transactional, Planet-Scale
High Performance, Transactional, Planet-Scale High Performance, Transactional, Planet-Scale
System-of-Record DBs for Global Apps
3© 2018 All rights reserved.
TRANSACTIONAL PLANET-SCALEHIGH PERFORMANCE
Distributed ACID Transactions
Document-Based, Strongly
Consistent Storage
Low Latency, Tunable Reads
High Throughput
CLOUD-NATIVE OPEN SOURCE
Apache 2.0
Popular APIs Extended
Apache Cassandra, Redis and PostgreSQL (BETA)
Built For The Container Era
Self-Healing, Fault-Tolerant
Auto Sharding & Rebalancing
Global Data Distribution
Design Goals
4© 2018 All rights reserved.
Inside The Hood - 3 Node Cluster
DocDB Storage Engine
Purpose-built for ever-growing data, extended from RocksDB
yb-master1
yb-master3
yb-master2
YB-Master
Manage shard metadata &
coordinate cluster-wide ops
node1
node3
node2
Global Transaction Manager
Tracks ACID txns across multi-row ops, incl. clock skew mgmt.
Raft Consensus Replication
Highly resilient, used for both data replication & leader election
tablet 1’
tablet 1’
yb-tserver1 yb-tserver2
yb-tserver3
tablet 1’
tablet2-leader
tablet3-leader
tablet1-leaderYB-TServer
Stores/serves data in/from
tablets (shards)
tablet1-follower
tablet1-follower
tablet3-follower
tablet2-follower
tablet3-follower
tablet2-follower
…
…
…
5© 2018 All rights reserved.
YugaByte DB on StatefulSets
https://docs.yugabyte.com/deploy/multi-node-cluster/
Stable network IDs Persistent volumesOrdered operations
STATEFUL
1. Start all yb-masters first (usually 3)
2. Start as many yb-tservers as needed
6© 2018 All rights reserved.
A Real-World Example
Yugastore – E-Commerce app on the YERN stack
Deployed on
github.com/YugaByte/yugastore
7© 2018 All rights reserved.
Kubernetes Deployment Architecture
yb-master
StatefulSet yugabytedb
yb-master-1 pod
yugabytedb
yb-master-0 pod
yugabytedb
yb-master-2 pod
yb-tserver
StatefulSet
tablet 1’
yugabytedb
yb-tserver-1 podtablet 1’
yugabytedb
yb-tserver-0 pod tablet 1’
yugabytedb
yb-tserver-2 pod
yb-masters
Headless Service
yb-master-ui
LoadBalancer Service
yb-tservers
Headless Service yugastore
Deployment
tablet 1’
yugastore
yugastore-1 podtablet 1’
yugastore
yugastore-0 pod
yugastore
LoadBalancer Service
End User
Admin User
8© 2018 All rights reserved.
Store less dynamic data
using the YCQL API
Example: description
Highly dynamic data
using the YEDIS API
Example: number of
reviews
Multi-API, Multi-Model in Action
9© 2018 All rights reserved.
Products modeled as a table
Show me an book in the
business category
Dynamic sets modeled as
Redis SORTED SETs
Show me the top 2 book with the
most reviews
Multi-API, Multi-Model in Action
10© 2018 All rights reserved.
Step 1
Deploy YugaByte DB cluster
https://docs.yugabyte.com/latest/deploy/kubernetes/local-ssd/
kubectl apply -f yugabyte-statefulset.yaml
11© 2018 All rights reserved.
Step 2
Deploy Yugastore app
kubectl run yugastore 
--image=yugabytedb/yugastore 
--port=3001 
--command start-for-kubernetes.sh
12© 2018 All rights reserved.
Step 3
Expose the Yugastore app as a service
kubectl expose 
deployment yugastore 
--type=LoadBalancer
13© 2018 All rights reserved.
Step 4
Run a workload
kubectl exec -it 
yugastore-<container-id> 
node yugastore/test/sample-user.js
14© 2018 All rights reserved.
Step 5
Scale out YugaByte DB
kubectl scale statefulset yb-tserver --replicas=4
15© 2018 All rights reserved.
gitter.im/YugaByte
@YugaByte
Thank You!

More Related Content

What's hot (20)

PDF
100PBを越えるデータプラットフォームの実情
Rakuten Group, Inc.
 
PDF
DRP (Stretch Cluster) for HDP - Future of Data : Paris
Mohamed Mehdi Ben Aissa
 
PDF
データインターフェースとしてのHadoop ~HDFSとクラウドストレージと私~ (NTTデータ テクノロジーカンファレンス 2019 講演資料、2019...
NTT DATA Technology & Innovation
 
PDF
コンテナセキュリティにおける権限制御(OCHaCafe5 #3 Kubernetes のセキュリティ 発表資料)
NTT DATA Technology & Innovation
 
PDF
Actionable Insights with AI - Snowflake for Data Science
Harald Erb
 
PPTX
Zero to Snowflake Presentation
Brett VanderPlaats
 
PDF
実用段階に入ったOpenStack ~ もうすぐ絶滅するというPrivate Cloudの多様性について ~
Rakuten Group, Inc.
 
PDF
HBaseCon 2012 | Lessons learned from OpenTSDB - Benoit Sigoure, StumbleUpon
Cloudera, Inc.
 
PDF
PostgreSQL10を導入!大規模データ分析事例からみるDWHとしてのPostgreSQL活用のポイント
NTT DATA OSS Professional Services
 
PPTX
Apache Hadoopに見るJavaミドルウェアのcompatibility(Open Developers Conference 2020 Onli...
NTT DATA Technology & Innovation
 
PDF
Log Structured Merge Tree
University of California, Santa Cruz
 
PPTX
PostgreSQL開発コミュニティに参加しよう! ~2022年版~(Open Source Conference 2022 Online/Kyoto 発...
NTT DATA Technology & Innovation
 
PDF
Apache Spark の紹介(前半:Sparkのキホン)
NTT DATA OSS Professional Services
 
PDF
Apache Sparkにおけるメモリ - アプリケーションを落とさないメモリ設計手法 -
Yoshiyasu SAEKI
 
PDF
トランザクション処理可能な分散DB 「YugabyteDB」入門(Open Source Conference 2022 Online/Fukuoka 発...
NTT DATA Technology & Innovation
 
PDF
Distributed Locking in Kubernetes
Rafał Leszko
 
PDF
Introduction to Impala
markgrover
 
PPTX
30%のMAU増加と78%のコスト削減を両立する方法.pptx
iRidge, Inc.
 
PDF
PFN のオンプレML基盤の取り組み / オンプレML基盤 on Kubernetes 〜PFN、ヤフー〜
Preferred Networks
 
PDF
[OpenInfra Days Korea 2018] Day 1 - T4-7: "Ceph 스토리지, PaaS로 서비스 운영하기"
OpenStack Korea Community
 
100PBを越えるデータプラットフォームの実情
Rakuten Group, Inc.
 
DRP (Stretch Cluster) for HDP - Future of Data : Paris
Mohamed Mehdi Ben Aissa
 
データインターフェースとしてのHadoop ~HDFSとクラウドストレージと私~ (NTTデータ テクノロジーカンファレンス 2019 講演資料、2019...
NTT DATA Technology & Innovation
 
コンテナセキュリティにおける権限制御(OCHaCafe5 #3 Kubernetes のセキュリティ 発表資料)
NTT DATA Technology & Innovation
 
Actionable Insights with AI - Snowflake for Data Science
Harald Erb
 
Zero to Snowflake Presentation
Brett VanderPlaats
 
実用段階に入ったOpenStack ~ もうすぐ絶滅するというPrivate Cloudの多様性について ~
Rakuten Group, Inc.
 
HBaseCon 2012 | Lessons learned from OpenTSDB - Benoit Sigoure, StumbleUpon
Cloudera, Inc.
 
PostgreSQL10を導入!大規模データ分析事例からみるDWHとしてのPostgreSQL活用のポイント
NTT DATA OSS Professional Services
 
Apache Hadoopに見るJavaミドルウェアのcompatibility(Open Developers Conference 2020 Onli...
NTT DATA Technology & Innovation
 
Log Structured Merge Tree
University of California, Santa Cruz
 
PostgreSQL開発コミュニティに参加しよう! ~2022年版~(Open Source Conference 2022 Online/Kyoto 発...
NTT DATA Technology & Innovation
 
Apache Spark の紹介(前半:Sparkのキホン)
NTT DATA OSS Professional Services
 
Apache Sparkにおけるメモリ - アプリケーションを落とさないメモリ設計手法 -
Yoshiyasu SAEKI
 
トランザクション処理可能な分散DB 「YugabyteDB」入門(Open Source Conference 2022 Online/Fukuoka 発...
NTT DATA Technology & Innovation
 
Distributed Locking in Kubernetes
Rafał Leszko
 
Introduction to Impala
markgrover
 
30%のMAU増加と78%のコスト削減を両立する方法.pptx
iRidge, Inc.
 
PFN のオンプレML基盤の取り組み / オンプレML基盤 on Kubernetes 〜PFN、ヤフー〜
Preferred Networks
 
[OpenInfra Days Korea 2018] Day 1 - T4-7: "Ceph 스토리지, PaaS로 서비스 운영하기"
OpenStack Korea Community
 

Similar to YugaByte DB on Kubernetes - An Introduction (20)

PPTX
Running Stateful Apps on Kubernetes
Yugabyte
 
PPTX
Demystifying Kubernetes Statefulsets
Yugabyte
 
PPTX
YugaByte + PKS CloudFoundry Meetup 10/15/2018
AlanCaldera
 
PDF
Meetup-#1-Getting-Started.pdf
Gwenn Etourneau
 
PDF
YugabyteDB - Distributed SQL Database on Kubernetes
DoKC
 
PPTX
A Planet-Scale Database for Low Latency Transactional Apps by Yugabyte
Carlos Andrés García
 
PPTX
A Planet-Scale Database for Low Latency Transactional Apps by Yugabyte
VMware Tanzu
 
PDF
Meetup - YugabyteDB - Introduction and key features
Franck Pachot
 
PPTX
Cairo Kubernetes Meetup - October event Talk #1
omehelba
 
PDF
Kubernetes
Sang-Min Park
 
PDF
Kubernetes for Java developers
Robert Barr
 
PPTX
Scale Transactional Apps Across Multiple Regions with Low Latency
Yugabyte
 
PPTX
Powering Microservices with MongoDB, Docker, Kubernetes & Kafka – MongoDB Eur...
Andrew Morgan
 
PDF
YugaByte DB—A Planet-Scale Database for Low Latency Transactional Apps
VMware Tanzu
 
PDF
Containerize! Between Docker and Jube.
Henryk Konsek
 
PDF
MongoDB Europe 2016 - Powering Microservices with Docker, Kubernetes, and Kafka
MongoDB
 
PDF
Where should I run my code? Serverless, Containers, Virtual Machines and more
Bret McGowen - NYC Google Developer Advocate
 
PDF
stupid-simple-kubernetes-final.pdf
DaniloQueirozMota
 
PDF
Large-Scale Automated Storage on Kubernetes - Matt Schallert OSCON 2019
Matt Schallert
 
PPTX
Containerized Storage for Containers- Kubernetes LA Meetup , July 2017
OpenEBS
 
Running Stateful Apps on Kubernetes
Yugabyte
 
Demystifying Kubernetes Statefulsets
Yugabyte
 
YugaByte + PKS CloudFoundry Meetup 10/15/2018
AlanCaldera
 
Meetup-#1-Getting-Started.pdf
Gwenn Etourneau
 
YugabyteDB - Distributed SQL Database on Kubernetes
DoKC
 
A Planet-Scale Database for Low Latency Transactional Apps by Yugabyte
Carlos Andrés García
 
A Planet-Scale Database for Low Latency Transactional Apps by Yugabyte
VMware Tanzu
 
Meetup - YugabyteDB - Introduction and key features
Franck Pachot
 
Cairo Kubernetes Meetup - October event Talk #1
omehelba
 
Kubernetes
Sang-Min Park
 
Kubernetes for Java developers
Robert Barr
 
Scale Transactional Apps Across Multiple Regions with Low Latency
Yugabyte
 
Powering Microservices with MongoDB, Docker, Kubernetes & Kafka – MongoDB Eur...
Andrew Morgan
 
YugaByte DB—A Planet-Scale Database for Low Latency Transactional Apps
VMware Tanzu
 
Containerize! Between Docker and Jube.
Henryk Konsek
 
MongoDB Europe 2016 - Powering Microservices with Docker, Kubernetes, and Kafka
MongoDB
 
Where should I run my code? Serverless, Containers, Virtual Machines and more
Bret McGowen - NYC Google Developer Advocate
 
stupid-simple-kubernetes-final.pdf
DaniloQueirozMota
 
Large-Scale Automated Storage on Kubernetes - Matt Schallert OSCON 2019
Matt Schallert
 
Containerized Storage for Containers- Kubernetes LA Meetup , July 2017
OpenEBS
 
Ad

Recently uploaded (20)

PDF
Reverse Engineering of Security Products: Developing an Advanced Microsoft De...
nwbxhhcyjv
 
PPTX
COMPARISON OF RASTER ANALYSIS TOOLS OF QGIS AND ARCGIS
Sharanya Sarkar
 
PPTX
Seamless Tech Experiences Showcasing Cross-Platform App Design.pptx
presentifyai
 
PDF
SIZING YOUR AIR CONDITIONER---A PRACTICAL GUIDE.pdf
Muhammad Rizwan Akram
 
PDF
LOOPS in C Programming Language - Technology
RishabhDwivedi43
 
PDF
What’s my job again? Slides from Mark Simos talk at 2025 Tampa BSides
Mark Simos
 
PDF
Mastering Financial Management in Direct Selling
Epixel MLM Software
 
PPTX
Future Tech Innovations 2025 – A TechLists Insight
TechLists
 
PDF
The Rise of AI and IoT in Mobile App Tech.pdf
IMG Global Infotech
 
PDF
Newgen Beyond Frankenstein_Build vs Buy_Digital_version.pdf
darshakparmar
 
PDF
How do you fast track Agentic automation use cases discovery?
DianaGray10
 
PDF
NASA A Researcher’s Guide to International Space Station : Physical Sciences ...
Dr. PANKAJ DHUSSA
 
PPTX
Mastering ODC + Okta Configuration - Chennai OSUG
HathiMaryA
 
PPTX
Agentforce World Tour Toronto '25 - MCP with MuleSoft
Alexandra N. Martinez
 
PDF
Kit-Works Team Study_20250627_한달만에만든사내서비스키링(양다윗).pdf
Wonjun Hwang
 
PDF
UPDF - AI PDF Editor & Converter Key Features
DealFuel
 
PDF
Transcript: Book industry state of the nation 2025 - Tech Forum 2025
BookNet Canada
 
PDF
Book industry state of the nation 2025 - Tech Forum 2025
BookNet Canada
 
PDF
Bitcoin for Millennials podcast with Bram, Power Laws of Bitcoin
Stephen Perrenod
 
PDF
POV_ Why Enterprises Need to Find Value in ZERO.pdf
darshakparmar
 
Reverse Engineering of Security Products: Developing an Advanced Microsoft De...
nwbxhhcyjv
 
COMPARISON OF RASTER ANALYSIS TOOLS OF QGIS AND ARCGIS
Sharanya Sarkar
 
Seamless Tech Experiences Showcasing Cross-Platform App Design.pptx
presentifyai
 
SIZING YOUR AIR CONDITIONER---A PRACTICAL GUIDE.pdf
Muhammad Rizwan Akram
 
LOOPS in C Programming Language - Technology
RishabhDwivedi43
 
What’s my job again? Slides from Mark Simos talk at 2025 Tampa BSides
Mark Simos
 
Mastering Financial Management in Direct Selling
Epixel MLM Software
 
Future Tech Innovations 2025 – A TechLists Insight
TechLists
 
The Rise of AI and IoT in Mobile App Tech.pdf
IMG Global Infotech
 
Newgen Beyond Frankenstein_Build vs Buy_Digital_version.pdf
darshakparmar
 
How do you fast track Agentic automation use cases discovery?
DianaGray10
 
NASA A Researcher’s Guide to International Space Station : Physical Sciences ...
Dr. PANKAJ DHUSSA
 
Mastering ODC + Okta Configuration - Chennai OSUG
HathiMaryA
 
Agentforce World Tour Toronto '25 - MCP with MuleSoft
Alexandra N. Martinez
 
Kit-Works Team Study_20250627_한달만에만든사내서비스키링(양다윗).pdf
Wonjun Hwang
 
UPDF - AI PDF Editor & Converter Key Features
DealFuel
 
Transcript: Book industry state of the nation 2025 - Tech Forum 2025
BookNet Canada
 
Book industry state of the nation 2025 - Tech Forum 2025
BookNet Canada
 
Bitcoin for Millennials podcast with Bram, Power Laws of Bitcoin
Stephen Perrenod
 
POV_ Why Enterprises Need to Find Value in ZERO.pdf
darshakparmar
 
Ad

YugaByte DB on Kubernetes - An Introduction

  • 1. 1YugaByte Confidential © 2018 All rights reserved. YugaByte DB on K8S Karthik Ranganathan Co-Founder & CTO June 2018
  • 2. 2© 2018 All rights reserved. Not Portable Not Portable Open Source Not Portable Open Source Open Source High Performance, Transactional, Planet-Scale High Performance, Transactional, Planet-Scale High Performance, Transactional, Planet-Scale High Performance, Transactional, Planet-Scale System-of-Record DBs for Global Apps
  • 3. 3© 2018 All rights reserved. TRANSACTIONAL PLANET-SCALEHIGH PERFORMANCE Distributed ACID Transactions Document-Based, Strongly Consistent Storage Low Latency, Tunable Reads High Throughput CLOUD-NATIVE OPEN SOURCE Apache 2.0 Popular APIs Extended Apache Cassandra, Redis and PostgreSQL (BETA) Built For The Container Era Self-Healing, Fault-Tolerant Auto Sharding & Rebalancing Global Data Distribution Design Goals
  • 4. 4© 2018 All rights reserved. Inside The Hood - 3 Node Cluster DocDB Storage Engine Purpose-built for ever-growing data, extended from RocksDB yb-master1 yb-master3 yb-master2 YB-Master Manage shard metadata & coordinate cluster-wide ops node1 node3 node2 Global Transaction Manager Tracks ACID txns across multi-row ops, incl. clock skew mgmt. Raft Consensus Replication Highly resilient, used for both data replication & leader election tablet 1’ tablet 1’ yb-tserver1 yb-tserver2 yb-tserver3 tablet 1’ tablet2-leader tablet3-leader tablet1-leaderYB-TServer Stores/serves data in/from tablets (shards) tablet1-follower tablet1-follower tablet3-follower tablet2-follower tablet3-follower tablet2-follower … … …
  • 5. 5© 2018 All rights reserved. YugaByte DB on StatefulSets https://docs.yugabyte.com/deploy/multi-node-cluster/ Stable network IDs Persistent volumesOrdered operations STATEFUL 1. Start all yb-masters first (usually 3) 2. Start as many yb-tservers as needed
  • 6. 6© 2018 All rights reserved. A Real-World Example Yugastore – E-Commerce app on the YERN stack Deployed on github.com/YugaByte/yugastore
  • 7. 7© 2018 All rights reserved. Kubernetes Deployment Architecture yb-master StatefulSet yugabytedb yb-master-1 pod yugabytedb yb-master-0 pod yugabytedb yb-master-2 pod yb-tserver StatefulSet tablet 1’ yugabytedb yb-tserver-1 podtablet 1’ yugabytedb yb-tserver-0 pod tablet 1’ yugabytedb yb-tserver-2 pod yb-masters Headless Service yb-master-ui LoadBalancer Service yb-tservers Headless Service yugastore Deployment tablet 1’ yugastore yugastore-1 podtablet 1’ yugastore yugastore-0 pod yugastore LoadBalancer Service End User Admin User
  • 8. 8© 2018 All rights reserved. Store less dynamic data using the YCQL API Example: description Highly dynamic data using the YEDIS API Example: number of reviews Multi-API, Multi-Model in Action
  • 9. 9© 2018 All rights reserved. Products modeled as a table Show me an book in the business category Dynamic sets modeled as Redis SORTED SETs Show me the top 2 book with the most reviews Multi-API, Multi-Model in Action
  • 10. 10© 2018 All rights reserved. Step 1 Deploy YugaByte DB cluster https://docs.yugabyte.com/latest/deploy/kubernetes/local-ssd/ kubectl apply -f yugabyte-statefulset.yaml
  • 11. 11© 2018 All rights reserved. Step 2 Deploy Yugastore app kubectl run yugastore --image=yugabytedb/yugastore --port=3001 --command start-for-kubernetes.sh
  • 12. 12© 2018 All rights reserved. Step 3 Expose the Yugastore app as a service kubectl expose deployment yugastore --type=LoadBalancer
  • 13. 13© 2018 All rights reserved. Step 4 Run a workload kubectl exec -it yugastore-<container-id> node yugastore/test/sample-user.js
  • 14. 14© 2018 All rights reserved. Step 5 Scale out YugaByte DB kubectl scale statefulset yb-tserver --replicas=4
  • 15. 15© 2018 All rights reserved. gitter.im/YugaByte @YugaByte Thank You!