SlideShare a Scribd company logo
4
Most read
7
Most read
13
Most read
Felipe Cardeneti Mendes, Technical Director, ScyllaDB
Designing Low-Latency Systems
with Rust and ScyllaDB
An Architectural Deep Dive
Presenter
Felipe Cardeneti Mendes,
Technical Director
+ Puppy Lover
+ Database Performance at Scale co-Author
+ ScyllaDB committer
+ For data-intensive applications that require high
throughput and predictable low latencies
+ Close-to-the-metal design takes full advantage of
modern infrastructure
+ >5x higher throughput
+ >20x lower latency
+ >75% TCO savings
+ Compatible with Apache Cassandra and Amazon
DynamoDB
+ DBaaS/Cloud, Enterprise solutions
The Database for Gamechangers
“ScyllaDB stands apart...It’s the rare product
that exceeds my expectations.”
– Martin Heller, InfoWorld contributing editor and reviewer
“For 99.9% of applications, ScyllaDB delivers all the
power a customer will ever need, on workloads that other
databases can’t touch – and at a fraction of the cost of
an in-memory solution.”
– Adrian Bridgewater, Forbes senior contributor
+400 Gamechangers Leverage ScyllaDB
Seamless experiences
across content + devices
Corporate fleet
management
Real-time analytics 2,000,000 SKU -commerce
management
Video recommendation
management
Threat intelligence service
using JanusGraph
Real time fraud detection
across 6M transactions/day
Uber scale, mission critical
chat & messaging app
Network security threat
detection
Power ~50M X1 DVRs with
billions of reqs/day
Precision healthcare via
Edison AI
Inventory hub for retail
operations
Property listings and
updates
Cryptocurrency exchange
app
Geography-based
recommendations
Global operations- Avon,
Body Shop + more
Predictable performance for
on sale surges
GPS-based exercise
tracking
Serving dynamic live
streams at scale
Powering India's top
social media platform
Personalized
advertising to players
Distribution of game
assets in Unreal Engine
Real-time ML-driven
recommendations
Connecting millions of
people around the globe
Agenda + Background: Why Rust, Tokio, ScyllaDB?
+ App Walkthrough
+ The ScyllaDB Rust driver
+ Let's break it!
IOT Rust Application Setup
$ git clone https://github.com/fee-mendes/rust-driver-example.git
$ cd rust-driver-example/docker-compose
$ docker compose up -d
$ docker exec -it rust-app /bin/bash
Minimum requirements:
+ Linux, macOS, Windows
+ On Windows you might need to adjust Docker network settings
+ Docker installed and setup
+ Quadcore CPU
+ 2 GB of memory available
+ Asynchronous, non-blocking runtimes
+ Tokio: Most widely used Rust runtime
+ Seastar: C++ runtime for ScyllaDB
+ Fast, flexible, and reliable
+ Scalable, allows high concurrency and low latency
+ Green and sustainable
Why Rust? Why Tokio? Why ScyllaDB?
Rust Driver ScyllaDB
Low latency, close
to hardware schedulers
Perfect horizontal & vertical scale
1000 Nodes Cluster
2000 Cluster
K8S Deployment
TBs per Node 256 Cores per Node
1B Operations
per Second
About ScyllaDB: Fast and Scalable
Poll:
How proficient are
you with the Rust
language?
IOT Application Overview
Metric Collector Metric Reader UUID Finder
Write to ScyllaDB in parallel
Deploy schema (ks/tables)
Generate data:
100 devices
3 days
Every 5 minutes
Device metrics aggregator
Analytics sample
Split token-ring in small parts:
Efficient full table scan
token() function usage
BYPASS CACHE
Single device queries
Real-time sample
Partition scan:
MAX(), AVG(), MIN()
Range queries
Date/Time handling
BUT...
We need a Driver! :-)
ScyllaDB Native Rust Driver
Rust Bindings
ScyllaDB cpp-rust-driver
Rust Driver
C/C++ API
Community scyllapy Driver
Rust Driver
Python API
➹ Wrapper libraries using language's FFIs (foreign function interface) feature
➹ Make an existing library written in language X usable in others
1. cargo add scylla
2. Follow examples
3. Profit!
Getting Started
Crate Features
See SerializeCql
Let's Code
Thank you
for joining us today.
@scylladb scylladb/
slack.scylladb.com
@scylladb company/scylladb/
scylladb/

More Related Content

Similar to Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep Dive (20)

PDF
5 Factors When Selecting a High Performance, Low Latency Database
ScyllaDB
 
PPTX
Optimizing Performance in Rust for Low-Latency Database Drivers
ScyllaDB
 
PDF
Learning Rust the Hard Way for a Production Kafka + ScyllaDB Pipeline
ScyllaDB
 
PDF
Using ScyllaDB for Extreme Scale Workloads
MarisaDelao3
 
PDF
Exploring Phantom Traffic Jams in Your Data Flows
ScyllaDB
 
PDF
Transforming the Database: Critical Innovations for Performance at Scale
ScyllaDB
 
PDF
New Ways to Reduce Database Costs with ScyllaDB
ScyllaDB
 
PPTX
Scylla Virtual Workshop 2022
ScyllaDB
 
PDF
Distributed Database Design Decisions to Support High Performance Event Strea...
StreamNative
 
PDF
Real time Object Detection and Analytics using RedisEdge and Docker
Ajeet Singh Raina
 
PDF
Build Low-Latency Applications in Rust on ScyllaDB
ScyllaDB
 
PDF
Techmeeting-17feb2016
Marko Broedersz
 
PPTX
Containerized Hadoop beyond Kubernetes
DataWorks Summit
 
PDF
NoSQL at Scale: Proven Practices & Pitfalls
ScyllaDB
 
PDF
Leapfrog into Serverless - a Deloitte-Amtrak Case Study | Serverless Confere...
Gary Arora
 
PDF
ScyllaDB Virtual Workshop: Getting Started with ScyllaDB 2024
ScyllaDB
 
PDF
Scaling Security on 100s of Millions of Mobile Devices Using Apache Kafka® an...
confluent
 
PDF
Getting started with MariaDB with Docker
MariaDB plc
 
PDF
Inside Triton, July 2015
Casey Bisson
 
PDF
Ibm db2 big sql
ModusOptimum
 
5 Factors When Selecting a High Performance, Low Latency Database
ScyllaDB
 
Optimizing Performance in Rust for Low-Latency Database Drivers
ScyllaDB
 
Learning Rust the Hard Way for a Production Kafka + ScyllaDB Pipeline
ScyllaDB
 
Using ScyllaDB for Extreme Scale Workloads
MarisaDelao3
 
Exploring Phantom Traffic Jams in Your Data Flows
ScyllaDB
 
Transforming the Database: Critical Innovations for Performance at Scale
ScyllaDB
 
New Ways to Reduce Database Costs with ScyllaDB
ScyllaDB
 
Scylla Virtual Workshop 2022
ScyllaDB
 
Distributed Database Design Decisions to Support High Performance Event Strea...
StreamNative
 
Real time Object Detection and Analytics using RedisEdge and Docker
Ajeet Singh Raina
 
Build Low-Latency Applications in Rust on ScyllaDB
ScyllaDB
 
Techmeeting-17feb2016
Marko Broedersz
 
Containerized Hadoop beyond Kubernetes
DataWorks Summit
 
NoSQL at Scale: Proven Practices & Pitfalls
ScyllaDB
 
Leapfrog into Serverless - a Deloitte-Amtrak Case Study | Serverless Confere...
Gary Arora
 
ScyllaDB Virtual Workshop: Getting Started with ScyllaDB 2024
ScyllaDB
 
Scaling Security on 100s of Millions of Mobile Devices Using Apache Kafka® an...
confluent
 
Getting started with MariaDB with Docker
MariaDB plc
 
Inside Triton, July 2015
Casey Bisson
 
Ibm db2 big sql
ModusOptimum
 

More from ScyllaDB (20)

PDF
Understanding The True Cost of DynamoDB Webinar
ScyllaDB
 
PDF
Database Benchmarking for Performance Masterclass: Session 2 - Data Modeling ...
ScyllaDB
 
PDF
Database Benchmarking for Performance Masterclass: Session 1 - Benchmarking F...
ScyllaDB
 
PDF
Powering a Billion Dreams: Scaling Meesho’s E-commerce Revolution with Scylla...
ScyllaDB
 
PDF
Leading a High-Stakes Database Migration
ScyllaDB
 
PDF
Achieving Extreme Scale with ScyllaDB: Tips & Tradeoffs
ScyllaDB
 
PDF
Securely Serving Millions of Boot Artifacts a Day by João Pedro Lima & Matt ...
ScyllaDB
 
PDF
How Agoda Scaled 50x Throughput with ScyllaDB by Worakarn Isaratham
ScyllaDB
 
PDF
How Yieldmo Cut Database Costs and Cloud Dependencies Fast by Todd Coleman
ScyllaDB
 
PDF
ScyllaDB: 10 Years and Beyond by Dor Laor
ScyllaDB
 
PDF
Reduce Your Cloud Spend with ScyllaDB by Tzach Livyatan
ScyllaDB
 
PDF
Migrating 50TB Data From a Home-Grown Database to ScyllaDB, Fast by Terence Liu
ScyllaDB
 
PDF
Vector Search with ScyllaDB by Szymon Wasik
ScyllaDB
 
PDF
Workload Prioritization: How to Balance Multiple Workloads in a Cluster by Fe...
ScyllaDB
 
PDF
Two Leading Approaches to Data Virtualization, and Which Scales Better? by Da...
ScyllaDB
 
PDF
Scaling a Beast: Lessons from 400x Growth in a High-Stakes Financial System b...
ScyllaDB
 
PDF
Object Storage in ScyllaDB by Ran Regev, ScyllaDB
ScyllaDB
 
PDF
Lessons Learned from Building a Serverless Notifications System by Srushith R...
ScyllaDB
 
PDF
A Dist Sys Programmer's Journey into AI by Piotr Sarna
ScyllaDB
 
PDF
High Availability: Lessons Learned by Paul Preuveneers
ScyllaDB
 
Understanding The True Cost of DynamoDB Webinar
ScyllaDB
 
Database Benchmarking for Performance Masterclass: Session 2 - Data Modeling ...
ScyllaDB
 
Database Benchmarking for Performance Masterclass: Session 1 - Benchmarking F...
ScyllaDB
 
Powering a Billion Dreams: Scaling Meesho’s E-commerce Revolution with Scylla...
ScyllaDB
 
Leading a High-Stakes Database Migration
ScyllaDB
 
Achieving Extreme Scale with ScyllaDB: Tips & Tradeoffs
ScyllaDB
 
Securely Serving Millions of Boot Artifacts a Day by João Pedro Lima & Matt ...
ScyllaDB
 
How Agoda Scaled 50x Throughput with ScyllaDB by Worakarn Isaratham
ScyllaDB
 
How Yieldmo Cut Database Costs and Cloud Dependencies Fast by Todd Coleman
ScyllaDB
 
ScyllaDB: 10 Years and Beyond by Dor Laor
ScyllaDB
 
Reduce Your Cloud Spend with ScyllaDB by Tzach Livyatan
ScyllaDB
 
Migrating 50TB Data From a Home-Grown Database to ScyllaDB, Fast by Terence Liu
ScyllaDB
 
Vector Search with ScyllaDB by Szymon Wasik
ScyllaDB
 
Workload Prioritization: How to Balance Multiple Workloads in a Cluster by Fe...
ScyllaDB
 
Two Leading Approaches to Data Virtualization, and Which Scales Better? by Da...
ScyllaDB
 
Scaling a Beast: Lessons from 400x Growth in a High-Stakes Financial System b...
ScyllaDB
 
Object Storage in ScyllaDB by Ran Regev, ScyllaDB
ScyllaDB
 
Lessons Learned from Building a Serverless Notifications System by Srushith R...
ScyllaDB
 
A Dist Sys Programmer's Journey into AI by Piotr Sarna
ScyllaDB
 
High Availability: Lessons Learned by Paul Preuveneers
ScyllaDB
 
Ad

Recently uploaded (20)

PDF
SIZING YOUR AIR CONDITIONER---A PRACTICAL GUIDE.pdf
Muhammad Rizwan Akram
 
PPTX
COMPARISON OF RASTER ANALYSIS TOOLS OF QGIS AND ARCGIS
Sharanya Sarkar
 
PDF
Mastering Financial Management in Direct Selling
Epixel MLM Software
 
PDF
What’s my job again? Slides from Mark Simos talk at 2025 Tampa BSides
Mark Simos
 
PPT
Ericsson LTE presentation SEMINAR 2010.ppt
npat3
 
PDF
Transcript: Book industry state of the nation 2025 - Tech Forum 2025
BookNet Canada
 
PDF
CIFDAQ Market Wrap for the week of 4th July 2025
CIFDAQ
 
PDF
The 2025 InfraRed Report - Redpoint Ventures
Razin Mustafiz
 
DOCX
Cryptography Quiz: test your knowledge of this important security concept.
Rajni Bhardwaj Grover
 
PDF
NASA A Researcher’s Guide to International Space Station : Physical Sciences ...
Dr. PANKAJ DHUSSA
 
PPTX
Q2 FY26 Tableau User Group Leader Quarterly Call
lward7
 
PDF
Bitcoin for Millennials podcast with Bram, Power Laws of Bitcoin
Stephen Perrenod
 
PDF
[Newgen] NewgenONE Marvin Brochure 1.pdf
darshakparmar
 
PDF
UiPath DevConnect 2025: Agentic Automation Community User Group Meeting
DianaGray10
 
PDF
Reverse Engineering of Security Products: Developing an Advanced Microsoft De...
nwbxhhcyjv
 
PPTX
Designing_the_Future_AI_Driven_Product_Experiences_Across_Devices.pptx
presentifyai
 
PPTX
The Project Compass - GDG on Campus MSIT
dscmsitkol
 
PDF
LOOPS in C Programming Language - Technology
RishabhDwivedi43
 
PDF
NLJUG Speaker academy 2025 - first session
Bert Jan Schrijver
 
PDF
Staying Human in a Machine- Accelerated World
Catalin Jora
 
SIZING YOUR AIR CONDITIONER---A PRACTICAL GUIDE.pdf
Muhammad Rizwan Akram
 
COMPARISON OF RASTER ANALYSIS TOOLS OF QGIS AND ARCGIS
Sharanya Sarkar
 
Mastering Financial Management in Direct Selling
Epixel MLM Software
 
What’s my job again? Slides from Mark Simos talk at 2025 Tampa BSides
Mark Simos
 
Ericsson LTE presentation SEMINAR 2010.ppt
npat3
 
Transcript: Book industry state of the nation 2025 - Tech Forum 2025
BookNet Canada
 
CIFDAQ Market Wrap for the week of 4th July 2025
CIFDAQ
 
The 2025 InfraRed Report - Redpoint Ventures
Razin Mustafiz
 
Cryptography Quiz: test your knowledge of this important security concept.
Rajni Bhardwaj Grover
 
NASA A Researcher’s Guide to International Space Station : Physical Sciences ...
Dr. PANKAJ DHUSSA
 
Q2 FY26 Tableau User Group Leader Quarterly Call
lward7
 
Bitcoin for Millennials podcast with Bram, Power Laws of Bitcoin
Stephen Perrenod
 
[Newgen] NewgenONE Marvin Brochure 1.pdf
darshakparmar
 
UiPath DevConnect 2025: Agentic Automation Community User Group Meeting
DianaGray10
 
Reverse Engineering of Security Products: Developing an Advanced Microsoft De...
nwbxhhcyjv
 
Designing_the_Future_AI_Driven_Product_Experiences_Across_Devices.pptx
presentifyai
 
The Project Compass - GDG on Campus MSIT
dscmsitkol
 
LOOPS in C Programming Language - Technology
RishabhDwivedi43
 
NLJUG Speaker academy 2025 - first session
Bert Jan Schrijver
 
Staying Human in a Machine- Accelerated World
Catalin Jora
 
Ad

Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep Dive

  • 1. Felipe Cardeneti Mendes, Technical Director, ScyllaDB Designing Low-Latency Systems with Rust and ScyllaDB An Architectural Deep Dive
  • 2. Presenter Felipe Cardeneti Mendes, Technical Director + Puppy Lover + Database Performance at Scale co-Author + ScyllaDB committer
  • 3. + For data-intensive applications that require high throughput and predictable low latencies + Close-to-the-metal design takes full advantage of modern infrastructure + >5x higher throughput + >20x lower latency + >75% TCO savings + Compatible with Apache Cassandra and Amazon DynamoDB + DBaaS/Cloud, Enterprise solutions The Database for Gamechangers “ScyllaDB stands apart...It’s the rare product that exceeds my expectations.” – Martin Heller, InfoWorld contributing editor and reviewer “For 99.9% of applications, ScyllaDB delivers all the power a customer will ever need, on workloads that other databases can’t touch – and at a fraction of the cost of an in-memory solution.” – Adrian Bridgewater, Forbes senior contributor
  • 4. +400 Gamechangers Leverage ScyllaDB Seamless experiences across content + devices Corporate fleet management Real-time analytics 2,000,000 SKU -commerce management Video recommendation management Threat intelligence service using JanusGraph Real time fraud detection across 6M transactions/day Uber scale, mission critical chat & messaging app Network security threat detection Power ~50M X1 DVRs with billions of reqs/day Precision healthcare via Edison AI Inventory hub for retail operations Property listings and updates Cryptocurrency exchange app Geography-based recommendations Global operations- Avon, Body Shop + more Predictable performance for on sale surges GPS-based exercise tracking Serving dynamic live streams at scale Powering India's top social media platform Personalized advertising to players Distribution of game assets in Unreal Engine Real-time ML-driven recommendations Connecting millions of people around the globe
  • 5. Agenda + Background: Why Rust, Tokio, ScyllaDB? + App Walkthrough + The ScyllaDB Rust driver + Let's break it!
  • 6. IOT Rust Application Setup $ git clone https://github.com/fee-mendes/rust-driver-example.git $ cd rust-driver-example/docker-compose $ docker compose up -d $ docker exec -it rust-app /bin/bash Minimum requirements: + Linux, macOS, Windows + On Windows you might need to adjust Docker network settings + Docker installed and setup + Quadcore CPU + 2 GB of memory available
  • 7. + Asynchronous, non-blocking runtimes + Tokio: Most widely used Rust runtime + Seastar: C++ runtime for ScyllaDB + Fast, flexible, and reliable + Scalable, allows high concurrency and low latency + Green and sustainable Why Rust? Why Tokio? Why ScyllaDB? Rust Driver ScyllaDB
  • 8. Low latency, close to hardware schedulers Perfect horizontal & vertical scale 1000 Nodes Cluster 2000 Cluster K8S Deployment TBs per Node 256 Cores per Node 1B Operations per Second About ScyllaDB: Fast and Scalable
  • 9. Poll: How proficient are you with the Rust language?
  • 10. IOT Application Overview Metric Collector Metric Reader UUID Finder Write to ScyllaDB in parallel Deploy schema (ks/tables) Generate data: 100 devices 3 days Every 5 minutes Device metrics aggregator Analytics sample Split token-ring in small parts: Efficient full table scan token() function usage BYPASS CACHE Single device queries Real-time sample Partition scan: MAX(), AVG(), MIN() Range queries Date/Time handling
  • 11. BUT... We need a Driver! :-)
  • 13. Rust Bindings ScyllaDB cpp-rust-driver Rust Driver C/C++ API Community scyllapy Driver Rust Driver Python API ➹ Wrapper libraries using language's FFIs (foreign function interface) feature ➹ Make an existing library written in language X usable in others
  • 14. 1. cargo add scylla 2. Follow examples 3. Profit! Getting Started
  • 17. Thank you for joining us today. @scylladb scylladb/ slack.scylladb.com @scylladb company/scylladb/ scylladb/