SlideShare a Scribd company logo
BADIR - Riyadh
29-12-2018
AWS Messaging
AWS Riyadh
User Group
Ahmed Aziz
21
@Ahmed_Aziz
/in/ahmedsleem
Ahmed.aziz.sleem@gmail.com
Agenda
• Events-Driven Architecture
• Overview
• Amazon MQ
• Amazon SQS
• Amazon Kinesis data stream
• Amazon SNS
• Amazon PinPoint
• AWS IoT Message Broker
If your application is
cloud-native, or large-scale,
or distributed, and doesn’t
include a messaging component,
that’s probably a bug
Tim Bray
Senior Principe Engineer
Events-Driven Architecture
Overview
• Enables different systems to communicate or
exchange information.
• Decouple and scale microservices, distributed
systems, and serverless applications.
• Stores messages redundantly across multiple AZs.
• Fully manage service:
– The underlying infrastructure is automatically provisioned
for high availability and message durability to support the
reliability of your applications.
Amazon MQ (1 of 2)
• Reduces your operational load by managing the provisioning,
setup, and maintenance of ActiveMQ.
• Uses standards(JMS, NMS, AMQP, STOMP, MQTT, WebSocket)
• There’s no need to rewrite any messaging code when you
migrate to AWS.
• With active/standby brokers, Amazon MQ automatically fails
over to a standby instance.
• Single-instance brokers (if the node fails, it will be unavailable
until it is restarted).
Amazon MQ (2 of 2)
• Uses the “network of brokers”.
• Brokers in the network share information about the
clients and destinations each broker hosts.
• You are charged for broker instance and storage usage,
and standard data transfer fees.
• Provides encryption of your messages at rest and in
transit.
• Integrated with AWS Identity and Access Management
(IAM)
Amazon SQS (1 of 3)
Standard Queues FIFO Queues
Unlimited Throughput • Up to 300 messages per second.
• Batch: 10 messages per operation(max)
At-Least-Once Delivery Exactly-Once Processing
Best-Effort Ordering First-In-First-Out Delivery
Tag the messages to form an ordered
groups
Amazon SQS
Amazon SQS (2 of 3)
• Message payload (single/Batch) size is (256 KB)
• Messages more than 256KB  use JAVA extended lib.
• Retain messages in queues up to 14 days (default 4d).
• Long polling is more cost effective than short polling.
• Message is locked once handled by the consumer.
• Message is not getting processed -> lock expired.
• Dead Letter Queue must be the same as source queue.
Amazon SQS (3 of 3)
• Exchange sensitive data between applications using
Server-Side Encryption (SSE) to encrypt each message
body.
• AWS Key Management Service (KMS) allows you to
centrally manage the keys that protect SQS messages.
• Transfer data between Amazon SQS and Amazon EC2
or AWS Lambda free of charge within a single region.
Amazon Kinesis (1 of 3)
• Collect, process, streaming data and analyze real-time.
• Transform the data before emitting to a data store.
• Designed to scale without limits via increasing the
number of shards.
• Records of a stream are accessible for up to 24 hours,
You can raise this limit to up to 7 days.
• The maximum size of a data blob 1 MB.
• Each shard can support up to 1000PUT records/second.
• It provides ordering of records.
Amazon Kinesis (2 of 3)
Amazon Kinesis (3 of 3)
Producer 1 Producer 2
Increase throughput Consumer Affinity
Amazon SNS (1 of 3)
• Push-based, many-to-many messaging. Using Amazon
SNS topics.
• Pub/Sub messaging architecture.
• Can fan out messages to a large number of endpoints.
• Subscribing endpoints receive only the messages of
interest.
• Data is encrypted in transit, and can also encrypt data
at rest.
Amazon SNS (2 of 3)
Amazon SNS (3 of 3)
• Push-based, many-to-many messaging uing SNS topics.
• Pub/Sub messaging architecture.
• Can fan out messages to a large number of endpoints.
• Subscribing endpoints filtration.
• Data is encrypted in transit, and at rest.
• maximum limit of 256 KB for published messages. Each
64KB chunk of published data is billed as 1 request.
• First 1 million  free, 1 million  $0.50 thereafter
Amazon PinPoint
• Messaging for real-time user engagement.
• Event-based campaigns to your customers when they
take specific actions within your applications.
• Deliverability Dashboard helps you improve your inbox
placement rate.
• Automatic responses when customers send you
messages that contain certain keywords.
• Reach your customers using dedicated, local number
AWS IoT Message Broker
• Pub/Sub broker service.
• Sending / receiving of messages to / from AWS IoT.
• Client sends a message addressed to a topic like
Sensor/temp/room1
• The message broker, in turn, sends the message to all
clients that have registered to receive messages for
that topic.
• The topic namespace is isolated for each AWS account
and region pair.
Questions
See You Next Meetup
AWS Riyadh User Group

More Related Content

PDF
Amazon relational database service (rds)
AWS Riyadh User Group
 
PPTX
Containers on AWS
AWS Riyadh User Group
 
PPTX
Amazon Virtual Private Cloud - VPC 1
AWS Riyadh User Group
 
PPTX
Amazon Virtual Private Cloud - VPC 2
AWS Riyadh User Group
 
PPTX
EC2 and S3 Level 100
AWS Riyadh User Group
 
PPTX
Blockchain on AWS
AWS Riyadh User Group
 
PPTX
Module 1 cloud computing
krnaween
 
PPTX
2016 Utah Cloud Summit: RDS
1Strategy
 
Amazon relational database service (rds)
AWS Riyadh User Group
 
Containers on AWS
AWS Riyadh User Group
 
Amazon Virtual Private Cloud - VPC 1
AWS Riyadh User Group
 
Amazon Virtual Private Cloud - VPC 2
AWS Riyadh User Group
 
EC2 and S3 Level 100
AWS Riyadh User Group
 
Blockchain on AWS
AWS Riyadh User Group
 
Module 1 cloud computing
krnaween
 
2016 Utah Cloud Summit: RDS
1Strategy
 

Similar to AWS Messaging (18)

PDF
Highlights of AWS ReInvent 2023 (Announcements and Best Practices)
Emprovise
 
PDF
JustGiving | Serverless Data Pipelines, API, Messaging and Stream Processing
BEEVA_es
 
PDF
JustGiving – Serverless Data Pipelines, API, Messaging and Stream Processing
Luis Gonzalez
 
PDF
AWS Study Group - Chapter 07 - Integrating Application Services [Solution Arc...
QCloudMentor
 
PPTX
AWS basics
mbaric
 
PPTX
AWS Serverless key services
Faisal Ahmed Farooqui
 
PPTX
Aws image recognition
Monika Mishra
 
PDF
Embrace the Cloud - Inspiring Conference 2015
Henrik Møller Rasmussen
 
PPTX
AWS GLOBAL INFRA AND SERVICE LIST01.pptx
susilmoharana621
 
PDF
UCT AWS_IOT
uniconvergetechnologies
 
PDF
AWS Chicago user group - October 2015 "reInvent Replay"
Cohesive Networks
 
PDF
AWS Summit Seoul 2015 - AWS 클라우드를 활용한 빅데이터 및 실시간 스트리밍 분석
Amazon Web Services Korea
 
PPTX
Mule sqs
Srikrishna k
 
PDF
Cloud computing aws -key services
Selvaraj Kesavan
 
KEY
Introduction to cloud computing
Vijay Kalangi
 
PPTX
Cloud Service.pptx
SibinBharathi
 
PDF
Em tempo real: Ingestão, processamento e analise de dados
Amazon Web Services LATAM
 
PDF
An Introduction to the Message Queuing Technology & IBM WebSphere MQ
Ravi Yogesh
 
Highlights of AWS ReInvent 2023 (Announcements and Best Practices)
Emprovise
 
JustGiving | Serverless Data Pipelines, API, Messaging and Stream Processing
BEEVA_es
 
JustGiving – Serverless Data Pipelines, API, Messaging and Stream Processing
Luis Gonzalez
 
AWS Study Group - Chapter 07 - Integrating Application Services [Solution Arc...
QCloudMentor
 
AWS basics
mbaric
 
AWS Serverless key services
Faisal Ahmed Farooqui
 
Aws image recognition
Monika Mishra
 
Embrace the Cloud - Inspiring Conference 2015
Henrik Møller Rasmussen
 
AWS GLOBAL INFRA AND SERVICE LIST01.pptx
susilmoharana621
 
AWS Chicago user group - October 2015 "reInvent Replay"
Cohesive Networks
 
AWS Summit Seoul 2015 - AWS 클라우드를 활용한 빅데이터 및 실시간 스트리밍 분석
Amazon Web Services Korea
 
Mule sqs
Srikrishna k
 
Cloud computing aws -key services
Selvaraj Kesavan
 
Introduction to cloud computing
Vijay Kalangi
 
Cloud Service.pptx
SibinBharathi
 
Em tempo real: Ingestão, processamento e analise de dados
Amazon Web Services LATAM
 
An Introduction to the Message Queuing Technology & IBM WebSphere MQ
Ravi Yogesh
 
Ad

More from AWS Riyadh User Group (15)

PDF
AWS reinvent 2019 recap - Riyadh - Containers and Serverless - Paul Maddox
AWS Riyadh User Group
 
PDF
AWS reinvent 2019 recap - Riyadh - Database and Analytics - Assif Abbasi
AWS Riyadh User Group
 
PDF
AWS reinvent 2019 recap - Riyadh - Network and Security - Anver Vanker
AWS Riyadh User Group
 
PDF
AWS reinvent 2019 recap - Riyadh - AI And ML - Ahmed Raafat
AWS Riyadh User Group
 
PPTX
Demistifying serverless on aws
AWS Riyadh User Group
 
PDF
Cutting to the chase for Machine Learning Analytics Ecosystem & AWS Lake Form...
AWS Riyadh User Group
 
PDF
Amazon SageMaker Build, Train and Deploy Your ML Models
AWS Riyadh User Group
 
PDF
AWS Technical Day Riyadh Nov 2019 - The art of mastering data protection on aws
AWS Riyadh User Group
 
PDF
AWS Technical Day Riyadh Nov 2019 - Scaling threat detection and response in aws
AWS Riyadh User Group
 
PDF
AWS Technical Day Riyadh Nov 2019 [Migration]
AWS Riyadh User Group
 
PPTX
AWS Amplify
AWS Riyadh User Group
 
PPTX
Devops on AWS
AWS Riyadh User Group
 
PPTX
AWS AI Services
AWS Riyadh User Group
 
PPTX
AWS Cloudformation Session 01
AWS Riyadh User Group
 
PPTX
AWS Cloud Security
AWS Riyadh User Group
 
AWS reinvent 2019 recap - Riyadh - Containers and Serverless - Paul Maddox
AWS Riyadh User Group
 
AWS reinvent 2019 recap - Riyadh - Database and Analytics - Assif Abbasi
AWS Riyadh User Group
 
AWS reinvent 2019 recap - Riyadh - Network and Security - Anver Vanker
AWS Riyadh User Group
 
AWS reinvent 2019 recap - Riyadh - AI And ML - Ahmed Raafat
AWS Riyadh User Group
 
Demistifying serverless on aws
AWS Riyadh User Group
 
Cutting to the chase for Machine Learning Analytics Ecosystem & AWS Lake Form...
AWS Riyadh User Group
 
Amazon SageMaker Build, Train and Deploy Your ML Models
AWS Riyadh User Group
 
AWS Technical Day Riyadh Nov 2019 - The art of mastering data protection on aws
AWS Riyadh User Group
 
AWS Technical Day Riyadh Nov 2019 - Scaling threat detection and response in aws
AWS Riyadh User Group
 
AWS Technical Day Riyadh Nov 2019 [Migration]
AWS Riyadh User Group
 
Devops on AWS
AWS Riyadh User Group
 
AWS AI Services
AWS Riyadh User Group
 
AWS Cloudformation Session 01
AWS Riyadh User Group
 
AWS Cloud Security
AWS Riyadh User Group
 
Ad

Recently uploaded (20)

PDF
Research-Fundamentals-and-Topic-Development.pdf
ayesha butalia
 
PDF
MASTERDECK GRAPHSUMMIT SYDNEY (Public).pdf
Neo4j
 
PDF
NewMind AI Weekly Chronicles - July'25 - Week IV
NewMind AI
 
PPTX
New ThousandEyes Product Innovations: Cisco Live June 2025
ThousandEyes
 
PDF
Cloud-Migration-Best-Practices-A-Practical-Guide-to-AWS-Azure-and-Google-Clou...
Artjoker Software Development Company
 
PPTX
Applied-Statistics-Mastering-Data-Driven-Decisions.pptx
parmaryashparmaryash
 
PDF
Automating ArcGIS Content Discovery with FME: A Real World Use Case
Safe Software
 
PPTX
OA presentation.pptx OA presentation.pptx
pateldhruv002338
 
PDF
Brief History of Internet - Early Days of Internet
sutharharshit158
 
PDF
A Day in the Life of Location Data - Turning Where into How.pdf
Precisely
 
PDF
Software Development Company | KodekX
KodekX
 
PDF
Advances in Ultra High Voltage (UHV) Transmission and Distribution Systems.pdf
Nabajyoti Banik
 
PPTX
Coupa-Overview _Assumptions presentation
annapureddyn
 
PPTX
Comunidade Salesforce São Paulo - Desmistificando o Omnistudio (Vlocity)
Francisco Vieira Júnior
 
PDF
Tea4chat - another LLM Project by Kerem Atam
a0m0rajab1
 
PDF
Doc9.....................................
SofiaCollazos
 
PDF
Data_Analytics_vs_Data_Science_vs_BI_by_CA_Suvidha_Chaplot.pdf
CA Suvidha Chaplot
 
PDF
Structs to JSON: How Go Powers REST APIs
Emily Achieng
 
PPTX
What-is-the-World-Wide-Web -- Introduction
tonifi9488
 
PDF
SparkLabs Primer on Artificial Intelligence 2025
SparkLabs Group
 
Research-Fundamentals-and-Topic-Development.pdf
ayesha butalia
 
MASTERDECK GRAPHSUMMIT SYDNEY (Public).pdf
Neo4j
 
NewMind AI Weekly Chronicles - July'25 - Week IV
NewMind AI
 
New ThousandEyes Product Innovations: Cisco Live June 2025
ThousandEyes
 
Cloud-Migration-Best-Practices-A-Practical-Guide-to-AWS-Azure-and-Google-Clou...
Artjoker Software Development Company
 
Applied-Statistics-Mastering-Data-Driven-Decisions.pptx
parmaryashparmaryash
 
Automating ArcGIS Content Discovery with FME: A Real World Use Case
Safe Software
 
OA presentation.pptx OA presentation.pptx
pateldhruv002338
 
Brief History of Internet - Early Days of Internet
sutharharshit158
 
A Day in the Life of Location Data - Turning Where into How.pdf
Precisely
 
Software Development Company | KodekX
KodekX
 
Advances in Ultra High Voltage (UHV) Transmission and Distribution Systems.pdf
Nabajyoti Banik
 
Coupa-Overview _Assumptions presentation
annapureddyn
 
Comunidade Salesforce São Paulo - Desmistificando o Omnistudio (Vlocity)
Francisco Vieira Júnior
 
Tea4chat - another LLM Project by Kerem Atam
a0m0rajab1
 
Doc9.....................................
SofiaCollazos
 
Data_Analytics_vs_Data_Science_vs_BI_by_CA_Suvidha_Chaplot.pdf
CA Suvidha Chaplot
 
Structs to JSON: How Go Powers REST APIs
Emily Achieng
 
What-is-the-World-Wide-Web -- Introduction
tonifi9488
 
SparkLabs Primer on Artificial Intelligence 2025
SparkLabs Group
 

AWS Messaging

  • 1. BADIR - Riyadh 29-12-2018 AWS Messaging AWS Riyadh User Group Ahmed Aziz 21 @Ahmed_Aziz /in/ahmedsleem [email protected]
  • 2. Agenda • Events-Driven Architecture • Overview • Amazon MQ • Amazon SQS • Amazon Kinesis data stream • Amazon SNS • Amazon PinPoint • AWS IoT Message Broker
  • 3. If your application is cloud-native, or large-scale, or distributed, and doesn’t include a messaging component, that’s probably a bug Tim Bray Senior Principe Engineer
  • 5. Overview • Enables different systems to communicate or exchange information. • Decouple and scale microservices, distributed systems, and serverless applications. • Stores messages redundantly across multiple AZs. • Fully manage service: – The underlying infrastructure is automatically provisioned for high availability and message durability to support the reliability of your applications.
  • 6. Amazon MQ (1 of 2) • Reduces your operational load by managing the provisioning, setup, and maintenance of ActiveMQ. • Uses standards(JMS, NMS, AMQP, STOMP, MQTT, WebSocket) • There’s no need to rewrite any messaging code when you migrate to AWS. • With active/standby brokers, Amazon MQ automatically fails over to a standby instance. • Single-instance brokers (if the node fails, it will be unavailable until it is restarted).
  • 7. Amazon MQ (2 of 2) • Uses the “network of brokers”. • Brokers in the network share information about the clients and destinations each broker hosts. • You are charged for broker instance and storage usage, and standard data transfer fees. • Provides encryption of your messages at rest and in transit. • Integrated with AWS Identity and Access Management (IAM)
  • 8. Amazon SQS (1 of 3) Standard Queues FIFO Queues Unlimited Throughput • Up to 300 messages per second. • Batch: 10 messages per operation(max) At-Least-Once Delivery Exactly-Once Processing Best-Effort Ordering First-In-First-Out Delivery Tag the messages to form an ordered groups
  • 10. Amazon SQS (2 of 3) • Message payload (single/Batch) size is (256 KB) • Messages more than 256KB  use JAVA extended lib. • Retain messages in queues up to 14 days (default 4d). • Long polling is more cost effective than short polling. • Message is locked once handled by the consumer. • Message is not getting processed -> lock expired. • Dead Letter Queue must be the same as source queue.
  • 11. Amazon SQS (3 of 3) • Exchange sensitive data between applications using Server-Side Encryption (SSE) to encrypt each message body. • AWS Key Management Service (KMS) allows you to centrally manage the keys that protect SQS messages. • Transfer data between Amazon SQS and Amazon EC2 or AWS Lambda free of charge within a single region.
  • 12. Amazon Kinesis (1 of 3) • Collect, process, streaming data and analyze real-time. • Transform the data before emitting to a data store. • Designed to scale without limits via increasing the number of shards. • Records of a stream are accessible for up to 24 hours, You can raise this limit to up to 7 days. • The maximum size of a data blob 1 MB. • Each shard can support up to 1000PUT records/second. • It provides ordering of records.
  • 14. Amazon Kinesis (3 of 3) Producer 1 Producer 2 Increase throughput Consumer Affinity
  • 15. Amazon SNS (1 of 3) • Push-based, many-to-many messaging. Using Amazon SNS topics. • Pub/Sub messaging architecture. • Can fan out messages to a large number of endpoints. • Subscribing endpoints receive only the messages of interest. • Data is encrypted in transit, and can also encrypt data at rest.
  • 16. Amazon SNS (2 of 3)
  • 17. Amazon SNS (3 of 3) • Push-based, many-to-many messaging uing SNS topics. • Pub/Sub messaging architecture. • Can fan out messages to a large number of endpoints. • Subscribing endpoints filtration. • Data is encrypted in transit, and at rest. • maximum limit of 256 KB for published messages. Each 64KB chunk of published data is billed as 1 request. • First 1 million  free, 1 million  $0.50 thereafter
  • 18. Amazon PinPoint • Messaging for real-time user engagement. • Event-based campaigns to your customers when they take specific actions within your applications. • Deliverability Dashboard helps you improve your inbox placement rate. • Automatic responses when customers send you messages that contain certain keywords. • Reach your customers using dedicated, local number
  • 19. AWS IoT Message Broker • Pub/Sub broker service. • Sending / receiving of messages to / from AWS IoT. • Client sends a message addressed to a topic like Sensor/temp/room1 • The message broker, in turn, sends the message to all clients that have registered to receive messages for that topic. • The topic namespace is isolated for each AWS account and region pair.
  • 21. See You Next Meetup AWS Riyadh User Group

Editor's Notes

  • #8: NMS : the open source .Net Messaging API. This allows you to build .Net applications in C# or VB to a single API  STOMP: formerly known as TTMP, is a simple text-based protocol, designed for working with message-oriented middleware (MOM). It provides an interoperable wire format that allows STOMP clients to talk with any message broker supporting the protocol. MQTT: Message Queuing Telemetry Transport) is an ISO standard (ISO/IEC PRF 20922) publish-subscribe-based messaging protocol.
  • #22: You can safely remove this slide. This slide design was provided by SlideModel.com – You can download more templates, shapes and elements for PowerPoint from http://slidemodel.com
  • #23: You can safely remove this slide. This slide design was provided by SlideModel.com – You can download more templates, shapes and elements for PowerPoint from http://slidemodel.com