Adding 1.21 Gigawatts to Applications with RabbitMQ (Bulgaria PHP 2016 - Tutorial)
1 like590 views
The document outlines an introduction to RabbitMQ, detailing its installation via Vagrant, the concepts of message queuing, and various types of exchanges including fanout, direct, and topic exchanges. It discusses practical applications, message acknowledgment, and advanced features such as TTL, dead letter exchanges, and clustering for high availability. Additionally, it includes technical instructions and demonstrations related to configuring and using RabbitMQ effectively.
![@asgrim
/etc/rabbitmq/rabbitmq.config
[
{rabbit, [
{loopback_users, []},
{vm_memory_high_watermark, 0.8}
]}
].](https://image.slidesharecdn.com/adding1-161008080543/85/Adding-1-21-Gigawatts-to-Applications-with-RabbitMQ-Bulgaria-PHP-2016-Tutorial-79-320.jpg)
![@asgrim
/etc/rabbitmq/rabbitmq.config
[{{{[{{[{{}}{][[[{[{{}[[}{[[{}[][}{}}}{}}{{,},]{
[[{rabbit, [{{}[[}{,,{}[][}{[][][{}{{{{}}}}[[}{{
{{}}{loopback_users, []},[][][]{}{}{}<}{[}[][][}
[{{[{vm_memory_high_watermark, 0.8}]]{}{[[[]]{}]
{{]}[{[{{}[[}{]]{}[][,{}[][}{[][][{}.[]}{]][][]}
]...{}[][,]{.}[][}{}[[[{}{][]}{}{}[}{}{}{]{}{}}[](https://image.slidesharecdn.com/adding1-161008080543/85/Adding-1-21-Gigawatts-to-Applications-with-RabbitMQ-Bulgaria-PHP-2016-Tutorial-80-320.jpg)
![@asgrim
node1$ rabbitmqctl cluster_status
Cluster status of node rabbit@node1 ...
[{nodes,[{disc,[rabbit@node1]}]},{running_nodes,[rabbit@node1]}]
...done.
Creating a cluster](https://image.slidesharecdn.com/adding1-161008080543/85/Adding-1-21-Gigawatts-to-Applications-with-RabbitMQ-Bulgaria-PHP-2016-Tutorial-81-320.jpg)
![@asgrim
node2$ rabbitmqctl join_cluster --ram rabbit@node1
node3$ rabbitmqctl join_cluster rabbit@node2
node3$ rabbitmqctl cluster_status
Cluster status of node rabbit@node3 ...
[{nodes,[{disc,[rabbit@node3,rabbit@node1]},{ram,[rabbit@node2]}]},
{running_nodes,[rabbit@node2,rabbit@node1,rabbit@node3]}]
...done.
Creating a cluster](https://image.slidesharecdn.com/adding1-161008080543/85/Adding-1-21-Gigawatts-to-Applications-with-RabbitMQ-Bulgaria-PHP-2016-Tutorial-82-320.jpg)
![@asgrim
node1$ rabbitmqctl stop_app
node2$ rabbitmqctl forget_cluster_node rabbit@node1
node1$ rabbitmqctl reset
node1$ rabbitmqctl start_app
node2$ rabbitmqctl cluster_status
Cluster status of node rabbit@node2 ...
[{nodes,[{disc,[rabbit@node3]},{ram,[rabbit@node2]}]},
{running_nodes,[rabbit@node2,rabbit@node3]}]
...done.
Removing Nodes](https://image.slidesharecdn.com/adding1-161008080543/85/Adding-1-21-Gigawatts-to-Applications-with-RabbitMQ-Bulgaria-PHP-2016-Tutorial-84-320.jpg)
Adding 1.21 Gigawatts to Applications with RabbitMQ (Bulgaria PHP 2016 - Tutorial)
- 1. @asgrim this slide is intentionally left blank
- 2. @asgrim Before we begin... Copy folder from USB to your local machine. $ cd /path/to/the/folder/you/copied/from/usb/ $ vagrant box add asgrim/rmq-vm rmq-vm.box $ vagrant up --no-provision Test it in your browser... http://192.168.33.99:15672/
- 4. James Titcumb www.jamestitcumb.com www.roave.com www.phphants.co.uk www.phpsouthcoast.co.uk @asgrim Who is this guy?
- 6. @asgrim What is a message?
- 7. @asgrim What is message queueing?
- 10. @asgrim Scaling with Rabbit RabbitMQApplication Background processing Background processing
- 11. @asgrim Scaling with Rabbit RabbitMQApplication Background processing Background processing Background processing
- 12. @asgrim Scaling with Rabbit RabbitMQApplication Background processing Background processing Background processing Background processing
- 13. @asgrim Scaling with Rabbit RabbitMQApplication Background processing Background processing Background processing Background processing Background processing
- 14. @asgrim AMQP
- 15. @asgrim AMQP Low Level Frame 1 1 67 <frame payload> 0xCE
- 16. @asgrim AMQP Frame: Basic.Publish <frame payload> Publish <exchange> <routing key> <flag> 1 1 67 0xCE Basic
- 17. @asgrim AMQP Message: Multiple Frames 1 1 67 Basic.Publish 0xCE 2 1 102 Content Header 0xCE 3 1 1024 Body 0xCE 3 1 1024 Body 0xCE 3 1 1024 Body 0xCE 3 1 1024 Body 0xCE
- 19. @asgrim AMQP Headers ● content-type ● content-encoding
- 20. @asgrim AMQP Headers ● content-type ● content-encoding ● message-id
- 21. @asgrim AMQP Headers ● content-type ● content-encoding ● message-id ● correlation-id ● reply-to
- 22. @asgrim AMQP Headers ● content-type ● content-encoding ● message-id ● correlation-id ● reply-to ● expiration
- 23. @asgrim AMQP Headers ● content-type ● content-encoding ● message-id ● correlation-id ● reply-to ● expiration ● priority
- 24. @asgrim AMQP Headers ● content-type ● content-encoding ● message-id ● correlation-id ● reply-to ● expiration ● priority ● headers
- 26. @asgrim Who is using it?
- 27. @asgrim SOA
- 29. @asgrim (you need Vagrant+VirtualBox already) Installing RabbitMQ
- 30. @asgrim vagrant up Copy folder from USB to your local machine. $ cd /path/to/the/folder/you/copied/from/usb/ $ vagrant box add asgrim/rmq-vm rmq-vm.box $ vagrant up --no-provision Test it in your browser... http://192.168.33.99:15672/
- 31. @asgrim Library with Composer composer require php-amqplib/php-amqplib
- 35. @asgrim Objective: Basic Queuing Producer Consumer test_queue 1 2 3 4 5
- 39. @asgrim A word on Temporary Queues test_exchangeProducer Messages go nowhere
- 41. @asgrim Objective: Direct Exchange test_direct BK = apple BK = banana, apple Consumer Consumer Producer BK = orange, banana, apple Consumer
- 42. @asgrim Objective: Direct Exchange test_direct BK = apple BK = banana, apple Consumer Consumer Producer MESSAGE ROUTING KEY = ORANGE BK = orange, banana, apple Consumer
- 43. @asgrim Objective: Direct Exchange test_direct BK = apple BK = banana, apple Consumer Consumer Producer MESSAGE ROUTING KEY = BANANA BK = orange, banana, apple Consumer
- 44. @asgrim Objective: Direct Exchange test_direct BK = apple BK = banana, apple Consumer Consumer Producer MESSAGE ROUTING KEY = APPLE BK = orange, banana, apple Consumer
- 46. @asgrim Objective: Topic Exchange test_topic BK = *.vegetable BK = # Consumer Consumer Producer BK = green.# Consumer BK = *.grass.* / *.*.long Consumer
- 47. @asgrim Objective: Topic Exchange test_topic BK = *.vegetable BK = # Consumer Consumer Producer RED.VEGETABLE BK = green.# Consumer BK = *.grass.* / *.*.long Consumer
- 48. @asgrim Objective: Topic Exchange test_topic BK = *.vegetable BK = # Consumer Consumer Producer GREEN.VEGETABLE BK = green.# Consumer BK = *.grass.* / *.*.long Consumer
- 49. @asgrim Objective: Topic Exchange test_topic BK = *.vegetable BK = # Consumer Consumer Producer GREEN.GRASS.LONG BK = green.# Consumer BK = *.grass.* / *.*.long Consumer
- 52. @asgrim
- 53. @asgrim Fetch message Logging Sequence ApplicationBrowser Log Server HTTP request JSON via AMQP Error! HTTP response RabbitMQ
- 57. @asgrim RPC
- 58. @asgrim RPC example Producer Consumer test_queue 1 reply_to: amq.gen-Xa2 1’
- 59. @asgrim TTL
- 60. @asgrim TTL - per queue message Producer Consumer test_queue 1 2 3 4 5 } 10s
- 61. @asgrim TTL - per message Producer Consumer test_queue 1 2 3 4 5 5s 3s 7s 1s 9s
- 62. @asgrim TTL - queue Producer test_queue } 5s (if no consumers)
- 63. @asgrim Photo: © Rob Allen (akrabat) https://flic.kr/p/6wp9iz
- 64. @asgrim DLX
- 66. @asgrim Scheduling / Delayed messages
- 67. @asgrim Shovel
- 69. @asgrim Federated Queues 1 Consumer WAN Rabbit Node #1 Rabbit Node #2 my_queue my_queue (federated)
- 70. @asgrim Priority
- 75. @asgrim Clustering RabbitMQ Node 1 RabbitMQ Node 3 RabbitMQ Node 2 RabbitMQ Node 4 RabbitMQ Node 5 RabbitMQ Node 6 Load Balance / Floating IP / Low TTL DNS etc.
- 79. @asgrim /etc/rabbitmq/rabbitmq.config [ {rabbit, [ {loopback_users, []}, {vm_memory_high_watermark, 0.8} ]} ].
- 80. @asgrim /etc/rabbitmq/rabbitmq.config [{{{[{{[{{}}{][[[{[{{}[[}{[[{}[][}{}}}{}}{{,},]{ [[{rabbit, [{{}[[}{,,{}[][}{[][][{}{{{{}}}}[[}{{ {{}}{loopback_users, []},[][][]{}{}{}<}{[}[][][} [{{[{vm_memory_high_watermark, 0.8}]]{}{[[[]]{}] {{]}[{[{{}[[}{]]{}[][,{}[][}{[][][{}.[]}{]][][]} ]...{}[][,]{.}[][}{}[[[{}{][]}{}{}[}{}{}{]{}{}}[
- 81. @asgrim node1$ rabbitmqctl cluster_status Cluster status of node rabbit@node1 ... [{nodes,[{disc,[rabbit@node1]}]},{running_nodes,[rabbit@node1]}] ...done. Creating a cluster
- 82. @asgrim node2$ rabbitmqctl join_cluster --ram rabbit@node1 node3$ rabbitmqctl join_cluster rabbit@node2 node3$ rabbitmqctl cluster_status Cluster status of node rabbit@node3 ... [{nodes,[{disc,[rabbit@node3,rabbit@node1]},{ram,[rabbit@node2]}]}, {running_nodes,[rabbit@node2,rabbit@node1,rabbit@node3]}] ...done. Creating a cluster
- 84. @asgrim node1$ rabbitmqctl stop_app node2$ rabbitmqctl forget_cluster_node rabbit@node1 node1$ rabbitmqctl reset node1$ rabbitmqctl start_app node2$ rabbitmqctl cluster_status Cluster status of node rabbit@node2 ... [{nodes,[{disc,[rabbit@node3]},{ram,[rabbit@node2]}]}, {running_nodes,[rabbit@node2,rabbit@node3]}] ...done. Removing Nodes
- 86. @asgrim HA + Queue Mirroring RabbitMQ Node 1 RabbitMQ Node 2 Load Balance / Floating IP / Low TTL DNS etc.
- 87. @asgrim BunnyPHP