Get Started with RabbitMQ (CoderCruise 2017)
0 likes151 views
This document contains a presentation on RabbitMQ and message queues. It discusses message queues and exchanges like fanout, direct, and topic exchanges. It covers installing and using RabbitMQ with PHP including examples of producers and consumers. It also discusses more advanced topics like scaling with background jobs, acknowledgements, RPC, TTL, DLX, priorities, and infrastructure with clustering and high availability.
![@asgrim
fanout/consumer.php
1 $q = $channel->queue_declare(
2 '', false, false, false, true);
3 $queue_name = $q[0];
4
5 $channel->exchange_declare(
6 'test_exchange', 'fanout', false, false, false);
7 $channel->queue_bind($queue_name, 'test_exchange');](https://image.slidesharecdn.com/170718-getstartedwithrabbitmqcodercruise2017-170728114803/85/Get-Started-with-RabbitMQ-CoderCruise-2017-44-320.jpg)
![@asgrim
direct/consumer.php
1 $q = $channel->queue_declare('', false, false, false, true);
2 $queue_name = $q[0];
3 $channel->exchange_declare(
4 'test_direct', 'direct', false, false, false);
5
6 // Bind for each routing key we want (BINDING KEY)
7 $channel->queue_bind($queue_name, 'test_direct', 'apple');
8 $channel->queue_bind($queue_name, 'test_direct', 'orange');
9 $channel->queue_bind($queue_name, 'test_direct', 'banana');](https://image.slidesharecdn.com/170718-getstartedwithrabbitmqcodercruise2017-170728114803/85/Get-Started-with-RabbitMQ-CoderCruise-2017-53-320.jpg)
![@asgrim
Message Acknowledgement
1 $channel->basic_consume(
2 'test_queue', '', false, false, false, false,
3 function(AMQPMessage $message) {
4 echo $message->body . "n";
5 throw new Exception('oh noes!!!');
6
7 $channel = $message->delivery_info['channel'];
8 $tag = $message->delivery_info['delivery_tag'];
9 $channel->basic_ack($tag);
10 });](https://image.slidesharecdn.com/170718-getstartedwithrabbitmqcodercruise2017-170728114803/85/Get-Started-with-RabbitMQ-CoderCruise-2017-67-320.jpg)
![@asgrim
/etc/rabbitmq/rabbitmq.config
[
{rabbit, [
{loopback_users, []},
{vm_memory_high_watermark, 0.8}
]}
].](https://image.slidesharecdn.com/170718-getstartedwithrabbitmqcodercruise2017-170728114803/85/Get-Started-with-RabbitMQ-CoderCruise-2017-86-320.jpg)
![@asgrim
/etc/rabbitmq/rabbitmq.config
[{{{[{{[{{}}{][[[{[{{}[[}{[[{}[][}{}}}{}}{{,},]{
[[{rabbit, [{{}[[}{,,{}[][}{[][][{}{{{{}}}}[[}{{
{{}}{loopback_users, []},[][][]{}{}{}<}{[}[][][}
[{{[{vm_memory_high_watermark, 0.8}]]{}{[[[]]{}]
{{]}[{[{{}[[}{]]{}[][,{}[][}{[][][{}.[]}{]][][]}
]...{}[][,]{.}[][}{}[[[{}{][]}{}{}[}{}{}{]{}{}}[](https://image.slidesharecdn.com/170718-getstartedwithrabbitmqcodercruise2017-170728114803/85/Get-Started-with-RabbitMQ-CoderCruise-2017-87-320.jpg)
![@asgrim
Creating a cluster
node1$ rabbitmqctl cluster_status
Cluster status of node rabbit@node1 ...
[{nodes,[{disc,[rabbit@node1]}]},{running_nodes,[rabbit@node1]}]
...done.](https://image.slidesharecdn.com/170718-getstartedwithrabbitmqcodercruise2017-170728114803/85/Get-Started-with-RabbitMQ-CoderCruise-2017-88-320.jpg)
![@asgrim
Creating a cluster
node2$ rabbitmqctl join_cluster --ram rabbit@node1
node3$ rabbitmqctl join_cluster rabbit@node2
node3$ rabbitmqctl cluster_status
Cluster status of node rabbit@node3 ...
[{nodes,[{disc,[rabbit@node3,rabbit@node1]},{ram,[rabbit@node2]}]},
{running_nodes,[rabbit@node2,rabbit@node1,rabbit@node3]}]
...done.](https://image.slidesharecdn.com/170718-getstartedwithrabbitmqcodercruise2017-170728114803/85/Get-Started-with-RabbitMQ-CoderCruise-2017-89-320.jpg)
![@asgrim
Removing Nodes
node1$ rabbitmqctl stop_app
node2$ rabbitmqctl forget_cluster_node rabbit@node1
node1$ rabbitmqctl reset
node1$ rabbitmqctl start_app
node2$ rabbitmqctl cluster_status
Cluster status of node rabbit@node2 ...
[{nodes,[{disc,[rabbit@node3]},{ram,[rabbit@node2]}]},
{running_nodes,[rabbit@node2,rabbit@node3]}]
...done.](https://image.slidesharecdn.com/170718-getstartedwithrabbitmqcodercruise2017-170728114803/85/Get-Started-with-RabbitMQ-CoderCruise-2017-91-320.jpg)
Get Started with RabbitMQ (CoderCruise 2017)
- 1. @asgrim Get started with RabbitMQ James Titcumb CoderCruise 2017
- 4. @asgrim What is a message?
- 5. @asgrim What is message queueing?
- 8. @asgrim Scaling with Rabbit RabbitMQApplication Background processing Background processing
- 9. @asgrim Scaling with Rabbit RabbitMQApplication Background processing Background processing Background processing
- 10. @asgrim Scaling with Rabbit RabbitMQApplication Background processing Background processing Background processing Background processing
- 11. @asgrim Scaling with Rabbit RabbitMQApplication Background processing Background processing Background processing Background processing Background processing
- 12. @asgrim AMQP
- 13. @asgrim AMQP Low Level Frame 1 1 67 <frame payload> 0xCE
- 14. @asgrim AMQP Frame: Basic.Publish <frame payload> Publish <exchange> <routing key> <flag> 1 1 67 0xCE Basic
- 15. @asgrim AMQP Message: Multiple Frames 1 1 67 Basic.Publish 0xCE 2 1 102 Content Header 0xCE 3 1 1024 Body 0xCE 3 1 1024 Body 0xCE 3 1 1024 Body 0xCE 3 1 1024 Body 0xCE
- 17. @asgrim AMQP Headers ● content-type ● content-encoding
- 18. @asgrim AMQP Headers ● content-type ● content-encoding ● message-id
- 19. @asgrim AMQP Headers ● content-type ● content-encoding ● message-id ● correlation-id ● reply-to
- 20. @asgrim AMQP Headers ● content-type ● content-encoding ● message-id ● correlation-id ● reply-to ● expiration
- 21. @asgrim AMQP Headers ● content-type ● content-encoding ● message-id ● correlation-id ● reply-to ● expiration ● priority
- 22. @asgrim AMQP Headers ● content-type ● content-encoding ● message-id ● correlation-id ● reply-to ● expiration ● priority ● headers
- 24. @asgrim SOA
- 27. @asgrim (on trusty64 Vagrant, other OSs may vary) Installing RabbitMQ
- 28. @asgrim ● add apt repo ○ deb http://www.rabbitmq.com/debian/ testing main ● add signing key ○ https://www.rabbitmq.com/rabbitmq-release-signing-key.asc ● apt-get update ● apt-get install rabbitmq-server ● rabbitmq-plugins enable rabbitmq_management ● sudo service rabbitmq-server restart Using Apt
- 35. @asgrim Objective: Basic Queuing Producer Consumer test_queue 1 2 3 4 5
- 37. @asgrim Please wait, connecting... 1 use PhpAmqpLibConnectionAMQPConnection; 2 3 $connection = new AMQPConnection( 4 'localhost', 5672, 'guest', 'guest', '/'); 5 6 $channel = $connection->channel();
- 38. @asgrim basic/producer.php 1 use PhpAmqpLibMessageAMQPMessage; 2 3 $channel->queue_declare( 4 'test_queue', false, true, false, false); 5 6 $message = new AMQPMessage('my test message'); 7 $channel->basic_publish($message, '', 'test_queue');
- 39. @asgrim basic/consumer.php 1 $channel->basic_consume( 2 'test_queue', '', false, true, false, false, 3 function(AMQPMessage $message) { 4 echo $message->body . "n"; 5 }); 6 7 while (count($channel->callbacks)) 8 $channel->wait();
- 43. @asgrim fanout/producer.php 1 use PhpAmqpLibMessageAMQPMessage; 2 3 $channel->exchange_declare( 4 'test_exchange', 'fanout', false, false, false); 5 6 $message = new AMQPMessage('test msg #' . $id); 7 $channel->basic_publish($message, 'test_exchange');
- 44. @asgrim fanout/consumer.php 1 $q = $channel->queue_declare( 2 '', false, false, false, true); 3 $queue_name = $q[0]; 4 5 $channel->exchange_declare( 6 'test_exchange', 'fanout', false, false, false); 7 $channel->queue_bind($queue_name, 'test_exchange');
- 46. @asgrim A word on Temporary Queues test_exchangeProducer Messages go nowhere
- 48. @asgrim Objective: Direct Exchange test_direct BK = apple BK = banana, apple Consumer Consumer Producer BK = orange, banana, apple Consumer
- 49. @asgrim Objective: Direct Exchange test_direct BK = apple BK = banana, apple Consumer Consumer Producer MESSAGE ROUTING KEY = ORANGE BK = orange, banana, apple Consumer
- 50. @asgrim Objective: Direct Exchange test_direct BK = apple BK = banana, apple Consumer Consumer Producer MESSAGE ROUTING KEY = BANANA BK = orange, banana, apple Consumer
- 51. @asgrim Objective: Direct Exchange test_direct BK = apple BK = banana, apple Consumer Consumer Producer MESSAGE ROUTING KEY = APPLE BK = orange, banana, apple Consumer
- 52. @asgrim direct/producer.php 1 $channel->exchange_declare( 2 'test_direct', 'fanout', false, false, false); 3 4 $messageContent = 'test msg, key=' . $routingKey; 5 $message = new AMQPMessage($messageContent); 6 $channel->basic_publish( 7 $message, 'test_direct', $routingKey);
- 53. @asgrim direct/consumer.php 1 $q = $channel->queue_declare('', false, false, false, true); 2 $queue_name = $q[0]; 3 $channel->exchange_declare( 4 'test_direct', 'direct', false, false, false); 5 6 // Bind for each routing key we want (BINDING KEY) 7 $channel->queue_bind($queue_name, 'test_direct', 'apple'); 8 $channel->queue_bind($queue_name, 'test_direct', 'orange'); 9 $channel->queue_bind($queue_name, 'test_direct', 'banana');
- 56. @asgrim Objective: Topic Exchange test_topic BK = *.vegetable BK = # Consumer Consumer Producer BK = green.# Consumer BK = *.grass.* / *.*.long Consumer
- 57. @asgrim Objective: Topic Exchange test_topic BK = *.vegetable BK = # Consumer Consumer Producer RED.VEGETABLE BK = green.# Consumer BK = *.grass.* / *.*.long Consumer
- 58. @asgrim Objective: Topic Exchange test_topic BK = *.vegetable BK = # Consumer Consumer Producer GREEN.VEGETABLE BK = green.# Consumer BK = *.grass.* / *.*.long Consumer
- 59. @asgrim Objective: Topic Exchange test_topic BK = *.vegetable BK = # Consumer Consumer Producer GREEN.GRASS.LONG BK = green.# Consumer BK = *.grass.* / *.*.long Consumer
- 62. @asgrim Fetch message Logging Sequence ApplicationBrowser Log Server HTTP request JSON via AMQP Error! HTTP response RabbitMQ
- 67. @asgrim Message Acknowledgement 1 $channel->basic_consume( 2 'test_queue', '', false, false, false, false, 3 function(AMQPMessage $message) { 4 echo $message->body . "n"; 5 throw new Exception('oh noes!!!'); 6 7 $channel = $message->delivery_info['channel']; 8 $tag = $message->delivery_info['delivery_tag']; 9 $channel->basic_ack($tag); 10 });
- 68. @asgrim RPC
- 69. @asgrim RPC example Producer Consumer test_queue 1 reply_to: amq.gen-Xa2 1’
- 70. @asgrim TTL
- 71. @asgrim TTL - per queue message Producer Consumer test_queue 1 2 3 4 5 } 10s
- 72. @asgrim TTL - per message Producer Consumer test_queue 1 2 3 4 5 5s 3s 7s 1s 9s
- 73. @asgrim TTL - queue Producer test_queue } 5s (if no consumers)
- 74. @asgrim DLX
- 76. @asgrim Scheduling / Delayed messages
- 77. @asgrim Priority
- 82. @asgrim Clustering RabbitMQ Node 1 RabbitMQ Node 3 RabbitMQ Node 2 RabbitMQ Node 4 RabbitMQ Node 5 RabbitMQ Node 6 Load Balance / Floating IP / Low TTL DNS etc.
- 86. @asgrim /etc/rabbitmq/rabbitmq.config [ {rabbit, [ {loopback_users, []}, {vm_memory_high_watermark, 0.8} ]} ].
- 87. @asgrim /etc/rabbitmq/rabbitmq.config [{{{[{{[{{}}{][[[{[{{}[[}{[[{}[][}{}}}{}}{{,},]{ [[{rabbit, [{{}[[}{,,{}[][}{[][][{}{{{{}}}}[[}{{ {{}}{loopback_users, []},[][][]{}{}{}<}{[}[][][} [{{[{vm_memory_high_watermark, 0.8}]]{}{[[[]]{}] {{]}[{[{{}[[}{]]{}[][,{}[][}{[][][{}.[]}{]][][]} ]...{}[][,]{.}[][}{}[[[{}{][]}{}{}[}{}{}{]{}{}}[
- 88. @asgrim Creating a cluster node1$ rabbitmqctl cluster_status Cluster status of node rabbit@node1 ... [{nodes,[{disc,[rabbit@node1]}]},{running_nodes,[rabbit@node1]}] ...done.
- 89. @asgrim Creating a cluster node2$ rabbitmqctl join_cluster --ram rabbit@node1 node3$ rabbitmqctl join_cluster rabbit@node2 node3$ rabbitmqctl cluster_status Cluster status of node rabbit@node3 ... [{nodes,[{disc,[rabbit@node3,rabbit@node1]},{ram,[rabbit@node2]}]}, {running_nodes,[rabbit@node2,rabbit@node1,rabbit@node3]}] ...done.
- 91. @asgrim Removing Nodes node1$ rabbitmqctl stop_app node2$ rabbitmqctl forget_cluster_node rabbit@node1 node1$ rabbitmqctl reset node1$ rabbitmqctl start_app node2$ rabbitmqctl cluster_status Cluster status of node rabbit@node2 ... [{nodes,[{disc,[rabbit@node3]},{ram,[rabbit@node2]}]}, {running_nodes,[rabbit@node2,rabbit@node3]}] ...done.
- 93. @asgrim HA + Queue Mirroring RabbitMQ Node 1 RabbitMQ Node 2 Load Balance / Floating IP / Low TTL DNS etc.