Netty Notes Part 3 - Channel Pipeline and EventLoops
Download as PPTX, PDF19 likes9,413 views
This document outlines key concepts of Netty, focusing on channel pipelines, event loops, and their lifecycle, authored by Rick Hightower. It covers the architecture of channel handlers, their lifecycle events, methods for managing data flow, and exception handling patterns. Additionally, it discusses the threading model used in Netty for efficient task management and provides resources for further learning.
More Related Content
Similar to Netty Notes Part 3 - Channel Pipeline and EventLoops (20)
![From Curiosity to ROI — Cost-Benefit Analysis of Agentic Automation [3/6]](https://cdn.slidesharecdn.com/ss_thumbnails/session-3-250903141006-a3917e1a-thumbnail.jpg?width=560&fit=bounds)
Netty Notes Part 3 - Channel Pipeline and EventLoops
- 1. NOTES ON NETTY PART 3 RICK HIGHTOWER’S CHANNEL PIPELINES, AND EVENT LOOPS
- 2. About Rick hightower About Rick • Implemented Microservices, Vert.x/Netty at massive scale • Author of QBit, microservices lib and Boon, Json parser and utility lib • Founder of Mammatus Technology • Rick’s Twitter, Rick’s LinkedIn, Rick’s Blog, Rick’s Slideshare
- 3. Great book on Netty! https://www.manning.com/books/netty-in- action
- 4. Great talk about Netty Best Practices given at Facebook, then Twitter University https://goo.gl/LbXheq
- 5. http://www.infoq.com/presentations/apple-netty Great talk about Netty at scale
- 6. Previous slide deck Previous SLIDE DECK • Notes on Netty Basics Slideshare • Part 1: http://www.slideshare.net/richardhig htower/notes-on-netty-baics • Part 2: http://www.slideshare.net/richardh ightower/netty-notes-part-2- transports-and-buffers • Notes on Netty Basics Google slides • Part 1: https://goo.gl/aUGm2N • Part 2: https://goo.gl/xZZhVs
- 8. Chaining channel handlers ChannelPipeline • Channel - Socket • ByteBuf - container for bytes of message • ChannelHandler process / transform messages • ChannelPipeline - forms chain of ChannelHandlers
- 9. Lifecycle of a channel Channel Lifecycle states • Active • connected to remote peer • Inactive • disconnected from remote peer • Unregistered • created • Registered • channel associated with event loop
- 10. methods on ChannelHandler for lifecycle event ChannelHandler Lifecycle Events • handlerAdded() • added to ChannelPipeline • handlerRemoved() • removed from ChannelPipeline • exceptionCaught() • error during ChannelPipeline processing
- 11. event notification event methods for ChannelInboundHander ChannelInboundHandler lifecycle methods for Channel • channelRegistered() - Channel married to an event loop • channelUnregistered() - Channel divorced from event loop • channelActive() - connected • channelInactive() - disconnected • channelReadComplete() - read operation completed • channelRead() - data is read on channel • channelWritabilityChanged() - outgoing IO buffer/limit is met or not • userEventTriggered() - someone passed a POJO to the event loop
- 12. Let it go. Let it go. Can't hold it back anymore Releasing messages • Not a good idea to override read unless you know what you are doing • you must free up pooled resources calling ReferenceCountUtil.release(messag e) • Use SimpleChannelInboundHandler and override channelRead0() instead, netty will free up message resource for you java -Dio.netty.leakDetectionLevel=ADVANCED You can leak on write or read
- 13. Handler for outbound ChannelOutboundHandler • Outbound operations • methods invoked by • Channel, ChannelPipeline, and ChannelHandlerContext. • Can defer operation or event • Powerful level of control • Many Methods take a ChannelPromise which extends ChannelFuture and provides ability to mark as succeeded or failed (setSuccess(), setFailure()) • You should mark promise failed or succeeded and also release resources
- 14. lifecycle event methods ChannelOutboundHandler • bind(channelHandlerContext, localSocketAddress, channelPromise) • listen to address for connections request event • connect(channelHandlerContext, socketAddress, channelPromise) • connect to remote peer request event • disconnect(channelHandlerContext, channelPromise) • disconnect from remote peer request event • close(channelHandlerContext, channelPromise) • close channel request event
- 15. lifecycle event methods ChannelOutboundHandler • deregister(channelHandlerContext, channelPromise) • removed from event loop request event • read(channelHandlerContext) • read more data from channel request event • flush(channelHandlerContext) • flush data to remote peer request event • write(channelHandlerContext, message:Object, channelPromise) • write data to channel request event
- 16. chain of channel handlers ChannelPipeline • ChannelPipeline is chain of ChannelHandlers • handlers intercept inbound and outbound events through Channel • ChannelHandlers process application IO data • Channel processes IO events • New Channel assigned to new ChannelPipeline • relationship is permanent • no cheating! Channel can’t attach to another ChannelPipeline • Channel can’t leave ChannelPipeline • Direction determines if event handled by ChannelInboundHandler or a ChannelOutboundHandler • Unhanded events go to next Channel in chain
- 17. ChannelHandlers can modify ChannelPipeline ChannelPipeline can be edited • ChannelHandler methods to change ChannelPipeline • addFirst() • addBefore() • addAfter() • addLast() • remove() • replace()
- 18. Used by Netty to fire events inbound ChannelPipeline methods • fireChannelRegistered • fireChannelUnregistered • fireChannelActive • fireChannelInactive • fireExceptionCaught • fireUserEventTriggered - user defined event so you can pass a POJO to the channel • fireChannelRead • fireChannelReadComplete
- 19. Outbound methods ChannelPipeline methods • bind - listen to a port, binds channel to port/address • connect - connect to a remote address • disconnect - disconnect from a remote address • close - close the channel after next channel handler is called • deregister • flush • write • writeAndFlush • read
- 20. Managing passing the events to next handler in chain ChannelHandlerContext • Associates ChannelHandler and ChannelPipeline • Created when ChannelHandler added to a ChannelPipeline • Manages interaction of its ChannelHandler to others in ChannelPipeline • Use context instead of pipeline (most often) as it involves a shorter event flow • otherwise must go through whole chain from start
- 21. Methods ChannelHandlerContext • channel - returns the Channel • bind, close, connect, disconnect • read, write • deregister • executor - returns EventExecutor (has thread pool scheduling interface) • fireChannelActive, fireChannelInactive, fireChannelRead, fireChannelReadComplete • handler - returns corresponding handler • isRemoved - has the handler been removed? • name - name of the instance • pipeline - returns the associated pipeline
- 22. In Bound Exception handling public class MyInboundExceptionHandler extends ChannelInboundHandlerAdapter { … @Override public void exceptionCaught(ChannelHandlerContext channelHandlerContext, Throwable cause) { logger.error(cause); channelHandlerContext.close(); } }
- 23. Outbound Exception handling public class MyHandler extends ChannelOutboundHandlerAdapter { @Override public void write( final ChannelHandlerContext channelHandlerContext, final Object message, final ChannelPromise channelPromise) { channelPromise.addListener(new ChannelFutureListener() { @Override public void operationComplete(final ChannelFuture channelFuture) { if (!channelFuture.isSuccess()) { logger.error(channelFuture.cause()); channelFuture.channel().close(); } } }); } }
- 24. EVENT LOOPS
- 25. Threading model specifics Event Loop And Threading model • Threading model specifies is key to understanding Netty • When threads are spawned is very important to your application code • You have to understand trade-offs and specifics of Netty • Multi cores are common occurrence • Netty uses Executor API interfaces to schedule EventLoop tasks • Netty tries to reduce cost of thread hand off and CPU cache line moving about by limiting the #of threads to handle IO • Less is more by reducing “context switching" • Increases CPU Register, L1, L2, cache hits by keeping things in same thread • Reduce wake up cost of threads and synchronization of shared variables
- 26. Tasks can be submitted to EventLoop EventLoop tasks • EventLoop indirectly extends Java’s ScheduledExecutorService • Events and Tasks are executed in order received • You can use ScheduledExecutorService methods to schedule a task for later execution • Tasks will run in same thread as IO so no sync needed
- 27. Use event loop to schedule tasks EventLoop task schedule ScheduledFuture<?> future = channel.eventLoop().scheduleAtFixedRate(...);
- 28. Netty does task management to make sure only one thread can handle IO Ensure Channel is handled by ONE Thread • Any Thread can call methods on a Channel • No synchronization in is needed • How? • If you call a method on a Channel and its not from the IO Thread (EventLoop thread) • Netty will schedule a task for that method to be run and the task will run in EventLoop thread • “Netty’s threading model hinges on determining the identity of the currently executing Thread; that is, whether or not it is the one assigned to the current Channel and its EventLoop.” (Netty in Action) • If method call is from EventLoop Thread, then method is executed right away • Each EventLoop has a task queue • task queue is not shared • Do not put long running tasks in the task queue of an event loop • If long running use another thread pool (not Netty) to execute and then call channel when done
- 29. Relationship for NIO For NIO • An EventLoop manages many Channels • Channels can be sockets/connections/clients • If you block in one, you block all clients • Do not block
- 30. THANKS AND BUY NORMAN’S BOOK
- 31. Netty in Action Ideas for slides • Many ideas for slides are directly derived from Netty in Action book by Norman et al and/or his talks on Netty • BUY THE BOOK Netty in Action! • The slides are a study aid for myself so I can better learn Netty • I’ve worked with ByteBuffer, NIO, Vert.x, and have often wanted to use parts of Netty on projects but lacked the knowledge of Netty internals so used NIO or ByteBuffer or OIO when I really wanted to use Netty instead
- 32. Previous slide deck Previous SLIDE DECK • Notes on Netty Basics Slideshare • Part 1: http://www.slideshare.net/richardhig htower/notes-on-netty-baics • Part 2: http://www.slideshare.net/richardh ightower/netty-notes-part-2- transports-and-buffers • Notes on Netty Basics Google slides • Part 1: https://goo.gl/aUGm2N • Part 2: https://goo.gl/xZZhVs
- 33. About Rick hightower About Rick • Implemented Microservices, Vert.x/Netty at massive scale • Author of QBit, microservices lib and Boon, Json parser and utility lib • Founder of Mammatus Technology • Rick’s Twitter, Rick’s LinkedIn, Rick’s Blog, Rick’s Slideshare The end… sleepless dev.