Scaling CometD by Kevin Nilson
- 1. ScalingCometD to The Massesby Kevin NilsonPrincipal Architect / E*Trade Financial
- 3. AgendaQuick Intro to CometDBasic Steps (OutsideCometD)Advanced Steps (InsideCometD)
- 4. Kevin NilsonJava ChampionCo-authored Web 2.0 Fundamentals BookLeader Silicon Valley Web Developer JUGLead Silicon Valley Google Tech User GroupLeader Silicon Valley JavaScript MeetupTaught 7 Courses College Of San MateoWinner of MySpace Editor's Choice Award for project YumieDate, at Open Social Weekend Apps hosted at Google
- 5. Intro To CometDWhat’s Comet? What’s Bayeux?What’s CometD? Pushing Data to The Net over HTTPChannel & JSON Based Comet ProtocolComet Client and Server Implementation using BayeuxWhat’s WebSockets?
- 7. Polling
- 8. Long Polling
- 9. Streaming
- 10. Basic Steps (OutsideCometD)Reduce overheadAllow MultithreadingRemove Simple Bottlenecks
- 11. Remove ApacheApache Has 1 Thread Per Request LimitBrowseApacheJetty
- 12. Separate Client Into TiersSome high throughput some lowSpreads broadcast over multiple threadsDelivery to 5 channels can be handled by 5 threadsDelivery to 1 Channel can be handled by only 1 thread/Player/GameUpdateHigh Volume/GameUpdatePublisher/Watcher/GameUpdateLow Volume
- 13. Only Deliver Changed Fields50% Field Delivery Reduction
- 14. Advanced StepsMove Customers to slower tier if they are not consuming fast enoughDisconnect users with very “large” queuesAuto adjust throttling if overall we are producing faster than we can consume (deliver to customers)
- 15. Before, No InternalVisiblityfilterJettyJMSBayeuxServiceBrowserLEDGENDI can seeI can’t see
- 16. Before – Full StoryfilterJettyJMSBayeuxServiceBrowserQueueLEDGENDI can seeI can’t see
- 17. AfterfilterJettyJMSBayeuxServiceBrowserQueueDeliverListenerQueueListenerLEDGENDI can seeI can’t see
- 18. Queue & Deliver Listener Codeclient.addListener(newQueueListener() { public booleanqueueMaxed(Client client, Client client1, Message arg2) { … }}client.addListener(newDeliverListener( ) { public void deliver(Client arg0, Queue<Message> queue) { … }}
- 19. Prevent Huge QueuefilterJettyJMSBayeuxServiceBrowserQueueCheck Queue Size:Disconnect Client if “Large”LEDGENDI can seeI can’t see
- 20. Measure Average Time in QueuefilterJettyJMSBayeuxServiceBrowserQueueCheck Time In Queue:Move Client to Slower Tier or Increase Overall ThrottlingLEDGENDI can seeI can’t see
- 21. Adjust Tier: Avg Queue Size of ClientPlatinumGoldSilverBronzeJMSMyBayeuxServicePlatinum = 100 updates / minuteGold = 50 updates / minuteSilver = 25 updates / minuteBronze = 10 updates / minuteLEDGEND
- 22. Broadcast in CometD, not JMSJMSMyBayeuxServiceBrowserBrowserBrowserJMSMyBayeuxServiceBrowserBrowserBrowser
- 23. Channel Create & RemoveListenerJMSMyBayeuxServicechannelAddedchannelRemoved
- 24. ChannelBayeuxListener Codebayeux.addListener(newChannelBayeuxListener() { public void channelAdded(Channel channel) { // Code Here } public void channelRemoved(Channel channel) { // Code Here } });
- 25. Adjust Tier Rate based on Avg Queue SizePlatinumGoldSilverBronzeJMSMyBayeuxServicePlatinum = 100 updates / minuteGold = 50 updates / minuteSilver = 25 updates / minuteBronze = 10 updates / minutePlatinum = 50 updates / minuteGold = 25 updates / minuteSilver = 10 updates / minuteBronze = 5 updates / minuteLEDGEND
- 26. Auto Throttle: Avg Message DelayfilterJettyJMSBayeuxServiceBrowserQueuePlatnium = 50 updates Gold = 25 updatesSilver = 10 updatesBronze = 5 updatesPlatnium = 100 updates Gold = 50 updatesSilver = 25 updatesBronze = 10 updatesLEDGEND
- 27. SummaryCometD IntroBasic StepsAdvanced Steps. . .
- 28. [email protected] - Web2.0 Fundamentals