Arcus:NHNMemcachedCloud




                   박준현/NHN
ARCUS




2 / SDEC 2011 발표자료
ARCUS개발배경
                                                   
                                                                                                                  •                                         
                                                                                                                       •                                                                                   


                                                              
                                                                                                                  •                                                                                                 
                                                                                                                                                                                                    
                                                                                                       •                                                                                 
                                                                                                                       •                                                                                                       
                                                                                               •                                                                      
    

                                                                            


3 / SDEC 2011 발표자료
ARCUS개발배경
                                                                                                                                        
                                                                                                                                                                                                                 •                                          
                                                                                                                                                                                                                                                          

                                                                                                  

                                                                                                                                                                                         •                                                                     
                                                                                                                                                                                                                                                                                                  
                                       
                            
                                                                                            
                                                                                                       

                                                                                                                                                                                   



                                                                                                                                                        


4 / SDEC 2011 발표자료
ARCUSCacheCloud

•                                                                                                                  
•                                                                                                 
•                                                                                      
•                                                                                                                             
•                                                                               
•                                                                                                               



     5 / SDEC 2011 발표자료
Memcached



•                                                                                                                                                        
•                                                                                                                                                    
•                                                                                                                                                                                                       
•                                                                                                                                                                         
•                                                                                                                                                                                            
                                                             

     6 / SDEC 2011 발표자료
MemcachedOperations

•                                                                                                                                          Commands

     •                              
                                                                                                                                                                                                                
•                                                                                                                                                                              

•                                                                                                                                              ,                                                                    )

                                                                            
     •                                                                                                                  ,                           
                                                         
                                                                                                                                                                     (                                                   ),
                                                                                                                                                                          




     7 / SDEC 2011 발표자료
MemcachedOperationExamples
•                      
     set	
  key	
  flags	
  exptime	
  bytes	
  [noreply]rn	
  
     valuern	
  
     	
  
                                 [jhpark@XXXX]$	
  telnet	
  localhost	
  11211	
  
     get	
  keyrn    Trying	
  127.0.0.1...	
  
                                          Connected	
  to	
  localhost.localdomain	
  (127.0.0.1).	
  
                                          Escape	
  character	
  is	
  '^]'.	
  
                                          	
  
                                          set	
  sample_key	
  0	
  0	
  12	
  
                                          sample_value	
  
                                          STORED	
  
                                          	
  
                                          get	
  sample_key	
  
                                          VALUE	
  sample_key	
  0	
  12	
  
                                          sample_value	
  
                                          END	
  




      8 / SDEC 2011 발표자료
MemcachedPerformance
•                                       

                      Throughput (TPS)              Response Time
     250000                                           (microsec)
                                              800
     200000                                   700
                                              600
     150000
                                              500
                                              400
     100000
                                              300
                                              200
     50000
                                              100

          0                                     0




     9 / SDEC 2011 발표자료
ConsistentHashing
•                                                                                                                       
                                                                                              •                                                               
                                                                                                      •                           
                                      Key z                                 Node 3
                                                                                                            Node 2
     Remapped to
                                                                              Join
     Node 3

                                                                                                               Key y
                          Node 1                                                                                         Remapped to
                                                                                                                         Node 1

                                                                                                         Node 0
                                                        Key x
                                                                                                    Leave (Failure)
     10 / SDEC 2011 발표자료
ConsistentHashing
•                                                                                      
                           Node 0 Node 2                                 •                                                                     
               Node 2                            Node 0                          •                                                                                       
     Node 0                                                                      •                                                               
                                                              Node 1
                                                                                 •                                                                                    
Node 1                                                               Node 2

                                                                     Node 1
Node 1
                                                            Node 2
     Node 2
                                                 Node 0
                   Node 0
                                    Node 1

     11 / SDEC 2011 발표자료
Arcus1.5Architecture
                      Clients               Cache Nodes
            Consistent hashing




         Java  C Smart Client
         + Local caching (Java)          Unified Cloud Admin
                                        (Zookeeper ensemble)


12 / SDEC 2011 발표자료
ZookeeperIntegration
•                                                
     •                                                                                                                                                                                    
     •                                                                                                                                                                                      
     •                                                                                                                                                                                                                               
     •                                                                                                                                                                                                                  
                                                


•                                                                                                                            
     •                                                                                                                                                                                                    
     •                                                                                            

     13 / SDEC 2011 발표자료
ZookeeperIntegration
Clients                                                       Cache Nodes
               Cache Node List M
                  aintenance
                                    Zookeeper Ensemble



                                   Cache Node List
                                   ------------------
                                   Node 1 IP:Port
                                   Node 2 IP:Port
                                   Node 3 IP:Port
                                   Node 4 IP:Port
                                                            Cache Node 구동

                                                           Zookeeper 세션 연결
                                                         Ephemeral Node 수동 생성

14 / SDEC 2011 발표자료
Arcus1.5Memcached
•                                                                                              
•                                                                                           

                                                   Memcached Core

                                                                                     ZK
                                                   Community Engine                 Client


                                                 Default              Arcus
                                                 Engine               Engine




     15 / SDEC 2011 발표자료
Collection개발배경
•                                                                                                                                                                                                                                                    
     •                                                                                                                      ­–                                                                                                                                                                   

•                                                                                                                        ­–                                                                                                                                        
     •                                                                 ­–                                                                                            
             •                                                                                                                                                                                                         
     •                                                                                                                                                      
     •                                                                                                                                                                                                     
     •                                                                                                                                                                                                            

•                                                                                                                                                                                                                                                                                                   

     16 / SDEC 2011 발표자료
Collection개요
•                                                                                                                                     
     •                 ­–                                                                                                                               
     •                                                                                                                                                                                                                       
             •                                                                                                                                                                                                                 
     •                                      ­–                                                                                                                                                                                                           
             •             64bitintegerkey(bkey),value                                                                                                                                                                                                                
             •                                                                                                                                                                                                                                                                        
                       •                                                                                                                                                               
             •                                                                                                                                                                                                          
•                                                                                                                                                                                                                                    
     •                                                                                           
     17 / SDEC 2011 발표자료
Collection저장구조
                                                                   Hash Table For Uniqueness Checking
header key                value
                                                                                                                                        value2

                                                                                                                                                                                  ..
                                                                                                                                                                                                            
                                                                                                                                                                                           .
header key             setinfo


                  item                                                                             Forward/Backward Range Scan
header key b+treeinfo
                                                                                                                                                     ..
                                                                                                                                                      .


                                                                 bkey1                ..                                                                                       ..                           
                                                                                
                                                                                                       .                                                                         
                                                                                                                                                                                                                        .                
                                                                                                                                                                                                       
                                                                 value


      18 / SDEC 2011 발표자료
NAVERMeCollection활용사례

정보콘텐츠on네이버

     카페    블로그


     뉴스        웹툰



       책       뮤직


                   etc...
   지식인




                                          

19 / SDEC 2011 발표자료
NAVERMeCollection활용사례
•                                                                     ­–                                              
     SELECT	
  *	
  	
  
     FROM	
  messages	
  
     WHERE	
  feedid	
  in	
  (feedID1,	
  feedID2,	
  …,	
  feedIDn)	
  
     	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  AND	
  create_time	
  	
  sysdate()	
  
     ORDER	
  BY	
  create_time	
  DESC	
  
     LIMIT	
  20;


•                                                                                                                                  
     •                                                                                                                                                    
     •                                                                                                                                                  
•                                                                                                                                                        
     20 / SDEC 2011 발표자료
NAVERMeCollection활용사례
•                                             
     •                                                                       
     •                                                                                          ­–                

                                                                                 Push Delivery
                                                                                                                                                User Inbox 1
     Feed 1

                                                                                                                                                User Inbox 2
     Feed M
                                                                                                                                                User Inbox N



     21 / SDEC 2011 발표자료
NAVERMeCollection활용사례

                                                                                                                                                                                              구독관계Cache
                                                                                                                                                                                                       (SETtype)
                                                                                         
                                                                                                                                                                                                           


                                                                                                                                                                                                      사용자별
                                                                                                                                           구독글목록Cache
      
                                                                                                                                                                                                    (B+Treetype)
                                                                                                                                                                                                                             
                                                                                                                                                                                                                           



                                                                                                                                                                                                   구독글내용Cache
                                                                                                                                                                                     (K/Vtype)
                                                                                                                                                                                    

           22 / SDEC 2011 발표자료
BulkInsert
•                                                                                                                           

•                                                                      
     •                                                                                                                                               
     •                                                                                                                                               

•                                                                                                    
     •                                                                                                                                                    


     23 / SDEC 2011 발표자료
SequentialCommandExecution
•                                                                                                                                                                            Client   Server

                                                                                                                                                                                           0 ms
              •                                                                                                                    
              •                                                                                                                                                                  40 usec

                                                                                                                                           1 ms
•                                                          
                                                                                                                                                                                                         40 usec
              •                                                                                                                                                         
                                                                                                                                                                                           2 ms
              •                                                                                                                                            
                                                                                                                                                                                                 40 usec

•                                                                                                                                          3 ms


              24 / SDEC 2011 발표자료
Server-sideCommandPipelining
•                                            ­–                                                 Client   Server

      •                                                                      
                                                                                                                         0 ms
                                                                                                                                                    120 usec
      •                                                                                       
                                                                                                               1.x ms



•                                                                            
      •                                                                                         
                                                          

      25 / SDEC 2011 발표자료
OtherFeatures
•                                                                                                                        
•                                                                            
•                                                                                                                                     
•                                                                                                         
•                                                              
•                          
                                                                                                                     New Technology
      Requirements                                                                                                   New Idea  Features
                                                                                                                     New Products

     26 / SDEC 2011 발표자료
ArcusandMembase
                              기술 협조,
                              공동 개발
                                                      Memcached 기반
                                                      Elastic data cloud




27 / SDEC 2011 발표자료
28 / SDEC 2011 발표자료

More Related Content

PDF
Ots2014 arcus-collection-open source
PDF
[2B3]ARCUS차별기능,사용이슈,그리고카카오적용사례
PDF
마인드맵 워크북
PDF
2. 트위터와 페이스북을 이용한 네트워크 구축-신철민
KEY
Software Quality Analysis with Alitheia Core
PDF
Journal Club
PDF
Sk 프로보노 활동안내
PDF
Social Innovation & New Media: 1. Class Introduction
Ots2014 arcus-collection-open source
[2B3]ARCUS차별기능,사용이슈,그리고카카오적용사례
마인드맵 워크북
2. 트위터와 페이스북을 이용한 네트워크 구축-신철민
Software Quality Analysis with Alitheia Core
Journal Club
Sk 프로보노 활동안내
Social Innovation & New Media: 1. Class Introduction

Similar to SDEC2011 Arcus NHN memcached cloud (20)

PDF
SK컴즈 독립출판FT 4주차
PDF
Seite 15
PDF
[TEDxHUFS] 한글과 다시 소통하다 강병인
PDF
110917 트리즈 강의 서면_pdf
PDF
깊게 지속되는 메시지 개인이 아니라 조직이 만든디 이원재
PDF
씽크리얼스의 스마트폰 비즈니스 1/2부
PDF
Shall we bonobo
PDF
맥스컴 키노트 강의
PDF
Rr reflections
PDF
[TEDxHUFS] 브랜드, 관통의 언어 선택하라 그리고 넘나들라 정지원
PDF
TEDxHUFS 수화 세상을 물들이다 김현철
PDF
TEDxHUFS 말로 표현하기 힘들때는 노래로 이종원 Jbell1
PDF
Prevalence Of Genetic Disorders 1
PDF
구름타고 쉽게 하늘을 날자 도안구
PDF
펩톡연애공작소
PDF
비즈니스를 위한 페이스북_페이지_커뮤니케이션_20110210_final
PDF
Facebook Page Communications for Business
PDF
사람을 깊게 알아야 사람을 위한 디자인을 제대로 할 수 있다 최병호
SK컴즈 독립출판FT 4주차
Seite 15
[TEDxHUFS] 한글과 다시 소통하다 강병인
110917 트리즈 강의 서면_pdf
깊게 지속되는 메시지 개인이 아니라 조직이 만든디 이원재
씽크리얼스의 스마트폰 비즈니스 1/2부
Shall we bonobo
맥스컴 키노트 강의
Rr reflections
[TEDxHUFS] 브랜드, 관통의 언어 선택하라 그리고 넘나들라 정지원
TEDxHUFS 수화 세상을 물들이다 김현철
TEDxHUFS 말로 표현하기 힘들때는 노래로 이종원 Jbell1
Prevalence Of Genetic Disorders 1
구름타고 쉽게 하늘을 날자 도안구
펩톡연애공작소
비즈니스를 위한 페이스북_페이지_커뮤니케이션_20110210_final
Facebook Page Communications for Business
사람을 깊게 알아야 사람을 위한 디자인을 제대로 할 수 있다 최병호
Ad

More from Korea Sdec (16)

KEY
SDEC2011 Big engineer vs small entreprenuer
PDF
SDEC2011 Implementing me2day friend suggestion
PDF
SDEC2011 Introducing Hadoop
PDF
Sdec2011 shashank-introducing hadoop
PDF
SDEC2011 NoSQL Data modelling
PDF
SDEC2011 Essentials of Pig
PDF
SDEC2011 Essentials of Mahout
PDF
SDEC2011 Essentials of Hive
PDF
SDEC2011 NoSQL concepts and models
ZIP
Sdec2011 Introducing Hadoop
PDF
SDEC2011 Replacing legacy Telco DB/DW to Hadoop and Hive
PDF
SDEC2011 Rapidant
PDF
SDEC2011 Mahout - the what, the how and the why
PDF
SDEC2011 Going by TACC
PDF
SDEC2011 Glory-FS development & Experiences
PDF
SDEC2011 Using Couchbase for social game scaling and speed
SDEC2011 Big engineer vs small entreprenuer
SDEC2011 Implementing me2day friend suggestion
SDEC2011 Introducing Hadoop
Sdec2011 shashank-introducing hadoop
SDEC2011 NoSQL Data modelling
SDEC2011 Essentials of Pig
SDEC2011 Essentials of Mahout
SDEC2011 Essentials of Hive
SDEC2011 NoSQL concepts and models
Sdec2011 Introducing Hadoop
SDEC2011 Replacing legacy Telco DB/DW to Hadoop and Hive
SDEC2011 Rapidant
SDEC2011 Mahout - the what, the how and the why
SDEC2011 Going by TACC
SDEC2011 Glory-FS development & Experiences
SDEC2011 Using Couchbase for social game scaling and speed
Ad

Recently uploaded (20)

PDF
Accessing-Finance-in-Jordan-MENA 2024 2025.pdf
PDF
Introduction to MCP and A2A Protocols: Enabling Agent Communication
PDF
The-Future-of-Automotive-Quality-is-Here-AI-Driven-Engineering.pdf
PDF
AI.gov: A Trojan Horse in the Age of Artificial Intelligence
PDF
Dell Pro Micro: Speed customer interactions, patient processing, and learning...
PPTX
Internet of Everything -Basic concepts details
PPTX
Training Program for knowledge in solar cell and solar industry
PDF
Rapid Prototyping: A lecture on prototyping techniques for interface design
PDF
LMS bot: enhanced learning management systems for improved student learning e...
PPTX
SGT Report The Beast Plan and Cyberphysical Systems of Control
PDF
Improvisation in detection of pomegranate leaf disease using transfer learni...
PPTX
AI-driven Assurance Across Your End-to-end Network With ThousandEyes
PDF
Transform-Your-Factory-with-AI-Driven-Quality-Engineering.pdf
PPTX
future_of_ai_comprehensive_20250822032121.pptx
PDF
CXOs-Are-you-still-doing-manual-DevOps-in-the-age-of-AI.pdf
PDF
5-Ways-AI-is-Revolutionizing-Telecom-Quality-Engineering.pdf
PDF
Lung cancer patients survival prediction using outlier detection and optimize...
PDF
“The Future of Visual AI: Efficient Multimodal Intelligence,” a Keynote Prese...
PDF
INTERSPEECH 2025 「Recent Advances and Future Directions in Voice Conversion」
DOCX
Basics of Cloud Computing - Cloud Ecosystem
Accessing-Finance-in-Jordan-MENA 2024 2025.pdf
Introduction to MCP and A2A Protocols: Enabling Agent Communication
The-Future-of-Automotive-Quality-is-Here-AI-Driven-Engineering.pdf
AI.gov: A Trojan Horse in the Age of Artificial Intelligence
Dell Pro Micro: Speed customer interactions, patient processing, and learning...
Internet of Everything -Basic concepts details
Training Program for knowledge in solar cell and solar industry
Rapid Prototyping: A lecture on prototyping techniques for interface design
LMS bot: enhanced learning management systems for improved student learning e...
SGT Report The Beast Plan and Cyberphysical Systems of Control
Improvisation in detection of pomegranate leaf disease using transfer learni...
AI-driven Assurance Across Your End-to-end Network With ThousandEyes
Transform-Your-Factory-with-AI-Driven-Quality-Engineering.pdf
future_of_ai_comprehensive_20250822032121.pptx
CXOs-Are-you-still-doing-manual-DevOps-in-the-age-of-AI.pdf
5-Ways-AI-is-Revolutionizing-Telecom-Quality-Engineering.pdf
Lung cancer patients survival prediction using outlier detection and optimize...
“The Future of Visual AI: Efficient Multimodal Intelligence,” a Keynote Prese...
INTERSPEECH 2025 「Recent Advances and Future Directions in Voice Conversion」
Basics of Cloud Computing - Cloud Ecosystem

SDEC2011 Arcus NHN memcached cloud

  • 1. Arcus:NHNMemcachedCloud 박준현/NHN
  • 2. ARCUS 2 / SDEC 2011 발표자료
  • 3. ARCUS개발배경 •  •  •  •  •  •  3 / SDEC 2011 발표자료
  • 4. ARCUS개발배경 •  •  4 / SDEC 2011 발표자료
  • 5. ARCUSCacheCloud •  •  •  •  •  •  5 / SDEC 2011 발표자료
  • 6. Memcached •  •  •  •  •  6 / SDEC 2011 발표자료
  • 7. MemcachedOperations •  Commands •  •  •  , ) •  , ( ), 7 / SDEC 2011 발표자료
  • 8. MemcachedOperationExamples •  set  key  flags  exptime  bytes  [noreply]rn   valuern     [jhpark@XXXX]$  telnet  localhost  11211   get  keyrn Trying  127.0.0.1...   Connected  to  localhost.localdomain  (127.0.0.1).   Escape  character  is  '^]'.     set  sample_key  0  0  12   sample_value   STORED     get  sample_key   VALUE  sample_key  0  12   sample_value   END   8 / SDEC 2011 발표자료
  • 9. MemcachedPerformance •  Throughput (TPS) Response Time 250000 (microsec) 800 200000 700 600 150000 500 400 100000 300 200 50000 100 0 0 9 / SDEC 2011 발표자료
  • 10. ConsistentHashing •  •  •  Key z Node 3 Node 2 Remapped to Join Node 3 Key y Node 1 Remapped to Node 1 Node 0 Key x Leave (Failure) 10 / SDEC 2011 발표자료
  • 11. ConsistentHashing •  Node 0 Node 2 •  Node 2 Node 0 •  Node 0 •  Node 1 •  Node 1 Node 2 Node 1 Node 1 Node 2 Node 2 Node 0 Node 0 Node 1 11 / SDEC 2011 발표자료
  • 12. Arcus1.5Architecture Clients Cache Nodes Consistent hashing Java C Smart Client + Local caching (Java) Unified Cloud Admin (Zookeeper ensemble) 12 / SDEC 2011 발표자료
  • 13. ZookeeperIntegration •  •  •  •  •  •  •  •  13 / SDEC 2011 발표자료
  • 14. ZookeeperIntegration Clients Cache Nodes Cache Node List M aintenance Zookeeper Ensemble Cache Node List ------------------ Node 1 IP:Port Node 2 IP:Port Node 3 IP:Port Node 4 IP:Port Cache Node 구동 Zookeeper 세션 연결 Ephemeral Node 수동 생성 14 / SDEC 2011 발표자료
  • 15. Arcus1.5Memcached •  •  Memcached Core ZK Community Engine Client Default Arcus Engine Engine 15 / SDEC 2011 발표자료
  • 16. Collection개발배경 •  •  ­– •  ­– •  ­– •  •  •  •  •  16 / SDEC 2011 발표자료
  • 17. Collection개요 •  •  ­– •  •  •  ­– •  64bitintegerkey(bkey),value •  •  •  •  •  17 / SDEC 2011 발표자료
  • 18. Collection저장구조 Hash Table For Uniqueness Checking header key value value2 .. . header key setinfo item Forward/Backward Range Scan header key b+treeinfo .. . bkey1 .. .. . . value 18 / SDEC 2011 발표자료
  • 19. NAVERMeCollection활용사례 정보콘텐츠on네이버 카페 블로그 뉴스 웹툰 책 뮤직 etc... 지식인 19 / SDEC 2011 발표자료
  • 20. NAVERMeCollection활용사례 •  ­– SELECT  *     FROM  messages   WHERE  feedid  in  (feedID1,  feedID2,  …,  feedIDn)                      AND  create_time    sysdate()   ORDER  BY  create_time  DESC   LIMIT  20; •  •  •  •  20 / SDEC 2011 발표자료
  • 21. NAVERMeCollection활용사례 •  •  •  ­– Push Delivery User Inbox 1 Feed 1 User Inbox 2 Feed M User Inbox N 21 / SDEC 2011 발표자료
  • 22. NAVERMeCollection활용사례 구독관계Cache (SETtype) 사용자별 구독글목록Cache (B+Treetype) 구독글내용Cache (K/Vtype) 22 / SDEC 2011 발표자료
  • 23. BulkInsert •  •  •  •  •  •  23 / SDEC 2011 발표자료
  • 24. SequentialCommandExecution •  Client Server 0 ms •  •  40 usec 1 ms •  40 usec •  2 ms •  40 usec •  3 ms 24 / SDEC 2011 발표자료
  • 25. Server-sideCommandPipelining •  ­– Client Server •  0 ms 120 usec •  1.x ms •  •  25 / SDEC 2011 발표자료
  • 26. OtherFeatures •  •  •  •  •  •  New Technology Requirements New Idea Features New Products 26 / SDEC 2011 발표자료
  • 27. ArcusandMembase 기술 협조, 공동 개발 Memcached 기반 Elastic data cloud 27 / SDEC 2011 발표자료
  • 28. 28 / SDEC 2011 발표자료