Cloud computing workshop at IIT bombay
4 likes2,107 views
Nilesh Satpute is an experienced cloud technology professional who has worked with major companies like IBM, HP, and Wipro. He is conducting a cloud computing workshop at IIT Bombay. The workshop covers the history and concepts of cloud computing including characteristics, service models, and deployment models. It discusses key cloud technologies like virtualization, Amazon Web Services, and provides use case examples for various AWS services like EC2, S3, SimpleDB, and SQS.
Cloud computing workshop at IIT bombay
- 1. IIT Tech Fest Cloud Workshop
- 2. Trainer Profile Co-founder and CEO at Applied Cloud Computing Mr. Nilesh is an experienced technology professional with hands on expertise on cloud technologies. Nilesh Satpute He is associated with IIT Bombay as an Independent Technology Advisor assisting them with their Virtualization journey. And Cloud Advisor with Wegilant University, an IIT startup. •Mr. Nilesh Served IBM, HP, Wipro, Hexaware as a cloud expert in last 10 years. •Few of his clients are HCL, Tata Interactive Systems, IIT Bombay, Future Group, CITIBANK, Boehringer Ingelheim india. AWS certified Solution Architect Netsuite Certified Implementation partner Peoplesoft Certified Technical consultant Qualification : BE Computer Science from VJTI : MBA form Jamnalal Bajaj Institute of management studies www.appliedcloudcomputing.com Linkedin Profile:http://www.linkedin.com/profile/view?id=200500065 2
- 3. Session 1 INTRODUCTION TO CLOUD COMPUTING www.appliedcloudcomputing.com 3
- 4. History of cloud computing • Need for Utility : (Electricity, Telecom) : Delivering computer resources over global network 1980(PC adoption) 1990-till date (internet economy) 2009(web 2.0) 1970(mainframes) 2004(Private Cloud) Paravirtualization 2002(Amazon Web Services) 1969 (ARPNET) Full virtualization 1999 (salesforce.com) www.appliedcloudcomputing.com Mainframe 4
- 5. cloud Cloud computing is a model for enabling ubiquitous, convenient, on-demand network access to a shared pool of configurable computing resources (e.g., networks, servers, storage, applications, and services) that can be rapidly provisioned and released with minimal management effort or service provider interaction. • 5 characteristics • On demand self Service, Broad Network Access, Resource pooling, Rapid Elasticity and Measured services • 3 Service Models •SaaS, PaaS, IaaS •4 Deployment model •Private Cloud, Public Cloud, Community cloud, And Hybrid Cloud www.appliedcloudcomputing.com 5
- 6. How Cloud Computing works 1/2 • Using resource pools to share common resources • Server Virtualization • Network Virtualization • Storage Virtualization • Virtualization to cloud : IT –as-a-Service • Data Centre transformation to shared Infrastructure www.appliedcloudcomputing.com 6
- 7. How Cloud Computing works 2/2 Business and Financial management New focus Area : Cloud services and operations management New role emerging •Cloud Architect •Cloud Admin •Cloud Capacity Planner •IT automation engineer Traditional Roles still essential IT Service Management Software as a Service Platform as a service Infrastructure as a service Virtual Infrastructure Management Virtual Infrastructure Architecture Backup and System Storage Recovery www.appliedcloudcomputing.com Networks Security 7
- 8. Application for Business • • • • • • • • Application testing and staging Temporary processing and storage needs Data archiving Virtual Desktop Infrastructure (VDI) Supplier management Back-office optimization Sales force management Project management and collaboration www.appliedcloudcomputing.com 8
- 9. Infrastructure Cloud Services Provider • • • • AWS Microsoft Azure Google App engine Rackspace Cloud www.appliedcloudcomputing.com 9
- 10. Cloud Computing Architecture 1/4 www.appliedcloudcomputing.com 10
- 11. Cloud Computing Architecture 2/4 www.appliedcloudcomputing.com 11
- 12. Cloud Computing Architecture 3/4 www.appliedcloudcomputing.com 12
- 13. Cloud Computing Architecture 4/4 www.appliedcloudcomputing.com 13
- 14. Cloud Computing Terminologies • • • • • Communication-as-a-Service (CaaS) Infrastructure-as-a-Service (IaaS) Monitoring-as-a-Service (MaaS) Software-as-a-Service (SaaS) Platform-as-a-Service (PaaS) www.appliedcloudcomputing.com 14
- 15. Cloud Advantage Disadvantage • • • • • • • Security • Response Time Access Scalable Cross Platform No upfront cost Data Security Integration www.appliedcloudcomputing.com 15
- 17. Virtualization Basics : Hypervisor Virtualization Hypervisor Host VM User Space Drivers VM OS kernel MM Guest VM User Space Drivers VM Space Guest VM User Space Drivers VM Space Drivers Virtual Hardware Drivers Virtual Hardware RM Scheduler Emulation Hypervisor Hardware www.appliedcloudcomputing.com 17
- 18. Virtualization Basics : OS Virtualization OS Virtualisation User Space (Container) Drivers User Space (Container) MM RM User Space (Container) Scheduler User API OS Kernel Hardware www.appliedcloudcomputing.com 18
- 19. Virtualization Basics : Para Virtualization Para Virtualisation User Space (Container) User Space (Container) User Space (Container) Hypervisor Drivers MM RM Scheduler User API OS Kernel Hardware www.appliedcloudcomputing.com 19
- 20. Benefits • • • • • • • • • • Hardware Abstraction Ease of Migration Encapsulation of storage Snapshots Ease of archiving Ease of growth Improved Monitoring and troubleshooting Workload consolidation Ease of environment segmentation Improved Remote management www.appliedcloudcomputing.com 20
- 21. Session 3 CLOUD NETWORK AND PRIVATE CLOUD www.appliedcloudcomputing.com 21
- 29. Session 4 AMAZON WEB SERVICES CLOUD www.appliedcloudcomputing.com 29
- 30. This session is about: Amazon Web Services (AWS) robust, scalable and affordable infrastructure for cloud computing. www.appliedcloudcomputing.com 30
- 31. 5 Benefits of Using Amazon Web Services
- 32. 1. Pay-per use model You are only charged for disk space, CPU time and bandwidth that you use.
- 33. 2. Instant scalability Your Service automatically scales on AWS stack.
- 34. 3. Reliable/Redundant/Secure Infrequent outages (so far). Data is redundant in the cloud. All services have built-in security. * Soon will add Comprehensive to the list.
- 35. 4. Most services accessed via simple REST/SOAP API Libraries are available in all major languages. Minimal learning curve.
- 36. 5. Amazon - Experience & Commitment Amazon has been doing this for ~15 years. Company-wide commitment to AWS.
- 37. Amazon Web Services Stack
- 38. Elastic Cloud Service (EC2) Simple Storage Service (S3) Simple Database Service (SimpleDB) Simple Queue Service (SQS) www.appliedcloudcomputing.com 38
- 39. Elastic Compute Cloud (EC2) On-demand grid
- 40. EC2 in a Nutshell Usage: QuickTime™ and a decompressor are neede d to se e this picture. QuickTime™ and a decompressor are neede d to se e this picture. QuickTime™ and a decompressor are neede d to se e this picture. • • • • Create Machine Image Deploy the image to S3 Start 1 or more instances Use it as regular machine(s) Main Options: Machine Image (OS + Apps) • • • • www.appliedcloudcomputing.com Dynamic/Static IPS Choose cores Choose locations Persistence via EBS 40
- 41. Sample EC2 Use Cases Batch Processing All instances are configured with the same code. Each instance operates on a subset of data. Partitions are specified in configuration file. Web Service All instances are configured with the same code. One or more instances are configured as load balancers (HAProxy for example). DNS Server distributes requests between load balancers. www.appliedcloudcomputing.com 41
- 42. EC2 vs. Web Hosting Company Good Instantly add new instances Full-control over the machines and choice of the environment Likely cheaper (but depends on your exact situation) Bad Need to put the images together and manage instances No dedicated technical support (but there is premium support and RightScale solutions) www.appliedcloudcomputing.com 42
- 43. Simple Storage Service (S3) Large media and everything else storage.
- 44. S3 in a Nutshell Idea: Amazon S3 Bucket 1 … Put object Bucket N Get object Put/Get objects into buckets based on unique keys. Main Features: • • Public/Private access. Support for large objects. Client www.appliedcloudcomputing.com 44
- 45. Sample S3 Use Cases Image/Video storage Put your media once on S3 and then serve it up Reads are 10 times cheaper than writes! Serialize your Java Objects Define unique key based on the object attributes Write out binary serialized version to a stream Write bytes to S3 Read them back when needed www.appliedcloudcomputing.com 45
- 46. Simple Database Service (SimpleDB) Basic database and indexing service
- 47. Simple DB in a Nutshell Simple DB Domain Idea: Record 1 Key1 Attributes: A1,A2… Create flat database with auto-indexed tables. … Record N Key2 Attributes: A1,A2… Get record Query records Put record Client Main Features: • • • • www.appliedcloudcomputing.com Each attribute is indexed. Record structure is flexible. Basic operators in queries Supports sorting. 47
- 48. Sample SimpleDB Use Cases Index Media files stored on S3 Use the same key as on S3 Write the record with each metadata element as attribute Store flat objects Use SimpleDB as a storage for non-nested data www.appliedcloudcomputing.com 48
- 49. Simple Queue Service (SQS) Infinite Asynchronous Queue
- 50. SQS in a Nutshell SQS Queue Idea: Message 1 Create an infinite asynchronous queue. … Message N Send Message Writer Receive Message Main Features: • • • Multiple queues Upto 4K messages Message Locking Reader www.appliedcloudcomputing.com 50
- 51. Sample SQS Use Cases Twitter Friend Update For each update generate a task to update friends Process updates in order Publish/Subscribe Post messages to the queue to inform multiple subscribers Process Pipeline Use different queues to put, for example, and order through a pipeline. www.appliedcloudcomputing.com 51
- 53. Contact • Nilesh Satpute • www.appliedcloudcomputing.com • [email protected] (official email) • [email protected] (personal email id) • Facebook http://www.facebook.com/nilesh.satpute.5 • http://www.facebook.com/AppliedCloudComputing www.appliedcloudcomputing.com 53