Soyez Big Data ready avec Isilon
1 like•786 views
1) Unstructured data is growing rapidly and will soon account for over 80% of all data. 2) EMC Isilon's scale-out NAS architecture can consolidate siloed storage into a single "data lake" and support both traditional and next-gen workloads like analytics and cloud apps from a single instance. 3) EMC Isilon's CloudPools feature allows for intelligent tiering of data to public clouds for low-cost, long term storage which extends the data lake model into the cloud.
Soyez Big Data ready avec Isilon
- 1. © Copyright 2015 EMC Corporation. All rights reserved© Copyright 2015 EMC Corporation. All rights reserved JEUDI 19 NOVEMBRE 2015 Bertrand OUNANIAN: Advisory System Engineer BIG DATA READY WITH ISILON
- 2. © Copyright 2015 EMC Corporation. All rights reserved© Copyright 2015 EMC Corporation. All rights reserved Unstructured Data Growth Source: IDC 2 © Copyright 2015 EMC Corporation. All rights reserved. 2013 37 EB Total Capacity Shipped Worldwide % of Unstructured Data 67% 74% 80% 2015 71 EB 2017 133 EB Demand doubles essentially every 2 years
- 3. © Copyright 2015 EMC Corporation. All rights reserved© Copyright 2015 EMC Corporation. All rights reserved 3 Data of Life Generation doubles every 2 years We want to KEEP EVERYTHING
- 4. © Copyright 2015 EMC Corporation. All rights reserved© Copyright 2015 EMC Corporation. All rights reserved Silos vs Consolidated Data Lake 4
- 5. © Copyright 2015 EMC Corporation. All rights reserved© Copyright 2015 EMC Corporation. All rights reserved NAS SAN CLOUD TAPE DAS OBJECT 5 NEXT-GEN WORKLOADSTRADITIONAL WORKLOADS Apps Backup/Archive Analytics Mobile Accessibility Shares Cloud Apps
- 6. © Copyright 2015 EMC Corporation. All rights reserved© Copyright 2015 EMC Corporation. All rights reserved TAPE NAS DAS CLOUDSAN OBJECT Isilon Scale-Out Data Lake 6 NEXT-GEN WORKLOADSTRADITIONAL WORKLOADS Apps Backup/Archive Analytics Mobile Accessibility Shares Cloud Apps NEXT-GEN WORKLOADSTRADITIONAL WORKLOADS
- 7. © Copyright 2015 EMC Corporation. All rights reserved© Copyright 2015 EMC Corporation. All rights reserved Isilon Next-Gen Access Methods FILE FILE Apps Analytics Cloud Apps Apps Backup/Archive Shares Mobile Accessibility One instance of the file services all dependent workloads simultaneously
- 8. © Copyright 2015 EMC Corporation. All rights reserved© Copyright 2015 EMC Corporation. All rights reserved Isilon OneFS: Scale-Out Architecture Single Volume/ File System Cloud Tiering Ready Simplicity & Ease of Use Linear Scalability Hadoop Enabled High Performance 8 Unmatched Efficiency Easy Growth
- 9. © Copyright 2015 EMC Corporation. All rights reserved© Copyright 2015 EMC Corporation. All rights reserved EMC Isilon Scale-Out NAS Architecture Clients and Applications Object API GET PUT POST DELETE 1 Gig-e 10 Gig-e Network OneFS Operating Environment Multi-Protocol Client/Application Layer Ethernet Layer Protocols SMBNFS FTPHTTP HDFS for Hadoop REST for Object Intra-cluster Communication
- 10. © Copyright 2015 EMC Corporation. All rights reserved© Copyright 2015 EMC Corporation. All rights reserved From TeraBytes to Petabytes with a few clicks • • • System Evolution
- 11. © Copyright 2015 EMC Corporation. All rights reserved© Copyright 2015 EMC Corporation. All rights reserved Storage Lifecycle Reduce Risk Never Migrate STORAGE EVOLUTION • Coexistent Generations of Nodes • Push-Button Retire
- 12. © Copyright 2015 EMC Corporation. All rights reserved© Copyright 2015 EMC Corporation. All rights reserved Isilon Platform Portfolio X-SERIES NL-SERIES High Throughput Platform Nearline Storage Platform X210 NL410 *Scales from 3 node cluster to 144 node cluster S-SERIES High Transactional Platform S210 X410 HD-SERIES High Density Platform HD400 SSD and SATA 1-4TB (24 TB –20.7 PB)* SATA 1-6TB (108 TB – 30 PB)* SSD and SAS (16 TB – 4.15 PB)* SATA 6TB (1 PB – 50 PB)*
- 13. © Copyright 2015 EMC Corporation. All rights reserved • Single point of management – Single file system/single volume – Multiple performance tiers • Automatic data movement – Policy-based tiering management – Transparent reallocation – NO application changes • Optimize storage resources – Automatically match storage resources with data requirements – Eliminate data migration Optimize Resources with Automated Tiering Isilon SmartPools S-Series Performance NL/HD-Series Active archives X-Series Collaboration Reduced cost/TB
- 14. © Copyright 2015 EMC Corporation. All rights reserved HDFS SMB, NFS, HTTP, FTP, HDFS Node reply Node reply Node reply Node reply Data Support Hadoop Distributions name node name node name node name node datanode NFS SMB SMB NFS MAP Reduce MAP Reduce MAP Reduce MAP Reduce MAP Reduce MAP Reduce MAP Reduce MAP Reduce MAP Reduce MAP Reduce MAP Reduce MAP Reduce MAP Reduce MAP Reduce MAP Reduce MAP Reduce MAP Reduce MAP Reduce
- 15. © Copyright 2015 EMC Corporation. All rights reserved© Copyright 2015 EMC Corporation. All rights reserved The Business Data Lake Approach Analytic Sandbox Ad Hoc Analytic Environment Structured BI Reporting Environment Data Preparation and Enrichment Via Hadoop Content ALL data fed into Business Data Lake EDWETL Offload EDW to Hadoop
- 16. © Copyright 2015 EMC Corporation. All rights reserved Comprehensive Enterprise Software SnapshotIQ Fast, Efficient Data Backup And Recovery SyncIQ Fast And Flexible Asynchronous Replication For Disaster Recovery Protection SmartConnect Policy-based Client Failover With Load Balancing SmartLock Policy-based WORM Data Protection SmartPools Policy-based Automated Tiering SmartDedupe Data Deduplication to reduce storage requirements and costs without impacting performance SmartQuotas Quota Management And Thin Provisioning InsightIQ Performance Monitoring And Reporting To Manage Storage Resources DATA PROTECTION DATA MANAGEMENT
- 17. © Copyright 2015 EMC Corporation. All rights reserved CONNECTING EDGE TO CORE TO CLOUD Big Data ready ?
- 18. © Copyright 2015 EMC Corporation. All rights reserved Recent EMC Isilon Innovations Leadership in Scale-out nas 2Xincrease in performance 2Xincrease in capacity NEWhigh density platform INTRODUCEDData Lake
- 19. © Copyright 2015 EMC Corporation. All rights reserved Enterprise Customer Challenges Managing storage at remote locations / branch offices (EDGE) 19© Copyright 2015 EMC Corporation. All rights reserved. Data storage growth Limited IT resources Islands of disconnected storage Inconsistent data protection Management complexity Inefficient storage utilization
- 20. © Copyright 2015 EMC Corporation. All rights reserved© Copyright 2015 EMC Corporation. All rights reserved PRODUCT FEATURES Software Defined scale-out NAS with OneFS features Runs on commodity hardware Integrated with VMware Scales to 36 TB and 3-6 nodes Free & frictionless (non-production, community support) KEY BENEFITS Simple, agile and cost efficient platform Easy to manage with standard VMware tools Consolidate/distribute data from/to remote locations Other use cases: test/dev, small-medium businesses 20© Copyright 2015 EMC Corporation. All rights reserved. EMC IsilonSD EDGE
- 21. © Copyright 2015 EMC Corporation. All rights reserved REMOTE OFFICES (EDGE) DATA CENTER (CORE) Software Defined Data Lake EDGE to CORE SyncIQ Access time 21 • Unified data lake • Simplicity at scale • Seamless management • No complex cloud gateway required
- 22. © Copyright 2015 EMC Corporation. All rights reserved© Copyright 2015 EMC Corporation. All rights reserved IsilonSD Edge deployment … Client 0 App 1 Client 1 App 2 Client N NFS / SMB/ HTTP / HDFS / Swift / etc.network IsilonSD ESXi SSD SSD HDD HDD HDD HDD ESXi SSD SSD HDD HDD HDD HDD EMPTY FULLCAPACITY EMPTY FULLCAPACITY ESXi SSD SSD HDD HDD HDD HDD CAPACITYEMPTY ESXi SSD SSD HDD HDD HDD HDD EMPTY FULLCAPACITY FULL 22
- 23. © Copyright 2015 EMC Corporation. All rights reserved IsilonSD edge solves Customer Challenges Managing storage at remote locations / branch offices (EDGE) 23© Copyright 2015 EMC Corporation. All rights reserved. Scales up to 36TB Leverage commodity storage Eliminate islands of storage Increases data protection Simplifies management >80% storage utilization
- 24. © Copyright 2015 EMC Corporation. All rights reserved© Copyright 2015 EMC Corporation. All rights reserved Isilon and IsilonSD edge comparison Isilon IsilonSD Edge Package Appliance (HW+SW) Software Only Commodity Hardware OneFS version Same Same Protocols / Access Methods Same Same Software/Apps Same Same Size 3 – 144 nodes 18 TB to 50 PB 3 - 6 nodes 4 TB – 36 TB Support EMC Community, EMC Management InsightIQ InsightIQ, vCenter
- 25. © Copyright 2015 EMC Corporation. All rights reserved IsilonSD edge solves Customer Challenges Managing storage at remote locations / branch offices (EDGE) EXPAND DATA LAKE TO THE EDGE 25© Copyright 2015 EMC Corporation. All rights reserved. EDGE CORE CLOUD
- 26. © Copyright 2015 EMC Corporation. All rights reserved Enterprise Customer Challenges Optimizing use of the cloud Leverage Cloud TCO Intelligent integration with cloud Data security concerns Choice of cloud providers Management complexity
- 27. © Copyright 2015 EMC Corporation. All rights reserved© Copyright 2015 EMC Corporation. All rights reserved PLATFORM FEATURES Cloud Enabled Data Lake Simple to deploy and manage Encryption and compression Seamless policy-based data placement KEY BENEFITS Multi-cloud choice of vendors Lower costs and optimize storage resources Extend data center with cloud-scale capacity Secure network transmission to the cloud Transparent to users and applications EMC ISILON CloudPools Capacity $/TB 27© Copyright 2015 EMC Corporation. All rights reserved. High Low HD-Series Deep archive X-Series Throughput NL-Series Archive Cloud Cold archive S-Series Performance
- 28. © Copyright 2015 EMC Corporation. All rights reserved S - Series X - Series NL-Series Isilon CloudPools 3rd Platform cloud Innovation HD-Series FUTURE
- 29. © Copyright 2015 EMC Corporation. All rights reserved DATA CENTER CloudPools SmartPools Policy Example <30 days >30 days S210 NL410 >2 years Cloud 29 EXPAND DATA LAKE TO THE CLOUD 30 days-1 year > 1 year HD400 CLOUD PROVIDER 1 year – 2 years
- 30. © Copyright 2015 EMC Corporation. All rights reserved DATA CENTER 30 CLOUD PROVIDER APPS & USERS Access time CloudPools CLOUD ENABLE DATA LAKE
- 31. © Copyright 2015 EMC Corporation. All rights reserved Cloudpools meets Customer Challenges Optimizing use of the cloud 31 © Copyright 2015 EMC Corporation. All rights reserved. Lower costs and meet performance Seamlessly integrate with cloud Secure data transmission with cloud Flexible choice of cloud providers Eliminate management complexity
- 32. © Copyright 2015 EMC Corporation. All rights reserved Enterprise customer challenges Connecting Edge to Core to Cloud 44% of enterprises have 10 - 50 TB per Branch Office 4 - 10% of Remote servers to support data collection for IoT Massively Scalable Capacity Reduce Cost EDGE CORE CLOUD EXPAND DATA LAKE TO THE EDGE … AND TO THE CLOUD ESG: Remote office / Branch Office technology Trends, May 2015 IDC: “Preparing for the Internet of Things: Assessing the Impact on your data center and edge IT sites”, June 2015 32© Copyright 2015 EMC Corporation. All rights reserved.
- 33. © Copyright 2015 EMC Corporation. All rights reserved© Copyright 2015 EMC Corporation. All rights reserved Si vous avez des questions sur cette présentation, n’hésitez pas à prendre contact directement contact avec : Bertrand OUNANIAN [email protected]