New Generation of Storage Tiering
0 likes•3,150 views
This document provides a summary of new storage tiering technologies that can improve performance, reduce costs, and manage risk. Key points discussed include using automated movement of data between storage tiers based on activity level and age, reducing costs by placing data on the most cost-effective tier, and managing risk through technologies like data replication and encryption. The document highlights IBM's Easy Tier software that automatically moves data within an array to optimize use of faster solid-state drives.
New Generation of Storage Tiering
- 1. New Generation of Storage Tiering: Less management, lower investment and increased performance Tony Pearson – IBM Master Inventor and Senior Managing Consultant March 2013 © 2013 IBM Corporation
- 2. Today’s Challenges, Tomorrow’s Opportunities IMPROVE SERVICE Not only ensuring high availability and quality of existing services, but also meeting customer expectations for real-time, dynamic access to innovative new services. REDUCE COST Not just containing operational cost and complexity, but achieving breakthrough productivity gains Deliver the right through virtualization, optimization, energy stewardship, and flexible information, sourcing. to the right people, at the right time … MANAGE RISK Not only addressing today’s security, and compliance challenges, but also … with an IT infrastructure preparing for the new risks posed by in a dynamically changing an even more connected and collaborative world. environment 2 © 2013 IBM Corporation
- 3. Four Fundamental Truths – A Basis for Storage Tiering 100 Machine data Email 80 EMR Database Data Value Surveillance Video 60 40 20 0 1w 2w 3w 4w 3m 6m 9m 1 yr 2 yr 5 yr 10 yr Age of Data All data is not created equal IT resources should be allocated according to the value of data Information changes in business value and in service level Information must be managed requirements over time throughout its entire lifespan … data outlives media 3 © 2013 IBM Corporation
- 4. Storage Tiers – A trade-off between performance and cost Technologies allow us to Server place and move data to the appropriate storage tier to Faster balance between Performance Cache and performance and cost Solid-State Drives Hard Disk Drives Tape Lower Cost Cloud 4 © 2013 IBM Corporation
- 5. Automated Sub-LUN Tiering within a Storage Array Problem: SSDs are considerably more expensive than traditional disks Without optimization tools, clients have been over-provisioning them Administrators spend too much time monitoring, reporting, and tuning tiers Solution: Three data relocation functions that enable smart data Solid-State Drives placement to optimize SSD deployments with minimal costs Enterprise HDD 15K and 10K rpm – Sub-LUN Automatic Movement – Entire-LUN Manual Relocation Nearline HDD – Re-balancing Intra-Tier Extent 7200 rpm Pool 5 © 2013 IBM Corporation
- 6. IBM Easy Tier® Extent Pools can have mixed media 1. Solid-State Drives (SSD) 2. Enterprise HDD (15K and 10K RPM) 3. Nearline HDD (7200 RPM) SSD RAID Array(s) Easy Tier measures and manages activity – 24 hour learning period – Every five minutes: up to 8 extents moved • Hottest Extents moved up to SSD • Coldest Extents moved down to slowest Enterprise HDD Disk – New allocations placed initially on fastest HDD A small amount of SSD (as little as 3%) can dramatically reduce response times and increase IOPS throughput Nearline HDD Storage Tier Advisory Tool can estimate benefits of adding SSD before purchase! 6 © 2013 IBM Corporation
- 7. IBM Easy Tier Application Transaction Improvement No change to the database 240% from or application Original brokerage No work to transaction identify active indexes No manual Application Transactions movement of files or volumes Just turn it on Easy Tier In Action and let it Easy Tier work! Learning 7 7 © 2013 IBM Corporation
- 8. IBM Easy Tier® Cooperative Server Caching To avoid performance bottlenecks over the SAN, IBM Easy Tier® will be extended to support server-based Flash Server Server • Most active data will be moved from SAN disk system to server SSD • Global cache statistics maintained in the Disk array • Applications can provide “hints” IBM Edge 2012 Demonstration showed POWER7 server with EXP30 SSD and SSD DS8800 Easy Tier, resulting in 5x performance boost for Filenet ECM Ent HDD IBM has acquired Texas Memory Systems, and plans to offer Easy Tier NL support for PCiE Flash cards as well HDD Announcement : http://www-01.ibm.com/common/ssi/cgi- bin/ssialias?subtype=ca&infotype=an&appname=iSource&supplier=877&letternum=ENUS ZG12-0163 8 © 2013 IBM Corporation
- 9. IBM SmartCloud Virtual Storage Center (VSC) Problem: Solution: High-end disk arrays are SmartCloud VSC can manage up to 256 expensive arrays (IBM and non-IBM) per SmartCloud VSC cluster Difficult to identify which data should be moved Storage Analytics Engine recommends up-tier and down-tier moves based on Manually re-locating LUNs performance and age of the data is manual and disruptive Move LUNs non-disruptively within and across arrays SSD Ent SSD HDD Ent HDD NL HDD SAN NL NL HDD HDD 9 © 2013 IBM Corporation
- 10. Hierarchical Storage Management (HSM) Problem: Disk faces challenges for density and has slowed to 20% Tape will continue to grow in Density at an average 40% CAGR Cost difference – Disk is 20x more expensive than Tape Hard Solution: Disk Drives Migrate or archive data from disk to tape based on age and anticipate access pattern Tape Automatically recall data back to disk when accessed by user or application 10 © 2013 IBM Corporation
- 11. Blended Disk and Tape Storage Solutions Reduced Costs, Increased Utilizing Tape Drastically Reduces TCO Flexibility 10 year TCO example. Assumes 250TB storage, 25% growth/yr Lower costs primarily from: $7 – Lower cost of media $6,365,950 Floor space – Minimal need for Power & Power & Cooling Cooling Maintenance Prod + DR Carts Increased flexibility from ability to: Millions Hardware $3.5 – Add capacity by simply adding Tape cartridges $2,255,346 – Expand Tape libraries over $946,405 and around existing equipment in the data center $0 Reliability: lower bit-error-rates, NL/SATA Tape Blended Disk Disk read verifications after writes. and Tape * TCO estimates based on IBM internal studies. 11 © 2013 IBM Corporation
- 12. Automate Data Placement and Migration File creation Optional TSM/HSM Server & Virtual or 30 days Physical Tape Pool Initial placement Enterprise 180 days SAS NL-SAS SONAS Storwize V7000 Unified 12 © 2013 IBM Corporation
- 13. Linear Tape File System (LTFS) Treat tape cartridges like USB memory sticks! Contents Tape LTFS Library Edition Device Directory, for the LTO5 tape Attach Host to Tape using a standard file System LTFS Single Drive Edition 13 © 2013 IBM Corporation
- 14. Hybrid Cloud Storage and the IBM Active Cloud Engine™ Problem: Solutions: Remote offices need A Cloud Storage Gateway can provide high access to corporate data performance access to most recently accessed data Corporate HQ needs access to Remote office – IBM SmartCloud Enterprise Object data Storage Data access across WAN can be slow or difficult to find IBM Active Cloud Engine provides a global namespace of all your files across all of your locations Hard Disk – Hub-and-Spoke design allows a central Drives HQ location (Hub) to work with up to 1000 remote offices (Spokes) Cloud 14 © 2013 IBM Corporation
- 15. The Ideal “Hybrid Storage Cloud” Highly scalable Variety of host attachment Cloud protocols Storage NFS, CIFS, Gateway iSCSI, FCoE • OxygenCloud • Nirvanix CloudNAS® Choices for different Cloud • TwinStrata (iSCSI) services • Panzura File System providers, and/or other data center locations 15 © 2013 IBM Corporation
- 16. Active Cloud Engine™ -- Hub and Spoke Design Central Datacenter Hub or Cloud SONAS Spoke-1 Read-access to SONAS some filesets Read-write access to filesets owned by this location Fileset owned by the Central Hub 1 Each Spoke can have a read-only cache copy Spoke-2 Periodic prefetch or On-Demand Pull. SONAS 2 Fileset owned at Spoke-1 (read/write) Updates are sent to the Central Hub Read-only cache copies available to other Spokes. 16 © 2013 IBM Corporation
- 17. The Shifting Roles of Storage Solid-State Primary Data Drives (SSD) Combined with Disk replication slower SATA and Virtual Backup Data disk to reduce Tape Libraries energy costs Physical tape, Long-term Space over 15K RPM Improved by combined with Management and drives low cost SATA, automation Data Retention compression, “Flash & Stash” deduplication Linear Tape Work Task File System Project Folder (LTFS) 17 © 2013 IBM Corporation
- 18. 18 © 2013 IBM Corporation
- 19. Tony Pearson 9000 S. Rita Road Bldg 9032 Room 1238 About the Speaker Master Inventor, Tucson, AZ 85744 Senior Managing Consultant Mr. Tony Pearson +1 520-799-4309 (Office) Master Inventor, IBM System Storage™ [email protected] Senior Managing Consultant IBM System Storage Tony Pearson is a Master Inventor and Senior managing consultant for the IBM System Storage™ product line. Tony joined IBM Corporation in 1986 in Tucson, Arizona, USA, and has lived there ever since. In his current role, Tony presents briefings on storage topics covering the entire System Storage product line, Tivoli storage software products, and topics related to Cloud Computing. He interacts with clients, speaks at conferences and events, and leads client workshops to help clients with strategic planning for IBM’s integrated set of storage management software, hardware, and virtualization products. Tony writes the “Inside System Storage” blog, which is read by hundreds of clients, IBM sales reps and IBM Business Partners every week. This blog was rated one of the top 10 blogs for the IT storage industry by “Networking World” magazine, and #1 most read IBM blog on IBM’s developerWorks. The blog has been published in series of books, Inside System Storage: Volume I through V. Over the past years, Tony has worked in development, marketing and customer care positions for various storage hardware and software products. Tony has a Bachelor of Science degree in Software Engineering, and a Master of Science degree in Electrical Engineering, both from the University of Arizona. Tony holds 19 IBM patents for inventions on storage hardware and software products. 19 © 2013 IBM Corporation
- 20. Additional Resources Email: [email protected] Twitter: http://twitter.com/az99Øtony Blog: http://ibm.co/brAeZØ Books: http://www.lulu.com/spotlight/99Ø_tony IBM Expert Network: http://www.slideshare.net/az99Øtony 20 © 2013 IBM Corporation
- 21. Trademarks and disclaimers Adobe, the Adobe logo, PostScript, and the PostScript logo are either registered trademarks or trademarks of Adobe Systems Incorporated in the United States, and/or other countries. IT Infrastructure Library is a registered trademark of the Central Computer and Telecommunications Agency which is now part of the Office of Government Commerce. Intel, Intel logo, Intel Inside, Intel Inside logo, Intel Centrino, Intel Centrino logo, Celeron, Intel Xeon, Intel SpeedStep, Itanium, and Pentium are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries. Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both. Microsoft, Windows, Windows NT, and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries, or both. ITIL is a registered trademark, and a registered community trademark of the Office of Government Commerce, and is registered in the U.S. Patent and Trademark Office. UNIX is a registered trademark of The Open Group in the United States and other countries. Java and all Java-based trademarks and logos are trademarks or registered trademarks of Oracle and/or its affiliates. Cell Broadband Engine is a trademark of Sony Computer Entertainment, Inc. in the United States, other countries, or both and is used under license therefrom. Linear Tape-Open, LTO, the LTO Logo, Ultrium, and the Ultrium logo are trademarks of HP, IBM Corp. and Quantum in the U.S. and other countries. Other product and service names might be trademarks of IBM or other companies. Information is provided "AS IS" without warranty of any kind. The customer examples described are presented as illustrations of how those customers have used IBM products and the results they may have achieved. Actual environmental costs and performance characteristics may vary by customer. Information concerning non-IBM products was obtained from a supplier of these products, published announcement material, or other publicly available sources and does not constitute an endorsement of such products by IBM. Sources for non-IBM list prices and performance numbers are taken from publicly available information, including vendor announcements and vendor worldwide homepages. IBM has not tested these products and cannot confirm the accuracy of performance, capability, or any other claims related to non-IBM products. Questions on the capability of non-IBM products should be addressed to the supplier of those products. All statements regarding IBM future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only. Some information addresses anticipated future capabilities. Such information is not intended as a definitive statement of a commitment to specific levels of performance, function or delivery schedules with respect to any future products. Such commitments are only made in IBM product announcements. The information is presented here to communicate IBM's current investment and development activities as a good faith effort to help with our customers' future planning. Performance is based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput or performance that any user will experience will vary depending upon considerations such as the amount of multiprogramming in the user's job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve throughput or performance improvements equivalent to the ratios stated here. Prices are suggested U.S. list prices and are subject to change without notice. Starting price may not include a hard drive, operating system or other features. Contact your IBM representative or Business Partner for the most current pricing in your geography. Photographs shown may be engineering prototypes. Changes may be incorporated in production models. © IBM Corporation 2013. All rights reserved. References in this document to IBM products or services do not imply that IBM intends to make them available in every country. Trademarks of International Business Machines Corporation in the United States, other countries, or both can be found on the World Wide Web at http://www.ibm.com/legal/copytrade.shtml. ZSP03490-USEN-00 21 © 2013 IBM Corporation