Huawei Symantec Oceanspace N8000 clustered NAS Overview

Oceanspace N8000 Clustered NAS Storage Solution Storage Solution Department 2009.10

Agenda Introduction Analysis of traditional NAS Overview of N8000 Features of N8000 Scenarios of N8000 Cases

Introduction The rapid development of unstructured data applications is necessitating products that can provide services for sharing data effectively. 1900 $M 1976 PB Huawei Symantec launches the N8000 Clustered NAS System to overcome the limitations of traditional NAS architectures in terms of performance, reliability, extensibility, and cost. 2006 322 PB 2010 Growth of the amount of unstructured data Revenues on the global market of data sharing Digital entertainment Internet Oil exploration Medical research Other fields 2008 20 $M 2012

Single control mode Single point failures. Traditional NAS (1): low availability CIFS NFS IP Dual control mode Active-standby. Services are interrupted during the switchover. Change of links take a long time. Switchover CIFS NFS Unix users Windows users CIFS NFS Windows users Unix users IP

Traditional NAS (2): l ow p erformance and e xtensibility Low extensibility The expansion of capacity is limited. The performance can not be scaled. Close coupling of the storage management system and the host ports The service performance is further restricted. Low performance Fixed single/dual head architecture. The configuration of individual set of devices is fixed. The performance can be enhanced only by adding multiple sets of devices. The multiple sets of devices, however, cannot share storage resources and several copies of backup data is required. Thus, the data consistency cannot be ensured. Head JBOD Traditional NAS

Traditional NAS (3): Failure in Sharing Data Between the Active and Standby Controllers Single head failure Service outage. When a normal head takes over the memory of a faulty head, the switchover costs a long time. IP IP No failure Low usage of head resources. Heads access their own memory. Free heads cannot share loads for busy heads.

Traditional NAS (4): No Support for Hierarchical Storage All the data is stored as the first-level storage, imposing great financial pressure upon enterprises. The cost for protecting the data is increasing. The yearly growth rate of the requirement for storing data resources by enterprises is 70%. The amount of files is soaring, doubling itself every 12 to 18 months. 2/8 principle: mixed distribution of frequently-accessed data and rarely-accessed data. Large amount of rarely-accessed files makes the retrieval rate gradually low. Rapid growth of data Mixed distribution of data resources High IT cost

Traditional NAS (5): complex backing up network Traditional NAS equipment Service hosts Production network Tape/disk network Backup Backup server The service host is used as the backup client. Backing up networks is complex . High usage of resources when backing up the data. Backup data flow

N8000 Clustered NAS System Multiple value-added functions DST dynamic hierarchical storage Integration of the NBU client to implement the server-free backup Snapshot Multi-dimensional and flexible expansion Capacity Performance File system High reliability Active-active mode Automatic failover and failback Protocol support NFS V2/V3 CIFS Install/Upgrade CIFS/NFS Client NAS Engines Storage Units IP FC Add/Delete N8000 Clustered NAS System

Introduction of N8000 Oceanspace N8300 clustered NAS storage system Oceanspace N8500 clustered NAS storage system SAS, FC,SATA Disk type 15PB 7.68PB Max. capacity RAID 0, 1,10, 5, 6 RAID 2*4Gb per NAS engine Interface of FC Active-Active Clustering mode 8/16GB per NAS engine Cache 4/6 per NAS engine 2-6 N8300 Interface of network 4-16 Num of NAS engine N8500 Item

Specifications N8000 ISM GUI, Command Line Interface(CLI) Management interfaces NAS management Dynamic storage tiering 、 Snapshot 、 Mirror 、 Clustered Veritas NetBackup Client Standard Features RAID controller management System management yes NDMP support Support Clustered symantec netbackup client for SAN and LAN Connectivity Backup type Backup attributes Automated Parallel RAID Striping and Multi-Pathing RAID striping Simultaneous CIFS and NFS Multi-protocol support 256TB Maximum file system size File system attributes FC, iSCSI, CIFS, NFS, NDMP, Network protocol support SSH, SNMP,NIS, DNS, NTP,Email Alerts Management protocols Protocols supported N8500 N8300 Item Up to 200 million Maximum files per system

Unified storage NAS FC SAN N8000 Cluster NAS File servers Database servers Application servers Applicable to requirements that requires lots of bandwidth IP SAN File-level access Block-level access iSCSI FC NFS/CIFS

Active-Active mode Services are not interrupted when one or multiple heads fail. Heads can fail back automatically after recovering from failures. Fully redundancy design All the components are designed redundantly to facilitate online change. Data protection scheme Cache synchronization scheme Data safe technology Global lock management scheme allows all heads of the cluster to modify various parts of the same file. High availability IP Windows user Unix user N8000 Cluster NAS CIFS NFS

Extensibility Extending performance smoothly online Adding more heads smoothly and quickly online. Enhancing performance linearly. Enhancing the performance of individual heads by upgrading the hardware configuration. Extending the capacity of backend storage Extending the storage capacity online Adding more storage arrays online (the capacity is extended from the TB level to the PB level). Configuring the host port flexibly Every head can provide 2–8 GE service ports. IP Network Windows user Unix user CIFS NFS N8000 Cluster NAS

All data sharing for multiple NAS engines The memory is shared by all heads Concurrent access to the hot spot data is shared by multiple heads The resources of heads are fully used. The head failure is transparent to services Automatic failover Uninterrupted services N8000 Cluster NAS IP Service host Hot spot data Application server active services

Flexible configuration of backend disk types Support for multiple disk types Large capacity and low cost – 500GB/750GB/1TB SATA disks High performance and reliability – 146GB/300GB/450GB FC disks Low cost and high performance – 146GB/300GB/450GB SAS disks Support for the mixed networking with disks of multiple types Disks of different types can be configured for the same system. The hierarchical storage is supported. FC SAS SATA N8000 Storage Units FC Storage Space

Dynamic tiering storage (DST) Data that is rarely accessed Primary storage FC Secondary storage SATA N8000 memory The hot spot data is accessed from the high performance storage to enhance the system performance. Data that is rarely accessed is moved to inexpensive disks by screening files according to the policy. Moved data can be accessed from the inexpensive storage and is transparent to applications. Memory on the high performance storage can be further used.

Support for intra-array volume mirrors Support for multiple mirrors User data is written to multiple sets of arrays for storage at the same time. Adding or deleting mirrors dynamically Change the number of mirrors to meet service requirements. Services are ensured to run online unceasingly when a set of arrays fails. FC Cluster heads Backend storage FC/SATA Array 1 FC/SATA Array 2 Service host IP network N8000 Cluster NAS Mirror N8000 Clustered NAS System

Efficient backup solution Tape/disk Service network N8000 Clustered NAS System /NBU Client NBU backup server Service host 1 Service host 2 Service host 3 Service host 4 Backing up networks is simple. The backup strategy can be easily set up. Backing up networks is independent from service hosts, simplifying the backup process. Supporting the server-free backup without occupying any host resources. Backup data flow

SnapShot Accelerate backup of file system Seconds to create backup copy Simple, easy to use Exact copy of online production data Can be used by other servers for read / write use Offers multiple recovery points Up to 512 snapshots can be established against a single source file system Benefits PiT backup image Data mining / analysis Rapid restore of files Application development and test Production Data Production Data Tuesday 6:00 p.m. Production Data Monday 6:00 p.m. SnapShot: Create a point-in-time (PiT) copies of business data

Convenient management interface Centralized management RAID management NAS sharing Dynamic storage tiering SnapShot schedule Management and Maintenance System monitor Support E-Mail 、 SNMP 、 Syslog warning

(1) Unified s torage a pplication : scenario Current Condition Multiple service types. Storage is generally based on the DAS architecture New services are emerging. Explosive growth of data. Increasing capacity expansion and upgrade of the system. Requirement : Storage Integration High performance data storage. Key services are stored through FC fiber-optic channels to protect the storage performance. Non-key services are stored through the NAS and IP-SAN architectures that can be deployed easily.

(1) Unified storage application: solution To integrate storage based on the different requirements that services have on the performance Bandwidth intensive applications To protect the service performance through the storage network of FC fiber-optic channels. Non-key services and data sharing services To reduce the construction cost and deployment cost through the IP-SAN and NAS ports. To store all service data to the N8000 uniformly Support for the dynamic expansion of 2-16 engine nodes and the linear expansion of performance To protect the investment of users. High throughput To meet the performance requirements of all service hosts. A maximum usable storage capacity of 15PB To meet the storage requirements of next ten years. To reduce the management cost of users Service LAN IP FC IP IP FC FC IP IP IP IP IP IP IP IP IP IP IP IP Manager IP Data center FC IP IP IP N8000 FC-SAN IP-SAN NAS

(2) Centralized backup of remote data:s cenario Current Condition All production centers are located independently from each other. All production centers are based on different storage networks, including SAN, NAS, DAS. Some production centers have set up backup systems with backup software from different vendors. Requirement The data of all production centers is backed up to the disaster backup center uniformly. Unit N Unit 3 Unit 2 IP IP IP IP Backup server LEGATO IP Backup server BackupEXEC IP FC FC FC FC IP IP IP IP Backup server CommVault Unit 1 IP-SAN NAS FC-SAN

(2) Centralized backup of remote data: solution Deployment effects The high reliability of the N8000 ensure the security of data. The existing backup networking architecture is not changed. All units set up their own backup policies. The high performance of the N8000 ensures that the bandwidth is enough for the networking. The performance in backing up data by multiple sub-units is not restricted. A maximum storage capacity of 15PB is provided to meet the requirements of disaster backup. Manager IP N8000 Disaster backup center IP IP Unit N Unit 1 Unit 2 Unit N Unit 3 Unit 2 IP IP IP IP Backup server LEGATO IP Backup server BackupEXEC IP IP-SAN FC FC FC FC-SAN FC IP IP IP IP Backup server CommVault Unit 1 IP Backup server BackupEXEC NAS IP Network

(3) Storage of high performance computing:scenario Current Condition Bottleneck in the performance of the disk I/O for high performance computers Single NAS storage array cannot meet the performance requirement of large numbers of computing nodes. The CPU usage by computing nodes is 30%–50% Low reliability of the traditional NAS storage array The traditional NAS storage array controller works in Active-Standby mode, and thus the computing is interrupted when any one controller fails. Requirement NAS storage solution with super high performance Extensible performance NAS storage equipment with high reliability The computing is not affected when a storage controller fails.

(3) Storage of high performance computing: solution High performance Support for 2–16 Engine nodes. Overall performance grows linearly as the number of nodes increases. High reliability All storage nodes work in Active-Active mode, and thus the computing is not affected when a single node fails. Support for the automatic failback without affecting the computing. File sharing The NFS- or CIFS-based network sharing protocol allows all computing nodes to share the same file. IP Manager IP IP IP N8000 Computing center IP IP IP IP IP IP IP IP IP IP IP IP IP IP IP IP IP IP IP IP IP Gigabit IP Network Computing nodes

(4) Hierarchical s torage : scenario Current Condition Increasing cost of the storage equipment The data amount of enterprises is soaring by 30% –50% yearly. Enterprises are scaling the capacity of storage arrays. Decreasing service performance Large amount of data is stored on single storage volumes, costing increasing time in retrieving data. Requirement Optimizing the primary storage data to enhance the service performance To move the rarely-accessed data to inexpensive storage arrays. Sustainable usability of the data The service host is able to access the moved data anytime. Service LAN IP IP IP IP IP IP IP IP IP IP IP IP IP IP IP NAS Storage array Data center IP IP IP IP IP Network Online storage

(4) Hierarchical storage: solution Upgrading the storage I/O performance of service hosts To store hot spot data in the primary storage array that has high performance. To migrate rarely-accessed or unused data to the inexpensive storage array. The host is able to access data in the secondary storage array without migrating the data back to the primary storage array. Readiness in operation The hierarchical storage is based on the information life cycle management policy (ILM). The data is migrated automatically and dynamically without human interference . Millions of files can be migrated. Service LAN IP FC IP IP FC FC IP IP IP IP IP IP IP IP IP IP IP Data center FC N8000 FC FC FC FC IP Primary storage Secondary storage FC-SAN NAS

(5) Intra-array volume mirror: scenario Requirement of the NAS Storage Array All service hosts, based on the CIFS and NFS protocol, can access the shared files. Requirements of high availability services To ensure that the host can access the storage arrays 24 hours every day around the year. To protect the data locally without using backup software. To store the data to two or more storage arrays simultaneously. The NAS storage array controller works in Active-Active mode and has no single point failure. The service is not interrupted when one storage array fails.

(5) Intra-array volume mirror: solution To ensure the service reliability continuously To provide two–sixteen clustered NAS engine nodes to ensure that services are not interrupted when the single point failure occurs. The full redundancy design of the storage arrays. The redundancy deployment of the storage arrays ensures that services are not interrupted when a single array fails. Service LAN IP FC IP IP FC FC IP IP IP IP IP IP IP IP IP IP IP Data center FC N8000 FC Storage array 1 Mirror volume 1 Mirror volume 2 Mirror volume 3 Storage array 2 FC FC FC IP FC-SAN NAS

(6) Efficient b ackup : scenario Current Condition The production center and the disaster backup center are connected through an IP network. Low bandwidth for the network 2Mbps – 5Mbps Large amount of data More than 1TB Requirement Requiring the high performance FC-SAN and the NAS architecture that supports the file sharing over the network. Backing data of the production center to a remote backup center. No backup software is installed on the service host. The backup process occupies no CPU resource of the service host.

(6) Efficient b ackup solution The backup process does not affect the performance of the service host The coupling of the N8000 and the NetBackup helps to transfer data to the disaster backup center without occupying any storage transfer network. To scale down the backup window Flexible backup policy: The daily incremental backup and monthly aggregate backup greatly reduce the usage of the backup network. To reduce the cost of users and to simplify the deployment No backup client is installed on the host. Service LAN IP FC IP IP FC FC IP IP IP IP IP IP IP IP IP IP IP Data center FC N8000 FC IP IP Disaster backup center FC/IP storage array /Virtual tape library (VTL) /Physical tape library Symantec Netbackup IP IP Manager IP IP FC-SAN NAS WAN

(7) Extension of storage performance: scenario Current Condition Large amount of services for enterprises Services hosts, distributed in different geographical locations, are connected through the IP network. Service types are increasing and the amount of service access is soaring. Multiple storage devices are managed on central basis. Requirement: The performance and capacity of storage devices can be scaled. To expand the I/O performance of individual storage devices linearly by adding more components. To expand the storage capacity from the TB level to the PB level.

(7) Extension of storage performance: solution To meet the performance requirement of increasing services The online expansion of a maximum sixteen clustered NAS engine nodes is supported. The overall performance is scaled linearly along with the expansion of nodes. To meet the capacity requirement of increasing data The online expansion of storage capacity for service hosts is supported. More storage arrays can be added online. A maximum of 64 storage arrays is supported. A maximum of 15PB storage capacity is supported. Data center N8000 Service LAN IP IP IP IP IP IP IP IP IP IP NAS FC FC FC FC FC FC IP IP IP IP FC FC IP IP IP IP IP IP IP IP IP IP

(8) Net-Disk services: scenario Current Condition Many servers in Enterprise / SMB No backup system, servers backup data on local disk Expensive for purchasing a set of backup system Requirement Backup important data in all servers No backup client installed in business servers Improve the security of files, any server can not read/write the data of others server

(8) Net-Disk services: solution Solution overview N8000 is added in Active Directory or NIS domain N8000 allocate Net-Disks for every server The servers backup the data to net disks termly by script or other method Solution benefits Easy use for backing up the important data Using for data backup just like local disk Reduce the TCO No need for a expensive backup system High data throughput The throughput of more than 1GB, can meet the performance needs of many servers’ data backup Scalable performance and capacity N8000 providing increased perormance and capacity on demand dir-1 dir-2 dir-3 dir-4 share dir N8000

(9) Optimize VMware Infrastructure with N8000 : scenario Requirement Enterprise or SMB need virtual server for lot’s of servers consolidation, and saving cost and simplifying Deploying all business server rapidly No single failure in the storage system

(9) Optimize VMware Infrastructure with N8000 : solution Solution overview The N8000 has connectivity with VMware through standard NAS protocols (NFS) Snapshot of N8000 provides a new virtual machine(VM) in seconds Solution benefits Deploy the business servers raplidly Every VM sharing the same operation system data, reducing the storage capacity of VM Efficient VM protection Dynamic storage tiering, migrate the VM from FC and SATA disk by file access frequency strategy Native NDMP backup Simple management Can deploy the same kind of VM in a directory (such as web application) N8000 File System N8000 OS App OS App OS App OS App OS App OS App OS App OS App OS x86 Architecture VMware ESX Server x86 Architecture VMware ESX Server

Case1: High-Performance Storage System on China Mobile Music Platform Requirements High reliability All components are redundant to eliminate single point failure and are designed with fault handling mechanism. Two sets of storage systems work in mirroring mode. In the case of a fault, the business system can fast switch over to the backup storage system. High performance: Provide the actual read performance above 1 GB/s. Data sharing: Music files are shared on multiple service hosts. Provide a large file system equal to or more than 50 TB to ease the data management and the invocation of service hosts. Huawei Symantec solution Configure two sets of N8500 cluster storage systems. Implement the data mirroring and improve the storage reliability. Each N8500 storage system is configured with four NAS servers and 60 TB storage capacity. available Allocate a 50 TB file system. Digital music platform Wireless

High-Performance Storage System on China Mobile Music Platform Central Music Platform Province Branch HuaSy N8000 Cluster NAS Media Server Mirror High reliability NAS servers are in Active-Active mode, without single point failure Configure two sets of N8500 storage systems to implement the data mirroring and ensure the service sustainability. High performance A maximum of 1 GB/s throughput to meet the user requirements for storage performance. Configure 50 TB file system Reduce the complexity of file deployment Advantages Province Branch Province Branch WAN IP Network

Case 2: Mass File Storage System on Taobao Background Taobao is the largest network retailer in the Asia-Pacific region and is founded in 2003 by Alibaba Group. By the end of 2008, Taobao had over 98 million registered members covering most of online procurement crowd in China. The trading volume in 2008 amounted to 99.96 billion yuan, accounting for 80% market share of China's online shopping market. Requirements Provide non-structural file mass data storage for Taobao trade platform. Data sharing: Over 500 servers can access the network sharing storage space. The storage system is highly reliable, flexible, and scalable, and can reduce the pressure of boosting data. High-speed data backup, decrease the backup windows. Huawei Symantec solution Adopt the cluster NAS N8500 storage solution. Configure two sets of N8500 cluster storage systems to meet the storage requirements for high reliability, performance, and scalability. Each N8500 storage system is configured with 12 cluster NAS servers. In total, 1496 TB storage capacity is configured. Through the NBU backup software built-in the N8500, the backup efficiency is improved.

Mass File Storage System on Taobao Equipment Room-A Equipment Room-B 4×4Gb FC HuaSy N8500 Cluster NAS NBU Master server SUN SL500 Physical Tape Library HuaSy N8500 Cluster NAS Backup data stream WAN IP Network IP Network

Mass File Storage System on Taobao High reliability The NAS servers adopt the Active-Active mode to eliminate single point failure and ensure the stable operation of user business systems. High performance The measured performance of each N8500 is over 3 GB/s, meeting the storage throughput of multiple business servers of the user. High scalability The maximum storage capacity of single N8500 is up to 960 TB, meeting the data growth of Taobao in 5 years. Effective data backup system Build in NBU Media backup media software on four NAS servers of the N8500 to implement the parallel data backup. Compared with the traditional NDMP protocol backup mode, the backup efficiency is increased nearly 4 times. Advantages

Case 3: Cluster Storage System of Virtual Community of Shanghai Shengda Network Requirements 80 servers with each loading five virtual servers. Each virtual server stores 30 GB files. Files of virtual servers can be saved in the NAS storage system. Feature high reliability, flexibility, and scalability. Can fast deploy files on virtual servers. Easy to manage, reduce the management cost. Huawei Symantec solution Adopt the Clustered storage system N8300. Configure five N8300 NAS servers. Configure the NAS network sharing interface protocol and 12 TB available storage capacity. Arrange 80 servers in five groups. Each NAS server is configured with four Gigabit Ethernet interfaces, which are accessed in one group of servers through the redundant path in network convergence mode to implement the performance balancing.

Cluster Storage System of Virtual Community of Shanghai Shanda Network App App OS OS ESX Server NAS server Storage unit IP Switch IP Switch IP Switch Community servers Group 1 Group 2 Group 3 Group 4 Group 5 HS N8300 Cluster NAS GE GE×2 GE×2 High reliability: no single point failure Faults on any NAS server do not affect services, thus ensuring the 7x24 sustainable operation. Storage performance: scalable Expand the storage performance by adding NAS servers or back-end storage arrays. Reducing management cost Work closely with the ActiveDirectory, reduce the complexity of the authority management. Fast deployment Batch clone files of virtual servers through the N8300. Able to clone files of a virtual server in 3 m. VM VM Files of virtual server VM VM VM VM Advantages

Case 4: New Media Storage Project of CCTV Background Since 2006, CCTV had began to build new media services based on the existing TV programs to provide brand-new interactive programs to computer, TV and mobile phone users through the Internet, cable TV, wireless transmission networks, broadband networks, and mobile networks . Requirements Adopt one high-performance NAS storage device for synthesis, transcoding, and distribution services. Excellent performance: Provide stable, fast, and simple data storage, search, sharing, and access services for multiple workstations, and increase the data switching speed. Sustainable access services: The storage system ensures 7x24 uninterrupted services. Data sharing: Multiple workstations can edit media in one file system at the same time. Stable I/O performance: Ensure that frame loss does not occur during the media data processing. Huawei Symantec solution Adopt the cluster NAS N8300 storage solution to meet the requirements for high reliability, performance, and scalability. Configure two NAS servers, CIF, NAS network sharing interface protocol, and 48 TB storage capacity.

New Media Storage Project of CCTV High reliability Active-Active working mode. Faults on any NAS server do not affect the service operation, thus ensuring the 7x24 sustainable service operation. High performance N8300 cluster storage structure meets the storage performance requirements of various media production services. High scalability Storage performance can be scaled with NAS servers. The maximum storage capacity can be scaled to 7PB. Stable performance Stable I/O performance ensures zero frame loss during the media production. Database server Data migration server Recording workstation Convergence workstation Editing workstation Application management workstation Transcoding workstation N8300 Clustered NAS Media Production Platform Advantages IP Network

Case 5: Clustered Storage System on Digital Campus of Shanghai Ocean University Requirements Ensure the high availability of data, implement the sustainable operation of data services. Clustered data storage and simplified data management improves the application system performance. Key database systems require high I/O performance and low delay. Partial services require information sharing. Implement the effective disk-based Clustered automatic data backup. Huawei Symantec solution Adopt the Clustered storage system N8500. Configure four N8500 NAS servers. Configure FC-SAN, IP-SAN, and NAS storage interfaces, and use 120 TB for online storage and 60 TB for backup storage. Configure snapshot, DTS, Server Free backup client. Work with the Symantec NetBackup to implement the data backup management.

Clustered Storage System on Digital Campus of Shanghai Ocean University The Clustered system provides the FC-SAN, IP-SAN, and NAS at the same time. Clustered storage eases the storage planning and saves user investment. High reliability: The Active-Active mode ensures the 7x24 sustainable operation on campus. High performance: The N8500 cluster storage structure meets the storage performance requirements for various services on campus. Data access frequency-based DTS: The FC disk data are automatically moved to near line SATA disk, thus reducing the user investment. Adopt the advanced snapshot and built-in NBU backup software, thus implementing the effective data backup. Advantages: Backup Server N8500 Unified Storage Linux Windows Unix Linux Windows Unix Linux Windows Unix Backup Media S5500 DR site IP Network FC SAN IP SAN NAS

Huawei Symantec Oceanspace N8000 clustered NAS Overview

More Related Content

What's hot (19)

Viewers also liked (10)

Similar to Huawei Symantec Oceanspace N8000 clustered NAS Overview (20)

Recently uploaded (20)

Huawei Symantec Oceanspace N8000 clustered NAS Overview

Editor's Notes