1、 Copyright Nexenta 2012 OPENSTORAGE WITH OPENSTACK BRAD STONE GM, NEXENTA CHINA 1 Enterprise Storage Storage is 40% of an enterprise ITs budget Market leaders are EMC, IBM and NetApp Enterprise Storage Continues to Grow Storage Trends Commodity components replacing specialized hardware for data stor
2、age Storage virtualization Commoditize by abstracting physical attributes Global economic downturn putting pressure on capital and energy costs Motivation to buy newer, more energy-efficient hardware “More data will be stored in the next three years than in the previous 40,000” - Berkeleys School of
3、 Management (2010) New use cases for data Machine-generated files Video surveillance What is OpenStorage? a) Storage software is open source b) No vendor lock-in; components no longer need to all come from the same vendor c) Open data formats d) All of the above e) Some of the above Top Reasons to u
4、se Open Source Software Avoid vendor lock-in Lower costs Competitive advantage Improve quality Brief Biased History of OpenStorage 1991: Linux kernel publicly announced 2004: Google MapReduce paper 2005: linux-iscsi and open-iscsi projects merge 2005: OpenSolaris released 2008: Nexenta ships first c
5、ommercial product 2008: Sun FISHworks storage appliance released 2010: OpenStack Nova released 2010: OpenStorage Summit features storage software vendors and commodity hardware 2013: OpenStorage Summit in China! NEXENTASTOR: A CASE STUDY FOR OPENSTORAGE What is NexentaStor? iSCSI SAS FC AoE InfiniBa
6、nd CIFS iSCSI NFS FC Software-based, unified storage appliance Leading OpenStorage solution Runs on standard hardware Key features: 128-bit architecture Unlimited file size & snaps Synchronous and asynchronous replication (including replication to OpenStack Swift) Superior storage for virtualized en
7、vironments File and Block Access Nexenta is a private company with an office in Beijing! Storage Pooling 11 Discover logical disks Determine RAID requirements Pool-A Pool-BCreate storage pools Create datasets Assign properties (e.g. de-dup) Share (NFS, CIFS, iSCSI, FC) NFSiSCSI CIFSNFS De-duplicatio
8、n Block-based In-line de-duplication Verify option In-flight de-duplication No verify option Existing data can easily be de-duped via NexentaStors auto-tier capability Flexibility De-duplication options can vary -Per volume -Per dataset -Per replication service Compression Compression done in-line a
9、t time of write Enabled by default Leverages typically idle processing power Can improve overall I/O performance Compresses only if at least 12% benefit Many algorithms supported LZJB for loss-less compression GZIP 0-9 Extensible Compression algorithm can be changed on-the-fly Affects future writes
10、Block support iSCSI and FibreChannel supported SCSI multi-pathing supported for each Storage efficiency Compression Cloning De-duplication Thin provisioning Support for variable block sizes Technical Advantages DescriptionLimit Number of data volumes on a system264 Maximum size of a data volume278 b
11、ytes Number of file systems in a data volume264 Maximum size of a file system264 bytes Number of devices in a data volume264 Number of files in a directory256 Maximum file size264 bytes Number of attributes of a file248 Maximum size of any attribute264 bytes Number of snapshots of a file system264 1
12、5 Self-healing NexentaStor doesnt blindly trust the data Relies on 256-bit checksums on every block Transparently return only the good data to the user Use the good data to fix the bad copy 16 X 0100110101 0110110101 Prevents silent data corruption Self-healing Data checked before it is returned to
13、user Good copy used to fix the bad copy of data Triple-parity RAID Disk capacities doubling, but disk throughput not increasing at same rate Result is longer time to recover from bit errors More likely that you can be recovering from two bit errors at once Data can then be at risk during recovery pe
14、riod NexentaStor provides triple-parity RAID Available with NexentaStor since 2009 VMDC 18 Providing visibility into your VMs storage usage Supports: ESX Xen Server Hyper-V Advantages of VMDC: 1. Provides consistent snapshots 2. Alternative is cumbersome: Take snapshot using VMware Then take snapsho
15、t on NexentaStor 3. Cloning is fast! Supported Storage Protocols: NFS iSCSI Fibre Channel Uses native hypervisor snapshotting functions Healthcare Finance Education Technology Internet Media More A Broad set of Customers and Partners CustomersPremier Partners Cloud Hosting and Telecom 20 in Asia Clo
16、ud services do not require cloud storage OpenStorage Adoption 200920102011201220132014 Universities R&D Hosting, cloud compute, private cloud, virtualization VDI Governments Finance NEXENTA AND OPENSTACK Cloud Storage Use Cases Storage for cloud applications File replication of critical data for dis
17、aster recovery Off-site backup for power and floorspace benefits in the datacenter Geographically dispersed teams that need to write to centralized storage for long-term data access Long-term deep data archives OpenStack Nova OpenStack Open source cloud computing project Started by Rackspace and NAS
18、A Now more than 150 participating companies OpenStack the largest open source cloud community OpenStack Nova targets cloud computing Includes a storage component Nova Orchestrates Volume Provisioning Provisions LUNs Interacts with storage systems Assigns volumes to compute nodes Ensures LUNs are ass
19、igned to at most one VM at a time Currently only iSCSI is supported by OpenStack Nova (not FibreChannel) Simplified Nova Architecture Rabbit MQ Nova Manage Nova API Nova Compute Nova Network Nova Schedule Nova Database Nova Volume NexentaStor Nova driver(s) Volume Controller /etc/nova/nova.conf Nova
20、 and NexentaStor Nova Manage Nova API Nova Database Nova Volume NexentaStor Nova driver(s) Volume Controller /etc/nova/nova.conf 2. Lookup in configuration file to determine which driver to use 3. Driver talks to NexentaStor to create volume 4. NexentaStor creates volume 5. Volume Controller updates
21、 database with volume details 1. Request to create a volume 6. Request to attach volume to a VM Virtual machine NexentaStor cloning can be used to create a new Nova volume from a snapshot Implementation complete and available Initially tested with OpenStack Diablo release Only Netapp and Nexenta have provided Nova storage drivers Wiki posted: http:/wiki.openstack.org/NexentaVolumeDriver Next: Test with Cinder Nexenta Nova Driver Project Status 28 Nexenta Systems Inc. CONFIDENTIAL What is C