01 - Storage Basics and Application Environments
01 - Storage Basics and Application Environments
Application Environments
Contents
1. What Is Storage? 4. What Are the Other Basic Storage Concepts?
• Storage Concepts • RAID
• Storage in Data Centers • LUN
• Storage Evolution • Multipathing
• Block Storage • File System
• File Storage • Local File System
• Object Storage • Network File System
2. What Are the Basic Concepts of Storage Hardware (L2)? • CIFS
• Disks (NVMe SCM) • NFS
• Disk Arrays • Storage Performance Indicators
• Controllers 5. What Are the Basic Concepts of Data Protection?
• Controller Enclosures • RPO and RTO
• Disk Enclosures • Backup
• High-Density Enclosures • Disaster Recovery
• I/O Modules and HBAs • Snapshot
3. What Are the Basic Concepts of Storage Protocols? • Remote Replication
• SCSI • Mirroring
• NVMe • Clone
• iSCSI
• Fibre Channel
• SAS
1 Huawei Confidential
What Is Storage?
— Storage Is the Media for Storing and Protecting Data
Storage in a narrow sense Storage in a broad sense
Server
Multipathing
software
Fibre
Channel
switch Fibre
Channel
link
Controller
1. Storage hardware (disk arrays, controllers, disk enclosures, and tape libraries)
Disk array
2. Storage software (management software, snapshot, replication, and multipathing software)
3. Storage networks (HBAs, Fibre Channel switches, as well as Fibre Channel and SAS cables)
4. Storage solutions (centralized storage, archiving, backup, and disaster recovery)
2 Huawei Confidential
Storage Concepts
Storage is to save data to certain storage media in a proper, secure, and effective manner to meet requirements of
different application environments and ensure effective accesses to the data. Specifically:
1. Storage is physical media for temporary or long-term data storage.
2. Storage is a method or behavior for ensuring data integrity and security. Storage combines the two aspects to provide
customers with a data storage solution.
3 Huawei Confidential
Storage in Data Centers
OceanStor 18500 V5
OceanStor or 18800 V5
OceanStor 6800 V5
OceanStor
5000 series V5
Application 2200 V3 or
(mid-range)
2600 V3
Runtime library
Database
OceanStor
Dorado 8000 V6 or OceanStor
Server 9000 100D
18000 V6
Virtualization
Dorado 6000 V6
Server hardware Dorado 5000 V6
Storage
Network
4 Huawei Confidential
Storage Evolution
External disk array (DAS) Smart disk array (DAS)
SAN NAS
Disks in a server Server
CPU Server CPU Application Application
Multiple
server server
application
Server Arm Arm servers
File system File system
CPU
Limitations JBOD logically connects several A controller provides RAID and large-capacity cache, Resolved issues
• Disks become the system performance physical disks to increase capacity. It enables the disk array to have multiple functions, and • Disks become the system performance
bottleneck. does not provide data protection. is equipped with dedicated management software. bottleneck.
• The number of disk slots is limited, • The number of disk slots is limited,
thereby providing limited capacity. Resolved issues Resolved issues thereby providing limited capacity.
• Data is stored on single disks, and data • The number of disk slots is limited, • Disks become the system performance bottleneck. • Data is stored on single disks, and data
storage is less reliable than expected. thereby providing limited capacity. • The number of disk slots is limited, providing a storage is less reliable than expected.
• Storage space utilization is low. • Data is stored on single disks, and small capacity. • Storage space utilization is low.
• Data is scattered in local storage data storage is less reliable than • Data is stored on single disks, and data storage is • Data is scattered in local storage
systems. expected. less reliable than expected. systems.
5 Huawei Confidential
File Storage
NFS or CIFS
File storage
• Advantages: easy management and
interoperability with applications
• Disadvantages: support for expansion but
with many restrictions
• Application scenarios: enterprises' internal
application integration and file sharing
6 Huawei Confidential
Block Storage
Block storage
• Advantages: direct access, minimized
overhead, and highest efficiency
• Disadvantages: highest cost and poor scalability
• Application scenarios: enterprise databases,
such as Oracle
7 Huawei Confidential
Object Storage
HTTP, REST, SOAP, or S3
• Object storage, also known as object-based
storage (OBS), is a network storage
architecture. The difference between OBS
Object
Object Object
Object
and block storage or file storage lies in the
storage Object
interfaces (S3 interfaces) provided by OBS.
Key Data
Object
Object OBS only generates an ID for the metadata
Metadata
Customized
of stored data and stores the ID, regardless
metadata of the data type.
... • This storage architecture is mainly used in
the application scenarios that have low
requirements on performance but high
Object storage requirements on capacity. It is mainly used
• Flat structure and nearly unlimited capacity expansion to meet customers' requirements on large
• More intelligent self-management capacity and low price. The application
• Standard Internet protocols and cross-region transmission scenarios include public cloud, Internet, and
capabilities
• Application scenarios: Internet-oriented storage, archiving,
space leasing.
and backup
8 Huawei Confidential
What Are the Basic Concepts of
Storage Hardware (L2)?
9 Huawei Confidential
Disks
10 Huawei Confidential
SSDs vs. HDDs
SSD HDD
Price High: several yuan (RMB) per GB Low: several jiao (RMB) per GB
11 Huawei Confidential
Disk Types
Media Functions
Desktop level
HDD Disk types Monitoring level
SSD Enterprise level
Desktop-level disks are mainly used for home applications, such as desktop
PCs and laptops. Enterprise-level disks are designed for enterprise
applications, such as servers, disk arrays, and graphics workstations.
Mainstream disk types
HDDs: SATA, NL-SAS, and SAS
SSDs: SATA, SAS, and NVMe
12 Huawei Confidential
Disk Types — Serial ATA (SATA)
Advantages
1. SATA is a serial bus interface protocol. During data transmission, the data and signal cables are used
independently, and the embedded clock frequency signal is used. Its rate can reach 30 times that of
Parallel ATA (PATA).
2. Instead of simple PATA improvement, the bus structure is brand new.
3. Control information is scattered in data and transmitted by using a predefined bit.
4. One path is used to transmit data, and the other is used to return a response.
5. SATA has stronger anti-interference capabilities and higher speeds than PATA. The installation is
easier and the number of cables used in the chassis is reduced.
6. The performance of single-thread tasks is good.
Disadvantages
1. SATA, designed for entry-level applications, is not as powerful as SCSI in terms of big data
throughput or multi-thread transmission.
2. When multiple threads are reading data, the head of a disk swings back and forth, causing the disk to
be overheated.
13 Huawei Confidential
Disk Types — Serial Attached SCSI (SAS)
1. SCSI is a storage interface protocol specially designed for small computer systems. 50-pin ports are
used. The appearance of a 50-pin port is similar to that of a common disk port. The SCSI disks
support connections to various devices. In addition, each SCSI disk has an independent chip for
data processing. The CPU usage is low, the bandwidth can reach 320 MB/s, and the stability is
good.
2. SAS is a disk connection technology that integrates the advantages of the parallel SCSI and serial
connection technologies.
3. SAS is a point-to-point, full-duplex, and dual-port interface.
4. SAS is compatible with SATA, meeting high-performance requirements of enterprises, achieving
interoperability with SATA, and bringing unprecedented flexibility and benefits to enterprises.
5. SAS features high performance, high reliability, and powerful scalability.
The serial technology is also used, which is better than SCSI in transmission rate and anti-interference.
However, the price is higher.
14 Huawei Confidential
Disk Types — Near-Line SAS (NL-SAS)
1. NL-SAS disks integrate SAS interfaces and SATA disks. In other words, NL-SAS disks refer to
SATA disks with SAS interfaces and near-SAS performance.
2. Near-line storage is oriented to applications between online storage and offline storage. Data that
is not frequently used or seldom accessed is stored on the storage devices of which performance
is relatively low. However, these devices must provide fast addressing capabilities and a high
transmission rate.
15 Huawei Confidential
Disk Types — SSDs
SSD hardware structure
6 Gbit/s Multi-channel
SAS port concurrence
DDR
16 Huawei Confidential
Comparison of Mainstream Disk Types
• A disk interface is a component connecting a disk and a host, and is used to transmit data between the disk cache and
host memory.
• Different disk interfaces determine the connection speed between disks and computers, which affects the program
running speed and system performance.
17 Huawei Confidential
Basic Concepts Related to RAID
Redundant Array of Inexpensive Disks or Drives, or Redundant Array of Independent Disks (RAID) is a data storage
virtualization technology that combines multiple physical disk drive components into one or more logical units for the
purposes of data redundancy, performance improvement, or both.
RAID is classified into different RAID levels based on Two different RAID levels can be combined to form a new
the combination methods. RAID level.
18 Huawei Confidential
SCM — Next-Generation Storage Media
Storage Class Memory (SCM) is a new storage medium High-performance SSDs provide the following
popular in the industry. SCM is similar to storage in its application forms in a storage system:
persistence and to memory in its byte-level access. • Metadata cache: As the metadata cache of
an AFA, SCM SSDs work with DRAM to
The SCM SSD, which uses the NVMe block interface build a memory + SCM SSD two-tier cache,
and is compatible with the native architecture, is the which avoids bottlenecks in memory
primary application form of SCM. Optane P4800X series capacity and supports a larger user
launched by Intel is an example. SCM SSDs have a capacity with stable performance.
negligible impact on the system architecture and • Data cache: SCM SSDs serve as the
provides better performance than flash SSDs. In acceleration layer for user data and
addition, SCM SSDs do not require garbage collection, improve performance in typical application
which prevents performance deterioration similar to that scenarios.
of NAND SSD after long-time running, and curbs latency • Main storage: SCM SSDs serve as the
at an appropriate level. This type of storage products is storage layer for user data and provide
springing up in the industry, and Huawei is also working high-performance storage to meet the
on the R&D of relevant products. performance requirements in some
scenarios.
19 Huawei Confidential
Disk Arrays
20 Huawei Confidential
Disk Array Composition
Separation of the controller
enclosure and disk enclosure
+ =
21 Huawei Confidential
Controllers
22 Huawei Confidential
Controller Enclosures
Chassis
Power module
Controller module
BBU
23 Huawei Confidential
Disk Enclosures
3.5-inch disk enclosure
24 x 3.5-inch disks
Support for mainstream SAS
Power modules
2 + 2 redundancy
efficiency
24 Huawei Confidential
High-Density Enclosures
25 Huawei Confidential
I/O Modules and HBAs
• An I/O module connects a storage system to a server or switch for data transmission. It is a field
replaceable unit with several ports.
• HBA is short for Host Bus Adapter. An HBA is a circuit board that provides I/O processing and
physical connections between a server and a storage device.
26 Huawei Confidential
What Are the Basic Concepts of
Storage Protocols?
27 Huawei Confidential
SCSI
28 Huawei Confidential
iSCSI
29 Huawei Confidential
Fibre Channel
30 Huawei Confidential
SAS
31 Huawei Confidential
NVMe
32 Huawei Confidential
What Are the Other Basic
Storage Concepts?
33 Huawei Confidential
RAID
The term RAID was invented by David Patterson, Garth A. Gibson and Randy Katz at the
University of California, Berkeley in 1987. It combines multiple independent physical disks
into a virtual logical disk using related algorithms to provide larger capacity, higher
performance, and better error tolerance capabilities.
RAID 0 RAID 5
RAID 1 RAID 6
RAID 10
RAID 50
RAID DP RAID MP
RAID 1E RAID 5EE
RAID 5E RAID ADG
34 Huawei Confidential
LUN
One or multiple logical volumes can be created for RAID based on the specified capacity.
A logical volume is identified by logical unit number (LUN).
RAID 10 RAID 5
35 Huawei Confidential
Multipathing
36 Huawei Confidential
File System
37 Huawei Confidential
Local File System
Storage silos
38 Huawei Confidential
Network File System
File system client File system client File system client File system client
Network protocol
39 Huawei Confidential
CIFS
40 Huawei Confidential
NFS
41 Huawei Confidential
IOPS
42 Huawei Confidential
OPS
43 Huawei Confidential
Performance Indicators and Evaluation Methods of
Storage Devices
Performance indicators
IOPS is the number of I/Os that can be processed by a storage device per second. It is used to measure the response capability of a
storage device. IOPS is the most important measurement indicator for a large number of small I/Os.
Bandwidth is also called throughput that indicates the total amount of data that can be processed per second. It is used to measure the
storage throughput. Bandwidth is useful for measuring large I/Os, especially for measuring the time required to process a large amount
of data.
Bandwidth = IOPS x Average I/O size
Latency refers to the time consumed for processing I/Os. It is used to measure the processing speed of storage devices. Latency is
classified into host latency and storage latency. The storage latency refers to the period from the time when I/Os arrive at a storage
device to the time when the storage device returns a processing completion message to the host. The host latency is the sum of the
storage latency, link transmission time, and host queuing time. Users focus on the host latency.
IOPS = Number of concurrent requests/Average latency
Performance evaluation
IOPS and bandwidth are the two most important indicators for performance evaluation.
IOPS evaluation focuses on the I/O sequence, cache hit ratio, and IOPS of a single disk. The major bottleneck of the maximum IOPS
of a storage system is the CPU processing capability.
Bandwidth evaluation focuses on the I/O size, bandwidth of a single disk, and storage hardware bandwidth. For the maximum
bandwidth of a storage system, the major bottleneck is the front-end and back-end channel bandwidth and mirroring bandwidth.
44 Huawei Confidential
What Are the Basic Concepts of
Data Protection?
45 Huawei Confidential
Backup
Online application information is extracted to create one or more copies based on certain
policies, and the copies are stored on preset storage media for recovery in case of an online
system fault.
46 Huawei Confidential
Three Elements of a Backup System
RPO
Backup Backup Point in time An error or Recovery Recovery Application
started completed to which data disaster occurs. startup completed recovery
is recovered
12:00
BW + RTO
00:00 = Economic loss
06:00
47 Huawei Confidential
Disaster Recovery
48 Huawei Confidential
Disaster Recovery and Its Tiers
Disaster recovery refers to establishing a systematic data emergency response model in advance by using scientific technical means and
methods to cope with disasters. The content includes data and system backup, business continuity planning, personnel architecture,
communication assurance, crisis management, disaster recovery planning, disaster recovery schemes, business recovery schemes, emergency
response, third-party cooperation organizations, and supply chain crisis management. The disaster recovery levels range from the module level
to system-level and solution-level.
SHARE's seven tiers of disaster recovery released in 1992, were updated in 2012 by IBM as an eight-tier model.
(Generally, data backup is usually applied to tier 1 to tier 4, and data disaster recovery is usually applied to tier 4 to tier 7.)
TCO
Tier 7: highly automated, business-integrated solution
50 Huawei Confidential
Active-Active Storage (HyperMetro)
In the active-active data centers solution, both data centers are running and can carry production
services. The overall service capabilities and system resource usage of the data centers are high.
51 Huawei Confidential
Snapshot (HyperSnap)
a b c a b c Function
Snapshot Snapshot is used for online data backup and
08:00 am d e f d e f
restoration. If an application fault or file
g h i g h i damage occurs on a storage device, data can
j k l j k l be quickly restored to the state at an available
point in time.
Benefits
a b c a b c A data copy that is consistent with the source
d m f file can be quickly obtained without interrupting
09:00 am d e f services. Therefore, the snapshot technique
g h n g h i can be used to solve problems with online
j k l j k l backup, data analysis, and application testing.
52 Huawei Confidential
Mirroring (HyperMirror)
1. Function: Data is stored concurrently in two independent storage areas (typically,
logical volumes) through the same I/O operations.
2. Benefits
• The two mirror volumes are identified by the host or storage array as the same
production volume. Services can be switched between the two volumes to
improve system reliability.
• Concurrent operations on mirror volumes can improve system performance.
I/O
LUN 1 LUN 2
53 Huawei Confidential
Clone (HyperClone)
A clone is a copy or multiple copies of source data at a specific point in time.
A snapshot is similar to a stereotyped shadow at a certain point in time, while a clone is
a stereotyped entity at a certain point in time.
4
2
1 3
Implementation process Primary LUN Secondary LUN Primary LUN Secondary LUN
11 22 33 44
Enable the clone function. After data synchronization After splitting is complete, The secondary LUN can
Start data synchronization. is complete, the primary the primary and secondary be mapped to a host and
and secondary LUNs LUNs become used for data analysis and
maintain the same data. independent of each other. query.
54 Huawei Confidential
Bring digital to every person, home, and organization for
a fully connected, intelligent world.
Thank You portfolio, new technology, etc. There are a number of factors
that could cause actual results and developments to differ
materially from those expressed or implied in the predictive
statements. Therefore, such information is provided for
reference purpose only and constitutes neither an offer nor
an acceptance. Huawei may change the information at any
time without notice.