IBM Spectrum Fusion HCI
A simple to deploy hyperconverged Red Hat OpenShift and hybrid cloud data platform
Nguyen Minh Duc
Storage Technical Sales
IBM Vietnam
[email protected] AGENDA
1 Infrastructure Modernization with Containers
2 IBM Spectrum Fusion – an “OpenShift HCI”
AGENDA
1 Infrastructure Modernization with Containers
2 IBM Spectrum Fusion – an “OpenShift HCI”
Containers are the Enabling Technology
74%
Business acceleration
of organization use
containers today*
Developer productivity
* Source: ESG Research Report: Data Storage Trends March 2020
Infrastructure cost efficiency
Regulatory, Compliance & Security Ubiquitous Adoption
Strategic optionality Solutions
OPENSHIFT Tanzu
Platforms Red Hat
Collaboration
Developers IT Operations Foundation
Infrastructure
© 2020 IBM Corporation
Virtual Machines versus Containers
Step 1: Understanding the differences
Virtual Machines Containers
App Modernization
Microservices
Hypervisor Containers C1, C2, C3…
Hardware Operating System
Kernel
Hardware
IBM Storage / © 2021 IBM Corporation
Virtual Machines versus Containers
Step 2: Understanding isolation
Virtual Machines Containers
App Modernization
Microservices
Hypervisor Containers C1, C2, C3…
Hardware Operating System
VM1, VM2, VM3… Kernel
Server Hardware
IBM Storage / © 2021 IBM Corporation
Virtual Machines versus Containers
Step 3: Resources
Virtual Machines Containers
App Modernization
Microservices
Hypervisor Containers C1, C2, C3…
Hardware OS
Namespaces
VM1, VM2, VM3… Kernel
Cgroups
Server Hardware
IBM Storage / © 2021 IBM Corporation
Virtual Machines versus Containers
Step 4: Portability flexibility
Virtual Machines Containers
App Modernization
Microservices
Hypervisor Containers C1, C2, C3…
Hardware OS
Namespaces
VM1, VM2, VM3… Kernel
Cgroups
Server Hardware
IBM Storage / © 2021 IBM Corporation
Virtual Machines versus Containers
A changing world
Virtual Machines Containers
App Modernization
Microservices
Type 1
Hypervisor Containers C1, C2, C3…
Type 2
Hardware OS
Namespaces
VM1, VM2, VM3… Kernel
Cgroups
Server Hardware
IBM Storage / © 2021 IBM Corporation
Summing up the differences between VMs and Containers
Virtual Machines
Containers are lighter weight and For data portability
deliver enhanced business benefits:
• Reduced overhead
• Rapid spin up
• Container Isolation and Security
Containers
• Portability
For data portability
• Cost
There are great advantages to use
containers in DevOps, Batch computing,
Lightweight PaaS and Microservices
IBM Storage / © 2021 IBM Corporation
Container History Lesson
Slide Title Goes Here
1982 2000 2005 2006 2007 2008 Today
Unix/chroot OpenVZ AIX Wpars
BSD Parallels IBM
FreeBSD
jails/Solaris
zones Cgroups/Process LXC
Containers
IBM/Google
IBM Cloud Kubernetes Service | ©2018 IBM Corporation
Container Orchestration
Allows users to define how to coordinate the
containers in the cloud when the multi-container
packaged application is deployed.
• Scheduling
• Cluster management
• Service discovery
• Provisioning
• Monitoring
•
IBM Storage / © 2021 IBM Corporation
Configuration management
Pioneering
Red Hat Named a Leader by Independent
Research Firm in Multicloud Container
Development Platforms Evaluation
Report states: “Red Hat-IBM offers the leading
platform for developers and operators”.
“OpenShift is the most widely deployed multicloud container
platform and boasts powerful development and unified
operations experiences across many public and on-premises
platforms.
Red Hat pioneered the ‘operator’ model for infrastructure
and application management and provides a rich partner
ecosystem and popular marketplace.
Red Hat and IBM aim to make ‘build once, deploy anywhere’
a reality; both companies’ deep commitment to Kubernetes-
powered modernization has paid off, moving OpenShift
further ahead of the market since Forrester’s last evaluation.”
13
Red Hat OpenShift is IBM’s hybrid cloud platform
Software from IBM IBM and third-party
and partner ecosystem products and solutions
for specific use cases
and industries
Unify and simplify
software experiences IBM Cloud Paks
with seamless integration
of related capabilities
14
Enable software to run Hybrid cloud platform
anywhere, on any cloud.
Edge
IBM Cloud / Date / © 2021 IBM Corporation
IBM Cloud / © 2021 IBM Corporation
AGENDA
1 Infrastructure Modernization with Containers
2 IBM Spectrum Fusion – an “OpenShift HCI”
Focus moves from container data to application data
Container focus 2016 - Present Application focus
Container-enabled Storage Container-native Storage Data Services APIs
Brings existing storage Integration improves Application-aware storage
into OpenShift efficiency and availability (container native) improves
environments security, resiliency and
governance
Data Services APIs
Containerized Storage
CSI Drivers
IBM Storage / © 2021 IBM Corporation
An application focus requires a new layer for the data
DevOps Layer 3 – Application Runtime Management
A storage services
layer to connect
Layer 2 – Storage Services
DevOps to the
Storage Admin
Storage Admin
Layer 1 – Storage Platform
Applications services to accelerate delivery of data
Capacity and Performance Discovery and
Data Resilience
Management Orchestration
Unified protection across traditional, Monitor performance and capacity Always-on data identification for
virtualize, cloud and container and with predictive analytics makes optimization and fast searching
environments real time adjustments enables rapid discovery
HA/DR Security/Encryption Migration
Policy based and application Enterprise security that is centrally Clone entire application
aware to maintain an always on maintained for global data and environments and access remote
access to data access data from multiple clusters
IBM Storage / © 2021 IBM Corporation
There are 3 ways to enable application-aware storage management
Mode 1: Build storage-awareness Mode 2: Build application-awareness Mode 3: Users specify application-
in Layer 3 in Layer 2 metadata to Layer 2
L3 – App Runtime Mgmt L3 – App Runtime Mgmt L3 – App Runtime Mgmt
Storage Awareness
Orchestrates Queries for app
App Metadata App Metadata App Metadata
storages services metadata
L2 – Storage Services L2 – Storage Services L2 – Storage Services
App Awareness
Implements storage Implements storage Implements storage
services with L1 primitives services with L1 primitives services with L1 primitives
L1 – Storage Underlay L1 – Storage Underlay L1 – Storage Underlay
✓ Most integrated, single-UI experience ✓ Most approachable for storage ✓ Most flexible and extensible
for users administrators; easiest on-ramp for architecture
✓ Allows flexibility in storage choices non-DevOps teams ✓ Very portable across container
✓ Portable across container platforms (if platforms
supported by vendor)
x Not portable across container platforms x App support and container platform x Least integration between runtime
support may lag state of art management and storage management
x Typically limited storage choices
IBM Storage / April 16, 2021 / © 2021 IBM Corporation 19
Dell/VMWare is extending the vSphere incumbency to containers while other storage
vendors are building container native storage stacks
Dell/VMWare (mode 1) Pure Storage (mode 3) NetApp (mode 2)
Multiple container orchestrators Multiple container orchestrators
Layer 3 vSphere/Tanzu
STORK CRDs “intelligent discovery”
Heptio Velero PX-Autopilot PX-Migrate
Layer 2 … Astra
VASA PX-Backup PX-DR
Layer 1 vSAN PX-Encrypt PX-Store Trident
• $550M acquisition of Heptio • $370M acquisition of Portworx • Project Trident started in 2016 to
• VMWare is establishing an end-to-end • Currently has the broadest catalog of provide CSI compliant storage
platform for container storage container storage services orchestration
management • Extends base CSI capabilities with a • Project Astra announced in April 2020
number of CRDs (custom resource to extend Trident and provide
definitions) application-aware storage services
“You can use whatever storage as
“You can use whatever container platform as long as
long as you are running
you are using [Portworx/NetApp] for Storage”
vSphere/VASA on Tanzu”
IBM Storage / April 16, 2021 / © 2021 IBM Corporation 20
Built on a Red Hat OpenShift data foundation
Layer 3 – Application RedHat OpenShift
Runtime Management
Capacity &
Data Discovery &
Layer 2 – Storage Services Resilience
Performance
Orchestration
HA/DR Security Migration
Management
Global High
Simultaneous Archive to Immutability
access and performance Optimized for
multi-protocol Tape or and
Layer 1 – Storage Platform enterprise access storage Cloud
AI use cases
encryption
ready caching
IBM Storage / © 2021 IBM Corporation
IBM Spectrum Fusion
A software defined hybrid cloud container-native data platform for Red Hat OpenShift
Red Hat OpenShift
Storage Services
based on IBM Spectrum software
IBM Spectrum Fusion
Storage Platform
based on IBM Spectrum Scale
Infrastructure IBM Public AWS Azure Google Edge Private Systems
Cloud Cloud
IBM Storage / © 2021 IBM Corporation
IBM Spectrum Fusion HCI
Design to meet the enterprise demands for OpenShift deployment
Fully tested
Faster compute,
persistent network and
Capacity and
storage storage. Single
Performance
deployment support contact
Management
for OCP
Access to the
Disaster existing data
Recovery on NFS, S3
solution storage
Data Global data
Protection with sharing &
a proven access for
backup IOT/Analytics
Data security Hybrid multi
solution
with cloud
encryption and deployment
immutability with IBM
Cloud Satellite
IBM Storage / © 2021 IBM Corporation
IBM Spectrum Fusion: OpenShift Projects / Namespaces
Licensed Software with Spectrum Fusion includes:
• Spectrum Scale ECE
• Spectrum Protect Plus
• HCI Management Software
HCI Management
Project Project A Project B Project C
Spectrum
Scale ECE
HCI
Management
Client OCP
Workloads
Client OCP
Workloads
Client OCP
Workloads …
OCP OCP OCP
CSI CNSS Virtualization Virtualization Virtualization
OpenShift Container Platform (Bare Metal)
Build and run cloud-native applications
IBM Spectrum Fusion
Highly available infrastructure
Compute, Storage and Network
IBM Spectrum Fusion HCI
Compute scalability
6 nodes to 20 nodes
(increment of 2)
Max 20 nodes
10 * 7.68TB NVMe flash
drives (in pairs) per node
One pair 2U GPU enhanced
nodes with AMD CPUs and
3x NVIDIA A100 GPUs
Min 6 nodes One pair 1U Global data
2 * 7.68TB NVMe flash access nodes
drives (in pairs) per node
Customize with GPU/AI
Storage scalability
2-10 7.68TB NVMe flash
or Global data access
drives (in pairs) per node nodes (optional)
IBM Storage / © 2021 IBM Corporation
Spectrum Fusion HCI example
Base configuration includes:
• 42U rack
• 2x Ethernet high-speed switches
• 2x Ethernet management switches
• 6x Storage/Compute servers with 2 NVMe drives/server
Options available:
• Additional storage/compute servers to a maximum of 20 (minus any GPU
servers)
• A pair of 2U GPU servers, each with 3x NVIDIA A100 GPUs
• Increased storage by adding drives to storage/compute servers
• 7.68TB NVMe PCIe Gen4 drives/server to a maximum of 10
drives/server
• AFM (Active File Manager) delivered as a pair of servers
Spectrum Fusion HCI meets challenges with operationalizing
enterprise applications
Backup and Restore
Spectrum Fusion • Data mobility and recovery
Data Disaster Recovery
• Maintain business continuity
Spectrum Application Mobility
Fusion
• Move applications between clusters
Hybrid Data Gravity
AI and ML
Cloud
• Intelligent data services to eliminate ad-
hoc data management and copies
Deploy OpenShift private cloud
Spectrum Fusion • That is simple to maintain and scale
HCI
Migrate, backup, and restore applications for business continuity
Red Hat
Advanced Cluster Manager
Migrate workloads App App
from one location to another OpenShift OpenShift
without duplicating data
Spectrum Fusion Spectrum Fusion
Data
(location A) (location B)
Backup and restore App Snapshot Restore App
S3 bucket
workloads
Data Data
OpenShift OpenShift
Clone environments
for global collaboration Spectrum Fusion Spectrum Fusion
(location A) (location B)
28
IBM Spectrum Fusion: Backups with Spectrum Protect Plus
• Application-Level Backup with granular container level snapshots
• OpenShift and control plane backup preconfigured during install s IBM Spectrum Fusion
System #2
Compute Restore
Spectrum Scale (ECE)
Compute
Containerized
External Backup Spectrum Protect Plus
OpenShift
(Target) vSnap server
Compute
Management
Spectrum Protect Plus
Control
Server container
Supported Target
HCI
Storage by SPP
Control
Local Backup
Control (via snapshot)
Install SPP OADP operator Tape
Install IBM Spectrum Protect Plus Operator + Helm based SPP agent
FlashSystem
IBM Spectrum Fusion FlashSystem
System #1 Supports local recovery for
containers
Eliminate data copies Intelligently cache data in Fusion HCI for use by containers
and lower cost of data • Preserve existing investments
• Simplify administrative data management
• Learn more
Applications
OpenShift Enterprise data infrastructure
On-premises
Spectrum Fusion
NFS Data Sources
Data • Dell-EMC
Applications • NetApp
OpenShift
Edge Cloud Object Stores
Spectrum Fusion
• AWS S3
• IBM Cloud Object Storage
S3 bucket
ROADMAP
Applications IBM
• ESS
OpenShift
Public cloud • Spectrum Scale
Spectrum Fusion • Tape
IBM Storage / © 2021 IBM Corporation
Ingest and process data at the edge
Data A AI applications
Data A Data B
Stream live to ESS 3200 or OpenShift
cloud for large scale AI
Data B IBM Spectrum Scale
(location B)
AI applications
EDGE
A100 GPUs
DGX A100 with ESS 3200
Data A
Process data with NVIDIA
A100 GPUs
Data X
Data A
Data A
Send data to cloud or directly
to an NVIDIA DGX A100 Data B Data B
(Core)
IBM Storage / © 2021 IBM Corporation
IBM Spectrum Fusion HCI
Red Hat OpenShift made simple
Simple to Simple to build Simple to
manage Simple to integrate Simple to deploy
and run apps manage data
infrastructure
• Integrated HCI appliance for both containers and VMs using Red Hat OpenShift
• Highly scalable containerized file system with global data mesh
• Data resilience for local and remote backup and recovery
• Simple installation and maintenance of hardware and software
• Global data access stretching from public clouds to any on-prem or edge locations
• IBM Cloud Satellite and Red Hat ACM native integration
• Ready for AI applications with optional NVIDIA A100 GPUs and global data for better AI
• Starts small with 6 servers and scales up to 20 (with HPC GPU enhanced options)
IBM Storage / © 2021 IBM Corporation
The Simple Equation for Faster AI & Business Results
Fast track your data to hybrid cloud
Faster AI business
results
IBM
+ Spectrum =
Fusion Faster and easier
path to hybrid cloud
33
