© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Restricted.
OpenStack and Fibre Channel
Walter A. Boring IV
February 4, 2015
© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Restricted.2
According to http://www.openstack.org/software
What is OpenStack?
“OpenStack is a cloud operating system that controls large pools of
compute, storage, and networking resources throughout a datacenter,
all managed through a dashboard that gives administrators control
while empowering their users to provision resources through a web
interface.”
OpenStack: The Open Source Cloud Operating System
© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Restricted.3
Open Development Process
•Time Based release cycles
− New software release every six months, with interim milestones
•Twice Yearly Design Summits
− Immediately following software release to plan next version
− Sessions led by developers and Project Technical Leads
•Broad Contributions
−1000 developers, from over 50 companies worldwide
•Elected Leadership
−Developers elect their own Project Technical Leaders
© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Restricted.4
OpenStack Goals
•Open platform
− Community driven
− Technology accessible in many ways: hourly via source, linux distributions,
appliances, DIY
•Empower users and developers
− Deep engagement from users and developers
− Users have more control of their own destiny
•Broad, global support from companies
− Not driven by a single company; no single source
− Aggregate investment is huge
© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Restricted.5
OpenStack Capabilities
Core Technologies
Compute
(Nova)
Provision and manage large pools of on-demand computing resources
Object Storage
(Swift)
Petabyes of reliable storage on standard gear
Block Storage
(Cinder)
Volumes on commodity storage gear, and drivers for more advanced systems
like HP, IBM, EMC, Red Hat/Gluster, Ceph/RBD, NetApp, SolidFire, and Nexenta
Networking
(Neutron)
Software defined networking automation with plugable backends
Dashboard
(Horizon)
Self-service, role-based web interface for users and administrators
Shared Services
(keystone, glance)
Multi-tenant authentication system that ties to existing roles (e.g. LDAP), Image
service
© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Restricted.6
Cloud computing fabric controller, the main part of an IaaS system.
OpenStack Compute (Nova)
Components of Nova
●
Rest API
●
Exposes the provisioning capabilities of Nova
●
Scheduler
●
Determines what Nova compute node to send provisioning requests
●
Compute Manager
●
Handles the provisioning requests from the scheduler and sends requests to libvirt
●
Libvirt Volume
●
Manages the discovery and removal of volumes for VMs
© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Restricted.7
Provide Software Defined Block Storage via abstraction and automation on top of various traditional
backend block storage devices.
OpenStack Block Storage (Cinder)
Components of Cinder
●
Rest API
●
Exposes the provisioning capabilities of Cinder
●
Scheduler
●
Determines what Cinder back-end to send provisioning requests
●
Volume Manager
●
Handles the provisioning requests from the scheduler and sends requests to volume
driver
●
Backup
●
Provides ability to backup and restore cinder volumes to external services (Swift, Glance)
© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Restricted.8
State of Fibre Channel today
Fibre Channel in OpenStack
History of Fibre Channel
●
Fibre Channel support was added by HP in the Grizzly release cycle (04/2013)
●
First component was adding support in Nova's libvirt volume library
●
Second component was adding Fibre Channel components in Cinder
●
Base Fibre Channel driver class
●
First Fibre Channel volume driver HP 3PAR
●
Fibre Channel Zone Manager was added in the Icehouse release cycle (04/2014)
●
The Zone Manager was co-designed by Brocade, HP with contributions from IBM, EMC,
Cisco
●
Provides lookup service
●
Zone creation / removal
© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Restricted.9
Automated Fibre Channel zoning
Fibre Channel Zone Manager
Components of the Zone Manager today
●
Lookup Service
●
Lookup service provides a way of asking the FC switches what initiator and targets can see each other.
●
This is needed to help the cinder drivers determine what ports on the array to export volumes.
●
Zoning
●
Create zone(s) on the defined fabrics so volumes can be attached to the compute hosts
●
Remove zone(s) when the last volume on the compute host has been detached.
●
Drivers
●
Currently 2 drivers are support to talk to vendor switches
●
Brocade
●
Cisco
© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Restricted.10
High level Architecture
VM
cinder-api
cinder-client
backup scheduler volume
REST
SQL
DB
/dev/vda
KVM
Storage Controller
CinderNova
iSCSI
initiator
Legend
Persistent volume control
Persistent volume data
AMPQ
REST/SSH to FC Switch(s)
VM
/dev/vda
HBA(s)
WWNs
…
iSCSI
target
WWNs
target
FCZM
© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Restricted.11
High level FC Zone Manager Architecture
Zone Manager
Legend
Control path
Lookup Service
Brocade plugin
Lookup service Driver Zone Driver
SSH Client
© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Restricted.12
Fibre Channel enhancements
What is in process for the current OpenStack Release?
●
Brocade zone manager driver friendly zone names
– https://review.openstack.org/#/c/144384
●
Brocade zone manager driver virtual fabrics
– https://review.openstack.org/#/c/144389/
Future work?
●
Add support for QoS settings
●
Add ability to fetch capabilities/statistics for scheduling
●
Libvirt needs NPIV support
© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Restricted.13
Useful links related to this course
• http://www.openstack.org
• http://docs.openstack.org/
• http://www.openstack.org/software/juno/
• http://docs.openstack.org/admin-guide-cloud/content/
• http://docs.openstack.org/juno/config-
reference/content/fibrechannel.html
• https://bugs.launchpad.net/cinder
• https://bugs.launchpad.net/nova
© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Restricted.14
Q & A

OpenStack State of Fibre Channel

  • 1.
    © Copyright 2015Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Restricted. OpenStack and Fibre Channel Walter A. Boring IV February 4, 2015
  • 2.
    © Copyright 2015Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Restricted.2 According to http://www.openstack.org/software What is OpenStack? “OpenStack is a cloud operating system that controls large pools of compute, storage, and networking resources throughout a datacenter, all managed through a dashboard that gives administrators control while empowering their users to provision resources through a web interface.” OpenStack: The Open Source Cloud Operating System
  • 3.
    © Copyright 2015Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Restricted.3 Open Development Process •Time Based release cycles − New software release every six months, with interim milestones •Twice Yearly Design Summits − Immediately following software release to plan next version − Sessions led by developers and Project Technical Leads •Broad Contributions −1000 developers, from over 50 companies worldwide •Elected Leadership −Developers elect their own Project Technical Leaders
  • 4.
    © Copyright 2015Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Restricted.4 OpenStack Goals •Open platform − Community driven − Technology accessible in many ways: hourly via source, linux distributions, appliances, DIY •Empower users and developers − Deep engagement from users and developers − Users have more control of their own destiny •Broad, global support from companies − Not driven by a single company; no single source − Aggregate investment is huge
  • 5.
    © Copyright 2015Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Restricted.5 OpenStack Capabilities Core Technologies Compute (Nova) Provision and manage large pools of on-demand computing resources Object Storage (Swift) Petabyes of reliable storage on standard gear Block Storage (Cinder) Volumes on commodity storage gear, and drivers for more advanced systems like HP, IBM, EMC, Red Hat/Gluster, Ceph/RBD, NetApp, SolidFire, and Nexenta Networking (Neutron) Software defined networking automation with plugable backends Dashboard (Horizon) Self-service, role-based web interface for users and administrators Shared Services (keystone, glance) Multi-tenant authentication system that ties to existing roles (e.g. LDAP), Image service
  • 6.
    © Copyright 2015Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Restricted.6 Cloud computing fabric controller, the main part of an IaaS system. OpenStack Compute (Nova) Components of Nova ● Rest API ● Exposes the provisioning capabilities of Nova ● Scheduler ● Determines what Nova compute node to send provisioning requests ● Compute Manager ● Handles the provisioning requests from the scheduler and sends requests to libvirt ● Libvirt Volume ● Manages the discovery and removal of volumes for VMs
  • 7.
    © Copyright 2015Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Restricted.7 Provide Software Defined Block Storage via abstraction and automation on top of various traditional backend block storage devices. OpenStack Block Storage (Cinder) Components of Cinder ● Rest API ● Exposes the provisioning capabilities of Cinder ● Scheduler ● Determines what Cinder back-end to send provisioning requests ● Volume Manager ● Handles the provisioning requests from the scheduler and sends requests to volume driver ● Backup ● Provides ability to backup and restore cinder volumes to external services (Swift, Glance)
  • 8.
    © Copyright 2015Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Restricted.8 State of Fibre Channel today Fibre Channel in OpenStack History of Fibre Channel ● Fibre Channel support was added by HP in the Grizzly release cycle (04/2013) ● First component was adding support in Nova's libvirt volume library ● Second component was adding Fibre Channel components in Cinder ● Base Fibre Channel driver class ● First Fibre Channel volume driver HP 3PAR ● Fibre Channel Zone Manager was added in the Icehouse release cycle (04/2014) ● The Zone Manager was co-designed by Brocade, HP with contributions from IBM, EMC, Cisco ● Provides lookup service ● Zone creation / removal
  • 9.
    © Copyright 2015Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Restricted.9 Automated Fibre Channel zoning Fibre Channel Zone Manager Components of the Zone Manager today ● Lookup Service ● Lookup service provides a way of asking the FC switches what initiator and targets can see each other. ● This is needed to help the cinder drivers determine what ports on the array to export volumes. ● Zoning ● Create zone(s) on the defined fabrics so volumes can be attached to the compute hosts ● Remove zone(s) when the last volume on the compute host has been detached. ● Drivers ● Currently 2 drivers are support to talk to vendor switches ● Brocade ● Cisco
  • 10.
    © Copyright 2015Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Restricted.10 High level Architecture VM cinder-api cinder-client backup scheduler volume REST SQL DB /dev/vda KVM Storage Controller CinderNova iSCSI initiator Legend Persistent volume control Persistent volume data AMPQ REST/SSH to FC Switch(s) VM /dev/vda HBA(s) WWNs … iSCSI target WWNs target FCZM
  • 11.
    © Copyright 2015Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Restricted.11 High level FC Zone Manager Architecture Zone Manager Legend Control path Lookup Service Brocade plugin Lookup service Driver Zone Driver SSH Client
  • 12.
    © Copyright 2015Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Restricted.12 Fibre Channel enhancements What is in process for the current OpenStack Release? ● Brocade zone manager driver friendly zone names – https://review.openstack.org/#/c/144384 ● Brocade zone manager driver virtual fabrics – https://review.openstack.org/#/c/144389/ Future work? ● Add support for QoS settings ● Add ability to fetch capabilities/statistics for scheduling ● Libvirt needs NPIV support
  • 13.
    © Copyright 2015Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Restricted.13 Useful links related to this course • http://www.openstack.org • http://docs.openstack.org/ • http://www.openstack.org/software/juno/ • http://docs.openstack.org/admin-guide-cloud/content/ • http://docs.openstack.org/juno/config- reference/content/fibrechannel.html • https://bugs.launchpad.net/cinder • https://bugs.launchpad.net/nova
  • 14.
    © Copyright 2015Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Restricted.14 Q & A