Introduction to HPDP
Senthilkumar Muthusamy
Agenda (1)
• Architecture
• Installation
• DP Basics
• Backup Device Preparation
• Logical Devices
• Media Pool Concepts
• Backup
• Enhanced Incremental Backup
• Object Consolidation
• Media Replication and
Management
Agenda (2)
• Restore
• Internal Database
Management
• Monitoring and Reporting
• Event Notification
• Users and Security
• Disaster Recovery
• Troubleshooting
• License Managment
• Manager of Managers
Data Protector Overview And
Architecture
Senthilkumar Muthusamy
What Is a Backup?
A backup is a process that creates a copy of data on backup
media. This copy is stored and kept for future use in case the
original is destroyed or corrupted.
What Is a Restore?
A restore is a process that recreates the original data from
a backup copy. This process consists of the preparation
and actual restore of data, and some post-restore actions
that make that data ready for use.
What is it?
HP Storage Data Protector
• Software that provides automated data Data Protector starter pack
protection for businesses with 24x7 availability -- data protection & media mgmt
needs.
What does it do?
drive and library mgmt
-- scalable device and library mgmt
• Data Protection: copies data onto a secondary
storage device, including disk or tape, so that in on-line backup
-- 24x7 application-aware backup
case of a disaster, data can be easily recovered.
• Media management: easily manages the library zero downtime backup
catalogues to keep track of all media and copies -- disk array integration for zero-impact
of data for fast recovery.
instant recovery
Most important features: -- disk-based recovery
• Automated backups that scale from small
workgroups to multi-site, heterogeneous SAN &
direct backup
-- efficient server-less data movement
NAS environments with hundreds or thousands
of servers. backup to disk
• Fully-integrated Zero-Downtime backup with -- restore from disk and migrate to tape
Instant-Recovery for HP StorageWorks XP and
EVA. media operations
-- removable media management
• High performance backup to disk with object
level replication/migration to tape(s)
It's been the industry’s only application for fully automated, fully integrated zero-downtime backup and instant recovery for over 5 years.
And now HP OpenView Storage Data Protector offers even more!
HP Data Protector 6.0 Highlights
•Backup to disk enhancements
– Synthetic Full
– Incremental Forever
– Space efficient Virtual Full
•Cell Manager for Linux
•Integrations enhancements
– VSS based Exchange ZDB/IR
– MS Data Protection Manager,
– MS SharePoint Portal Server
– Oracle 10g, DataGuard
•Miscellaneous
– Secure Shell support for installation (UX)
– Multiple flexible free pools
– Mail notification with SMTP Server
– Native 64-bit agents (AMD x64, Intel EM64T, IA-64)
Managed Environment
Backup Models
direct-attached backup EVA snapshot backup
management Application Server
application
server
media
disk host
host •SAN
•SCSI
•NDMP Backup Server
tape
network backup XP split-mirror backup
management Application Server
media
host P
disk
host S S S
tape
Backup Server
Backup and Replication Methods
•Possibilities: •Combinations:
– Backup to Virtual Libraries – Disk -> Tape (D2T)
– Advanced Backup to Disk – Disk -> Disk (D2D)
– Backup to File Devices – Disk -> Disk -> (D2D2T)
– Backup Mirroring – Disk -> Disk + Tape (D2D+T)
– Synthetic Full Backup – Disk -> Disk -> Disk + Tape
– Virtual Full Backup – Tape -> Tape
– Media Copy – Tape -> Tapes
– Object Copy – Tapes -> Tape
– Media Consolidation
Split-Mirror Backup Concept (ZDB/IR)
• True online backup for
integrated applications
• Split mirrors may used for
instant recovery or resynced
Application host XP
• No performance impact on
applications during backup
P
• Mirror synchronization before
or after backup
• Automatic mirror rotation
• API based integration
M M M
0 1 2 Backup host
P – primary LDEV
M – mirror copy (MU0-2)
Snapshot Backup Concept (ZDB/IR)
• Similar to split-mirror backups
• Snapshots get created on the fly
VA or are reused
Application host
EVA • Backup host processes the data
P P • Snapshot information is stored in
Instant Recovery database for VA
and EVA
• API/SMI-S provider based
integration
S S
Backup host
P – primary LUN
S – snapshot / snapclone
Hp Openview Building Integration
• OpenView Enterprise Console
• OpenView Operations:
Event and Problem Management
Network, Systems, Application and Database Management
Management
Service Level Management Repository
~200 Openview Partner Solutions
systems network performance application service
management management management management management
• Operations • Network Node • GlancePlus • SMART Plug-Ins: • Internet Services
• Data Protector Manager • Performance • Apps, DBs • Service Desk
• data backup • Customer Views • Reporter • Web/App • Internet Usage
• data recovery • PolicyXpert • Web Transaction Servers Manager
• Storage Area • Internet Services Observer • Mgmt Server • Service Reporter
Manager • Internet Services • Managed Nodes • WebQoS
• Media Operations • Service Info. Portal
Network
Desktop Network Access Servers Databases Applications
Managing Distributed UNIX and Windows Environments, End-to-End
SM Integrations
• HP OM (Operations Manager)
• DP SPI (OM Data protector Smart Plug IN)
• SN (Service Navigator)
• SIP (Service Information Portal)
• DP OVR (Open View Reporter)
Data Protector Architecture
The Data Protector cell is a network environment that has a
Cell Manager, client systems, and devices. The Cell Manager is
the central control point where Data Protector software is
installed. After installing Data Protector software, you can add
systems to be backed up. These systems become Data
Protector client systems that are part of the cell. When Data
Protector backs up files, it saves them to media in backup
devices.
The Data Protector internal database (IDB) keeps track of the
files you back up so that you can browse and easily recover the
entire system or single files.
Cell Concept
• Backup domain
• Logical organization of systems
• Can match your organization
• Heterogeneous system support
• Independent but can be centrally
cell
managed
cell
cell
HPDP CELL
Cell Manager
The Cell Manager is the main system in the cell.
The Cell Manager:
• Manages the cell from a central point
• Contains the IDB
The IDB contains information about backup details such as,
backup durations, media IDs, and sessionIDs
• Runs core Data Protector software
• Runs Session Managers that start and stop backup and
restore sessions and write session information to the IDB
Systems to Be Backed Up
Client systems you want to back up must have the Data
Protector Disk Agent (DA), also called Backup Agent, installed.
To back up online database integrations, install the Application
Agent.
Systems with Backup Devices
Client systems with connected backup devices must have a
Data Protector Media Agent (MA) installed. Such client
systems are also called Drive Servers.
A backup device can be connected to any system and not only
to the Cell Manager.
A Media Agent reads or writes data from or to media in the
device and sends or receives data from the Disk Agent.
Systems with a User Interface
You can manage Data Protector from any system on the network
on which the Data Protector graphical user interface (GUI) is
installed.
You can have the Cell Manager system in a computer room while
managing Data Protector from your desktop system.
Installation Server
The Installation Server holds a repository of the Data Protector
software packages for a specific architecture. The Cell Manager
is by default also an Installation Server.
At least two Installation Servers are needed for mixed
environments: one for UNIX systems and one for Windows
systems.
Operations in the Cell
The Data Protector Cell Manager controls backup and restore
sessions, which perform all the required actions for a backup
or restore, respectively.
What Is a Backup Session?
A backup session is a process that creates a copy of data on
storage media. It is started either interactively by an operator
using the Data Protector user interface, or unattended using
the Data Protector Scheduler.
The Backup Session Manager process starts Media Agent(s)
and Disk Agent(s), controls the session, and stores generated
messages to the IDB.
Data is read by the Disk Agent and sent to a Media Agent,
which saves it to media.
Backup Session
A number of Disk Agents read data from multiple disks in
parallel and send data to one or more Media Agents.
Restore Session
A restore session is a process that restores data from previous
backups to a disk. The restore session is interactively started by
an operator using the Data Protector user interface.
How Does It Work?
After you have selected the files to be restored from a previous
backup, you invoke the actual restore. The Restore Session
Manager process starts the needed Media Agent(s) and Disk
Agent(s), controls the session, and stores messages in the IDB.
Data is read by a Media Agent and sent to the Disk Agent, which
writes it to disks.
Data Protector Architecture
manager of OpenView
distributed Java GUI
managers SPI
GUI
GUI
cell
manager
cell cell
client client
Client-Server Modules
cell console
(CC)
cell manager
(CM)
media agent
(MA) disk agent
(DA)
Cell Manager:
Platform Support, DP 6.0
GUI: Application (Integration) Agents
HP-UX (PA, IA-64) Oracle/Oracle Data Guard
HP-UX (PA, IA-64)
Windows (32-bit) SAP R/3
Windows XP, 2000/2003
Windows (64-bit) SAPDB
Linux
Linux (SLES 9, RHEL4 Informix
Solaris 8
Solaris IBM DB2 UDB
Sybase
Disk Agent: MS SQL Server
HP-UX 11.X MS Exchange Server
HP OpenVMS MS Exchange SMB
HP Tru64 Unix MS VSS
HP MPE/iX MS DPM
Win ME, XP Pro/HE Baan IV on Oracle, Informix
Windows 2000/2003 Lotus Domino
Sun Solaris
IBM AIX Media Agent (with robotic):
Linux Redhat/SuSe/Caldera Windows 2000/2003, XP
Linux United/Debian HP-UX (PA, IA-64)
Novell NetWare HP Tru64
SGI IRIX HP MPE/iX
SCO OpenServer Linux Redhat/SuSE/Debian/United
SCO Unixware Novell NetWare
SNI SINIX Sun Solaris
Additional platforms via NFS / shared disk (CIFS) Media Agent (without robotic):
IBM AIX
All platforms subject to change, see platform support documentation SCO OpenServer
SNI Sinix
Cell Manager
HP-UX, Windows, Linux, Solaris
Cell Manager
Manually installed Cell Console
Daemons
(Services) (user interfaces)
Provides:
CRS
Internal database
Session managers
RDS IDB
MMD
Scheduler
Cell Console and agents
Session Managers
Installation server (optional)
Cell Services (daemons)
Disk, Media and Integration
─ manage services with: Agents
omnisv stop
omnisv start
DA MA DA
omnisv status
Internal Database Size Limits
200GB 1-50 stores • File Versions (10x # of file names)
• 50 directories (containing binary files)
DCBF • 4 GB per directory
• 10,000 files per directory (2GB per file)
1 DCBF by default
32GB • 700 Million File Names Unix (est.)
• 450 Million File Names on Windows (est.)
CDB (32 GB maximum filenames)
2GB by default
• 40,000 Media per pool
20-50MB
• 500,000 Media
MMDB • 1,000,000 Sessions (max 2,000 per day)
• 100 parallel backup sessions (UX, 60 Win)
IDB
Capacity Planning Spreadsheet
Estimate of
IDB
capacity
Describe
environment
Cell Console (User Interface)
HP-UX, Windows, Solaris
Present on all cell managers
Provides:
Graphical user interface
Web reporting java interface
Command-line interface
Full Java interface
May be further distributed from:
Cell manager
Media
No additional license required
Java GUI
Disk Agent
May be installed from:
Install server
Media
Installed once per client
Invoked by session manager
Provides disk access HP-UX
(read/write) Windows 2000/XP/2003
Linux
Tru64
Multi-vendor support OpenVMS
HP MPE/iX
Novell Netware
Exchanges data with media Sun Solaris
agents IBM AIX
SGI IRIX
SCO Openserver
SCO Unixware
Media Agent
HP-UX
May be installed from: Windows/2000/XP/2003
Install server Linux
HP Tru64
Media
HP OpenVMS
Novell Netware
Installed once per client NDMP
Sun Solaris
Invoked by session manager IBM AIX
SNI SINIX
Provides media access SCO OpenServer
Multi-vendor support.
Exchanges data with disk agents
HP VLS 6000 HP MSL
HP SSL
Integration Agent
Database/Application
Integration:
Distributed by install server SAP R/3
SAPDB
Database and application Oracle
integrations Informix
DB2
Sybase
Integrates with vendors MS SQL
API/ backup and restore tools MS Exchange Server
MS Exchange SMB
Invoked by session manager MS VolumeShadowService
MS Data Protection Mgr
Executed during backup and MS Share Point Portal
Other
restore of databases Lotus Notes/Domino
Baan IV Integrations:
Works with disk and media agents
StorageWorks EVA, XP, VA
OpenView
Multi-vendor support ServiceGuard
MS Cluster
EMC
Installation Server
Manually installed
Repository for agent software
Must be registered with cell
manager
HP-UX, Windows, Linux, and Solaris
platforms
Used separately by UNIX/Linux and
Windows clients HP-UX
Distributes the installation load Linux
May be shared by multiple cells Windows
Supports SSH on Unix
Solaris
Typical Data Protector Session
cell manager system
request read/write
crs rds
start
cell console
connect
session IDB
bsm catalog
control/report
tcp/ip 5555 tcp/ip 5555
media agent client disk agent client
data
ma da
read/write read/write
Cell Manager Directory Structure (UX)
<OMNICONFIG> <OMNIVAR> <OMNIHOME>
/etc/opt/omni/server /var/opt/omni/server /opt/omni
options cell db40
doc sbin bin databases
devices rid tmp
java lbin lib newconfig
datalists dr
log
schedules users vendor
install utilns gui
dlgroups integ
man omnirc.tmpl
dltemplates dr
rptgroups amo
rptschedules amoschedules
barlists
barschedules
snmp
sap cc win ma opc sybase
mom
acs oracle oracle8 da das stk informix
Note: these directories contain the installation server components
Cell Manager Directory Tree (Windows)
<OMNIHOME>
C:\Program Files\OmniBack
<OMNIVAR>
<OMNICONFIG>
installation
server
repository
(shared)
Global Options
– Centrally managed
– Product defaults (documented)
– Customizable
– Parsed with each job
<OMNICONFIG>
options
global
Localized Options
• Locally managed
• Agent parameters
• Customizable
<OMNIHOME>
omnirc/.omnirc omnirc.tmpl
copy/modify
Thank You
“The contents of this document are proprietary and confidential to Fore Brain Technologies (P) Ltd. and
may not be disclosed in whole or in part at any time, to any third party without the prior written consent
of Fore Brain Technologies (P) Ltd .”
“© 2011 Fore Brain Technologies (P) Ltd . All rights reserved. Copyright in the whole and any part of this
document belongs to Fore Brain Technologies (P) Ltd . This work may not be used, sold, transferred,
adapted, abridged, copied or reproduced in whole or in part, in any manner or form, or in any media,
without the prior written consent of Fore Brain Technologies (P) Ltd .”