231 Concepts Guide
231 Concepts Guide
1 MU4
Release Notes
3PAR Inc.
4209 Technology Dr.
Fremont, CA 94538 USA
QL226-96005
May 2011
3PAR Confidential
Revision Notice
This is the first release of this document.
Changes
The material in this document is for information only and is subject to change without notice. While reasonable efforts have been
made in the preparation of this document to assure its accuracy, 3PAR Inc. assumes no liability resulting from errors or omissions in
this document or from the use of the information contained herein.
3PAR reserves the right to make changes in the product design without reservation and without notification to its users.
Copyrights
© 2011 3PAR Inc. All rights reserved. No part of this publication may be reproduced, stored in a retrieval system, or transmitted in any
form or by any means, electronic, mechanical, photocopying, recording or otherwise, without the prior written consent of 3PAR Inc.,
4209 Technology Drive, Fremont, CA 94538. By way of exception to the foregoing, the user may print one copy of electronic material
for personal use only.
Trademarks
3PAR, InServ, InForm, InSpire and Serving Information are registered trademarks of 3PAR Inc.
Intel and Pentium are registered trademarks of Intel Corporation.
Linux is a registered trademark of Linus Torvalds.
Microsoft, Windows, and Windows NT are either registered trademarks or trademarks of Microsoft Corporation.
Oracle is a registered trademark of Oracle Corporation.
Sun, Solaris, and Java are trademarks of Sun Microsystems, Inc.
UNIX is a registered trademark of The Open Group.
All other trademarks and registered trademarks are owned by their respective owners.
3PAR Confidential
InForm OS Version 2.3.1 MU4 3PAR InForm OS Release Notes
Table of Contents
1 Introduction
1.1 Audience 1.1
iv Table of Contents
3PAR Confidential
InForm OS Version 2.3.1 MU4 3PAR InForm OS Release Notes
1
Introduction
In this chapter
1.1 Audience 1.1
This document provides the release notes for the 3PAR InForm OS (Operating System) and
Command Line Interface (CLI).
You should read this document prior to installing the 2.3.1 Maintenance Update 4 (MU4)
version of this product.
NOTE: These release notes describe the features and bug fixes included in
InForm OS 2.3.1 MU4. Refer to the appropriate release notes for all prior releases.
1.1 Audience
The information in these release notes is intended for use by 3PAR customers, partners, and
3PAR field representatives.
Introduction 1.1
3PAR Confidential
3PAR InForm OS Release Notes InForm OS Version 2.3.1 MU4
1.2 Organization
This guide is organized as follows:
◆ Chapter 2, 3PAR InForm Operating System Release Notes, provides the InForm
Operating System release notes.
◆ Chapter 3, 3PAR InForm CLI Release Notes, provides the InForm CLI release notes.
Using the InForm Command Line 3PAR InForm OS CLI Administrator’s Manual
Interface (CLI) to configure and and InForm OS Command Line Interface
administer InServ Storage Servers Reference
Using the InForm Management Console 3PAR InForm Management Console Online
graphical user interface to configure and Help
administer InServ Storage Servers
1.2 Organization
3PAR Confidential
InForm OS Version 2.3.1 MU4 3PAR InForm OS Release Notes
2
3PAR InForm Operating
System Release Notes
In this chapter
2.1 Online Upgrade Considerations 2.1
NOTE: Installing this Maintenance Update (MU) will likely disconnect the
management interfaces, thereby ending the CLI and InForm Management
Console (IMC) sessions and possibly generating alerts. This is expected behavior. If
the management interfaces are disconnected, reconnect and start new CLI or IMC
sessions.
3PAR Confidential
InForm OS Version 2.3.1 MU4 3PAR InForm OS Release Notes
If you are licensed for and using the Thin Persistence feature and you are
upgrading from InForm OS 2.3.1 GA to 2.3.1 MU4, you must install 2.3.1 P10
before installing 2.3.1 MU4.
If you are licensed for and using the Thin Persistence feature and you are
upgrading from InForm OS 2.3.1 MU1 to 2.3.1 MU4, you must install 2.3.1 MU1 P9
before installing 2.3.1 MU4.
2.3 Components
Component Version
OS 2.3.1.330 (MU4)
CLI 2.3.1.330
46473 Node goes off-line due When a local host write was terminated with an
to a Remote Copy error while a Remote Copy request was scheduled
request that is not for retransmission, the Remote Copy request was
properly cancelled sometimes not removed from the retransmit queue
from the retransmit before it was canceled. This could result in the
queue following retransmit queue retaining stale entries which
termination of a local could cause controller nodes to go offline at a later
host write operation. stage. The most common situation for a local host
write to be terminated with an error was when a
different controller node would go offline.
3PAR Confidential
InForm OS Version 2.3.1 MU4 3PAR InForm OS Release Notes
49261 Processing of requests Requests that required CIM Server to process large
that require an responses, (e.g., when processing an
extensive response by EnumerateInstances request), could result in a
CIM Server results in a failure condition that caused the process to hang or
process failure. crash.
50428 CIM Server process A response queue function is serialized per request
occasionally fails when by locking a mutex owner based on the
sending a chunked OperationAggregate object for that request.
response. However, if the response enqueued was the last
response, the OperationAggregate object was
deleted within the method. When the AutoMutex
that was created at the beginning of the method
went out of scope, it held onto a mutex that had
previously been deleted.
Capabilities of a DynamicStoragePool.
Dynamic
New instances of fixed TPD_StorageSetting
StoragePool
that are associated to the StorageCapabilities
required for creation
of a DynamicStoragePool have been added so
of a volume from
that a client can use them to create a volume from
Dynamic
that DynamicStoragePool.
StoragePool
in the CIM API.
54726 CMP owner node is The CMP owner node was not properly handling
not properly handling the merging of credit pages when a new credit
the merging of credit dmask overlapped.
pages.
The IO write credit pages merge code path has
been modified, so that when the LDIO flusher
flushes dirty cache pages, it leaves the dirty mask in
the log entry for those credit pages in a consistent
state.
3PAR Confidential
InForm OS Version 2.3.1 MU4 3PAR InForm OS Release Notes
55017 Clearing of older In some cases, older message references were not
message references being cleared properly when cancelling inter-
not handled properly process messages.
when canceling inter-
process messages. Message references are now properly cleared.
56195 SAN boot on Cisco UCS When the firmware in the 2-port 4G fibre channel
M1 Blade Server brings HBA in the E and F Series systems received certain
port down. incorrectly formatted fibre channel frames, the
frame buffers were not released into the free
buffer pool. When a large number of these invalid
frames were received, the port could run out of
buffer credits causing the port to go off-line.
3PAR Confidential
InForm OS Version 2.3.1 MU4 3PAR InForm OS Release Notes
58269 SCSI-3 Persistent In some cases, the InForm OS kernel was incorrectly
Reservation events identifying SCSI-3 Persistent Reservation events
from multiple nodes from different nodes as duplicate events and thus
incorrectly identified omitting some steps in validating and processing
as duplicate events. the events. As a consequence, each node's list of
registered SCSI initiators could be corrupted with
un-initialized values. The resulting inconsistency
triggered an assertion failure on all nodes when an
initiator registration was removed, causing a cluster
failure.
58703 Memory leak occurs The InForm OS Kernel could leak memory when
when processing processing some SCSI commands, as memory
certain SCSI commands buffers dynamically allocated for command
received on LUNs to processing were not being freed on command
which no volumes are completion. This leak affected certain commands
exported. received on LUNs to which no Virtual Volume was
exported. If a sufficiently large number of these
commands were received, available memory could
be exhausted and the controller node would go
off-line.
58766 Host ID not available It was not previously possible to get the Host ID
from from the StorageHardwareIDCollection class.
StorageHardwareID
Collection class in A new property ID has been added to the
the CIM API. TPD_StorageHardwareIDCollection class and
a new association has been implemented between
TPD_AuthorizedPrivilege and
TPD_StorageHardwareIDCollection.
3PAR Confidential
InForm OS Version 2.3.1 MU4 3PAR InForm OS Release Notes
58886 Virtual volume size or In some cases, the size for a virtual volume and
snapspace reclamation snapspace resulting from a reclaim operation were
provided by System not being properly evaluated and processed by the
Manager is not metadata checker.
properly evaluated.
For a virtual volume, if the metadata view of size is
smaller than the actual size, the meta data checker
now fails the volume. Also when checking
snapspace due to a reclaim operation, if the
metadata view cannot account for all the holes, the
meta data checker fails the volume.
59114 Multiple disk drives If the firmware on the 4-port 4G fibre channel HBA
are marked failed (3PAR FC044X) received a fatal error while IO was
after a path goes ongoing to disk drives via the HBA, the firmware
down due to HBA would not respond for several seconds while the
fwcore dumps. transmit and receive lasers were still active. This
could lead to the disk drives becoming
unresponsive for several minutes resulting in the
drives being marked failed by the InServ. If disk
cages were connected to multiple ports of the HBA,
this could result in multiple drives getting marked
failed leading to virtual volumes getting marked
unavailable.
60141 The system goes off When attempting to rebalance the load after a
line when a controller controller node rejoins a cluster, out of resource
node rejoins a cluster conditions could cause the system to go off line.
due to an inefficiency
in rebalancing when Resources are now evaluated prior to initiating the
encountering load rebalancing process after a controller node
insufficient resources. rejoins a cluster.
3PAR Confidential
InForm OS Version 2.3.1 MU4 3PAR InForm OS Release Notes
61315 SCSI-2 reservations on The Logical Unit Reset task management command
addressed LUN not received on 4G fibre channel ports was not properly
properly released by releasing SCSI-2 reservations for addressed LUNs.
Logical Unit Reset Task
Management Handling of the Logical Unit Reset task
command. management function has been modified to ensure
that SCSI-2 reservations on an addressed LUN are
released appropriately.
In some configurations, depending on switch type and InForm OS version, selecting Auto-
negotiation has overcome the problem, while in others, forcing the ports to 100/Full has
provided relief. In all cases, utilizing a 1Gbps switch port has alleviated all negotiation issues.
To resolve this issue, 3PAR requires all Remote Copy IP ports to be connected to a 1Gbps switch
port in order to alleviate the observed connectivity and negotiation related problems.
3PAR Confidential
InForm OS Version 2.3.1 MU4 3PAR InForm OS Release Notes
The resource counts in use on the 4G fibre channel ports as indicated are output to the debug
eventlog every hour. Here is an example that shows that the port has 0x1c7 (455) RPI resources
available.
Workaround - Resetting the InServ fibre channel port using the controlport rst
<n:s:p> command restores all of the resources of the port.
2.7.3 CIM Server Error Passing Maximum Length Virtual Volume Name
(Bug 55445)
The virtual volume buffer in apilib is 1 byte shorter when it should be 32 bytes including 1
byte for the null terminator. A 31 byte long virtual volume name causes cimserver to crash.
Workaround - Use virtual volume names of 30 bytes long or shorter to avoid this problem.
Use the setvv –name <new_name> vvname command to rename a virtual volumes over
31 bytes long.
2.7.4 Physical Copy Issue with Larger Destination Volume Size (Bug 55681)
The PblkRemain field describes how many physical blocks still remain to be copied from the
parent volume during the physical copy process. The number of blocks should always be
positive. This bug occurs when using a larger size destination volume than parent volume. The
value of PblkRemain is calculated using the size of the parent volume rather than the size of
the destination volume.
Workaround - Use parent and destination volumes of the same size when creating
physical copies.
Workaround - None.
■ Dual SD Space - Thin Provisioned virtual volumes can have two Snap Data (SD) volumes in
2.3.1 and 2.3.1 MU2. This is not a supported feature in previous InForm releases. Prior to a
downgrade, dual SD TPVVs must be converted to single SD TPVVs by removing all of the
snapshots for those TPVVs.
■ Raid Multi-Parity (MP) - Raid MP was not supported in InForm OS releases prior to 2.3.1,
therefore any Raid MP Logical Disks (LDs) must be tuned to a supported RAID type or
removed prior to downgrade.
3PAR Confidential
InForm OS Version 2.3.1 MU4 3PAR InForm OS Release Notes
■ 256 Read/Write Snapshots - In InForm OS 2.3.1 and 2.3.1 MU2, the number of read/write
snapshots was increased to 256 per virtual volume. Previous release supported a smaller
maximum number of read/write snapshots per virtual volume. A downgrade will be
prevented if any virtual volume has more read/write snapshots than the maximum
supported on the previous release. When enough snapshots have been removed to meet
this criterion the downgrade is allowed.
■ Multiple Read/Write Snapshots per Read-Only Snapshot - In InForm OS 2.3.1 and 2.3.1
MU2, the creation of multiple read/write snapshots per read-only snapshot is permitted.
Previous releases supported a single read/write snapshot per read-only snapshot. A
downgrade will be prevented if any read-only snapshot has more than one read/write
snapshot. Once enough read/write snapshots have been removed to meet this criteria, the
downgrade is allowed.
■ Synchronous Long Distance Remote Copy - If there are Remote Copy groups
configured with multiple targets, those groups must be removed or reduced to a single
target before a downgrade is allowed.
■ 16 TB Support - Virtual volumes larger than the maximum size supported in a previous
release must be removed before a downgrade is allowed.
■ Multiple Remote Copy Links per Node - InForm OS release 2.3.1 and 2.3.1 MU2 allow
multiple Remote Copy links to be configured on a individual node. Previous releases only
allowed a single link per node. Before downgrading, ensure that additional Remote Copy
links are dismissed to ensure a valid configuration for the downgrade. A check is run prior
to downgrade to validate the existing Remote Copy link configuration.
■ Host Personas - If a system running InForm OS release 2.3.1 MU2 is downgraded, host
persona fields are cleared and the old port persona settings resume effect. However, these
settings are not kept up-to-date nor are they converted back on downgrade, so they will
not reflect any configuration changes made since loading 2.3.1 MU2. On a system which
only ran 2.3.1 MU2, there will be no port persona settings to revert to.
Prior to the downgrade, a check is run to ensure the system can run in the downgraded
state. If host persona specific configurations are detected, a message is issued. This
condition will need to be resolved before the downgrade is permitted. One example of this
would be different host persona settings sharing a port which can not be supported via
port personas.
Workaround:
Remote Copy can support the mixture of Recovery Manager snapshots and Remote Copy
snapshots (outside of Recovery Manager) if the following procedure is followed:
5) Recovery Manger will monitor the SyncStatus to be "Synced" every 120 seconds as
default then issue snapshot creation of secondary volumes. Wait until these
snapshots complete.
6) Reset Remote Copy period to the sync period it was at prior to setting to 0 in step 1.
NOTE: See Product Alert 247-200010 in DCS for a more detailed explanation.
3PAR Confidential
InForm OS Version 2.3.1 MU4 3PAR InForm OS Release Notes
Workaround - There is no workaround for this and no user action is required. After the
core dump is generated, the port pair is reset and comes online automatically after a few
seconds.
Workaround - To avoid this device pop-up message you can install NULL driver for 3PAR
SCSI Enclosure Service device located on DCS.
Workaround - Once it has been verified that the alert is indeed invalid, check showcage -
d and showpd to verify the loop is present. The alert can be removed by removealert or
setalert.
2.7.11 System Manager Could Crash During Rolling Upgrade if Remote Copy
Groups Running (Bug 40867)
When creating snapshots during the shutdown process there is a known race condition that
may result in a system manager crash. Therefore, the user is no longer permitted to manually
take snapshots during this process. However, this is not the case with snapshots that are taken
when a synchronous remote copy group is stopped.
During a rolling upgrade synchronous groups are normally not stopped. However, if there is a
target failure during the process any associated groups will automatically be stopped, and if
the group is synchronous a snapshot for each volume in the group will be taken. This leaves
the system open to hitting the race condition described above.
Workaround - Stop all remote copy groups before starting a rolling upgrade.
2.7.12 No Explicit Way to Reset the Default Value for Tunelinks (Bug 43579)
setrcopytarget tunelinks command can be used to adjust the performance value for the
target's links using the <bandwidth> and <latency> specifiers. After using this command,
there is no explicit way for the user to reset the tuning parameters back to its default values.
Workaround - Reset the parameter to the default value by reissuing tunelinks with
bandwidth=128000 (or higher) and latency=100.
Workaround - None.
2.7.14 Remote Copy Volumes go Stale Due to Lack of Adm Space (Bug 44963)
The default grow value of 64 GB might be insufficient for volumes which are in Remote Copy
groups. The reason is Remote Copy relies on taking snapshots during the initial sync phase and
also during the resync periods. The snapshots end up using administrator space depending on
the IOPS and throughput load on the Remote Copy volumes.
Workaround - If the -f flag was used and the system still prompts for confirmation,
respond to the prompt. If there are other messages, they need to be resolved (e.g. take
port offline), or possibly reissue the command.
3PAR Confidential
InForm OS Version 2.3.1 MU4 3PAR InForm OS Release Notes
Workaround - The virtual volume detailed status is cleared once the restarted virtual
volume copy completes. No user intervention is required.
Workaround - The Physical Disk drive number is correctly displayed in the alert and in the
InServ Storage Server's event log. Examine the CLI output of the showpd and showpd -s
commands to determine the cage/magazine location of the failed disk.
Workaround - Run the showcage and showcage -d command to see if a firmware upgrade
is still required. Verify there are no other instances of upgradecage running, then run
upgradecage again.
NOTE: This was observed when multiple upgradecage commands were run. Do
not run multiple upgradecage commands.
Workaround - In these cases updatevv did complete for all virtual volumes in the set,
however the completion time is incorrect. The actual completion time can found by
gathering the creation time of the new snapshots.
Workaround - Following the failed upgrade using the showsched command to determine
which scheduled tasks need to be suspended again. Use the setsched -suspend
<schedule_name> command.
There is a known issue that can occur with any I/O that has been aborted as a result of an
unsuccessful write to the secondary cluster with fail_wrt_on_err policy; that is, data may
get written successfully to the primary cluster and not to the secondary cluster and host I/O
fails with errors. This will lead to a primary volume going out of sync with respect to secondary
volume.
Work around:
1 When the host I/O is completed with errors, start a full sync of the remote copy group
having that VLUN.
2.7.22 CIM Server Core after Upgrade from 2.2.3.116 (MU1) to 2.2.4.160
(MU6) (Bug 50476)
After the CIM Server starts, it sends SLP service requests in multicast to advertise availability of
the SMI-S service capability, including the host and port. If the host address or port field is
missing from the multicast message, the problem can occur.
Workaround - None.
3PAR Confidential
InForm OS Version 2.3.1 MU4 3PAR InForm OS Release Notes
2.7.23 Remote Copy: Long Waits for Remote Copy Commands to Return Data
Commands can take quite some time to return on a busy system. For this reason, the secondary
Remote Copy system cannot be used as a standalone system. Commands such as showrcopy
and showvv have been observed to take between 2 and 8 minutes to return data. Remote
Copy operations are not impacted, however during the time of a DR restore, where multiple
resyncs to different targets could be taking place, commands can take a significant amount of
time to execute.
3PAR Confidential
InForm OS Version 2.3.1 MU4 3PAR InForm OS Release Notes
3
3PAR InForm CLI Release Notes
In this chapter
3.1 Installation Notes for the InForm CLI 3.1
48776 CLI online help for The CLI online help for the createsv command, in the
createsv states A Notes section, incorrectly states that a maximum of
maximum of 2048 2048 virtual copies per volume are allowed.
virtual copies per
volume are allowed. This sentence should read A maximum of 500 virtual
copies per volume are allowed.
44872 Passing a virtual volume Use of createsv –i with virtual volume sets is not
set to the createsv –i currently supported.
command results in an
error.
44937 Misleading command When using the createvvcopy command with virtual
output when passing volume sets, if both sets are empty, the output of the
empty virtual volume sets command erroneously references the
to the createvvcopy creategroupvvcopy command.
command.
Workaround: Pass virtual volume sets that are not
empty to the createvvcopy command.
45413 Integer arguments to CLI The CLI shell is a TCL-based shell, as such it parses
commands with leading 0 integers with leading 0 (zero) as octal numbers, just
(zeros) are treated as octal like many other languages and shells (bash, perl, etc).
numbers. Consequently, integer arguments passed to the CLI
commands are also treated as octal numbers if they
have a leading 0.
3PAR Confidential
InForm OS Version 2.3.1 MU4 3PAR InForm OS Release Notes
46372 Drive cage displays do not The showcage -sfp command shows the sfp state as
correctly report degraded OK, Degraded, Failed or Unknown. For an
SFPs. unqualified SFP, the state should be Degraded but is
shown as OK.
47270 Discrepancy between There are two issues associated with this bug.
showsys -space and
showvv -r data for base 1 Base volume space is double counted.
volumes.
This problem has already been fixed in 2.3.1 GA and
also back ported to 2.2.4 MU6 (bug 31892 and 45225).
3PAR Confidential