Installation and Configuration Guide Exadata Database Machine
Installation and Configuration Guide Exadata Database Machine
19.3.0
E93155-08
February 2020
Oracle Exadata Database Machine Installation and Configuration Guide for Exadata Database Machine,
19.3.0
E93155-08
Contributors: Doug Archambault, Leo Agranonik, Andrew Babb, Bharat Baddepudi, Michael Belef, Nilesh
Choudhury, Henry Chow, Kevin Closson, Bob Cyphers, Ravindra Dani, Boris Erlikhman, Jaime Figueroa,
Gurmeet Goindi, Roger Hansen, Shrikumar Hariharasubrahmanian, Kevin Jernigan, Sarat Karkarla, Leslie
Keller, Frank Kobylanski, Poojan Kumar, René Kundersma, Robert S. Lee, Sue Lee, Jennifer Leung, Yang
Liu, Juan Loaiza, Barb Lundhild, Catherine Luu, Varun Malhotra, Bagish Mishra, Valarie Moore, Philip
Newlan, Adrian Ng, Dan Norris, Michael Nowak, Bharat Paliwal, Umesh Panchaksharaiah, Hector Pujol,
Sugam Pandey, Dmitry Potapov, Darryl Presley, Vince Pulice, Ashish Ray, Samitha Samaranayake, Richard
Scales, Olly Sharwood, Jia Shi, Kesavan Srinivasan, Mahesh Subramaniam, Michelle Sun, Krishnadev
Telikicherla, Cliff Thomas, Alex Tsukerman, Shreyas Udgaonkar, Kothanda Umamageswaran, Doug Utzig,
James Viscusi, Vern Wagman, Zheren Zhang
This software and related documentation are provided under a license agreement containing restrictions on
use and disclosure and are protected by intellectual property laws. Except as expressly permitted in your
license agreement or allowed by law, you may not use, copy, reproduce, translate, broadcast, modify,
license, transmit, distribute, exhibit, perform, publish, or display any part, in any form, or by any means.
Reverse engineering, disassembly, or decompilation of this software, unless required by law for
interoperability, is prohibited.
The information contained herein is subject to change without notice and is not warranted to be error-free. If
you find any errors, please report them to us in writing.
If this is software or related documentation that is delivered to the U.S. Government or anyone licensing it on
behalf of the U.S. Government, then the following notice is applicable:
U.S. GOVERNMENT END USERS: Oracle programs (including any operating system, integrated software,
any programs embedded, installed or activated on delivered hardware, and modifications of such programs)
and Oracle computer documentation or other Oracle data delivered to or accessed by U.S. Government end
users are "commercial computer software" or “commercial computer software documentation” pursuant to the
applicable Federal Acquisition Regulation and agency-specific supplemental regulations. As such, the use,
reproduction, duplication, release, display, disclosure, modification, preparation of derivative works, and/or
adaptation of i) Oracle programs (including any operating system, integrated software, any programs
embedded, installed or activated on delivered hardware, and modifications of such programs), ii) Oracle
computer documentation and/or iii) other Oracle data, is subject to the rights and limitations specified in the
license contained in the applicable contract. The terms governing the U.S. Government’s use of Oracle cloud
services are defined by the applicable contract for such services. No other rights are granted to the U.S.
Government.
This software or hardware is developed for general use in a variety of information management applications.
It is not developed or intended for use in any inherently dangerous applications, including applications that
may create a risk of personal injury. If you use this software or hardware in dangerous applications, then you
shall be responsible to take all appropriate fail-safe, backup, redundancy, and other measures to ensure its
safe use. Oracle Corporation and its affiliates disclaim any liability for any damages caused by use of this
software or hardware in dangerous applications.
Oracle and Java are registered trademarks of Oracle and/or its affiliates. Other names may be trademarks of
their respective owners.
Intel and Intel Inside are trademarks or registered trademarks of Intel Corporation. All SPARC trademarks are
used under license and are trademarks or registered trademarks of SPARC International, Inc. AMD, Epyc,
and the AMD logo are trademarks or registered trademarks of Advanced Micro Devices. UNIX is a registered
trademark of The Open Group.
This software or hardware and documentation may provide access to or information about content, products,
and services from third parties. Oracle Corporation and its affiliates are not responsible for and expressly
disclaim all warranties of any kind with respect to third-party content, products, and services unless otherwise
set forth in an applicable agreement between you and Oracle. Oracle Corporation and its affiliates will not be
responsible for any loss, costs, or damages incurred due to your access to or use of third-party content,
products, or services, except as set forth in an applicable agreement between you and Oracle.
Contents
Preface
Audience xiv
Documentation Accessibility xiv
Related Documentation xiv
Conventions xvi
iii
1.1.14 General Environmental Requirements for Oracle Exadata Storage
Expansion Rack X6-2 and later 1-19
1.1.15 General Environmental Requirements for Oracle Exadata Storage
Expansion Rack X5-2 1-20
1.1.16 General Environmental Requirements for Oracle Exadata Storage
Expansion Rack X4-2 1-22
1.1.17 General Environmental Requirements for Oracle Exadata Storage
Expansion Rack X3-2 1-23
1.1.18 General Environmental Requirements for Oracle Exadata Storage
Expansion Rack with Exadata Storage Server with Sun Fire X4270 M2
Servers 1-25
1.1.19 General Environmental Requirements for Single Servers 1-26
1.2 Space Requirements 1-30
1.2.1 Space Requirements for Oracle Exadata Database Machine X7-2 and
Later Systems 1-30
1.2.2 Space Requirements for Racks up to Oracle Exadata Database
Machine X6 1-31
1.3 Receiving, Unpacking, and Access Route Requirements 1-31
1.3.1 Rack Weights for Oracle Exadata Database Machine 1-32
1.3.1.1 Rack Weights for Oracle Exadata Database Machine 2-Socket
Servers 1-32
1.3.1.2 Rack Weights for Oracle Exadata Database Machine 8-Socket
Servers 1-34
1.3.2 Rack Weights for Oracle Exadata Storage Expansion Rack 1-35
1.4 Maintenance Access Requirements 1-37
1.5 Flooring Requirements 1-38
1.6 Electrical Power Requirements 1-38
1.6.1 PDU Power Requirements 1-39
1.6.1.1 Low-voltage 15 kVA Single Phase PDUs for North America, South
America, Japan and Taiwan 1-40
1.6.1.2 Low-voltage 15 kVA Three Phase PDUs for North America, South
America, Japan and Taiwan 1-40
1.6.1.3 High-voltage 15 kVA Single Phase PDUs for Europe, the Middle
East and Africa (EMEA), and Asia Pacific (APAC), except for
Japan and Taiwan 1-41
1.6.1.4 High-voltage 15 kVA Three Phase for Europe, the Middle East
and Africa (EMEA), and Asia Pacific (APAC), except for Japan
and Taiwan 1-42
1.6.1.5 Low-voltage 22 kVA Single Phase PDUs for North America, South
America, Japan and Taiwan 1-43
1.6.1.6 High-voltage 22 kVA Single Phase PDUs for Europe, the Middle
East and Africa (EMEA), and Asia Pacific (APAC), except for
Japan and Taiwan 1-44
1.6.1.7 Low-voltage 24 kVA Three Phase PDUs for North America, South
America, Japan and Taiwan 1-45
iv
1.6.1.8 High-voltage 24 kVA Three Phase PDUs for Europe, the Middle
East and Africa (EMEA), and Asia Pacific (APAC), except for
Japan and Taiwan 1-46
1.6.2 Facility Power Requirements 1-47
1.6.3 Circuit Breaker Requirements 1-47
1.6.4 Electrical Grounding Guidelines 1-47
1.7 Temperature and Humidity Requirements 1-48
1.8 Ventilation and Cooling Requirements 1-49
1.9 Network Connection and IP Address Requirements for Oracle Exadata
Database Machine 1-50
1.9.1 Network Connection Requirements for Oracle Exadata Database
Machine 1-51
1.9.2 DNS Configuration for Oracle Exadata Database Machine 1-54
1.9.3 IP Address Requirements for Oracle Exadata Database Machine 1-55
1.9.3.1 IP Address Requirements for Oracle Exadata Database Machine
X8M Systems 1-55
1.9.3.2 IP Address Requirements for Oracle Exadata Database Machine
X5-2 and Later Systems 1-59
1.9.3.3 IP Address Requirements for Oracle Exadata Database Machine
X4 Systems 1-64
1.9.3.4 IP Address Requirements for Oracle Exadata Database Machine
X3 Systems 1-68
1.9.3.5 IP Address Requirements for Oracle Exadata Database Machine
X2 Systems 1-73
1.9.4 Calculating the IP Address Requirements when Using Oracle VMs 1-76
1.10 Network Connection and IP Address Requirements for Oracle Exadata
Storage Expansion Rack 1-79
1.11 Ensuring That the Site is Ready 1-82
v
2.2.7 Oracle Exadata Database Machine X4-2 Database Server 2-12
2.2.8 Oracle Exadata Database Machine X4-8 Full Rack Database Server 2-12
2.2.9 Oracle Exadata Database Machine X3-2 Database Server 2-13
2.2.10 Oracle Exadata Database Machine X3-8 Full Rack and Oracle
Exadata Database Machine X2-8 Full Rack Database Server 2-13
2.3 Network Channel Bonding Support 2-13
2.3.1 Bonded Network Configurations 2-14
2.3.1.1 Bonded Network Configuration for Oracle Exadata Database
Machine Two-Socket Systems 2-14
2.3.1.2 Bonded Network Configuration for Oracle Exadata Database
Machine X7-8, X8-8, and X8M-8 2-16
2.3.1.3 Bonded Network Configuration for Oracle Exadata Database
Machine X4-8, X5-8, and X6-8 2-17
2.3.1.4 Bonded Network Configuration for Oracle Exadata Database
Machine X3-8 Full Rack and Oracle Exadata Database Machine
X2-8 Full Rack 2-17
2.3.2 Non-bonded Network Configuration 2-18
2.3.2.1 Non-bonded Network Configuration for Oracle Exadata Database
Machine Two-Socket Systems 2-19
2.3.2.2 Non-bonded Network Configuration for Oracle Exadata Database
Machine X5-8 and X6-8 2-20
2.3.2.3 Non-bonded Network Configuration for Oracle Exadata Database
Machine X4-8 Full Rack 2-21
2.3.2.4 Non-bonded Network Configuration for Oracle Exadata Database
Machine X3-8 Full Rack and Oracle Exadata Database Machine
X2-8 Full Rack 2-21
2.3.3 Additional Networks 2-22
2.4 Configuring a Separate Network for ILOM 2-23
2.5 Using Network VLAN Tagging with Oracle Exadata Database Machine 2-23
2.6 Default IP Addresses 2-25
2.6.1 Default IP Addresses for Oracle Exadata Database Machine X8M-2 2-26
2.6.2 Default IP Addresses for Oracle Exadata Database Machine X5-2 to
X8-2 2-27
2.6.3 Default IP Addresses for Oracle Exadata Database Machine X4-2 2-29
2.6.4 Default IP Addresses for Oracle Exadata Database Machine X3-2 and
Oracle Exadata Database Machine X2-2 2-31
2.6.5 Default IP Addresses for Oracle Exadata Database Machine X8M-8 2-33
2.6.6 Default IP Addresses for Oracle Exadata Database Machine X5-8 to
X8-8 Eight-Socket Systems 2-35
2.6.7 Default IP Addresses for Oracle Exadata Database Machine X4-8 2-37
2.6.8 Default IP Addresses for Oracle Exadata Database Machine X3-8 and
Oracle Exadata Database Machine X2-8 2-38
2.6.9 Default IP Addresses for Oracle Exadata Storage Expansion Rack X4-2 2-40
2.6.10 Default IP Addresses for Oracle Exadata Storage Expansion Rack
X3-2 and X2-2 2-41
vi
2.7 Port Assignments When Using a Firewall 2-43
vii
3.3.13 Define Clusters Details 3-58
3.3.13.1 Configuring Automatic Cluster File System (ACFS) 3-64
3.3.14 Review and Edit SCAN, Client, VIP and Optional Backup Networks 3-64
3.3.15 Cell Alerting Configuration Page 3-64
3.3.16 Platinum Configuration Page 3-65
3.3.17 Auto Service Request Configuration Page 3-67
3.3.18 Oracle Configuration Manager Configuration Page 3-68
3.3.19 Grid Control Agent Configuration Page 3-69
viii
4.3.5.1 CLONE COMPUTE 4-19
4.3.5.2 DELETE COMPUTE 4-22
4.3.6 DATABASE 4-23
4.3.6.1 ADD DATABASE 4-23
4.3.6.2 ALTER DATABASE 4-25
4.3.6.3 DELETE DATABASE 4-26
4.3.6.4 LIST DATABASES 4-28
4.3.7 DATABASE HOME 4-29
4.3.7.1 ADD DATABASEHOME 4-29
4.3.7.2 ALTER DATABASEHOME 4-31
4.3.7.3 DELETE DATABASEHOME 4-32
4.3.7.4 LIST DATABASEHOMES 4-33
4.3.8 DISKGROUP 4-34
4.3.8.1 ADD DISKGROUP 4-34
4.3.8.2 ALTER DISKGROUP 4-35
4.3.8.3 ALTER DISKGROUPS 4-38
4.3.8.4 DELETE DISKGROUP 4-39
4.3.8.5 LIST DISKGROUPS 4-40
4.3.9 ES 4-40
4.3.9.1 ALTER ES 4-40
4.3.9.2 DISCOVER ES 4-41
4.3.10 GUEST 4-41
4.3.10.1 CLONE GUEST 4-42
4.3.10.2 DELETE GUEST 4-44
4.3.11 ILOM 4-45
4.3.11.1 ALTER ILOM 4-45
4.3.11.2 LIST ILOMS 4-45
4.3.12 MACHINE 4-46
4.3.12.1 ALTER MACHINE 4-46
4.3.12.2 LIST MACHINES 4-47
4.3.13 NETWORK 4-47
4.3.13.1 ADD NETWORK 4-48
4.3.13.2 ALTER NETWORK 4-49
4.3.13.3 DELETE NETWORK 4-50
4.3.13.4 LIST NETWORKS 4-51
4.3.14 SCAN 4-52
4.3.14.1 ADD SCAN 4-52
4.3.14.2 ALTER SCAN 4-52
4.3.14.3 DELETE SCAN 4-53
4.3.14.4 LIST SCANS 4-53
4.3.15 SWITCH 4-54
ix
4.3.15.1 ALTER SWITCH 4-54
4.3.15.2 LIST SWITCHES 4-55
4.3.16 VIP 4-55
4.3.16.1 ADD VIP 4-55
4.3.16.2 ALTER VIP 4-56
4.3.16.3 DELETE VIP 4-57
4.3.16.4 LIST VIPS 4-57
x
6.6 Configuring the Threshold Settings for the Power Distribution Units 6-27
6.6.1 PDU Thresholds for Oracle Exadata Database Machine X5-2 and Later 6-28
6.6.2 PDU Thresholds for Oracle Exadata Database Machine X4-2 6-29
6.6.2.1 PDU Thresholds for Oracle Exadata Database Machine X4-2 Full
Rack 6-29
6.6.2.2 PDU Thresholds for Oracle Exadata Database Machine X4-2 Half
Rack 6-31
6.6.2.3 PDU Thresholds for Oracle Exadata Database Machine X4-2
Quarter Rack 6-33
6.6.3 PDU Thresholds for Oracle Exadata Database Machine X3-2 6-34
6.6.3.1 PDU Thresholds for Oracle Exadata Database Machine X3-2 Full
Rack 6-35
6.6.3.2 PDU Thresholds for Oracle Exadata Database Machine X3-2 Half
Rack 6-37
6.6.3.3 PDU Thresholds for Oracle Exadata Database Machine X3-2
Quarter Rack 6-38
6.6.4 PDU Thresholds for Oracle Exadata Database Machine X2-2 (with
X4170 M2 and X4270 M2 servers) 6-40
6.6.4.1 PDU Thresholds for Oracle Exadata Database Machine X2-2
(with X4170 M2 and X4270 M2 servers) Full Rack 6-41
6.6.4.2 PDU Thresholds for Oracle Exadata Database Machine X2-2
(with X4170 M2 and X4270 M2 servers) Half Rack 6-43
6.6.4.3 PDU Thresholds for Oracle Exadata Database Machine X2-2
(with X4170 M2 and X4270 M2 servers) Quarter Rack 6-45
6.6.5 PDU Thresholds for Oracle Exadata Database Machine X2-2 (with
X4170 and X4275 servers) 6-47
6.6.5.1 PDU Thresholds for Oracle Exadata Database Machine X2-2
(with X4170 and X4275 servers) Full Rack 6-47
6.6.5.2 PDU Thresholds for Oracle Exadata Database Machine X2-2
(with X4170 and X4275 servers) Half Rack 6-49
6.6.5.3 PDU Thresholds for Oracle Exadata Database Machine X2-2
(with X4170 and X4275 servers) Quarter Rack 6-51
6.6.6 PDU Thresholds for Oracle Exadata Database Machine X4-8 and Later 6-53
6.6.7 PDU Thresholds for Oracle Exadata Database Machine X3-8 Full Rack 6-53
6.6.8 PDU Thresholds for Oracle Exadata Database Machine X2-8 Full Rack 6-56
6.6.9 PDU Thresholds for Oracle Exadata Storage Expansion Rack with
Exadata Storage Server with Sun Fire X4270 M2 Servers 6-58
6.6.9.1 PDU Thresholds for Oracle Exadata Storage Expansion Full Rack
with Exadata Storage Server with Sun Fire X4270 M2 Servers 6-58
6.6.9.2 PDU Thresholds for Oracle Exadata Storage Expansion Half Rack
with Exadata Storage Server with Sun Fire X4270 M2 Servers 6-60
6.6.9.3 PDU Thresholds for Oracle Exadata Storage Expansion Quarter
Rack with Exadata Storage Server with Sun Fire X4270 M2
Servers 6-62
6.7 Checking Exadata Storage Servers 6-64
6.8 Checking Oracle Exadata Database Servers 6-68
xi
6.9 Performing Additional Checks and Configuration 6-72
6.10 Verifying the RDMA over RoCE Network Fabric Configuration 6-73
6.11 Verifying the RDMA over InfiniBand Network Fabric Network 6-74
6.12 Imaging a New System 6-76
6.12.1 Using ISO Images to Image a New System 6-76
6.12.2 Using Elastic Configuration to Image a New System 6-79
6.12.3 Using ISO to Image a New System 6-81
6.12.4 Using PXE to Image a New System 6-87
6.12.4.1 Using PXE to Image a New System Using Release 12.1.2.2.0 or
Later 6-87
6.12.4.2 Using PXE to Image a New System for Releases Earlier than
12.1.2.2.0 6-91
6.12.5 Using USB to Image a New System 6-95
6.12.6 Updates to Imaging Parameters 6-99
6.13 Performing Initial Elastic Configuration of Oracle Exadata Database Machine 6-100
6.14 Adding Additional Elastic Nodes to an Existing Rack 6-106
6.15 Loading the Configuration Information and Installing the Software 6-108
6.15.1 Configuring Oracle Exadata Database Machine Using OEDA 6-108
6.15.2 Configuring Oracle Database and Oracle ASM Instances for Oracle
Exadata Database Machine Manually 6-111
6.15.2.1 Configuring the Compatible Parameter for a Database Instance 6-113
6.15.2.2 Configuring Initialization Parameters for an Oracle ASM Instance 6-113
6.15.2.3 Using the Same DB_UNIQUE_NAME for Multiple Database
Instances 6-114
6.16 Installing Oracle Enterprise Manager Cloud Control 6-115
A Site Checklists
A.1 System Components Checklist A-2
A.2 Data Center Room Checklist A-3
A.3 Data Center Environment Checklist A-4
A.4 Access Route Checklist A-6
A.5 Facility Power Checklist A-8
A.6 Safety Checklist A-10
A.7 Logistics Checklist A-11
A.8 Network Configuration Checklist A-14
A.9 Auto Service Request Checklist A-16
A.10 Reracking Checklists A-17
A.11 Recycling the Racks A-21
xii
B Database High Availability Checklist
Index
xiii
Preface
Preface
This guide describes Oracle Exadata Database Machine for online transaction
processing (OLTP) and enterprise data warehousing. It includes information about site
planning and configuration, as well as physical, electrical, and environmental
specifications.
• Audience
• Documentation Accessibility
• Related Documentation
• Conventions
Audience
This guide is intended for Oracle Exadata Database Machine customers and those
responsible for data center site planning, configuration, and maintenance of Oracle
Exadata Database Machine.
Documentation Accessibility
For information about Oracle's commitment to accessibility, visit the Oracle
Accessibility Program website at http://www.oracle.com/pls/topic/lookup?
ctx=acc&id=docacc.
Related Documentation
In addition to theOracle Exadata Database Machine documentation set, the following
guides contain hardware information for Oracle Exadata Database Machine:
• Oracle Exadata Database Machine System Overview
• Oracle Exadata Database Machine Security Guide
• Oracle Engineered System Safety and Compliance Guide, Compliance Model No.:
ESY27
• Oracle Engineered Systems Extending and Multi-Rack Cabling Guide
• Oracle Exadata Database Machine Maintenance Guide
xiv
Preface
xv
Preface
Conventions
The following text conventions are used in this document:
Convention Meaning
boldface Boldface type indicates graphical user
interface elements associated with an action,
or terms defined in text or the glossary.
italic Italic type indicates book titles, emphasis, or
placeholder variables for which you supply
particular values.
monospace Monospace type indicates commands within a
paragraph, URLs, code in examples, text that
appears on the screen, or text that you enter.
$ prompt The dollar sign ($) prompt indicates a
command run as the oracle user.
# prompt The pound (#) prompt indicates a command
that is run as the root user.
xvi
1
Site Requirements for Oracle Exadata
Database Machine and Oracle Exadata
Storage Expansion Rack
This chapter describes the site requirements for Oracle Exadata Database Machine
and Oracle Exadata Storage Expansion Rack.
Note:
For ease of reading, the name "Oracle Exadata Rack" is used when
information refers to both Oracle Exadata Database Machine and Oracle
Exadata Storage Expansion Rack.
1-1
Chapter 1
General Environmental Requirements
1-2
Chapter 1
General Environmental Requirements
1-3
Chapter 1
General Environmental Requirements
1-4
Chapter 1
General Environmental Requirements
1-5
Chapter 1
General Environmental Requirements
1-6
Chapter 1
General Environmental Requirements
1-7
Chapter 1
General Environmental Requirements
1-8
Chapter 1
General Environmental Requirements
1-9
Chapter 1
General Environmental Requirements
1-10
Chapter 1
General Environmental Requirements
1-11
Chapter 1
General Environmental Requirements
1-12
Chapter 1
General Environmental Requirements
1-13
Chapter 1
General Environmental Requirements
1-14
Chapter 1
General Environmental Requirements
1-15
Chapter 1
General Environmental Requirements
1-16
Chapter 1
General Environmental Requirements
1-17
Chapter 1
General Environmental Requirements
1-18
Chapter 1
General Environmental Requirements
1-19
Chapter 1
General Environmental Requirements
Related Topics
• Oracle Exadata Configuration Assistant (OECA) Downloads
1-20
Chapter 1
General Environmental Requirements
1-21
Chapter 1
General Environmental Requirements
1-22
Chapter 1
General Environmental Requirements
1-23
Chapter 1
General Environmental Requirements
1-24
Chapter 1
General Environmental Requirements
1-25
Chapter 1
General Environmental Requirements
1-26
Chapter 1
General Environmental Requirements
1-27
Chapter 1
General Environmental Requirements
1-28
Chapter 1
General Environmental Requirements
1-29
Chapter 1
Space Requirements
Table 1-20 Environmental Requirements for 8-Socket Servers, Model X4-8 and
Later
1-30
Chapter 1
Receiving, Unpacking, and Access Route Requirements
mm (36 inches) of space required above the rack height for maintenance access, as
described in Table 1-23. The space surrounding the cabinet must not restrict the
movement of cool air between the air conditioner and the front of the systems within
the cabinet, or the movement of hot air coming out of the rear of the cabinet.
1-31
Chapter 1
Receiving, Unpacking, and Access Route Requirements
Caution:
Prior to moving the rack, always make sure that all four leveling and
stabilizing feet are raised and out of the way.
1.3.1.1 Rack Weights for Oracle Exadata Database Machine 2-Socket Servers
Use this table to determine the net and shipping weight of your Oracle Exadata Rack
X*-2.
1-32
Chapter 1
Receiving, Unpacking, and Access Route Requirements
1-33
Chapter 1
Receiving, Unpacking, and Access Route Requirements
1.3.1.2 Rack Weights for Oracle Exadata Database Machine 8-Socket Servers
Use this table to determine the net and shipping weight of your Oracle Exadata Rack
X*-8.
1-34
Chapter 1
Receiving, Unpacking, and Access Route Requirements
1-35
Chapter 1
Receiving, Unpacking, and Access Route Requirements
Table 1-22 Rack Weights for Oracle Exadata Storage Expansion Rack
1-36
Chapter 1
Maintenance Access Requirements
Table 1-22 (Cont.) Rack Weights for Oracle Exadata Storage Expansion Rack
1-37
Chapter 1
Flooring Requirements
Table 1-23 Maintenance Access Requirements for Oracle Exadata Rack (All
Models)
Note:
Description Requirement
Maximum allowable weight of installed rack 952.5 kg (2100 lbs)
equipment
Maximum allowable weight of installed power 52.16 kg (115 lbs)
distribution units
Maximum dynamic load (maximum allowable 1004.66 kg (2215 lbs)
weight of installed equipment including PDUs)
1-38
Chapter 1
Electrical Power Requirements
To protect Oracle Exadata Rack from such disturbances, you should have a dedicated
power distribution system, power-conditioning equipment, as well as lightning arresters
or power cables to protect from electrical storms.
• PDU Power Requirements
Each rack has two pre-installed power distribution units (PDUs). The PDUs accept
different power sources. You must specify the type of PDU that is correct for your
Oracle Exadata Rack and data center.
• Facility Power Requirements
To prevent catastrophic failures, design the input power sources to ensure
adequate power is provided to the PDUs.
• Circuit Breaker Requirements
If computer equipment is subjected to repeated power interruptions and
fluctuations, then it is susceptible to a higher rate of component failure.
• Electrical Grounding Guidelines
The cabinets for Oracle Exadata Rack are shipped with grounding-type power
cords.
1-39
Chapter 1
Electrical Power Requirements
1.6.1.1 Low-voltage 15 kVA Single Phase PDUs for North America, South
America, Japan and Taiwan
Table 1-25 Specifications for Low-voltage 15 kVA Single Phase PDUs for North
America, South America, Japan and Taiwan
Materials Required
The following are needed to connect an Oracle Exadata rack to a low-voltage three-
phase power source:
• 6 power cords for two PDUs, each rated for 30 amperes at 200-240 VAC
• 6 receptacles for 2 PDUs, each must be 15kVA, with three 30A/250V 2-pole/3-wire
NEMA L6-30P plugs
Figure 1-1 Low-voltage Single Phase Power Connector for North America,
South America, Japan and Taiwan
1.6.1.2 Low-voltage 15 kVA Three Phase PDUs for North America, South
America, Japan and Taiwan
Table 1-26 Specifications for Low-voltage 15 kVA Three Phase PDUs for North
America, South America, Japan and Taiwan
1-40
Chapter 1
Electrical Power Requirements
Table 1-26 (Cont.) Specifications for Low-voltage 15 kVA Three Phase PDUs for
North America, South America, Japan and Taiwan
Materials Required
The following are needed to connect an Oracle Exadata system to a low-voltage three-
phase power source:
• 2 power cords for two PDUs, 60 amperes at 190-220 VAC three-phase
• 2 receptacles to connect the PDUs to 2 IEC 60309 60A 4-pin 250VAC 3ph IP67
data center receptacles
Figure 1-2 Low-voltage Three Phase Power Connector for North America,
South America, Japan and Taiwan
1.6.1.3 High-voltage 15 kVA Single Phase PDUs for Europe, the Middle East
and Africa (EMEA), and Asia Pacific (APAC), except for Japan and Taiwan
Table 1-27 Specifications for High-voltage 15 kVA Single Phase PDUs for
Europe, the Middle East and Africa (EMEA), and Asia Pacific (APAC), except for
Japan and Taiwan
1-41
Chapter 1
Electrical Power Requirements
Table 1-27 (Cont.) Specifications for High-voltage 15 kVA Single Phase PDUs
for Europe, the Middle East and Africa (EMEA), and Asia Pacific (APAC), except
for Japan and Taiwan
Note:
The high-voltage 15kVA single phase PDU is no longer available. The high-
voltage 22kVA is a compatible replacement with the same receptacle and
breaker requirements
1.6.1.4 High-voltage 15 kVA Three Phase for Europe, the Middle East and
Africa (EMEA), and Asia Pacific (APAC), except for Japan and Taiwan
Table 1-28 Specifications for High-voltage 15 kVA Three Phase for Europe, the
Middle East and Africa (EMEA), and Asia Pacific (APAC), except for Japan and
Taiwan
1-42
Chapter 1
Electrical Power Requirements
Table 1-28 (Cont.) Specifications for High-voltage 15 kVA Three Phase for
Europe, the Middle East and Africa (EMEA), and Asia Pacific (APAC), except for
Japan and Taiwan
Materials Required
The following are needed to connect an Oracle Exadata system to a high-voltage
three-phase power source:
• 2 power cords for two PDUs, 25 amperes at 220/380-240/415 VAC three-phase
• 2 receptacles to connect the PDUs to 2 IEC 60309 32A 5-pin 230/400VAC 3ph
IP44 data center receptacles
1.6.1.5 Low-voltage 22 kVA Single Phase PDUs for North America, South
America, Japan and Taiwan
Table 1-29 Specifications for Low-voltage 22 kVA Single Phase PDUs for North
America, South America, Japan and Taiwan
1-43
Chapter 1
Electrical Power Requirements
Table 1-29 (Cont.) Specifications for Low-voltage 22 kVA Single Phase PDUs
for North America, South America, Japan and Taiwan
Materials Required
The following are needed to connect an Oracle Exadata system to a low-voltage
single-phase power source:
• 3 power cords for two PDUs
• 6 receptacles to connect the PDUs
The following image shows the low-voltage, 22 kVA single phase PDU power
connector for North America, South America, Japan and Taiwan. This power
connector is different from the power connector for the low-voltage 15 kVA single
phase PDU.
1.6.1.6 High-voltage 22 kVA Single Phase PDUs for Europe, the Middle East
and Africa (EMEA), and Asia Pacific (APAC), except for Japan and Taiwan
Table 1-30 Specifications for High-voltage 22 kVA Single Phase PDUs for
Europe, the Middle East and Africa (EMEA), and Asia Pacific (APAC), except for
Japan and Taiwan
1-44
Chapter 1
Electrical Power Requirements
Table 1-30 (Cont.) Specifications for High-voltage 22 kVA Single Phase PDUs
for Europe, the Middle East and Africa (EMEA), and Asia Pacific (APAC), except
for Japan and Taiwan
Materials Required
Note:
The high-voltage 15kVA single phase PDU is no longer available. The high-
voltage 22kVA is a compatible replacement with the same receptacle and
breaker requirements
The following are needed to connect an Oracle Exadata system to a high-voltage one-
phase power source:
• 6 power cords for two PDUs, 25 amperes at 220/380-240/415 VAC 1-phase
voltage
• 6 receptacles to connect the PDUs to 2 IEC 60309 32A 3-pin 250VAC IP44 data
center receptacles, and requires 22 kVA, 1-phase
1.6.1.7 Low-voltage 24 kVA Three Phase PDUs for North America, South
America, Japan and Taiwan
Table 1-31 Specifications for Low-voltage 24 kVA Three Phase PDUs for North
America, South America, Japan and Taiwan
1-45
Chapter 1
Electrical Power Requirements
Table 1-31 (Cont.) Specifications for Low-voltage 24 kVA Three Phase PDUs for
North America, South America, Japan and Taiwan
Materials Required
The following are needed to connect an Oracle Exadata system to a low-voltage three-
phase power source:
• 4 power cords for two PDUs
• 4 receptacles to connect the PDUs
1.6.1.8 High-voltage 24 kVA Three Phase PDUs for Europe, the Middle East
and Africa (EMEA), and Asia Pacific (APAC), except for Japan and Taiwan
Table 1-32 Specifications for High-voltage 24 kVA Three Phase PDUs for
Europe, the Middle East and Africa (EMEA), and Asia Pacific (APAC), except for
Japan and Taiwan
Materials Required
The following are needed to connect an Oracle Exadata system to a high-voltage
three-phase power source:
1-46
Chapter 1
Electrical Power Requirements
Note:
Electrical work and installations must comply with applicable local, state, or
national electrical codes. Contact your facilities manager or qualified
electrician to determine what type of power is supplied to the building.
PDU power cords are 4 meters (13.12 feet) long, and 1 to 1.5 meters (3.3 to 4.9 feet)
of the cord is routed within the rack cabinet. The installation site AC power receptacle
must be within 2 meters (6.6 feet) of the rack.
Note:
Electrical work and installations must comply with applicable local, state, or
national electrical codes.
1-47
Chapter 1
Temperature and Humidity Requirements
• Ensure that the facility administrator or qualified electrical engineer verifies the
grounding method for the building, and performs the grounding work.
Note:
Studies have shown that temperature increases of 10 degrees Celsius (15
degrees Fahrenheit) above 20 degrees Celsius (70 degrees Fahrenheit)
reduce long-term electronics reliability by 50 percent.
The following table lists the temperature, humidity and altitude requirements for
operating and non-operating machines.
Set conditions to the optimal temperature and humidity ranges to minimize the chance
of downtime due to component failure. Operating Oracle Exadata Rack for extended
periods at or near the operating range limits, or installing it in an environment where it
remains at or near non-operating range limits could significantly increase hardware
component failure.
The ambient temperature range of 21 to 23 degrees Celsius (70 to 74 degrees
Fahrenheit) is optimal for server reliability and operator comfort. Most computer
equipment can operate in a wide temperature range, but near 22 degrees Celsius (72
degrees Fahrenheit) is desirable because it is easier to maintain safe humidity levels.
Operating in this temperature range provides a safety buffer in the event that the air
conditioning system goes down for a period of time.
1-48
Chapter 1
Ventilation and Cooling Requirements
The ambient relative humidity range of 45 to 50 percent is suitable for safe data
processing operations. Most computer equipment can operate in a wide range (20 to
80 percent), but the range of 45 to 50 percent is recommended for the following
reasons:
• Optimal range helps protect computer systems from corrosion problems
associated with high humidity levels.
• Optimal range provides the greatest operating time buffer in the event of air
conditioner control failure.
• This range helps avoid failures or temporary malfunctions caused by intermittent
interference from static discharges that may occur when relative humidity is too
low.
Electrostatic discharge (ESD) is easily generated, and hard to dissipate in areas of low
relative humidity, such as below 35 percent. ESD becomes critical when humidity
drops below 30 percent. It is not difficult to maintain humidity in a data center because
of the high-efficiency vapor barrier and low rate of air changes normally present.
1-49
Chapter 1
Network Connection and IP Address Requirements for Oracle Exadata Database Machine
• Allow a minimum clearance of 1219.2 mm (48 inches) at the front of the server,
and 914 mm (36 inches) at the rear of the server for ventilation.
Use perforated tiles, approximately 400 CFM/tile, in front of the rack for cold air intake.
The tiles can be arranged in any order in front of the rack, as long as cold air from the
tiles can flow into the rack. Inadequate cold air flow could result in a higher inlet
temperature in the servers due to exhaust air recirculation. The following table
describes the recommended number of floor tiles:
Figure 1-7 shows a typical installation of the floor tiles for Oracle Exadata Database
Machine Full Rack in a typical data center.
Figure 1-7 Typical Data Center Configuration for Perforated Floor Tiles
1-50
Chapter 1
Network Connection and IP Address Requirements for Oracle Exadata Database Machine
1-51
Chapter 1
Network Connection and IP Address Requirements for Oracle Exadata Database Machine
Note:
Note:
This network is optional. A cable is not required unless the network is
configured during deployment.
Oracle Exadata Database Machine X2-8 Full Rack has a total of 16 Ethernet ports per
server. The additional networks for Oracle Exadata Database Machine X2-8 Full Rack
are NET2 through NET15.
The following table shows examples of connection requirements for different sample
environments. The table applies to two-socket Oracle Exadata Database Machine
models X3-2 to X6-2.
1-52
Chapter 1
Network Connection and IP Address Requirements for Oracle Exadata Database Machine
The following table shows examples of connection requirements for different sample
environments with Oracle Exadata Database Machine X2-2.
1-53
Chapter 1
Network Connection and IP Address Requirements for Oracle Exadata Database Machine
Related Topics
• Understanding the Network Requirements for Oracle Exadata Database Machine
Review the network requirements for Oracle Exadata Database Machine before
installing or configuring the hardware.
Note:
Grid Naming Service (GNS) is not configured on Oracle Exadata Database
Machine during initial configuration.
1-54
Chapter 1
Network Connection and IP Address Requirements for Oracle Exadata Database Machine
See Also:
1-55
Chapter 1
Network Connection and IP Address Requirements for Oracle Exadata Database Machine
1-56
Chapter 1
Network Connection and IP Address Requirements for Oracle Exadata Database Machine
1-57
Chapter 1
Network Connection and IP Address Requirements for Oracle Exadata Database Machine
1-58
Chapter 1
Network Connection and IP Address Requirements for Oracle Exadata Database Machine
1-59
Chapter 1
Network Connection and IP Address Requirements for Oracle Exadata Database Machine
1-60
Chapter 1
Network Connection and IP Address Requirements for Oracle Exadata Database Machine
1-61
Chapter 1
Network Connection and IP Address Requirements for Oracle Exadata Database Machine
1-62
Chapter 1
Network Connection and IP Address Requirements for Oracle Exadata Database Machine
1-63
Chapter 1
Network Connection and IP Address Requirements for Oracle Exadata Database Machine
1-64
Chapter 1
Network Connection and IP Address Requirements for Oracle Exadata Database Machine
Table 1-36 (Cont.) IP Address Requirements for Oracle Exadata Database Machine X4-2 and
X4-8 Full Rack
1-65
Chapter 1
Network Connection and IP Address Requirements for Oracle Exadata Database Machine
Table 1-36 (Cont.) IP Address Requirements for Oracle Exadata Database Machine X4-2 and
X4-8 Full Rack
1-66
Chapter 1
Network Connection and IP Address Requirements for Oracle Exadata Database Machine
Table 1-36 (Cont.) IP Address Requirements for Oracle Exadata Database Machine X4-2 and
X4-8 Full Rack
1-67
Chapter 1
Network Connection and IP Address Requirements for Oracle Exadata Database Machine
1-68
Chapter 1
Network Connection and IP Address Requirements for Oracle Exadata Database Machine
Table 1-37 (Cont.) IP Address Requirements for Oracle Exadata Database Machine X3-2 and
Oracle Exadata Database Machine X3-8 Full Rack
1-69
Chapter 1
Network Connection and IP Address Requirements for Oracle Exadata Database Machine
Table 1-37 (Cont.) IP Address Requirements for Oracle Exadata Database Machine X3-2 and
Oracle Exadata Database Machine X3-8 Full Rack
1-70
Chapter 1
Network Connection and IP Address Requirements for Oracle Exadata Database Machine
Table 1-37 (Cont.) IP Address Requirements for Oracle Exadata Database Machine X3-2 and
Oracle Exadata Database Machine X3-8 Full Rack
1-71
Chapter 1
Network Connection and IP Address Requirements for Oracle Exadata Database Machine
Table 1-37 (Cont.) IP Address Requirements for Oracle Exadata Database Machine X3-2 and
Oracle Exadata Database Machine X3-8 Full Rack
1-72
Chapter 1
Network Connection and IP Address Requirements for Oracle Exadata Database Machine
1-73
Chapter 1
Network Connection and IP Address Requirements for Oracle Exadata Database Machine
Table 1-38 (Cont.) IP Address Requirements for Oracle Exadata Database Machine X2-2 and
Oracle Exadata Database Machine X2-8 Full Rack
1-74
Chapter 1
Network Connection and IP Address Requirements for Oracle Exadata Database Machine
Table 1-38 (Cont.) IP Address Requirements for Oracle Exadata Database Machine X2-2 and
Oracle Exadata Database Machine X2-8 Full Rack
1-75
Chapter 1
Network Connection and IP Address Requirements for Oracle Exadata Database Machine
Table 1-38 (Cont.) IP Address Requirements for Oracle Exadata Database Machine X2-2 and
Oracle Exadata Database Machine X2-8 Full Rack
1-76
Chapter 1
Network Connection and IP Address Requirements for Oracle Exadata Database Machine
Oracle VM deployment:
The following table shows the network requirements by component. The IP address
numbers are per component, not rack.
1-77
Chapter 1
Network Connection and IP Address Requirements for Oracle Exadata Database Machine
1-78
Chapter 1
Network Connection and IP Address Requirements for Oracle Exadata Storage Expansion Rack
The following table shows an example of the IP addresses requirements when using
Oracle VMs in Oracle Exadata Database Machine X5 or later models.
1-79
Chapter 1
Network Connection and IP Address Requirements for Oracle Exadata Storage Expansion Rack
1-80
Chapter 1
Network Connection and IP Address Requirements for Oracle Exadata Storage Expansion Rack
– 1 Ethernet connection for each of the two PDUs. Network connectivity to the
PDUs is only required if the electric current is monitored remotely.
The following table lists the IP address requirements for Oracle Exadata Storage
Expansion Racks:
1-81
Chapter 1
Ensuring That the Site is Ready
1-82
Chapter 1
Ensuring That the Site is Ready
1-83
2
Understanding the Network Requirements
for Oracle Exadata Database Machine
Review the network requirements for Oracle Exadata Database Machine before
installing or configuring the hardware.
Note:
For ease of reading, the name "Oracle Exadata Rack" is used when
information refers to both Oracle Exadata Database Machine and Oracle
Exadata Storage Expansion Rack.
2-1
Chapter 2
Overview of Network Requirements
The information in this section should be used in conjunction with Oracle Exadata
Deployment Assistant (OEDA) to configure your environment for Oracle Exadata
Database Machine.
Note:
In release 11.2.2.1.0, the names used for bonding changed. The names are
BONDIB0 for the RDMA over InfiniBand Network Fabric bonding and BONDETH0
for Ethernet bonding. In earlier releases, the names were BOND0 and BOND1,
respectively.
On Oracle Exadata Database Machine X4-2 systems using release
11.2.3.3.0 and later, the name used for the RDMA over InfiniBand Network
Fabric interfaces changed again, from BONDIB0 to IB0 and IB1.
Starting with Oracle Exadata System Software release 19.3 and Oracle Exadata
Database Machine X8M, RDMA over Converged Ethernet (RoCE) is used for the
RDMA Network Fabric instead of InfiniBand. RDMA over RoCE Network Fabric uses
different switches and cables from those used by RDMA over InfiniBand Network
Fabric.
To deploy Oracle Exadata Database Machine ensure that you meet the minimum
network requirements. Oracle Exadata Database Machine requires a minimum of
three networks, and there are interfaces available for additional networks. Each
network must be on a distinct and separate subnet from the others. Oracle
recommends one common additional network for backup, which you can configure
with OEDA. The network descriptions are as follows:
• Management network: This required network connects to your existing
management network, and is used for administrative work for all components of
Oracle Exadata Database Machine. It connects the servers, Integrated Lights Out
Manager (ILOM), and switches connected to the Ethernet switch in the rack. There
is one uplink from the Ethernet switch in the rack to your management network
and one uplink for each power distribution unit (PDU).
Notes:
Each database server and storage server has two network interfaces for
management. One provides management access to the operating system through
the embedded NET0 Ethernet port on Oracle Exadata Database Machine Two-
Socket systems, or the NEM0/NET1 Ethernet port on Oracle Exadata Database
2-2
Chapter 2
Overview of Network Requirements
Note:
If your system will use more than 10 VIP addresses in the cluster and
you have VLAN configured for the Oracle Clusterware client network,
then you must use 3 digit VLAN ids. Do not use 4 digit VLAN ids
because the VLAN name can exceed the 15 character operating system
interface name limit.
2-3
Chapter 2
Overview of Network Requirements
RDMA over RoCE Network Fabric is available starting with Oracle Exadata
Database Machine X8M.
Note:
All networks must be on distinct and separate subnets from each other. For
better security, the management network should be isolated from all other
networks.
2-4
Chapter 2
Overview of Network Requirements
Figure 2-1 Network Diagram for Oracle Exadata Database Machine X8M
* BONDETH0
NET4 NET3 NET2 NET1 NET0 ILOM ILOM NET0
Exadata Database Server Exadata Storage Server
RDMA Network
Fabric Switch
RDMA Network
Key Fabric Switch
Management Network
Client Network
RDMA Network Fabric based on RoCE
The following image shows the default network diagram for Oracle Exadata Database
Machine X7-2 and X8-2 with RDMA over InfiniBand Network Fabric. Use the files from
OEDA to verify the cable connections when cabling Oracle Exadata Database
Machine to the existing network.
2-5
Chapter 2
Overview of Network Requirements
Figure 2-2 Network Diagram for Oracle Exadata Database Machine X7-2 and
X8-2
Ethernet
Switch PDU A PDU B
BONDETH0
NET4 NET3 NET2 NET1 NET0 ILOM ILOM NET0
Exadata Exadata
Database Server Storage Server
IB0 IB1 IB1 IB0
InfiniBand
Switch
InfiniBand
Switch
Key
Management
Client Access
Private InfiniBand
The following image shows the default network diagram for Oracle Exadata Database
Machine X4-2, X5-2, and X6-2 models. Use the files from OEDA to verify the cable
connections when cabling Oracle Exadata Database Machine to the existing network.
2-6
Chapter 2
Overview of Network Requirements
Figure 2-3 Network Diagram for Oracle Exadata Database Machine X4-2, X5-2,
and X6-2 Models
Ethernet
Switch PDU A PDU B
Oracle Exadata
Database Server Storage Servers
InfiniBand
Switch
InfiniBand
Switch
Management
Client Access
Private InfiniBand
Additional network 1 (optional)
The following image shows the default network diagram for Oracle Exadata Database
Machine X3-2 and Oracle Exadata Database Machine X2-2. Use the files from OEDA
to verify the cable connections when cabling Oracle Exadata Database Machine to the
existing network.
2-7
Chapter 2
Overview of Network Requirements
Figure 2-4 Network Diagram for Oracle Exadata Database Machine X3-2 and
Oracle Exadata Database Machine X2-2
KVM Ethernet
(X2-2) Switch PDU A PDU B
Oracle Exadata
Database Server Storage Servers
BONDIB0 BONDIB0
InfiniBand
Switch
InfiniBand
Switch
Management
Client Access
Private InfiniBand
Additional network 1 (optional)
Notes:
• Oracle Exadata Database Machine X3-8 Full Rack, and Oracle Exadata
Database Machine X2-8 Full Rack have BONDIB0, BONDIB1, and so on for
the RDMA Network Fabric.
• The keyboard, video, and mouse (KVM) switch is only available in
Oracle Exadata Database Machine X2-2 racks.
• Additional configuration, such as defining multiple virtual local area
networks (VLANs) or enabling routing, may be required for the switch to
operate properly in your environment, and is not included in the
installation service. If additional configuration is needed, then the
network administrator performs the necessary configuration during
Oracle Exadata Database Machine installation.
Related Topics
• Using Oracle Exadata Deployment Assistant
2-8
Chapter 2
Network Components and Interfaces
2-9
Chapter 2
Network Components and Interfaces
Note:
The SFP28 modules for the 25GbE PCIe 3.0 network cards are purchased
separately.
Note:
The Small Form-Factor Pluggable (SFP) modules are purchased separately.
2-10
Chapter 2
Network Components and Interfaces
Note:
The SFP28 modules for the 25GbE PCIe 3.0 network cards are purchased
separately.
Note:
The Small Form-Factor Pluggable (SFP) modules are purchased separately.
Note:
The Small Form-Factor Pluggable (SFP) modules for the 10 GbE PCIe 2.0
network cards are purchased separately.
2-11
Chapter 2
Network Components and Interfaces
2.2.6 Oracle Exadata Database Machine X5-8 and X6-8 Full Rack
Database Server
Each Oracle Exadata Database Machine X5-8 or X6-8 Full Rack database server
consists of the following network components and interfaces:
• 4 dual-port 4x QDR (40 Gb/s) InfiniBand Host Channel Adapter (HCA)
• 10 x 1 GbE Base-T Ethernet Ports (2 Quad-port PCIe 2.0 network card, and 2
embedded ports based on the Intel I350 1GbE Controller technology)
• 8 x 10 GbE Ethernet SFP+ Ports (4 Dual-port 10GbE PCIe 2.0 network card
based on the Intel 82599 10GbE Controller technology)
Note:
The Small Form-Factor Pluggable (SFP) modules for the 10 GbE PCIe 2.0
network cards are purchased separately.
Note:
The Small Form-Factor Pluggable (SFP) modules for the 10 GbE PCIe 2.0
network cards are purchased separately.
2-12
Chapter 2
Network Channel Bonding Support
Note:
The Small Form-Factor Pluggable (SFP) modules for the 10 GbE PCIe 2.0
network cards are purchased separately.
Note:
The Small Form-Factor Pluggable (SFP) modules for the 10 GbE PCIe 2.0
network cards are purchased separately.
2.2.10 Oracle Exadata Database Machine X3-8 Full Rack and Oracle
Exadata Database Machine X2-8 Full Rack Database Server
Each Oracle Exadata Database Machine X3-8 Full Rack and Oracle Exadata
Database Machine X2-8 Full Rack database server consists of the following network
components and interfaces:
• 2 Network Express Modules (NEMs) providing the total of the following:
– 8 x 10 GbE network ports
– 8 x 1 Gb Ethernet network ports
• 4 dual-port 4X QDR InfiniBand PCIe 2.0 Express Modules (EMs)
• 1 Ethernet port for Sun Integrated Lights Out Manager (ILOM) remote
management
Note:
The SFP+ modules for the NEMs are purchased separately.
2-13
Chapter 2
Network Channel Bonding Support
Oracle RAC SCAN and VIP addresses are defined on the BONDETH0 interface on
database servers.
• Bonded Network Configurations
A bonded network configuration is used when there is a need to aggregate
multiple network interfaces together for client connections to the database.
• Non-bonded Network Configuration
A non-bonded network configuration is used when there is no need or ability to
implement network bonding.
• Additional Networks
2-14
Chapter 2
Network Channel Bonding Support
The following table shows the port connections for Oracle Exadata Database Machine
two-socket systems database servers when using channel bonding. The client access
network and the backup network must use different ports, in that one network must
use the embedded GbE ports and the other network must use the PCIe ports.
Table 2-1 Channel Bonding Connections for Oracle Exadata Database Machine
X7-2, X8-2, and X8M-2
Table 2-2 Channel Bonding Connections for Other Oracle Exadata Database
Machine Two-Socket Systems
2-15
Chapter 2
Network Channel Bonding Support
Note:
When using a bonded network configuration, you must provide a network
switch capable of supporting the chosen bonding mode. For example, if
mode 4 is configured (IEEE 802.3ad Dynamic link aggregation), then you
must supply and configure the network switch capable of supporting this
bonding mode. Requirements for specific bonding policies are documented
in the "Linux Ethernet Bonding Driver HOWTO" at https://
www.kernel.org/doc/Documentation/networking/bonding.txt
Table 2-3 Channel Bonding Connections for Oracle Exadata Database Machine
X7-8, X8-8, and X8M-8
2-16
Chapter 2
Network Channel Bonding Support
Table 2-4 Channel Bonding Connections for Oracle Exadata Database Machine
X4-8, X5-8, and X6-8
2-17
Chapter 2
Network Channel Bonding Support
• Port NEM1/NET3: Provides access to the database using the client access
network, and is bonded with port NEM0/NET1 to create the BONDETH0 interface.
• Port NET MGT: Provides access to ILOM using the management network.
Table 2-5 shows the port connections for Oracle Exadata Database Machine X3-8 Full
Rack and Oracle Exadata Database Machine X2-8 Full Rack database servers when
using channel bonding. The NEM0 ports are on the left, and the NEM1 ports are on
the right.
Table 2-5 Channel Bonding Connections for Oracle Exadata Database Machine
X2-8 and X3-8 Full Rack
When channel bonding is configured for the client access network during initial
configuration, the Linux bonding module is configured for active-backup mode
(mode=1). If a different bonding policy is preferred, then you may reconfigure the
bonding module after initial configuration. For configuration details, refer to the Linux
Ethernet Bonding Driver HOWTO in the /usr/share/doc/kernel-doc-2.6.18/
Documentation/networking/bonding.txt directory on any Oracle Exadata Database
Machine database server.
Note:
When using a bonded network configuration, you must provide a network
switch capable of supporting the chosen bonding mode. For example, if
mode 4 is configured (IEEE 802.3ad Dynamic link aggregation), then you
must supply and configure the network switch capable of supporting this
bonding mode. Requirements for specific bonding policies are documented
in the Linux Ethernet Bonding Driver HOWTO.
2-18
Chapter 2
Network Channel Bonding Support
Note:
Non Bonded networks are not supported for Oracle Exadata Database
Machine X7-2 and later systems.
The following sections describe the non-bonded network configuration for Oracle
Exadata Database Machine:
• Non-bonded Network Configuration for Oracle Exadata Database Machine Two-
Socket Systems
• Non-bonded Network Configuration for Oracle Exadata Database Machine X5-8
and X6-8
• Non-bonded Network Configuration for Oracle Exadata Database Machine X4-8
Full Rack
• Non-bonded Network Configuration for Oracle Exadata Database Machine X3-8
Full Rack and Oracle Exadata Database Machine X2-8 Full Rack
2-19
Chapter 2
Network Channel Bonding Support
Figure 2-5 Network Diagram for Oracle Exadata Database Machine Two-Socket
Systems When Not Using Bonding
Oracle Exadata
Database Server Storage Servers
BONDIB0 BONDIB0
InfiniBand
Switch
InfiniBand
Switch
Management
Client Access
Private InfiniBand
Additional network 1 (optional)
Additional network 2 (optional)
2-20
Chapter 2
Network Channel Bonding Support
Note:
Oracle Exadata Database Machine X5-8 and X6-8 have BONDIB0,
BONDIB1, and so on for the InfiniBand private network.
Note:
Oracle Exadata Database Machine X4-8 Full Rack has BONDIB0, BONDIB1,
and so on for the InfiniBand private network.
2-21
Chapter 2
Network Channel Bonding Support
Note:
Oracle Exadata Database Machine X4-8 Full Rack, Oracle Exadata
Database Machine X3-8 Full Rack, and Oracle Exadata Database Machine
X2-8 Full Rack have BONDIB0, BONDIB1, and so on for the InfiniBand
private network.
2-22
Chapter 2
Configuring a Separate Network for ILOM
A new section appears on the page, with the heading of ILOM. In this area you
specify the information required to configure the ILOM network.
3. Provide the required values for the ILOM network:
• Gateway
• Start IP Address
• Subnet Mask
• Domain Name
4. Optional: If you do not want to use the default names and values for the ILOM
network, click the Modify Masks button and customize the network settings.
2-23
Chapter 2
Using Network VLAN Tagging with Oracle Exadata Database Machine
By default, the network switch is minimally configured, without VLAN tagging. If VLAN
tagging is to be used, then it must be enabled by the customer after the initial
deployment. This applies to both physical and Oracle VM deployments.
Client and backup VLAN networks must be bonded. The admin network is never
bonded.
Notes:
The following table shows IPv4/IPv6 support on the admin, client, and backup
networks for the different Oracle Exadata Database Machine systems and Oracle
Database versions.
Related Topics
• Implementing InfiniBand Partitioning across Oracle VM Oracle RAC Clusters on
Oracle Exadata
• Enabling 802.1Q VLAN Tagging in Exadata Database Machine over client
networks (My Oracle Support Doc ID 1423676.1)
2-24
Chapter 2
Default IP Addresses
Note:
Prior to connecting Oracle Exadata Database Machine to the network,
ensure these IP addresses do not conflict with other addresses on the
network. Use the checkip.sh script generated by Oracle Exadata
Deployment Assistant (OEDA) to check for conflicts. You run the checkip.sh
script on the network after the DNS entries for the Oracle Exadata Database
Machine have been created, but before the Oracle Exadata Database
Machine is configured or connected to the network. Oracle recommends
running the script to avoid configuration delays, even if a check was
performed as part of planning process before the machine was delivered.
See Verifying the Network Configuration Prior to Configuring the Rack.
If you ran OEDA on a Microsoft Windows system, then the generated script
is checkip.bat.
2-25
Chapter 2
Default IP Addresses
Table 2-6 Default IP Addresses for Oracle Exadata Database Machine X8M-2
2-26
Chapter 2
Default IP Addresses
Table 2-6 (Cont.) Default IP Addresses for Oracle Exadata Database Machine
X8M-2
Table 2-7 Default IP Addresses for Oracle Exadata Database Machine X5-2 to
X8-2
2-27
Chapter 2
Default IP Addresses
Table 2-7 (Cont.) Default IP Addresses for Oracle Exadata Database Machine
X5-2 to X8-2
2-28
Chapter 2
Default IP Addresses
Table 2-7 (Cont.) Default IP Addresses for Oracle Exadata Database Machine
X5-2 to X8-2
Table 2-8 Default IP Addresses for Oracle Exadata Database Machine X4-2
2-29
Chapter 2
Default IP Addresses
Table 2-8 (Cont.) Default IP Addresses for Oracle Exadata Database Machine
X4-2
2-30
Chapter 2
Default IP Addresses
Table 2-9 Default IP Addresses for Oracle Exadata Database Machine X3-2 and
Oracle Exadata Database Machine X2-2
2-31
Chapter 2
Default IP Addresses
Table 2-9 (Cont.) Default IP Addresses for Oracle Exadata Database Machine
X3-2 and Oracle Exadata Database Machine X2-2
2-32
Chapter 2
Default IP Addresses
Table 2-9 (Cont.) Default IP Addresses for Oracle Exadata Database Machine
X3-2 and Oracle Exadata Database Machine X2-2
Table 2-10 Default IP Addresses for Oracle Exadata Database Machine X8M-8
Full Rack Systems
2-33
Chapter 2
Default IP Addresses
Table 2-10 (Cont.) Default IP Addresses for Oracle Exadata Database Machine
X8M-8 Full Rack Systems
2-34
Chapter 2
Default IP Addresses
Table 2-10 (Cont.) Default IP Addresses for Oracle Exadata Database Machine
X8M-8 Full Rack Systems
Table 2-11 Default IP Addresses for Oracle Exadata Database Machine X5-8 to
X8-8 Full Rack Systems
2-35
Chapter 2
Default IP Addresses
Table 2-11 (Cont.) Default IP Addresses for Oracle Exadata Database Machine
X5-8 to X8-8 Full Rack Systems
2-36
Chapter 2
Default IP Addresses
Note:
For Oracle Exadata Database Machine X4-8 racks with Oracle Exadata
Storage Server X5-2 Servers, the NETO IP addresses are assigned during
the elastic configuration process.
Table 2-12 Default IP Addresses for Oracle Exadata Database Machine X4-8
Full Rack
2-37
Chapter 2
Default IP Addresses
Table 2-12 (Cont.) Default IP Addresses for Oracle Exadata Database Machine
X4-8 Full Rack
2-38
Chapter 2
Default IP Addresses
Table 2-13 Default IP Addresses for Oracle Exadata Database Machine X3-8
Full Rack and Oracle Exadata Database Machine X2-8 Full Rack
2-39
Chapter 2
Default IP Addresses
Table 2-13 (Cont.) Default IP Addresses for Oracle Exadata Database Machine
X3-8 Full Rack and Oracle Exadata Database Machine X2-8 Full Rack
Table 2-14 Default IP Addresses for Oracle Exadata Storage Expansion Rack
X4-2
2-40
Chapter 2
Default IP Addresses
Table 2-14 (Cont.) Default IP Addresses for Oracle Exadata Storage Expansion
Rack X4-2
2-41
Chapter 2
Default IP Addresses
Table 2-15 Default IP Addresses for Oracle Exadata Storage Expansion Rack
X3-2 and Oracle Exadata Storage Expansion Rack with Sun Fire X4270 M2
Servers
2-42
Chapter 2
Port Assignments When Using a Firewall
Table 2-15 (Cont.) Default IP Addresses for Oracle Exadata Storage Expansion
Rack X3-2 and Oracle Exadata Storage Expansion Rack with Sun Fire X4270 M2
Servers
2-43
Chapter 2
Port Assignments When Using a Firewall
2-44
Chapter 2
Port Assignments When Using a Firewall
2-45
Chapter 2
Port Assignments When Using a Firewall
2-46
Chapter 2
Port Assignments When Using a Firewall
2-47
Chapter 2
Port Assignments When Using a Firewall
2-48
Chapter 2
Port Assignments When Using a Firewall
See Also:
Appendix E, "Managing Oracle Database Port Numbers", in the Oracle Real
Application Clusters Installation Guide for Linux and UNIX.
2-49
3
Using Oracle Exadata Deployment
Assistant
Oracle Exadata Deployment Assistant creates the Oracle Exadata Rack configuration
file. The file automates the installation process. OEDA can be downloaded from Oracle
Technology Network.
You can use the command-line interface OEDACLI perform Oracle Exadata Database
Machine life cycle management tasks.
Note:
For ease of reading, the name "Oracle Exadata Rack" is used when
information refers to both Oracle Exadata Database Machine and Oracle
Exadata Storage Expansion Rack.
3-1
Chapter 3
Overview of Oracle Exadata Deployment Assistant
1. Work with your network and database administrators to evaluate the current
network settings, such as current IP address use and network configuration.
2. Define the settings for the rack, such as network configuration and backup
method.
3. Download the latest version of OEDA from Oracle Technology Network.
4. Unzip and run the configuration script on a supported platform, and select the
type of system to configure.
5. Go through every page in OEDA and supply values for all required fields. You
will not be able to advanced to the next page if you do not supply all the
required values. You must provide naming details and DNS, NTP, and
networking details.
6. At the end of the dialogue with OEDA, configuration files are generated on the
client. The files are also listed at the bottom of the
InstallationTemplate.html file that is generated by OEDA. Depending on
your engineered system and configuration, OEDA generates all or some of the
following files:
– databasemachine.xml
– CustomerName-rackname.xml
– CustomerName-rackname-preconf_GUID.csv
– CustomerName-rackname-InstallationTemplate.html
– CustomerName-rackname-platinum.csv
– CustomerName-rackname-checkip.sh
– CustomerName-rackname.zip
– pkey_GUID.csv and pkey_racknamehostname_GUID.csv — if you enabled
InfiniBand partitioning for your virtual environments
The CustomerName-hostname.zip file contains all the generated files.
7. Review the InstallationTemplate.html file to check the entire
configuration and verify all information was entered correctly.
• Shortly before your engineered system arrives, or is scheduled to be configured,
validate the network configuration, as directed by Oracle. See Verifying the
Network Configuration Prior to Configuring the Rack.
• After your engineered system arrives, the configuration files are copied to a
database server, and the validation and installation is completed. See Configuring
Oracle Exadata Database Machine Using OEDA.
Accessibility Note: If you are using Oracle Exadata Deployment Assistant with
assistive technology (for accessibility) on Windows, you need to enable Java Access
Bridge.
• Considerations when Using Oracle Exadata Deployment Assistant
Review this information when using Oracle Exadata Deployment Assistant
(OEDA).
• Using Oracle Exadata Deployment Assistant on Systems with Non-Default root
Passwords
You can use the -p option to prompt for a password instead of resetting the root
password to the expected default value.
3-2
Chapter 3
Overview of Oracle Exadata Deployment Assistant
3-3
Chapter 3
Overview of Oracle Exadata Deployment Assistant
• A valid time zone name is required when installing Oracle Exadata Database
Machine. Time zone values provided for Oracle Exadata Database Machine and
Oracle Linux comes from the Time Zone Database. You must specify a valid time
zone name for each server using the TZ environment variable. The variable value
is of the form Area/Location. For example, America/New_York is a valid TZ value;
EST, EDT, and UTC-4 are invalid values.
Related Topics
• iana Time Zone Database
• Maximum Availability with Oracle ASM
3-4
Chapter 3
OEDA Browser-based User Interface
The -p option causes OEDA to prompt for the root password. Make sure you enter
the correct password because an incorrect password will disable root access for 5
minutes by default, and after 5 failed login attempts, the server will be locked down.
Related Topics
• Default Security Settings Enacted by OEDA
The utility is located in the same directory as the install and config scripts.
You cannot use this utility if the servers are locked down.
• To change the password of both oracle and grid users on all database servers
and clusters, run the changePassword command.
For config.xml, specify the full path name to the deployment file created by OEDA.
The utility prompts for the current root password and allows you to change the
password of any users in the rack.
• To change the password for a specific user, such as oracle or grid, use the -
userName user_name option with the command.
• To change the password for all users within a specific cluster, use the -
clusterName cluster_name option with the command.
• Use the -h option with the command to display the usage information.
Note:
The OEDA Web interface does not support Oracle SuperCluster. Instead,
use the configssc.sh command.
You can use this interface to enter configuration details for new racks and also import
configuration files from the old OEDA interface. Use the Menu button to import and
save configurations.
To use the Web-based version of OEDA, perform the following steps.
1. Download the latest release of OEDA.
Extract the contents of the downloaded compressed file. When you extract the
contents, it creates a directory based on the operating system, such as linux-x64,
3-5
Chapter 3
OEDA Browser-based User Interface
./installOedaServer.sh -p 7001
• On Microsoft Windows:
installOedaServer.cmd -p 7001
Note:
You can specify a non-default port (for example 8002) by using a value
other than 7001. However, it is not recommended to use port numbers
less than 1024.
When you run the installOedaServer program, it first stops and removes any
previous installation of the OEDA Web Server. Then it installs and starts the latest
version of the OEDA Web Server on the local system.
3. Access the local OEDA Web Server.
After the OEDA Web Server has been installed, you can access the web-based
application by opening a browser and entering the following URL:
http://localhost:7001/oeda
3-6
Chapter 3
OEDA Browser-based User Interface
3-7
Chapter 3
OEDA Browser-based User Interface
The following list describes the configuration information you specify in OEDA:
1. Select the hardware for the deployment on the Select Hardware page. Also
provide customer information on this page.
2. Choose whether to configuration Oracle VM on the nodes.
Note:
Creating more than 8 VMs on Exadata Database Servers is not
supported.
3. Enter the management network and private network information on the Rack
Networks page.
4. Specify the user and group configuration on the Users and Groups page. You
can choose between Default, Role Separated, or a Custom configuration.
5. Define the clusters on the Define Clusters page for each cluster.
6. Define the disk group layout on the Diskgroups page.
7. Specify the Oracle Database home information for each Oracle home on the
Create Database Home page.
8. Enter the client and backup network information on the Cluster Networks page.
If an ingest network or replication network is needed, specify their information on
the Cluster Networks page.
9. Configure the email alerts, SNMP alerts, Auto Service Request, Oracle Config
Manager, and Enterprise Manager alerting on the Alerting page.
10. Answer the configuration questionnaire and provide additional information about
the deployment in the text field on the Comments page. Information entered in
this field appears at the bottom of the InstallationTemplate.html file.
11. Click Save and Download to create the configuration files. You are prompted to
choose a location in which to save a ZIP file to your local computer.
12. Copy the ZIP file to a directory on the first database server in Oracle Exadata
Rack. Use a subdirectory of /u01, such as the /u01/oeda directory. These files
are used by the field engineer to configure the Oracle Exadata Rack.
3-8
Chapter 3
OEDA Browser-based User Interface
* 8-socket models (X8M-8, X8-8, X7-8, X6-8, and so on): Two 8-socket
database severs and 14 storage servers.
* Storage Expansion Racks (X2, X3, and X4): 18 storage servers
* Half: A standard configuration consisting of:
* 2-socket models (X8-2, X7-2, X6-2, and so on): Four 2-socket
database servers and 7 storage servers
* Storage Expansion Racks (X2, X3, and X4): Nine storage servers
* Quarter: A standard configuration consisting of:
* 2-socket models (X8-2, X7-2, X6-2, and so on): Two 2-socket
database servers and 3storage servers
* Storage Expansion Racks (X2, X3, and X4): Four storage servers
* Eighth: A standard configuration consisting of 2 database servers and 3
storage servers with only half the cores enabled in each server. Available
for 2-socket systems model X3-2 and later.
* Eighth Elastic: A customizable configuration with 2 database servers and
3 storage servers. Available for 2-socket systems model X4-2 and later.
– Compute Node, Storage Cell, and Disk Size: The values you can select for
each successive field are determined by the value you selected for the
previous fields:
* X8-2 Compute Node
* X8 Storage Cell
* HC 14TB (High Capacity 14 TB drives)
* EF 6.4 TB (Extreme Flash 6.4 TB drives)
* X8-8 Compute Node
* X8 Storage Cell
* HC 14TB (High Capacity 14 TB drives)
* EF 6.4 TB (Extreme Flash 6.4 TB drives)
* X7-2 Compute Node
* X7 Storage Cell
* HC 10TB (High Capacity 10 TB drives)
* EF 6.4 TB (Extreme Flash 6.4 TB drives)
* X7-8 Compute Node
* X7 Storage Cell
* HC 10TB (High Capacity 10 TB drives)
* EF 6.4 TB (Extreme Flash 6.4 TB drives)
* X6-2 Compute Node
* X6 Storage Cell
* EF 3.2TB (Extreme Flash 3.2 TB drives)
* HC 8TB (High Capacity 8 TB drives)
* X6-8 Compute Node
3-9
Chapter 3
OEDA Browser-based User Interface
* X6 Storage Cell
* EF 3.2TB (Extreme Flash 3.2 TB drives)
* HC 8TB (High Capacity 8 TB drives)
* X5-8 Compute Node
* X5 Storage Cell
* EF 1.6TB (Extreme Flash 1.6 TB drives)
* HC 8TB (High Capacity 8 TB drives)
* X5-2 Compute Node
* X5 Storage Cell
* EF 1.6TB (Extreme Flash 1.6 TB drives)
* HC 8TB (High Capacity 8 TB drives)
* HC 4TB (High Capacity 4 TB drives)
* X4-8 Compute Node
* X5 Storage Cell
* EF 1.6TB (Extreme Flash 1.6 TB drives)
* HC 8TB (High Capacity 8 TB drives)
* HC 4TB (High Capacity 4 TB drives)
* X4 Storage Cell
* HP 1.2TB (High Performance 1.2 TB drives)
* HC 4TB (High Capacity 4 TB drives)
* X4-2 Compute Node
* X4 Storage Cell
* HP 1.2TB (High Performance 1.2 TB drives)
* HC 4TB (High Capacity 4 TB drives)
* HC 8TB (High Capacity 8 TB drives)
* X4 Storage Expansion Compute Node
* X4 Storage Cell
* HP 1.2TB (High Performance 1.2 TB drives)
* HC 4TB (High Capacity 4 TB drives)
* HC 8TB (High Capacity 8 TB drives)
* X3-2 Compute Node
* X3 Storage Cell
* HP (High Performance drives)
* HC 3TB (High Capacity 3 TB drives)
* HC 4TB (High Capacity 4 TB drives)
* HC 8TB (High Capacity 8 TB drives)
* X3-8 Compute Node
3-10
Chapter 3
OEDA Browser-based User Interface
* X4 Storage Cell
* HP 1.2TB (High Performance 1.2 TB drives)
* HC 4TB (High Capacity 4 TB drives)
* X3 Storage Cell
* HP (High Performance drives)
* HC 3TB (High Capacity 3 TB drives)
* HC 8TB (High Capacity 8 TB drives)
* X3 Storage Expansion Compute Node
* X3 Storage Cell
* HP (High Performance drives)
* HC 3TB (High Capacity 3 TB drives)
* HC 8TB (High Capacity 8 TB drives)
* X2-2 Compute Node
* X2 Storage Cell
* HP (High Performance drives)
* HC 2TB (High Capacity 2 TB drives)
* HC 3TB (High Capacity 3 TB drives)
* HC 4TB (High Capacity 4 TB drives)
* HC 8TB (High Capacity 8 TB drives)
* X2-8 Compute Node
* X2 Storage Cell
* HP (High Performance drives)
* HC 2TB (High Capacity 2 TB drives)
* HC 3TB (High Capacity 3 TB drives)
* HC 8TB (High Capacity 8 TB drives)
* X2 Storage Expansion Compute Node
* X2 Storage Cell
* HP (High Performance drives)
* HC 2TB (High Capacity 2 TB drives)
* HC 3TB (High Capacity 3 TB drives)
– Add Rack (+): Click this button after you have selected the hardware to add
the rack to the configuration and display the Rack Details options.
• Zero Data Loss Recovery Appliance
Supply the following additional information for this choice:
– ZDLRA Server, Capacity, and Cell Count: The model of the ZDLRA rack,
the disk storage types and the cell count. The values you can select for each
successive field are determined by the value you selected for the previous
fields:
3-11
Chapter 3
OEDA Browser-based User Interface
* Server X8-2
* Capacity HC 14TB (High Capacity)
* Server X7-2
* Capacity HC 10TB (High Capacity)
* Server X6-2
* Capacity HC 8TB (High Capacity)
* Server X5-2
* Capacity HC 4TB (High Capacity)
* Capacity HC 8TB
* Server X4 Zdlra
* Capacity: HC 4TB (High Capacity)
* Cell Count: The number of cells in the rack. Choose the value from the
drop-down list. Available values are from 3 to 13. You can also use
the Search field in the drop-down list to find a value.
– Add Rack (+): Click this button after you have selected the hardware to add
the rack to the configuration and display the Rack Details options.
• Exadata Cloud
Supply the following additional information for this choice:
– Exadata cloud options: Select the Exadata deployment option from the list,
for example, Cloud at Customer.
– Rack Size: The size of the rack you are configuring. Your choices are:
* Full: A standard configuration consisting of eight 2-socket database
servers and 12 storage servers.
* Half: A standard configuration consisting of four 2-socket database
servers and 6 storage servers.
* Quarter: A standard configuration consisting of two 2-socket database
servers and 3 storage servers.
* Base Rack: A configuration consisting of 2 database servers and 3
storage servers. You can specify the minimum and maximum number of
compute cores (OCPUs) to enable on each database server.
– Compute Node, Storage Cell, and Disk Size: The values you can select for
each successive field are determined by the value you selected for the
previous fields:
* X8-2 Compute Node
X8 Storage Cell
HC 14TB (High Capacity 14 TB drives)
* X7-2 Compute Node
X7 Storage Cell
HC 10TB (High Capacity 10 TB drives)
* X6-2 Compute Node
X6 Storage Cell
3-12
Chapter 3
OEDA Browser-based User Interface
Rack Details
Provide additional information about the rack and how it will be deployed.
• Rack Name: Value is supplied automatically based on the inputs in the previous
section.
• Rack Prefix: Defines the prefix for network interfaces. The prefix can contain any
alphanumeric character. The prefix cannot contain spaces. The maximum length is
20 characters. This field cannot be empty. The default value is dm01.
For example, a value of dm01 results in a database server host name of dm01db01,
and a storage server host name of dm01cel01.
• Spine Switch: Click the check box if you want to include a spine switch as part of
the rack configuration. Do this for each rack that will have a spine switch.
Customer Details
Provide information about the environment in which the rack will be deployed.
• Customer Name: Identifies the customer. This is a free-form field that can contain
any alphanumeric characters, including spaces. This field cannot be empty.
• Application Name: Identifies the application used with the rack. This is a free-
form field that can contain any alphanumeric characters, including spaces. This
field cannot be empty.
• Region: Sets the region for the rack. Choose a value from the drop-down list. You
can also use the Search field to locate a region. Your choices are:
– Africa
– America
– Antarctica
– Arctic
– Asia
– Atlantic
– Australia
– Europe
– Indian
– Other
– Pacific
• Timezone: Sets the time zone where the rack will be installed. The time zones
shown are based on the selected region. Choose a value from the drop-down list.
• Compute Node #: (only for X5-2 and X6-2 ZDLRA Elastic Rack) Specifies the
number of compute nodes to configure
• Storage Node #: (only for X5-2 and X6-2 ZDLRA Elastic Rack) Specifies the
number of storage nodes to configure
3-13
Chapter 3
OEDA Browser-based User Interface
• DNS Servers: Sets the DNS IP Address. At least one IP address must be entered.
For Exadata Cloud, these values are provided for you.
• NTP Servers: Sets the IP Address for the Network Time Protocol (NTP) server. At
least one IP address must be entered. For Exadata Cloud, these values are
provided for you.
Capacity on Demand
(Available for only Exadata racks X3 and later) Click this check box to reduce the initial
number of active cores on the servers.
If you select this option, a slider bar appears which allows to select the number of
active cores, with a range that is specific to the hardware model of the database
server.
Note:
To qualify for Capacity on Demand, within 3 months after installation, this
Exadata system must use either Platinum Services, Oracle Enterprise
Manager Harvester (in disconnected or connected mode) or Oracle
Configuration Manager (in connected mode).
Save
After you have entered all the information for the racks being configured, click the
Save button in the lower right corner of the page.
3-14
Chapter 3
OEDA Browser-based User Interface
Admin Network
Supply values for the following fields. For Exadata Cloud, these values are provided
for you.
• Default gateway for database servers: A check box that indicates that the
gateway IP address is the default gateway for the database servers.
• Gateway: Sets the IP address for the gateway. This field cannot be empty.
• Start IP Address: Assigns the starting IP address for the administration network
of the servers and switches. This field cannot be empty.
Oracle Exadata Deployment Assistant (OEDA) generates a pool of consecutive IP
addresses based on the specified Start IP Address. If consecutive IP addresses
are not available, then specific IP addresses can be modified during the
configuration process.
3-15
Chapter 3
OEDA Browser-based User Interface
Note:
These addresses are also assigned to the ILOM ports on the database
and storage servers
• Subnet Mask: Sets the IP address mask for the subnet. You can choose a subnet
mask from the drop-down list which contains supported values from 255.0.0.0 to
255.255.255.252
• Domain Name: Sets the network domain name. Use lowercase letters for the
name. This field cannot be empty.
The domain name specified on this page is used as the domain for all networks. If
different domains are used for the client and backup networks, then specify the
administration network on this page. The client and backup networks can be
changed on the Cluster Networks page.
• Separate ILOM Network: (Not available with Exadata Cloud) A check box that
indicates that ILOM uses a network that is different from the administration
network. If you check this option, you must specify the following additional
information for the ILOM network:
– Gateway
– Start IP Address
– Subnet Mask
– Domain Name
Advanced
(Not available with Exadata Cloud) If you click the Advanced button in the upper right
corner of this page, you can select the following options:
• Remove PDU's — Select this option if you do not want to add administration IP
addresses to the PDUs. If you select this option, then OEDA does not allocate IP
addresses for each of the two PDUs in the rack, and the administration names do
not appear in the Admin network Review and Edit section of this page.
• Enable Vlan — Allows you to create VLANs on database servers and storage
servers for the admin network, ILOM, client and the backup access network. If you
select this option, then the following additional fields are visible on the Admin
Network page:
– Vlan — Specifies the VLAN identifier. The value must be a positive integer.
3-16
Chapter 3
OEDA Browser-based User Interface
Note:
* If your system will use more than 10 VIP addresses in the cluster
and you have VLAN configured for the Oracle Clusterware client
network, then you must use 3 digit VLAN ids.
* Do not use 4 digit VLAN ids because the VLAN name can
exceed the 15 character operating system interface name limit.
* If VLAN tagging is to be used, then it must be enabled by the
customer after the initial deployment.
See the My Oracle Support notes for details.
Modify Masks
(Not available with Exadata Cloud) If you click the button Modify Masks, it opens a
pop-up window where you can enter the following information:
• Compute Name Mask — There is a preview field at the bottom of this window that
shows how the generated administration names will appear based on the values
you specify for the following fields:
Note:
In the following fields, the name prefix can contain alphanumeric
characters. The percent signs (%) in the names are replaced by the
numbers entered into the Start ID field. At least one percent sign is
required in each mask field. If you use more than one percent sign in a
mask field, the symbols must be contiguous. For example, you can use
test%%-ilom, but not test%new%-ilom.
– Compute Name Mask: The string used to generate administration names for
each database server in this rack. The default string is {Rack Prefix}adm%%,
which results in names such as dbm0adm01, dbm0adm02, and so on. This field
cannot be empty.
– Compute Name Start Id: The starting value to use when generating the
database server administration names. The default value is 1. This field
cannot be empty.
• Compute ILOM Mask — There is a preview field at the bottom of this section that
shows how the generated administration names will appear based on the values
you specify for the following fields:
– Compute ILOM Mask: The string used to generate administration names for
each database server ILOM in this rack. The default string is {Compute Name
Mask}%-ilom, which results in names such as dbm0adm01–ilom, dbm0adm02–
ilom, and so on. This field cannot be empty.
– ILOM Name Start Id: The starting value to use when generating the ILOM
administration names. The default value is the same value as Compute Name
Start Id. This field cannot be empty.
3-17
Chapter 3
OEDA Browser-based User Interface
Note:
Oracle recommends using the same starting IDs for the servers and
server ILOMs.
• Storage Name Mask — There is a preview field at the bottom of this section that
shows how the generated administration names will appear based on the values
you specify for the following fields:
– Storage Name Mask: The string used to generate administration names for
each storage server. The default string is {Rack Prefix}celadm%%, which
results in names such as dbm0celadm01, dbm0celadm02, and so on. This field
cannot be empty.
– Storage Name Start Id: The starting value to use when generating the
storage server network names. The default value is 1. This field cannot be
empty.
• Storage ILOM Mask — There is a preview field at the bottom of this section that
shows how the generated server names will appear based on the values you
specify for the following fields:
– Storage ILOM Mask: The string used to generate administration names for
each storage server ILOM in this rack. The default string is {Storage Name
Mask}%-ilom, which results in names such as dbm0celadm01–ilom,
dbm0celadm02–ilom, and so on. This field cannot be empty.
– Storage Name Start Id: The starting value to use when generating the ILOM
network names. The default value is the same value as Storage Name Start
Id. This field cannot be empty.
Note:
Oracle recommends using the same starting IDs for the servers and
server ILOMs.
3-18
Chapter 3
OEDA Browser-based User Interface
– PDU-A — The string used to generate the administration names for Power
Distribution Unit (PDU) A in this rack. The default value is {Rack Prefix}sw-
pdua%, which results in names such as dbm0sw-pdua1.
– PDU-B — The string used to generate the administration names for Power
Distribution Unit (PDU) B in this rack. The default value is {Rack Prefix}sw-
pdub%, which results in names such as dbm0sw-pdub1.
– KVM Switch — (Exadata X2-2 only) The string used to generate the
administration name for the keyboard, video, and mouse (KVM) switch. The
default value is {Rack Prefix}sw-kvm%, which results in names such as
dbm0sw-kvm1.
After you have entered the custom network name masks, click the Save button at the
bottom of the page. To undo your changes, you can either close the window or click
the Cancel button at the bottom of the page.
Private Network
Provide the information necessary to configure the private network on the rack.
In the upper right corner of the Private Network section is a line that displays the Total
IP Addresses that will be configured for the rack. This value is based on the hardware
you selected on the Hardware page. For Exadata Cloud, these values are provided for
you.
• Enable active bonding — (Exadata and ZDLRA racks only, X4-2 or higher)
Specifies whether active bonding should be enabled for only the private network
on compute nodes. By default this option is selected.
You should only use a non-default option if you are adding a compute node to a
cluster that contains other compute nodes that are X3 or earlier models.
• Start IP Address: Assigns the starting IP address for the private network of the
servers. This field cannot be empty.
OEDA generates a pool of consecutive IP addresses based on the specified Start
IP Address. If consecutive IP addresses are not available, then specific IP
addresses can be modified during the configuration process.
• Subnet Mask: Sets the IP address mask for the subnet. You can choose a subnet
mask from the drop-down list. The list contains supported values from
255.255.240.0 to 255.255.255.252
3-19
Chapter 3
OEDA Browser-based User Interface
• Domain Name: Sets the network domain name. The default value is the domain
name value entered for the Admin Network. Use lowercase letters for the name.
This field cannot be empty.
(Not available with Exadata Cloud) If you click the Modify Masks button, it opens a
popup window where you can modify the generated names for the database and
storage server private names. There are preview fields at the bottom of this window
that shows how the generated private names will appear based on the values in the
name mask fields. The default strings used to generate the private names are:
• Compute private name mask: {Rack prefix}adm%%-priv, which results in names
such as dbm0adm01–priv, dbm0adm02–priv, and so on
• Cell private name mask: {Rack Prefix}celadm%%-priv, which results in names
such as dbm0celadm01–priv, dbm0celadm02–priv, and so on.
After you have entered the custom private network name masks, click the Save button
at the bottom of the page. To undo your changes, you can either close the window or
click the Cancel button at the bottom of the page.
After you have entered the private network configuration information, click the Save
button at the bottom of the page.
3-20
Chapter 3
OEDA Browser-based User Interface
you can click the Add group (+) button. The information you entered is saved with the
label UserCollection-1_id. A new section appears on the page where you can enter
information for an additional group of software installation users with distinct names
and permissions. The new user information collection is automatically assigned the
label UserCollection-2_id.
If you want to remove a user information collection, click the Delete Group (-) button
next to the ID of the group you want to remove.
After you have entered all the user information, click the Save button at the lower right
side of the page to continue.
3-21
Chapter 3
OEDA Browser-based User Interface
3-22
Chapter 3
OEDA Browser-based User Interface
3-23
Chapter 3
OEDA Browser-based User Interface
* Group Name: The name of the operating system group that will be the
Oracle Database DBA group. The default value is dba. This field cannot be
empty.
* Group Id: The operating system identification number for the Oracle
Database DBA group. This field cannot be empty. The default value is
1002.
* Group Type: The group type. The default value is ORADBA.
– Oracle RAC Operator group information:
* Group Name: The name of the operating system group that will be the
Oracle RAC Operator group, or other group type you select. The default
value is racoper. This group of operating system users has a limited set of
Oracle RAC instance administrative privileges that includes starting and
stopping the Oracle RAC database instances. This field cannot be empty.
* Group Id: The operating system identification number for the Oracle RAC
Operator group, or other group type that you select. This field cannot be
empty. The default value is 1003.
* Group Type: The group type. The default value is RACOPER.
– Oracle software installation group information:
* Group Name: The name of the operating system group that owns the
Oracle Inventory. The default value is oinstall. This field cannot be
empty.
* Group Id: The operating system identification number for the Oracle
Inventory group. This field cannot be empty. The default value is 1001.
* Group Type: The group type. This value is automatically set to OINSTALL
and cannot be changed.
3-24
Chapter 3
OEDA Browser-based User Interface
• User Name: The operating system user name that will own the Oracle software.
This field cannot be empty. The default value is oracle.
• User Id: The operating system identification number for this user. This field cannot
be empty.
• Home Directory: The user home directory. This field cannot be empty. The
default value is /home/username.
• User Type: The type of software user. You can choose from the following values:
– Grid and Database: The user will have permissions for both the Oracle
Database and the Oracle Grid Infrastructure software installations.
– Grid: The user will have permissions for the Oracle Grid Infrastructure
software installation.
– Database: The user will have permissions for the Oracle Database software
installation.
– custom: The user type does not fit a pre-defined model.
• Group Name: The name of the operating system group to which the user will be
assigned. This field cannot be empty.
• Group Id: The operating system identification number for the operating system
group. This field cannot be empty.
• Group Type: The group type. You can choose from the list of pre-defined group
types.
After you have entered the user and group information, you can click the Add User (+)
button to add a new section. You can also click the Add Group (+) button to add an
additional operating system group for the specified user.
Save
After you have entered all the information for the racks being configured, click the
Apply button. Be sure to go to the Menu and select Save.
3-25
Chapter 3
OEDA Browser-based User Interface
• Cluster Name: The cluster name, which must be unique across your enterprise.
The cluster name is case-insensitive, must be at least one character long and no
more than 15 characters in length, must be alphanumeric, cannot begin with a
numeral, and may contain hyphens (-). Underscore characters (_) are not allowed.
This field cannot be empty.
• Inventory Location: The Oracle inventory (oraInventory) directory path. The
default value is /u01/app/oraInventory.
• Grid Home Owner: Use the drop-down list to select the collection of user
information previously created on the Users page. By default, the first user
collection is selected.
• Grid Infrastructure Home Location: The Oracle Grid Infrastructure directory
path, which typically includes the software release number. The default value
is /u01/app/release_number/grid, for example, /u01/app/18.2.0.0/grid.
This value is automatically set depending on the value selected for Cluster
Version. You can overwrite the default value.
• Cluster Version: After you select the nodes to assign to this cluster, you will be
able to select the cluster version from the drop-down list. The list contains all
supported versions of the Oracle Grid Infrastructure. Choose any of the supported
values.
• Base Directory: The base directory for the Oracle Grid Infrastructure software.
The default value is /u01/app/grid.
After you assign nodes to the cluster, you can modify the default values for each
cluster, if needed. The following customer information fields appear below the
Available Machines list:
• Customer Name: The customer name. The default value is the value you
provided earlier on the Hardware page in the Customer Details section.
• Application: The application name or description. The default value is the value
you provided earlier on the Hardware page in the Customer Details section.
• Region: The geographical location of the rack. The default value is the value you
provided earlier on the Hardware page in the Customer Details section.
• Time zone: The time zone in which the rack is located. The default value is the
value you provided earlier on the Hardware page in the Customer Details section.
• DNS Servers: The IP addresses for the DNS servers. The default values are the
values you provided earlier on the Hardware page in the Customer Details section.
• NTP Servers: The IP addresses for the NTP servers. The default values are the
values you provided earlier on the Hardware page in the Customer Details section.
The following additional information fields help allocate resources across multiple
clusters:
• Cores: The number of cores to use for each guest VM for this cluster. The
minimum value is 2 cores per guest. This field cannot be empty.
• vCPU: The number of virtual CPUs for each guest VM in this cluster. The
minimum value is 4 vCPUs per guest. This is not modifiable, and is automatically
set to twice the core count.
• Memory: The amount of memory in GB allocated to the guest VMs, or user
domains (domU), for this cluster. This field cannot be empty.
3-26
Chapter 3
OEDA Browser-based User Interface
• Increased compute node memory: This check box allows database servers to
be configured with higher memory.
• Local Disk(GB): The amount of local disk space to use on the servers for this
cluster. This field cannot be empty.
If you assign Oracle VMs to your cluster, then you need to provide the following
information:
• Guest Image Version: The Oracle Exadata System Software image version for
guest VMs. Use the drop-down list to select the value. Selecting the default
option sets the guest image version to match the image version of dom0.
Note:
The guest image version must be the same as or an earlier version than
the image version of the management domain (dom0).
3.2.7 Diskgroups
Define the Oracle ASM disk groups and their sizes for each cluster in the rack. This
page is not available for Exadata Cloud.
If you specified more than one cluster, use the tabs at the top of this page to select
each cluster and provide the disk group information.
ZDLRA Racks
For ZDLRA racks, the following information is used:
• Diskgroup name: Automatically set to CATALOG and DELTA
• Diskgroup Type: Automatically set to CATALOG and DELTA
• Redundancy: The CATALOG disk group is configured to use NORMAL
redundancy. For the DELTA disk group, you can choose either HIGH or NORMAL
(default).
• Size: The CATALOG disk group has a size of Default, and the DELTA disk group
has a size of 95%.
• Size Type: The disk group sizes are specified as percent.
After you have entered the values for the disk groups and clicked Save, the following
fields are then populated with the estimated values:
• CATALOG disk group — The usable space and raw size are set to default.
• DELTA disk group — The values depends on the hardware selected, for example,
with NORMAL redundancy selected, there is 312007GB of usable space and
624013GB raw disk size for HC 10TB disks.
Exadata Racks
For Exadata racks, you must provide the following information:
• Diskgroup layout: The ratios to use when creating the disk groups. The options
are:
3-27
Chapter 3
OEDA Browser-based User Interface
– Legacy 80% 20% — Useful when using external backups. The DATA disk
group is assigned 80% of the available disk space and the RECO disk group is
assigned 20% of the available disk space.
– Legacy 40% 60% — Useful when using internal backups. The DATA disk
group is assigned 40% of the available disk space and the RECO disk group is
assigned 60% of the available disk space.
– Custom — Select this option when you want a non-standard layout for the
disk groups. For example, if you want to create additional disk groups, or use
percentages that are not 20%, 40%, 60%, or 80%.
• Diskgroup name: The name for the disk group. You must specify a name for each
disk group you specify. Default names are provided, such as DBFSC1, DATAC1
and RECOC1.
Note:
If you selected X8 or X7 hardware, then you cannot specify any
information for the DBFS disk group.
• Type: The type of data to store in the disk group. Possible values are DATA, RECO,
DBFS (automatically supplied).
• Redundancy: The redundancy level for the disk group. Possible values are HIGH,
NORMAL, or UNUSED.
Note:
Oracle recommends the use of HIGH redundancy disk groups for mission
critical applications.
• Size: The amount of available disk space to use when creating this disk group.
You can enter either a percentage, such as 40%, or the actual size specified in GB
or TB, such as 250GB. For the DBFS disk group, the size is set to Default.
• Size Type: Whether the value specified was a percentage or actual disk size. The
drop-down list contains the values percent, usable size, or slice size. You
must use the same Size Type for all disk groups.
You can configure additional disk groups by clicking the Add new diskgroup (+)
button. Enter the same information for the new diskgroup as you did for the DATA and
RECO disk groups. For the Type, you must specify a different type, such as
DBFS_DG. If you try to create more than one DATA or one RECO disk group, you will
get an error when you click Save. If you want to remove a disk group, you can click the
remove last diskgroup (-) button. You must have at least one DATA and one RECO
disk group.
After you have entered the values for the disk groups, click Save. The following fields
are then populated with the estimated values:
• Usable Space — The amount of usable disk space available in the disk group,
accounting for redundancy, for example 204355GB.
• Raw Size — The total disk space used by the disk group, for example 613066GB.
3-28
Chapter 3
OEDA Browser-based User Interface
Advanced Options
In the upper right corner of this page is a check box labeled Advanced. If you click this
box, then the following options are available:
• Enable sparse diskgroup — Enables the creation of sparse disk groups. Sparse
grid disks can be used to create a sparse disk group to store database files that
will use a small portion of their allocated space. Sparse grid disks allocate space
as new data is written to the disk, and therefore have a virtual size that can be
much larger than the actual physical size.
Note:
To create a sparse disk group, the version of Oracle Grid Infrastructure
software needs to be release 12.1.0.2 BP5 or later.
If you choose this option, a new disk group appears in the list, with a default name
of SPARSEC1. Also, the Type field for this disk group is set to SPARSE.
• Configure Acfs — a button that opens a popup window where you can configure
Oracle ASM Cluster File System (Oracle ACFS). Oracle ACFS provides a general
purpose file system. The following information is required to configure Oracle
ACFS:
– Enable ACFS for disk group — you must check this option.
– Diskgroup — The disk group to use as the Oracle ACFS disk group, The
drop-down list contains the names of the disk groups specified on the
Diskgroups page.
Note:
You should use a different group than DATA or RECO for Oracle
ACFS. Use the Add new diskgroup (+) button on the Diskgroups
page to add another disk group.
– ACFS Volume Name — The volume name to associate with this disk group.
This field cannot be empty.
– ACFS Volume Size — The size of the Oracle ACFS volume. This field cannot
be empty.
– ACFS Mount Path — The mount path for the Oracle ACFS volume. This field
cannot be empty.
When you have finished configuring Oracle ACFS, click the Save button in the ACFS
Configuration window.
3-29
Chapter 3
OEDA Browser-based User Interface
Specify how to configure the Oracle Database software installation by providing the
following information:
• DB Home Type: The type of Oracle Database deployment — either RAC Home
(for Oracle Real Application Clusters (Oracle RAC) or Oracle RAC One Node) or
single instance.
• Select Cluster: The cluster on which to deploy the Oracle Database software.
This is a drop-down list that is populated with the cluster names specified on the
Clusters page. By default, the first cluster is selected.
• Database Home Name: A name given to the Oracle Database software
installation. This name identifies the program group associated with a particular
home and the Oracle services installed on this home. The Oracle home name
must be between 1 to 127 characters long, and can include only alphanumeric
characters and underscores. This field cannot be empty. The default value is
DbHome_1.
• Database Home Version: The version of the Oracle Database software to install
in the cluster. Choose the value from the drop-down list. The most recent version
is selected by default.
• Database Home Location: A directory path where the Oracle Database software
will be installed. This value is set automatically based on the value specified for
the Database Home Version. For example, if you select version 12.1.0.2 DBBP13,
then the Database Home Location is set to /u01/app/oracle/product/
12.1.0.2/dbhome_1. After specifying the Database Home Version, you can
type over the default value to use a different location, if needed. This field cannot
be empty.
• Base Directory: The Oracle Base directory location. The Oracle Database binary
home is located underneath the Oracle base path. You can use the same Oracle
base directory for multiple installations of Oracle software. If different operating
system users install Oracle software on the same system, then you must create a
separate Oracle base directory for each installation owner. This field cannot be
empty. The default value is /u01/app/oracle.
• Database Home Owner: Use the drop-down list to select the collection of user
information previously created on the Users page. By default, the first user
collection is selected.
• Available Computes and Selected Computes — If you chose Single Instance
Home for the DB Home Type, then you select the database servers on which you
want to install the Oracle Database software. If you selected RAC Home for the
DB Home Type, then the Oracle Database software is automatically installed on
every database server in the specified cluster.
Use the Add Node (>) or Add All Nodes (>>) buttons to move servers from the
Available Computes list to the Selected Computes list. Use the Delete Node (>) or
Delete All Nodes (>>) buttons to remove servers from the Selected Computes list.
To specify multiple Oracle homes, use the Add Database Home (+) button at the top
of this page, next to the tab for the existing Oracle home. To remove an Oracle Home,
click the X on the tab, next to the name of the Oracle home.
When you have finished configuring the Oracle home information, click Apply and
then Save from the Menu.
3-30
Chapter 3
OEDA Browser-based User Interface
3.2.9 Database
Provide information about the databases to create in the specified database home
directories.
For Exadata Cloud configurations, you can specify the name of the database. All other
options are pre-configured and cannot be modified.
• Database Name: The name of the database you want to create in the database
home. The database name (DB_UNIQUE_NAME) portion is a string of no more than
30 characters that can contain alphanumeric, underscore (_), dollar ($), and pound
(#) characters, but must begin with an alphabetic character. No other special
characters are permitted in a database name. The DB_NAME parameter for a
database is set to the first 8 characters of the database name. The domain portion
of the global database name (DB_DOMAIN) uses the value you provided for the
domain when configuring the networks. The values for
DB_UNIQUE_NAME.DB_DOMAIN in its entirety must be unique within the enterprise.
This field cannot be empty.
• Database Home: The name of the Database Home in which you want to create
the database. This value is automatically populated with the first home specified
on the Database Home page.
Use the drop down list to select the database home name if you specified multiple
database homes on the Database Home page.
• Database Type: (Exadata racks only) The type of database to create in the
database home selected. If the database software was installed with the type
Oracle Real Application Clusters (Oracle RAC) (as specified on the Database
Home page), then you can choose to create either a Oracle RAC database or an
Oracle RAC One Node database. If you selected a DB Home Type of single
instance for the database home, then the Single Instance DB option is selected
automatically and cannot be changed.
• Database Owner: Use the drop-down list to select the collection of user
information previously created on the Users page. By default, the first user
collection is selected.
• Character Sets: (Exadata racks only) Specifies the character set to use with the
database. Use the drop-down list to select one of the available values. Character
sets are the encoding schemes used to display characters on your computer
screen. The character set determines what languages can be represented in the
database. The recommended value is Unicode AL32UTF8.
• Database Template: (Exadata racks only) The template to use when configuring
the database. Preconfigured databases are based on templates that Oracle
provides or that you create. Each Oracle-provided template is optimized for a
particular workload type. The two options are online transaction processing
(OLTP) or data warehousing (DW).
• Block Size: (Exadata racks only) The database block size. The default value is
8192. You can use the drop-down list to select a different value. Supported values
range from 8KB to 32KB.
• DATA Diskgroup: (Exadata racks only) The name of the Oracle ASM disk group
to use when creating data files for the database. You can use the drop-down list to
select one of the disk groups you configured on the Diskgroups page. The disk
group selected must have disk group type set to DATA.
3-31
Chapter 3
OEDA Browser-based User Interface
• RECO Diskgroup: (Exadata racks only) The name of the Oracle ASM disk group
to use when creating the recovery area for the database. You can use the drop-
down list to select one of the disk groups you configured on the Diskgroups page.
The disk group selected must have disk group type set to RECO.
• Enable CDB: (Exadata racks only) Select this check box to create the database
as a Oracle Multitenant container database (CDB) with a single pluggable
database (PDB). See "Deciding Between Multitenant Container Databases and
Non-CDBs in Oracle RAC" in Oracle Real Application Clusters Installation Guide
for Linux and UNIX for information about whether to select this option. If you select
this option, then you must provide the following additional information:
– PDB Name: The name of the PDB to create in the container database.
You can use the Add Pdb Name (+) button to add additional PDBs to the
configuration. If you want to remove a PDB, you can use the Remove Pdb Name
(-) button that appears to the right to the PDB name you want to remove.
• Available Computes and Selected Computes — (Exadata racks only) If you
chose RAC One Node DB or Single Instance DB for the Database Type, then you
select the database servers on which you want to create the database instance.
Selecting one node deploys Oracle RAC One Node on a single node. Oracle
recommends that you select all nodes in the cluster to which you want Oracle RAC
One Node to be able to fail over.
Use the Add Node (>) or Add All Nodes (>>) buttons to move servers from the
Available Computes list to the Selected Computes list. Use the Delete Node (>) or
Delete All Nodes (>>) buttons to remove servers from the Selected Computes list.
When you have finished configuring the database configuration information, click Save
from the Menu.
Admin Network
For some Exadata rack configurations, at the top of the Cluster Networks section, on
the right side, is a check box Enable Admin network. You can use this option to
configure an Admin network inside a virtual compute server. This option is not
required. If you select this option, you can fill in the following information:
3-32
Chapter 3
OEDA Browser-based User Interface
• Default gateway for database servers: Select this option if the gateway IP
address is the default gateway for all database servers
• Defines Domain hostname for database servers: Select this option if you want
the name used for the Admin network on a virtual compute server to be used as
the host name for the virtual compute server. If you do not select this option, then
the virtual compute server uses the network name assigned to the client network
as the host name.
• Gateway: Sets the IP address for the gateway for the client network. This field
cannot be empty.
• Start IP Address: The first IP address that will be used for client access to the
database servers. This value is filled in automatically, based on the value supplied
for the gateway. OEDA generates a pool of consecutive IP addresses based on
the specified Start IP Address. If consecutive IP addresses are not available, then
specific IP addresses can be modified using the Modify Masks button. This field
cannot be empty.
• Subnet Mask: Sets the IP address mask for the subnet. You can choose a subnet
mask from the drop-down list which contains supported values from 255.0.0.0 to
255.255.255.252.
• Domain Name: Sets the network domain name for client connections. Use
lowercase letters for the name. This field cannot be empty. For Exadata Cloud
configurations, this value is provided for you.
After you have specified all the configuration details for the Admin network, click the
Apply button at the bottom of the section, or click Modify Masks to customize the
network configuration.
Modify Masks
If you click the Modify Masks button, it opens a pop-up window where you can modify
the generated names for the client or ingest network. There are preview fields at the
bottom of each section that show how the generated network names will appear based
on the values in the name mask fields. The default strings used to generate the
network names are:
• Client Access Details:
– Name:
* Exadata racks: {Rack prefix}db%%, which results in names such as
dbm0db01, dbm0db02, and so on
* ZDLRA racks: {Rack prefix}ingest%%, which results in names such as
{Rack prefix}ingest01, {Rack prefix}ingest02, and so on
– Start id: The number to start with when generating sequential names.
• Vip details:
– Name:
* Exadata racks: {Rack prefix}db%%-vip, which results in names such as
dbm0db01, dbm0db02, and so on
* ZDLRA racks: {Rack prefix}ingest%%-vip, which results in names such
as {Rack prefix}ingest01–vip, {Rack prefix}ingest02–vip, and so on
– Start id: The number to start with when generating sequential names.
3-33
Chapter 3
OEDA Browser-based User Interface
• Scan details: The configuration details for the single client access network (SCAN)
listener.
– Name: The name of the listener. The default value is {Rack prefix}-scan1.
– Port: The network port which the SCAN listener monitors for incoming
connection requests. The default value is 1521.
After you have completed the modifications to the client or ingest network
configuration, click the Apply button at the bottom of the Client Network Masks
window. To undo your changes, you can either close the window or click the Cancel
button at the bottom of the Client Network Masks window.
Advanced
At the very top of the Cluster Networks section, before the Client Network or Ingest
Network configuration details, there is a button for Advanced configuration. If you click
this button, the Advanced options window appears. There are two options you can
select in this window:
• Enable Vlan: Select this option if there is a need for virtual deployments on the
rack to access additional virtual local area networks (VLANs) on the network, such
as enabling network isolation across user domains.
If you select this option, then in the client or ingest network configuration details,
an additional field appears:
– Vlan: The VLAN identifier. The VLAN ID is a numeric value between 1 and
4095. You also need to select the Bonded option to enable VLAN. If the
Backup or Replication network uses VLAN, then the Client or Ingest network
must also be configured to use VLAN. If the VLAN ID field is empty, then
VLAN is not enabled.
Note:
For all networks, you are responsible for configuring VLAN on the switch.
3-34
Chapter 3
OEDA Browser-based User Interface
• If you select one of the SFP28 network types, then you must additionally specify
whether to use 10 Gbit or 25 Gbit connections.
Client (Ingest) network format: (For X7 or later racks for Exadata and ZDLRA)
Specifies the Ethernet cards, based on the hardware selected on the first page
and the type of cable being used.
Options for X7-2 and Later Systems:
On X7 or later racks for Exadata and ZDLRA, there are 3 available formats for
client networks or ingest networks:
– RJ45/SFP28 Combined on Motherboard
* RJ45 1/10 Gbit
* SFP28 10 Gbit
* SFP28 25 Gbit
– SFP28 PCI Dual Port Card
* SFP28 10 Gbit
* SFP28 25 Gbit
– SFP28 2nd PCI Dual Port Card (extra cost option on X8 systems, not available
my default)
– RJ45 PCI Quad Port Card (extra cost option, not available my default)
Options for Exadata X7-8 or Later Systems:
On Exadata X7-8 or later systems, there are 2 available formats for client and
backup networks:
– RJ45 on Motherboard
– SFP28 PCI Dual Port Cards
* SFP28 10 Gbit
* SFP28 25 Gbit
• Bonded: For X7 or later racks and Exadata Cloud, only bonded networks are
supported.
For X6 and earlier racks of Exadata and ZDLRA, or Exadata Cloud, select this
option if using a bonded network.
• LACP: Check this option to enable the Link Aggregation Control Protocol (LACP)
on the network.
• Gateway: Sets the IP address for the gateway for the network. This field cannot
be empty.
• Start IP Address: The first IP address that will be used for access to the database
servers on this network. This value is filled in automatically, based on the value
supplied for the gateway. OEDA generates a pool of consecutive IP addresses
based on the specified Start IP Address. If consecutive IP addresses are not
available, then specific IP addresses can be modified using the Modify Masks
button. This field cannot be empty.
• Subnet Mask: Sets the IP address mask for the subnet. You can choose a subnet
mask from the drop-down list which contains supported values from 255.0.0.0 to
255.255.255.252.
3-35
Chapter 3
OEDA Browser-based User Interface
• Domain Name: Sets the network domain name for client or ingest connections.
Use lowercase letters for the name. This field cannot be empty. For Exadata Cloud
configurations, this value is provided for you.
After you have specified all the configuration details for the client or ingest network
configuration, click the Apply button at the bottom of the section.
Private Network
This section appears only if you select the Advanced network option Enable InfiniBand
Partitioning or if you selected Exadata Cloud for the hardware.
In the upper right corner of the Private Network section is a line that displays the Total
IP Addresses that will be configured for the rack for this section. At the top of the
section are tabs, each designating one of the clusters you specified on the Clusters
page.
You provide the following information for each cluster to configure InfiniBand
Partitioning:
• Cluster pkey:
– Pkey: (Not available for Exadata Cloud) Sets the address for the database
servers or compute nodes. This address is used by all database servers or
compute nodes in the cluster. The first cluster address is set to 0xa010, the
second cluster address is set to 0xa011, and so on.
Note:
Each cluster must have a unique address.
By default, OEDA deployment with pkeys will set the default membership in
the InfiniBand fabric to limited. However, you can choose to have both full and
limited membership, or shared membership.
– Domain Name: (Not available for Exadata Cloud) The domain name for the
InfiniBand network, if it is different.
– Start IP Address: Sets the starting IP address for the cluster’s network.
Oracle recommends using the default IP address.
– Subnet Mask: (Not available for Exadata Cloud) Sets the subnet mask for the
InfiniBand network. The drop-down list contains values from 255.255.240.0 to
255.255.255.252.
3-36
Chapter 3
OEDA Browser-based User Interface
– Name Mask: (Not available for Exadata Cloud) Defines the mask used to
generate network names for this cluster. The default value is {Rack
Prefix}adm%%-priv, which results in names such as dbm0adm01-priv,
dbm0adm02-priv, and so on.
– Start Id: (Not available for Exadata Cloud) Sets the starting identifier for this
cluster. The default value is 1.
• Storage pkey (Not available for Exadata Cloud):
– Pkey: Sets the address for the storage servers or cells. This address is used
by all storage servers or cells in the rack. The default value is 0xaa10.
– Domain Name: The domain name for the InfiniBand network for the storage
servers or cells, if it is different.
3-37
Chapter 3
OEDA Browser-based User Interface
* SFP28 10 Gbit
* SFP28 25 Gbit
– SFP28 PCI Dual Port Card
* SFP28 10 Gbit
* SFP28 25 Gbit
– RJ45 PCI Quad Port Card (extra cost option)
Options for Exadata X7-8 or Later Racks:
There are 2 available formats for client and backup networks:
– RJ45 on Motherboard
– SFP28 PCI Dual Port Cards
* SFP28 10 Gbit
* SFP28 25 Gbit
If you select one of the SFP28 network types on X7 or later racks, then you must
additionally specify whether to use 10 Gbit or 25 Gbit connections.
• Bonded: (Not available on X7 or later racks or Exadata Cloud) Select this option
to use network bonding. For X7 or later racks for Exadata and ZDLRA, and
Exadata Cloud, only bonded networks are supported.
• LACP: Check this option to enable the Link Aggregation Control Protocol (LACP)
on the network.
• Gateway: Sets the IP address for the gateway for the network. This field cannot
be empty.
• Start IP Address: The first IP address that will be used for the network. This value
is filled in automatically, based on the value supplied for the gateway. OEDA
generates a pool of consecutive IP addresses based on the specified Start IP
Address. If consecutive IP addresses are not available, then specific IP addresses
can be modified using the Modify Masks button. This field cannot be empty.
• Subnet Mask: Sets the IP address mask for the subnet. You can choose a subnet
mask from the drop-down list which contains supported values from 255.0.0.0 to
255.255.255.252.
• Domain Name: (Not available for Exadata Cloud) Sets the network domain name
for network connections. Use lowercase letters for the name. This field cannot be
empty.
After you have specified all the configuration details for the network configuration, click
the Apply button at the bottom of the section.
(Not available for Exadata Cloud) If you click the Modify Masks button, it opens a
pop-up window where you can modify the generated names for the network. There is a
preview field at the bottom of the window that shows how the generated network
names will appear based on the values in the name mask fields. The default strings
used to generate the network names are:
• Client Access Details:
– Name:
* Exadata racks: {Rack prefix}db%%, which results in names such as
dbm0db01, dbm0db02, and so on
3-38
Chapter 3
OEDA Browser-based User Interface
3.2.11 Alerting
In this section you configure alerting (Not available for Exadata Cloud).
You use the following methods for receiving or handling alerts:
3-39
Chapter 3
OEDA Browser-based User Interface
Note:
Additional SNMP targets may be defined after installation of the
Exadata rack. Refer to the ALTER CELL CellCLI command or the
ALTER DBSERVER DBMCLI command.
– Port: Sets the SNMP email server port used to send alert notifications. The
default value is 162. This field cannot be empty.
– Community: Sets the SNMP server community. The default value is public.
This field cannot be empty.
• Enable ASR Alerting: Enables Oracle Auto Service Request (ASR). Oracle ASR
is designed to automatically open service requests when specific rack hardware
faults occur.
Oracle recommends that you install Oracle ASR Manager on an external,
standalone server. The server must be installed have connectivity to the Exadata
servers or Recovery Appliance nodes and an outbound Internet connection using
HTTPS or an HTTPS proxy. This server must run an Oracle Solaris or Linux
operating system.
– ASR Manager Request: The host name of the Oracle ASR Manager server.
This field cannot be empty.
3-40
Chapter 3
OEDA Browser-based User Interface
– HTTP Proxy Host: If you want to enable an HTTP proxy to upload to Oracle
ASR, then specify the proxy server host name.
– Contact Name: The name of the technical contact person for the rack. This
field cannot be empty.
– Contact Email: The e-mail address of the technical contact for the rack. This
field cannot be empty.
– HTTP Proxy User: If you want to enable an HTTP proxy to upload to Oracle
ASR, then specify the proxy server user name.
– Port: If you want to enable an HTTP proxy to upload to Oracle ASR, then
specify the HTTP proxy server port number.
– My Oracle Support Account Name: The email address of the My Oracle
Support account. This field cannot be empty.
• Enable OCM Alerting: Enables Oracle Configuration Manager to collect
configuration information.
Oracle Configuration Manager is used to collect configuration information and
upload it to an Oracle repository, for access when needed by Oracle Support
Services.
– MOS Email Address: The My Oracle Support account (email address) to
receive updates from My Oracle Support. This field cannot be empty.
– HTTP Proxy Host: If you use an HTTP proxy to upload configuration
information to the Oracle repository, then specify the proxy server host name.
The proxy server may be between the following:
* Database (compute) servers and Oracle (applicable when you do not have
Oracle Support Hub)
* Database (compute) servers and Oracle Support Hub (applicable when
you have only Oracle Support Hub)
* Oracle Support Hub and Oracle
If passwords are needed, then provide them during installation.
– Support Hub Hostname: The Support Hub server host name. Oracle Support
Hub allows Oracle Configuration Manager instances to connect to a single
internal port (the Oracle Support Hub), and upload configuration data. This
eliminates the need for each individual Oracle Configuration Manager instance
in the database servers to access the Internet. This field cannot be empty.
– HTTP Proxy User: If you want to enable an HTTP proxy to upload
configuration information to the Oracle repository, then specify the HTTP proxy
server user name.
– Hub User Name: The Oracle Support Hub operating system user name. This
field cannot be empty.
– Port: If you want to enable an HTTP proxy to upload configuration information
to the Oracle repository, then specify the HTTP proxy server port number. The
default value is 80.
• Enable EM Alerting: Enables alerts in Oracle Enterprise Manager.
Oracle Enterprise Manager Cloud Control or Oracle Enterprise Manager Grid
Control is used to monitor the rack. When Oracle Enterprise Manager agents are
installed on the rack, they can send information to the Oracle Management Server.
3-41
Chapter 3
OEDA Browser-based User Interface
If you do not have an existing Oracle Management Server, then install a new
Oracle Management Server on a separate host.
– EM Home Base Location: The base directory for the Oracle Enterprise
Manager agents installed on the database or compute servers. The default
value is /u01/app/oracle/product/EMbase. This field cannot be empty.
– OMS HTTPS Upload Port: The port the Oracle Enterprise Manager agent
should use to upload information to the Oracle Management Server. The
default value is 4900. This field cannot be empty.
– OMS Host Name: The name of the server or host where the Oracle
Management Server repository is installed. This field cannot be empty.
3.2.13 Comments
Enter any additional information about the deployment in the text field.
3-42
Chapter 3
OEDA Graphical User Interface
For Oracle Exadata Rack, this section contains a list of questions about the
configuration to help ensure a smooth installation and configuration process for your
rack. You can type in the answers in the text field.
For all deployments, you can provide additional comments about your environment or
the deployment in this field.
When you have finished providing the information, click Save and Download. You are
prompted to save a ZIP file containing the deployment and configuration files. The
main configuration files are:
Note:
Do not edit or modify any of the generated files.
3-43
Chapter 3
OEDA Graphical User Interface
When you run the config.sh program, it starts the OEDA graphical user interface. If
you are configuring Oracle SuperCluster and have downloaded OEDA for release 19.1
or later, then use the configssc.sh program.
The OEDA interface walks you through several configuration details screens, where
you provide information about your Oracle Exadata Rack configuration, and then
generates a configuration file. The configuration file is then used to configure the
Oracle Exadata Rack.
The following topics describe the OEDA Java-based interface:
• Using the GUI Interface for Oracle Exadata Deployment Assistant
Use the deployment assistant for initial configuration, and when adding to an
existing deployment. You can import an existing configuration when adding new
racks or components.
• Customer Details Configuration Page
• Hardware Selection Configuration Page
• Rack Details Configuration Page
• Customer Network Configuration Page
• Administration Network Configuration Page
• Client Ethernet Configuration Page
Applications access the database through the client Ethernet network using Single
Client Access Name (SCAN) and Oracle RAC Virtual IP (VIP) addresses.
• InfiniBand Network Configuration Page
• Backup Network Configuration Page
• Review and Edit Management and Private Networks
Review and update entries for the node specific data for the Management, ILOM,
and private networks for the compute nodes, storage cells, and the switches used
in the rack.
• Identify Compute Node OS and Enable Capacity-on-Demand Configuration Page
• Define Clusters
• Define Clusters Details
• Review and Edit SCAN, Client, VIP and Optional Backup Networks
• Cell Alerting Configuration Page
Cell alert delivery may be configured during or after installation.
• Platinum Configuration Page
• Auto Service Request Configuration Page
• Oracle Configuration Manager Configuration Page
• Grid Control Agent Configuration Page
3-44
Chapter 3
OEDA Graphical User Interface
Have the following information available before running the deployment assistant:
• IP addresses
• Machine names
• DNS information
• NTP information for the rack
The following buttons are available on each Oracle Exadata Deployment Assistant
page:
• Help: View context-sensitive help.
• Import: Import an existing configuration file. The file format is XML.
• Back: View the previous page.
• Next: View the next page.
• Cancel: Cancel the configuration process.
The following procedure describes how to use the deployment assistant:
Notes:
Explanations for each field on the pages are provided in the other sections of
this chapter.
1. Ensure the machine that is used to run Oracle Exadata Deployment Assistant has
Oracle JRE 1.6 or later.
Accessibility Note: For screen reader and screen magnifier users: Accessibility
testing is conducted only on the Windows platform. The JRE version must be
1.7.0_80 for the Java Access Bridge to function correctly with the assistive
technology such as JAWS and ZoomText. JRE 1.7.0_80 is shipped with Oracle
Exadata Deployment Assistant for Windows in the November 2015 release.
2. Copy the operating system-specific directory to the machine that will run Oracle
Exadata Deployment Assistant. The following directories are available:
linux-x64
macos-x64
solaris-sparcv9
solaris-x64
windows-i586
Note:
3-45
Chapter 3
OEDA Graphical User Interface
./config.sh
• On Microsoft Windows:
./config.cmd
Note:
To change the default names of the administration network, click Modify.
After changing the fields, click Save to save the changes.
9. Enter the client network information on the Client Ethernet Network page, and click
Next.
Note:
To change the default names of the client network, click Modify. After
changing the fields, click Save to save the changes.
10. Enter the InfiniBand information on the InfiniBand Network page, and click Next.
Note:
To change the default names of the InfiniBand network, click Modify.
After changing the fields, click Save to save the changes.
11. Enter the backup information on the Backup Network page, and click Next.
Note:
To change the default names of the backup network, click Modify. After
changing the fields, click Save to save the changes.
12. Enter the operating system information on the Identify Compute Node Base OS
configuration page, and click Next.
3-46
Chapter 3
OEDA Graphical User Interface
13. Review, and edit the information for the management and private networks, and
click Next.
14. Define the clusters on the Define Clusters page for each cluster, and click Next.
15. Review and edit the cluster information for each cluster, and click Next.
16. Enter the e-mail alert information on the Cell Alerting page, and click Next.
17. Enter the Oracle Configuration Manager information on the Oracle Configuration
Manager page, and click Next.
18. Enter the Auto Service Request (ASR) information on the Auto Service Request
page, and click Next.
19. Enter the Oracle Enterprise Manager Grid Control information on the Grid Control
Agent page, and click Next.
20. Enter additional information about the deployment in the text field. Information
entered in the field appears at the bottom of the InstallationTemplate.html
file.
21. Click Next to create the configuration file.
22. Enter a file name, and click OK to create the file, or Cancel to not create the file.
23. Copy the configuration files to a directory in the /u01 directory, such as the /u01/
oeda directory, on the first database server in Oracle Exadata Rack.
The file is located in the /tmp/OneCommand directory on Linux, Apple, and UNIX
systems, and the drive:\OneCommand directory on Microsoft Windows systems.
The drive depends on the where deployment assistant was run on the Microsoft
Windows system.
See Also:
"Running Oracle Exadata Deployment Assistant on Windows" in Oracle
Exadata System Software User's Guide
Note:
The domain specified on this page is used as the domain for all networks. If
different domains are used for the client and backup networks, then specify
the administration network on this page. The client and backup networks can
be changed on the Review and Edit SCAN, Client, VIP and Optional Backup
Networks page.
3-47
Chapter 3
OEDA Graphical User Interface
3-48
Chapter 3
OEDA Graphical User Interface
3-49
Chapter 3
OEDA Graphical User Interface
Note:
Each IP address pool should consist of consecutive IP addresses. If
consecutive IP addresses are not available, then modify the IP addresses at
the end of the Oracle Exadata Deployment Assistant process.
3-50
Chapter 3
OEDA Graphical User Interface
Note:
• Oracle recommends using the same starting IDs for the servers and
server ILOMs.
• All fields must be filled in.
• The percent signs (%) in the names are replaced by the numbers
entered into the Starting ID fields.
3-51
Chapter 3
OEDA Graphical User Interface
3-52
Chapter 3
OEDA Graphical User Interface
3-53
Chapter 3
OEDA Graphical User Interface
Note:
3-54
Chapter 3
OEDA Graphical User Interface
Note:
Sample name formats are based on the prefix entered on the Customer
Details page. To modify the name formats, click Modify.
Note:
The percent signs (%) in the names are replaced by the numbers entered
into the Starting ID fields.
3-55
Chapter 3
OEDA Graphical User Interface
Note:
Sample name formats are based on the prefix entered on the Customer
Details page. To modify the name formats, click Modify.
3-56
Chapter 3
OEDA Graphical User Interface
Note:
The percent signs (%) in the names are replaced by the numbers entered
into the Starting ID fields.
3-57
Chapter 3
OEDA Graphical User Interface
Click Enable Capacity-on-Demand to reduce the initial number of active cores on the
servers, and then set the number of active cores.
OS Field Description
Cluster name Assigns the cluster name.
Note: The name can contain alphanumeric
characters, periods (.), and hyphens (-). The
name must start with an alphanumeric
character.
This field cannot be empty.
Prefix Assigns the prefix for the cluster.
DNS Sets the DNS IP Address.
Note: At least one IP address must be
entered.
NTP Sets the NTP IP Address.
Note: At least one IP address must be
entered.
Domain Name Sets the cluster domain name.
Region Sets the region for the cluster.
Timezone Sets the time zone for the cluster.
Role Separated Allows the responsibilities and privileges to be
separated by role.
Note: Providing system privileges for the
storage tier using the SYSASM privilege
instead of the SYSDBA privilege provides a
clear division of responsibility between Oracle
ASM administration and database
administration.
When used with Oracle ASM and database-
scoped security, role separation helps to
prevent different databases using the same
storage from accidentally overwriting each
other's files.
3-58
Chapter 3
OEDA Graphical User Interface
OS Field Description
User name Sets the user name for the database owner.
This option is not available if using role-
separated authentication.
User ID Assigns the database owner ID.
This option is not available if using role-
separated authentication.
User base Sets the database directory.
This option is not available if using role-
separated authentication.
DBA Group name Sets the DBA group name.
This option is not available if using role-
separated authentication.
DBA Group ID Assigns the DBA group ID.
This option is not available if using role-
separated authentication.
Grid ASM Home OS User Sets the Oracle ASM owner name. The
default value is grid. This is the user that
owns the Oracle Grid Infrastructure software
installation.
This option is available when using role-
separated authentication.
Grid ASM Home OS User ID Assigns Oracle ASM owner ID. The default
value is 1000.
This option is available when using role-
separated authentication.
Grid ASM Home base Sets the Oracle Grid Infrastructure directory.
The default value is /u01/app/grid.
This option is available when using role-
separated authentication.
ASM DBA Group Sets the Oracle ASM DBA group name. The
default value is asmdba.
Membership in this group enables access to
the files managed by Oracle ASM.
This option is available when using role-
separated authentication.
ASM DBA Group ID Assigns the Oracle ASM DBA group ID. The
default value is 1004.
This option is available when using role-
separated authentication.
3-59
Chapter 3
OEDA Graphical User Interface
OS Field Description
ASM Home Oper Group Sets the Oracle ASM operator group name.
The default value is asmoper.
This group of operating system users has a
limited set of Oracle ASM instance
administrative privileges including starting up
and stopping the Oracle ASM instance.
This option is available when using role-
separated authentication.
ASM Home Oper Group ID Assigns the Oracle ASM operator group ID.
The default value is 1005.
This option is available when using role-
separated authentication.
ASM Home Admin Group Sets the Oracle ASM administration group
name. The default value is asmadmin.
This group uses SQL to connect to an Oracle
ASM instance as SYSASM using operating
system authentication. The SYSASM
privileges permit mounting and dismounting of
disk groups, and other storage administration
tasks. SYSASM privileges provide no access
privileges on an Oracle Database instance.
This option is available when using role-
separated authentication.
ASM Home Admin Group ID Assigns the Oracle ASM administration group
ID. The default value is 1006.
This option is available when using role-
separated authentication.
RDBMS Home OS User Sets the Oracle Database software installation
owner name. The default value is oracle.
This option is available when using role-
separated authentication.
RDBMS Home OS User ID Assigns the Oracle Database software
installation owner ID. The default value is
1001.
This option is available when using role-
separated authentication.
RDBMS Home base Sets the Oracle Database software installation
directory. The default value is /u01/app/
oracle.
This option is available when using role-
separated authentication.
RDBMS DBA Group Sets the DBA group name. The default value
is dba.
This option is available when using role-
separated authentication.
3-60
Chapter 3
OEDA Graphical User Interface
OS Field Description
RDBMS DBA Group ID Assigns the DBA group ID. The default value
is 1002.
This option is available when using role-
separated authentication.
RDBMS Home Oper Group Sets the Oracle Database operator group
name. The default value is racoper.
This option is available when using role-
separated authentication.
RDBMS Home Oper Group ID Assigns the Oracle Database operator group
ID. The default value is 1003.
This option is available when using role-
separated authentication.
OINSTALL group Sets the Oracle Inventory group name. The
default value is oinstall.
OINSTALL Group ID Assigns the Oracle Inventory group ID. The
default value is 1001.
Inventory Location Sets the Oracle inventory (oraInventory)
directory path. The default value
is /u01/app/oraInventory.
Grid Infrastructure Home Sets the Oracle Grid Infrastructure software
release and the directory path. The default
value is /u01/app/release_number/
grid.
Database Home Location Sets the Oracle Database software release
and the directory path. The default value
is /u01/app/oracle/product/
release_number/dbhome_1.
Software Languages Defines the languages installed for the
database. The default value is English (en).
Diskgroup Layout Sets the disk group layout. The options are:
• 80% 20% for DATA and RECO when
using external backups.
• 40% 60% for DATA and RECO when
using internal backups.
The disk group layout options with sparse disk
group are:
• 72% 18% 10% for DATA, RECO, and
SPARSE when using external backups.
• 34% 56% 10% for DATA, RECO, and
SPARSE when using internal backups.
Note: On X7 systems, you cannot specify any
sizes for the DBFS_DG.
3-61
Chapter 3
OEDA Graphical User Interface
OS Field Description
Virtual Guest Size Sets the size of a virtual guest. The options
are Small, Medium, and Large.
You can use the sliders to customize the
definitions of small, medium, and large for
your environment.
Note:
Creating more
than 8 VMs on
Exadata
Database
Servers is not
supported.
Guest Image Version Sets the image version for virtual guests. The
options are default and 12.1.2.*.*.
Selecting the default option sets the guest
image version to match dom0's image version.
Note: The guest image version needs to be
the same as or earlier than dom0's image
version.
DBFS DiskGroup Sets the DBFS disk group name.
Note: This field does not exist for X7 systems.
DATA Disk Group Sets the DATA disk group name, redundancy
and size. The redundancy options are NORMAL
and HIGH.
Note: Oracle recommends the use of HIGH
redundancy disk groups for mission critical
applications.
RECO Disk Group Sets the RECO name, redundancy and size.
The redundancy options are NORMAL and
HIGH.
Note: Oracle recommends the use of HIGH
redundancy disk groups for mission critical
applications.
Sparse Disk Group Sets the sparse disk group name,
redundancy, and size. The redundancy
options are NORMAL and HIGH.
Click the Advanced Options button, and then
select Enable Sparse Disk Group.
Note: To create a sparse disk group, the
version of Oracle Grid Infrastructure software
needs to be release 12.1.0.2 BP5 or later.
Database name Sets the database name.
3-62
Chapter 3
OEDA Graphical User Interface
OS Field Description
Block size Sets the database block size. The default
value is 8192.
To use a different block size, select the block
size from the list
Database Type Defines the type of workload that runs on the
database.
The options are OLTP for online transaction
processing, and DW for data warehouse.
Base Adapter Sets the physical network for the client
network. The default value is client.
Note: Oracle recommends using the default.
Domain Defined on the Customer Details page.
Start IP Defined on the Customer Details page.
Pool Size Defined on the Customer Details page.
Gateway IP Defined on the Customer Details page.
VLAN ID Specifies a VLAN tag on a per cluster basis.
This is a numeric value between 1 and 4095.
Name Mask Defined on the Customer Details page.
Start Id Defined on the Customer Details page.
VIP Name mask Defined on the Customer Details page.
Start Id Defined on the Customer Details page.
SCAN Name Defined on the Customer Details page.
Base Adapter Sets the backup network. The options are Not
in use, and Backup.
Domain Defined on the Customer Details page.
Start IP Defined on the Customer Network page.
Pool size Defined on the Customer Network page.
Name mask Defined on the Customer Network page.
Start Id Defined on the Customer Network page.
3-63
Chapter 3
OEDA Graphical User Interface
Note:
Automatic Cluster File System (ACFS) requires Grid Infrastructure 12.1.0.2
or later.
3.3.14 Review and Edit SCAN, Client, VIP and Optional Backup
Networks
Review and update entries for the clusters and client network, then click Re-Generate
Data, and then click Next.
Note:
The domain specified on Customer Details page is used as the domain for all
networks. If different domains are used for the client and backup networks,
then specify those domains on this page.
3-64
Chapter 3
OEDA Graphical User Interface
Related Topics
• Oracle Exadata System Software User's Guide
3-65
Chapter 3
OEDA Graphical User Interface
3-66
Chapter 3
OEDA Graphical User Interface
Related Topics
• Oracle Platinum Services information
• Oracle Advanced Support Gateway Hardware Minimum Requirements
• Oracle Advanced Support Gateway Documentation Library
3-67
Chapter 3
OEDA Graphical User Interface
Related Topics
• Oracle Exadata Database Machine Maintenance Guide
3-68
Chapter 3
OEDA Graphical User Interface
[proxy_user@]proxy_host[:proxy_port]
Related Topics
• Oracle Technical Support Policies
• Oracle Configuration Manager Companion Distribution Guide
3-69
Chapter 3
OEDA Graphical User Interface
Table 3-17 (Cont.) Oracle Enterprise Manager Grid Control Configuration Page
3-70
4
OEDA Command Line Interface
When you run the oedacli program, it starts the OEDA command line interface.
• Edit mode
– Used against an es.xml file before you run the install.sh command steps
– Used to edit an XML file, for example to add a second Database Home, then
save the XML file
– Can be used as a logical XML editor for the es model prior to deployment
• Deploy mode
– Used to edit an es.xml file after you have run the install.sh command
steps
– Can be used to Clone Oracle VM Guests or grow or shrink Oracle ASM Disk
groups
– Has a smaller list of supported changes than Edit mode
4-1
Chapter 4
About the OEDA Command Line Interface
– Can be used as a logical XML editor and deployment tool after the initial
deployment
3. After you have provided all the commands for an action, save the action to a list of
actions to be processed within the command line interface. At this point, the data
in the es.xml file is not yet updated.
SAVE ACTION
4. Merge the actions into the main body of the in-memory copy of the es.xml using
the FORCE keyword.
5. Save the memory copy of the es.xml, overwriting the input file or writing to a new
file that you specify.
SAVE ACTION
4-2
Chapter 4
Starting the OEDACLI Utility
4. Merge the actions into the main body of the in-memory copy of the es.xml.
MERGE ACTIONS
5. Deploy the actions into the main body of the es.xml file. This step will perform the
specified actions such as creating the new Oracle VM guest.
DEPLOY ACTIONS
6. Save the memory copy of the es.xml, overwriting the input file or writing to a new
file that you specify.
Prerequisites
To use oedacli, you must meet the following requirements:
• Download the August 2017 release or later of OEDA. The August 2017 release of
OEDA is only supported on Oracle Linux.
• Have the original OEDA configuration XML file used for deployment
• Use the default password on the nodes in the cluster (for the root, oracle and
grid users)
Note:
If your environment does not use the default passwords for the specified
users, then refer to My Oracle Support Doc ID 2163751.1.
File Path
The directory that contains the unzipped files from the OEDA download. For
example /u01/joc/linux-x64.
Syntax
./oedacli
Usage Notes
To display the help output, use one of the following:
• HELP
• HELP command name
4-3
Chapter 4
Starting the OEDACLI Utility
oedacli> HELP
HELP [topic]
Available Objects:
ACFSVOLUME
LIST ACFSVOLUMES
CELL
LIST CELLS
CLUSTER
LIST CLUSTERS
DISKGROUP
LIST DISKGROUPS
DATABASE
LIST DATABASES
DATABASEHOME
LIST DATABASEHOMES
DOM0
LIST DOM0S
GUEST
CLONE GUEST
DELETE GUEST
LIST GUESTS
ILOM
LIST ILOMS
MACHINE
LIST MACHINES
NETWORK
LIST NETWORKS
SCAN
LIST SCANS
SWITCH
LIST SWITCHES
VIP
LIST VIPS
CLI COMMANDS
LOAD FILE
4-4
Chapter 4
Starting the OEDACLI Utility
SAVE FILE
SAVE FILES
LIST XMLACTIONS
SAVE ACTION
MERGE ACTIONS
DEPLOY ACTIONS
Example 4-2 Help Output for the OEDACLI ALTER DATABASE command
This example shows how to display the syntax for the ALTER DATABASE command
of OEDACLI. The help output is shown for the 18c (18.1.0) release.
Purpose:
Alters an existing database
Arguments:
<blocksize> : Default: 8192, not required for PDB
<characterset> : Default: AL32UTF8, not required for PDB
<datadg> : *The DATA diskgroup, not required for PDB
<dblang> : Default: all_langs, not required for PDB
<dbname> : *Database name
<dbtemplate> : Default: ADMIN, otherwise ADMIN or DW, not required
for PDB
<dbtype> : Default: normal DB, otherwise CDB or PDB
<hostnames> : Default: list of nodes from db home
<recodg> : *The RECO diskgroup, not required for PDB
Where:
<databaseid> : The es xml id of the database
<clusternumber> : The cluster number in the es xml, starting at 1
<clustername> : The name of the cluster
<clusterid> : The es xml id of the cluster
<databasename> : The name of the database in the cluster
4-5
Chapter 4
OEDACLI Command Reference
4-6
Chapter 4
OEDACLI Command Reference
• LOAD FILE
• SAVE ACTION
• MERGE ACTIONS
• DEPLOY ACTIONS
• SAVE FILE
• SAVE FILES
• LIST STEPS
This command lists the steps for a given cluster.
• LIST XMLACTIONS
Syntax
Arguments
• NAME : Specifies the name of an existing engineered system XML file
Example 4-3 Loading a File into OEDACLI for Editing
Syntax
Arguments
Specify FORCE if the action should be auto-merged into the engineered system model.
Note:
The engineered system configuration should be saved as a file using a
subsequent SAVE FILE command.
4-7
Chapter 4
OEDACLI Command Reference
Syntax
Arguments
Specify FORCE if you do not want this action to be processed by a DEPLOY ACTIONS
command.
Syntax
DEPLOY ACTIONS
Syntax
Arguments
The optional argument, NAME, is used to specify the name of a new engineered system
XML file. If you do not specify the NAME argument, then this command overwrites the
source file.
4-8
Chapter 4
OEDACLI Command Reference
Syntax
Arguments
The LOCATION argument specifies the directory in which the new file set will be created.
Usage Notes
If the specified directory does not exist, it will be created.
The list of valid steps for a cluster depends on the features selected for the cluster.
The steps listed are valid for the identified cluster. If the XML file contains only 1
cluster, then there is no need to identify the cluster explicitly.
The step numbers listed may change depending on features implemented for the
cluster, but the short name identifier is always the same for a given step.
Syntax
4-9
Chapter 4
OEDACLI Command Reference
"id" : "5"
}, {
"stepName" : "Create Cell Disks",
"shortName" : "CELLDISKS",
"id" : "6"
}, {
"stepName" : "Create Grid Disks",
"shortName" : "GRIDDISKS",
"id" : "7"
}, {
"stepName" : "Install Cluster Software",
"shortName" : "INSTALLGI",
"id" : "8"
}, {
"stepName" : "Initialize Cluster Software",
"shortName" : "INITGI",
"id" : "9"
}, {
"stepName" : "Install Database Software",
"shortName" : "INSTALLDB",
"id" : "10"
}, {
"stepName" : "Relink Database with RDS",
"shortName" : "RELINK",
"id" : "11"
}, {
"stepName" : "Create ASM Diskgroups",
"shortName" : "ASMDG",
"id" : "12"
}, {
"stepName" : "Create Databases",
"shortName" : "DATABASE",
"id" : "13"
}, {
"stepName" : "Apply Security Fixes",
"shortName" : "APPLYFIXES",
"id" : "14"
}, {
"stepName" : "Install Exachk",
"shortName" : "EXACHK",
"id" : "15"
}, {
"stepName" : "Create Installation Summary",
"shortName" : "INSTALLSUMMARY",
"id" : "16"
}, {
"stepName" : "Resecure Machine",
"shortName" : "RESECURE",
"id" : "17"
} ]
}
4-10
Chapter 4
OEDACLI Command Reference
Syntax
LIST XMLACTIONS
4.3.2 ACFSVOLUME
You can add, alter, delete, or list Oracle ACFS volumes.
• ADD ACFSVOLUME
• ALTER ACFSVOLUME
• DELETE ACFSVOLUME
• LIST ACFSVOLUME
Syntax
ADD ACFSVOLUME
VOLUMENAME = volume_name |
VOLUMESIZE = volume_size |
MOUNTPATH = mountpath
WHERE
DISKGROUPID = diskgroup_id |
CLUSTERNUMBER = cluster_number DISKGROUPNAME = diskgroup_name |
CLUSTERNAME = cluster_name DISKGROUPNAME diskgroup_name |
CLUSTERID = cluster_id DISKGROUPNAME = diskgroup_name
Arguments
You can specify the following attributes for the new Oracle ACFS volume:
• VOLUMENAME : Specifies a unique name for the new volume
• VOLUMESIZE : A number that specifies the size of the new volume in GB
• MOUNTPATH : Specifies the file system mount path for the new volume
The following arguments are available in the WHERE clause:
4-11
Chapter 4
OEDACLI Command Reference
Syntax
ALTER ACFSVOLUME
VOLUMENAME = volume_name |
VOLUMESIZE = volume_size |
MOUNTPATH = mountpath
WHERE
ID = acfs_volume_id |
DISKGROUPID = diskgroup_id VOLUMENAME = volume_name|
CLUSTERNUMBER = cluster_number DISKGROUPNAME = diskgroup_name VOLUMENAME
= volume_name|
CLUSTERNAME = cluster_name DISKGROUPNAME diskgroup_name VOLUMENAME =
volume_name|
CLUSTERID = cluster_id DISKGROUPNAME = diskgroup_name VOLUMENAME =
volume_name
Arguments
You can modify the following attributes of the Oracle ACFS volume:
• VOLUMENAME : Specifies a new, unique volume name
• VOLUMESIZE : A number that specifies the new size of the volume in GB
• MOUNTPATH : Specifies the new file system mount path for the volume
The following arguments are available in the WHERE clause:
Syntax
DELETE ACFSVOLUME
WHERE
ID = acfs_volume_id |
DISKGROUPID = diskgroup_id VOLUMENAME = volume_name|
4-12
Chapter 4
OEDACLI Command Reference
Arguments
The following arguments are available in the WHERE clause:
• ID : Specifies the es.xml ID for the Oracle ACFS volume
• DISKGROUPID : Specifies the es.xml ID for the container disk group
• CLUSTERNUMBER : Specifies the cluster number in the es.xml, starting at 1
• CLUSTERNAME : Specifies the name of the cluster
• CLUSTERID : Specifies the es.xml ID of the cluster
• DISKGROUPNAME : Specifies the name of the container disk group
• VOLUMENAME : Specifies the name of the existing Oracle ACFS volume
Syntax
LIST ACFSVOLUMES
WHERE
ID = id |
DISKGROUPID = diskgroup_id |
CLUSTERNUMBER = cluster_number [DISKGROUPNAME = diskgroup_name] |
CLUSTERNAME = cluster_name [DISKGROUPNAME diskgroup_name] |
CLUSTERID = cluster_id [DISKGROUPNAME = diskgroup_name]
Arguments
The following arguments are available in the WHERE clause:
• ID : Specifies the es.xml ID for the Oracle ACFS volume
• DISKGROUPID : Specifies the es.xml ID for the container disk group
• CLUSTERNUMBER : Specifies the cluster number in the es.xml, starting at 1
• CLUSTERNAME : Specifies the name of the cluster
• CLUSTERID : Specifies the es.xml ID of the cluster
• DISKGROUPNAME : Specifies the name of the container disk group
Usage Notes
There is no WHERE clause that will list all the Oracle ACFS volumes in the es.xml file.
4-13
Chapter 4
OEDACLI Command Reference
4.3.3 CELL
You can clone, delete, or list Oracle Exadata storage cells.
• CLONE CELL
• DELETE CELL
• LIST CELLS
Syntax
Arguments
SRCNAME is used to specify the name of an existing cell from which the new cell is
derived.
The following arguments are available in the SET clauses:
• ADMINNET : Specifies the DNS name (admin_name) with an optional domain name
and the IP address to be used for the admin network.
• PRIVNET : Specifies the name with an optional domain name and the IP address to
be used for the first and second private networks.
• ILOMNET : Specifies the DNS name with an optional domain name and the IP
address to be used for the ILOM network.
• RACK : Specifies the rack number in a multi-rack configuration, where 1 is the first
rack, and the physical Ulocation (slot) of the cell in that rack.
Syntax
Arguments
SRCNAME is used to specify the host name of an existing cell that you want to remove.
4-14
Chapter 4
OEDACLI Command Reference
Syntax
LIST CELLS
4.3.4 CLUSTER
You can alter or list the Oracle RAC Clusters on the Oracle Exadata Database
Machine.
• ALTER CLUSTER
• CREATE CLUSTER
This command is used to run all the steps required to create the virtual guests for
a cluster and the following steps to configure and deploy an Oracle RAC database.
• DESTROY CLUSTER
This command is used to cleanly destroy a cluster.
• LIST CLUSTERS
This command lists the existing Oracle RAC clusters.
• UPGRADE CLUSTER
This command is used to upgrade Oracle Clusterware running on the virtual hosts.
Syntax
Arguments
You can modify the following attributes of the Oracle RAC Cluster:
• CLUSTERNAME : Specifies a new, unique name for the cluster
• GIVERSION : Specifies the clusterware version, including the bundle patch, for
example 12.1.0.2.170418
• GIHOMELOC : Specifies a new path for the Grid home
• INVLOC : Specifies a new path for the inventory
• BASEDIR : Specifies a new path for the Oracle base directory
• PATCHLIST : Specifies a full list of patches separated by commas and enclosed in
single quotes. By default, this is derived from the bundle patch specified by
GIVERSION.
The following arguments are available in the WHERE clause:
4-15
Chapter 4
OEDACLI Command Reference
Syntax
The simplest form of this command does not require any arguments. However, if the
XML file being used by OEDACLI contains more than one cluster, then the WHERE
clause is mandatory.
There are additional parameters and WHERE clause options for the command that you
can use.
Arguments
• STEPS: This parameter allows you to specify which steps to run. Each step in the
list is separated by a space and the list is enclosed in single quotes. When you run
the CREATE CLUSTER command with this parameter, it performs only the steps
listed in the STEPS clause, excluding any steps listed in the SKIPSTEPS clause.
• SKIPSTEPS: When you run the CREATE CLUSTER command, it performs all the steps
listed in LIST STEPS excluding those listed in the SKIPSTEPS clause. Each step in
the list is separated by a space and the list is enclosed in single quotes.
• DELETEDB: If you do not require the database created by OEDA, then the database
can be removed upon complete of the CREATE CLUSTER command by specifying
the parameter DELETEDB=true. The default value for this parameter is false, which
leaves the database in-place.
The following arguments are available in the WHERE clause:
4-16
Chapter 4
OEDACLI Command Reference
Example 4-6 Using the SKIPSTEPS and DELETEDB Parameters with CREATE
CLUSTER
If there are 17 steps for the CREATE CLUSTER command, and SKIPSTEPS is not
specified, then OEDACLI will complete all 17 steps. If you use the following command,
then only 13 steps are completed, after which the database is deleted.
Syntax
Arguments
The following arguments are available in the WHERE clause:
Syntax
LIST CLUSTERS
[ WHERE
CLUSTERNUMBER = cluster_number |
CLUSTERNAME = cluster_name |
CLUSTERID = cluster_id ]
4-17
Chapter 4
OEDACLI Command Reference
Arguments
The following arguments are available in the WHERE clause:
Usage Notes
The WHERE clause is optional.
Syntax
Arguments
• GIVERSION: The version of the Oracle Grid Infrastructure software you are
upgrading to
• GIHOMELOC: The target location of the Oracle Grid Infrastructure home directory
The following arguments are available in the WHERE clause:
4-18
Chapter 4
OEDACLI Command Reference
Usage Notes
• This option is only available for virtual environments.
• The RUN_ROOTSCRIPT step runs the rootupgrade.sh script in a rolling mode on all
nodes. This step also restarts the database instances on each of the nodes.
Example 4-9 Using the UPGRADE CLUSTER Command
This example shows how to upgrade the Oracle Grid Infrastructure software to release
18.6 for both nodes in the first cluster.
4.3.5 COMPUTE
Use these commands to add or delete a physical compute node as a cluster member.
• CLONE COMPUTE
Use this command to clone an existing physical compute cluster node.
• DELETE COMPUTE
This command deletes an existing compute node, removes the instance, home
and clusterware from the cluster.
4-19
Chapter 4
OEDACLI Command Reference
Syntax
CLONE COMPUTE
SRCNAME = source_compute_node
TGTNAME = target_compute_node
WHERE
[ STEPNAME = stepname ]
Arguments
SRCNAME is used to specify the host name of an existing compute server, from which
the new compute node is derived.
TGTNAME is used to specify the host name of the new compute server.
• ADMINNET: Specifies the DNS name (admin_name) with an optional domain name
and the IP address (admin_IP) to be used for the admin network.
• PRIVNET: Specifies the name with an optional domain name and the IP address to
be used for the first and second private networks.
• INTERCONNECT: Only required if the compute nodes are configured with InfiniBand
security (PKEYS). Specifies the name with an optional domain name and the IP
address to be used for the first and second private networks.
• CLIENTNET: Specifies the DNS name with the domain name and the IP address to
be used for the client network.
• VIPNET: Specifies the DNS name with the domain name and the IP address to be
used for the virtual IP (VIP) network.
• BACKUP: Specifies the DNS name with the domain name and the IP address to be
used for the optional backup network.
• ILOMNET: Specifies the DNS name with an optional domain name and the IP
address to be used for the ILOM network.
• RACK: Specifies the rack number in a multi-rack configuration, where 1 is the first
rack, and the physical Ulocation (slot) of the cell in that rack.
4-20
Chapter 4
OEDACLI Command Reference
...
4-21
Chapter 4
OEDACLI Command Reference
Syntax
Arguments
SRCNAME is used to specify the host name of the guest that you want to remove.
STEPNAME is used to clean up steps from a failed CREATE COMPUTE command. Specify
the name of the individual creation step to be reverted. The values for stepname are:
• ADD_INSTANCE
• EXTEND_DBHOME
• ADD_NODE
• CELL_CONNECTIVITY
• CREATE_USERS
Example 4-12 Deleting a Compute Node - Simple Case
This example removes the dbadm04 compute node from the cluster.
4-22
Chapter 4
OEDACLI Command Reference
SAVE ACTION
MERGE ACTIONS
DEPLOY ACTIONS
...
4.3.6 DATABASE
You can add, alter, delete, or list the Oracle databases.
• ADD DATABASE
• ALTER DATABASE
• DELETE DATABASE
• LIST DATABASES
Syntax
ADD DATABASE
[ BLOCKSIZE = blocksize ]
[ CHARSET = database_character_set
DATADG = data_diskgroup
[ DBLANG = database_language ]
DBNAME = database_name
[ DBTEMPLATE = database_template ]
[ DBTYPE = database_type ]
[ HOSTNAMES = 'host_names' ]
RECODG = reco_diskgroup
WHERE
{ DBHOMEID = database_home_id |
CLUSTERNUMBER = cluster_number DBHOMELOC = database_home_location |
CLUSTERNAME = cluster_name DBHOMELOC = database_home_location |
CLUSTERID = cluster_id DBHOMELOC = database_home_location |
CLUSTERNUMBER = cluster_number CDBNAME = container_database_name |
CLUSTERNAME = cluster_name CDBNAME = container_database_name |
CLUSTERID = cluster_id CDBNAME = container_database_name }
Arguments
You can specify the following attributes for the new Oracle database:
• BLOCKSIZE : Specifies the block size for the new database. The default value is
8192. This argument is not required for pluggable databases.
• CHARSET : Specifies the character set to use for the new database. The default
value is AL32UTF8. This argument is not required for pluggable databases.
• DATADG : (Mandatory) Specifies the name of the DATA disk group for the new
database. This argument is not required for pluggable databases.
• DBLANG : Specifies the language to use for the new database. The default value is
all_langs. This argument is not required for pluggable databases.
4-23
Chapter 4
OEDACLI Command Reference
4-24
Chapter 4
OEDACLI Command Reference
basedir : "/u01/app/oracle"
useZfs : "false"
id : "c0_databaseHome1"
3. Create an action for creating the new database. You must provide a name for the
new database, and the names of the DATA and RECO disk groups that the new
database should use. Also, use the ID retrieved in the previous step to specify the
Oracle Home in which to create this database.
Syntax
ALTER DATABASE
[ BLOCKSIZE = blocksize ]
[ CHARSET = database_character_set
DATADG = data_diskgroup
4-25
Chapter 4
OEDACLI Command Reference
[ DBLANG = database_language ]
DBNAME = database_name
[ DBTEMPLATE = database_template ]
[ DBTYPE = database_type ]
[ HOSTNAMES = 'host_names' ]
RECODG = reco_diskgroup
WHERE
ID = database_id |
CLUSTERNUMBER = cluster_number DATABASENAME = database_name |
CLUSTERNAME = cluster_name DATABASENAME = database_name |
CLUSTERID = cluster_id DATABASENAME = database_name
Arguments
You can modify the following attributes for the Oracle database:
• BLOCKSIZE : Specifies the new block size for the database. The default value is
8192. This argument is not required for pluggable databases.
• CHARSET : Specifies the new character set to use for the database. The default
value is AL32UTF8. This argument is not required for pluggable databases.
• DATADG : (Mandatory) Specifies the name of the DATA disk group for the database.
This argument is not required for pluggable databases.
• DBLANG : Specifies the new language to use for the database. The default value is
all_langs. This argument is not required for pluggable databases.
• DBNAME : (Mandatory) Specifies the name of the database.
• DBTEMPLATE : Specifies the template to use when creating the database, ADMIN or
DW. The default value is ADMIN. This argument is not required for pluggable
databases.
• DBTYPE : Specifies the type of database to create. The accepted values are normal
DB, CDB, or PDB. The default value is normal DB.
• HOSTNAMES : Specifies a comma-separated list of host names on which the
database should be created. The default value is the list of nodes registered with
the database home.
• RECODG : (Mandatory) Specifies the name of the RECO disk group for the
database. This argument is not required for pluggable databases.
The following arguments are available in the WHERE clause:
4-26
Chapter 4
OEDACLI Command Reference
Syntax
DELETE DATABASE
WHERE
ID = database_id |
CLUSTERNUMBER = cluster_number DATABASENAME = database_name |
CLUSTERNAME = cluster_name DATABASENAME = database_name |
CLUSTERID = cluster_id DATABASENAME = database_name
Arguments
The following arguments are available in the WHERE clause:
2. List the databases contained in the XML configuration file, so that you can identify
the database ID associated with the database you want to delete.
4-27
Chapter 4
OEDACLI Command Reference
machines :
machine :
....
....
databaseTemplate : "OLTP"
databaseStyle : "ADMIN"
language : "all_langs"
diskGroups :
diskGroup :
id : "c0_datadg"
id : "c0_recodg"
id : "c0_testdb01"
3. Create an action to delete the target database. Use the database id identified in
the previous step
Syntax
LIST DATABASES
[ WHERE
ID = database_id |
CLUSTERNUMBER = cluster_number |
CLUSTERNAME = cluster_name |
CLUSTERID = cluster_id ]
4-28
Chapter 4
OEDACLI Command Reference
Arguments
The following arguments are available in the WHERE clause:
Syntax
ADD DATABASEHOME
OWNER = owner DBVERSION = version
DBHOMELOC = database_home_path [DBHOMENAME = database_home_name]
[INVLOC = inventory_location] [DBLANG = database_language]
[MACHINELIST = 'machine_list'] [PATCHLIST = 'patch_list']
[BASEDIR = base_directory] [VOLUMESIZE = volume_size]
WHERE
{ CLUSTERNUMBER = cluster_number | CLUSTERNAME = cluster_name |
CLUSTERID = cluster_id }
Arguments
You can specify the following attributes for the new Oracle database home:
• OWNER : (Mandatory) Specifies the operating system user that owns the Oracle
home.
• DBVERSION : (Mandatory) Specifies the version of the software in the database
home, including the bundle patch, for example 12.1.0.2.170418.
• DBHOMELOC : (Mandatory) Specifies the file system path for the new Oracle
database home directory.
• DBHOMENAME : Specifies the name of the new database home. The default value is
the standard template name, for example, dbhome_1.
• INVLOC : Specifies the location of the Oracle inventory directory. The default value
is derived from the cluster home.
4-29
Chapter 4
OEDACLI Command Reference
• DBLANG : Specifies the language to use with the Oracle home. The default value is
all_langs.
• MACHINELIST : Specifies a list of nodes to create the Oracle home on. The default
value is list of nodes registered with the Grid home.
• PATCHLIST : Specifies a comma-separated list of patches for the database home.
The default value is derived from DBVERSION.
• BASEDIR : Specifies the location of the Oracle Base directory. The default value is
derived from OWNER.
• VOLUMESIZE : Specifies the size of the home directory volume. The default value is
50 GB. This argument is applicable only for database homes for Oracle VM
clusters.
The following arguments are available in the WHERE clause:
./oedacli
4-30
Chapter 4
OEDACLI Command Reference
Syntax
ALTER DATABASEHOME
OWNER = owner |
DBVERSION = version |
4-31
Chapter 4
OEDACLI Command Reference
DBHOMELOC = database_home_path |
DBHOMENAME = database_home_name |
INVLOC = inventory_location |
DBLANG = language |
MACHINELIST = 'machine_list' |
PATCHLIST = 'patch_list' |
BASEDIR = base_directory
WHERE
ID = database_home_id |
CLUSTERNUMBER = cluster_number DBHOMELOC = database_home_path |
CLUSTERNAME = cluster_name DBHOMELOC = database_home_path |
CLUSTERID = cluster_id DBHOMELOC = database_home_path
Arguments
You can modify the following attributes for the Oracle database home:
• OWNER : Specifies the operating system user that owns the Oracle home.
• DBVERSION : Specifies the version of the software in the database home, including
the bundle patch, for example 12.1.0.2.170418.
• DBHOMELOC : Specifies the file system path for the new Oracle database home
directory.
• DBHOMENAME : Specifies the new name of the database home. The database home
name must be unique within a cluster.
• INVLOC : Specifies the location of the Oracle inventory directory.
• DBLANG : Specifies the supported languages for the Oracle home.
• MACHINELIST : Specifies a list of nodes. The nodes must exist within the cluster.
• PATCHLIST : Specifies a comma-separated, custom list of patches for the database
home.
• BASEDIR : Specifies the location of the Oracle Base directory.
The following arguments are available in the WHERE clause:
Syntax
DELETE DATABASEHOME
WHERE
ID = database_home_id |
CLUSTERNUMBER = cluster_number DBHOMELOC = database_home_path |
4-32
Chapter 4
OEDACLI Command Reference
Arguments
The following arguments are available in the WHERE clause:
Usage Notes
The database home you are deleting must not contain any dependent databases.
Example 4-17 Removing an Existing Oracle Database Home
This example shows how to delete an existing Oracle Database home directory.
4-33
Chapter 4
OEDACLI Command Reference
Syntax
LIST DATABASEHOMES
[ WHERE
ID = database_home_id |
CLUSTERNUMBER = cluster_number NAME = database_home_name |
CLUSTERNAME = cluster_name NAME = database_home_name |
CLUSTERID = cluster_id NAME = database_home_name ]
Arguments
The following arguments are available in the WHERE clause:
4.3.8 DISKGROUP
You can add, alter, delete, or list the Oracle ASM disk groups.
• ADD DISKGROUP
• ALTER DISKGROUP
• ALTER DISKGROUPS
• DELETE DISKGROUP
• LIST DISKGROUPS
Syntax
ADD DISKGROUP
[ ACFSNAME=acfs_name ]
[ ACFSPATH=acfs_path ]
[ ACFSSIZE=acfs_size ]
[ CELLLIST='cell_list' ]
DISKGROUPNAME=diskgroup_name
DISKGROUPSIZE=diskgroup_size
[ OCRVOTE=ocr_voting_disks_included ]
[ QUORUMDISK=quorum_disks_included ]
REDUNDANCY=redundancy_level
SLICESIZE=slice_size
[ SPARSE=sparse ]
[ SPARSEVIRTUALSIZE=sparse_virtual_size ]
[ TYPE = diskgroup_type [ DATABASENAME = database_name ]]
4-34
Chapter 4
OEDACLI Command Reference
WHERE
CLUSTERNUMBER = cluster_number |
CLUSTERNAME = cluster_name |
CLUSTERID = cluster_id
Arguments
You can specify the following attributes for the new Oracle ASM disk group:
• ACFSNAME : Specifies the name for the Oracle ACFS volume on this diskgroup
• ACFSPATH : Specifies the path for the Oracle ACFS file system
• ACFSSIZE : Specifies the size for the Oracle ACFS volume on this diskgroup
• CELLLIST : A comma separated list of cells for this disk group, enclosed in single
quotes
• DISKGROUPNAME : (Mandatory) Specifies the name of the disk group
• DISKGROUPSIZE : (Mandatory) Specifies the size of the disk group
• OCRVOTE : A boolean variable, where TRUE indicates the disk group should store the
OCR and voting disks for the cluster.
• QUORUMDISK : A boolean variable, where TRUE indicates the disk group requires a
quorum
• REDUNDANCY : (Mandatory) Specifies the redundancy level for the disk group. The
accepted values are NORMAL or HIGH.
• SLICESIZE : (Mandatory) Specifies the slice size on disk for each grid disk for this
disk group.
• SPARSE : A boolean variable, where TRUE indicates this should be sparse disk
group.
• SPARSEVIRTUALSIZE : Specifies the sparse virtual size.
• TYPE : Specifies the diskgroup type, which can be DATA, RECO, DBFS or OTHER. The
default value is OTHER. If you want the database to use this disk group, then the
type must be set to DATA or RECO.
• DATABASENAME : Specifies the name of the target database for disk groups of type
DATA or RECO.
The following arguments are available in the WHERE clause:
Syntax
ALTER DISKGROUP {
ACFSNAME=acfs_name|
4-35
Chapter 4
OEDACLI Command Reference
ACFSPATH=acfs_path |
ACFSSIZE=acfs_size |
CELLLIST='cell_list' |
DISKGROUPNAME=diskgroup_name |
DISKGROUPSIZE=diskgroup_size |
OCRVOTE=ocr_voting_disks_included |
QUORUMDISK=quorum_disks_included |
REDUNDANCY=redundancy_level |
SLICESIZE=slice_size |
SPARSE=sparse |
SPARSEVIRTUALSIZE=sparse_virtual_size }
WHERE {
ID = diskgroup_id|
CLUSTERNUMBER = cluster_number DISKGROUPNAME = diskgroup_name|
CLUSTERNAME = cluster_name DISKGROUPNAME = diskgroup_name|
CLUSTERID = cluster_id DISKGROUPNAME = diskgroup_name }
Arguments
You can modify the following attributes of an Oracle ASM disk group:
• ACFSNAME : Specifies a new name for the Oracle ACFS volume on this diskgroup
• ACFSPATH : Specifies the new path for the Oracle ACFS file system
• ACFSSIZE : Specifies a new size for the Oracle ACFS volume on this diskgroup
• CELLLIST : A comma separated list of cells for this disk group, enclosed in single
quotes
• DISKGROUPNAME : Specifies a new name for the disk group
• DISKGROUPSIZE : Specifies a new size for the disk group
• OCRVOTE : A boolean variable, where TRUE indicates the disk group should store the
OCR and voting disks for the cluster.
• QUORUMDISK : A boolean variable, where TRUE indicates the disk group requires a
quorum
• REDUNDANCY : Specifies the redundancy level for the disk group. The accepted
values are NORMAL or HIGH.
• SLICESIZE : Specifies the slice size on disk for each grid disk for this disk group.
• SPARSE : A boolean variable, where TRUE indicates this should be sparse disk
group.
• SPARSEVIRTUALSIZE : Specifies the sparse virtual size.
The following arguments are available in the WHERE clause:
4-36
Chapter 4
OEDACLI Command Reference
Usage Notes
If you modify the redundancy, the volume size will be maintained, however the slice
size will be recalculated.
Example 4-18 Resizing an Oracle ASM Diskgroup Using OEDACLI
This example shows how to resize an existing Oracle ASM disk group using
OEDACLI.
1. Load the OEDA XML configuration file.
2. Use the command LIST DISKGROUPS to view the disk group details.
4-37
Chapter 4
OEDACLI Command Reference
quorumDisk : "false"
id : "c0_recodg"
4-38
Chapter 4
OEDACLI Command Reference
Syntax
ALTER DISKGROUPS
DATASPLIT=data_split_percent
RECOSPLIT=reco_split_percent
DATAREDUNDANCY=data_redundancy_level
RECOREDUNDANCY=reco_redundancy_level
SPLITDISK=percent_of_cell_disk
WHERE
DATADG = data_diskgroup
RECODG = reco_diskgroup
CLUSTERNAME = cluster_name | CLUSTERNUMBER = cluster_number |
CLUSTERID = cluster_id
Arguments
You can modify the following sizing attributes of the DATA and RECO Oracle ASM disk
groups:
• DATASPLIT : Specifies a percentage of the Oracle ASM volume allocated to the
DATA disk group
• RECOSPLIT : Specifies a percentage of the Oracle ASM volume allocated to the
RECO disk group
• DATAREDUNDANCY : Specifies the redundancy level for the DATA disk group. The
accepted values are NORMAL or HIGH.
• RECOREDUNDANCY : Specifies the redundancy level for the RECO disk group. The
accepted values are NORMAL or HIGH.
• SPLITDISK : Specifies the percentage of the cell disk to allocate to the DATA and
RECO disk groups. The specified value must be less an integer between 1 and
100.
The following arguments are available in the WHERE clause:
• DATADG : Specifies the name of the DATA disk group in the cluster
• RECODG : Specifies the name of the RECO disk group in the cluster
• CLUSTERNUMBER : Specifies the cluster number in the es.xml, starting at 1
• CLUSTERNAME : Specifies the name of the cluster
• CLUSTERID : Specifies the es.xml ID of the cluster
Syntax
DELETE DISKGROUP
WHERE
ID = diskgroup_id|
CLUSTERNUMBER = cluster_number DISKGROUPNAME = diskgroup_name|
4-39
Chapter 4
OEDACLI Command Reference
Arguments
The following arguments are available in the WHERE clause:
Syntax
LIST DISKGROUPS
[ WHERE
ID = diskgroup_id|
CLUSTERNUMBER = cluster_number |
CLUSTERNAME = cluster_name |
CLUSTERID = cluster_id ]
Arguments
The following arguments are available in the WHERE clause:
4.3.9 ES
You can discover an engineered system or alter a limited number of attributes of an
engineered system.
• ALTER ES
This command alters the attributes of an engineered system.
• DISCOVER ES
This command discovers an existing configuration of an engineered system.
4.3.9.1 ALTER ES
This command alters the attributes of an engineered system.
4-40
Chapter 4
OEDACLI Command Reference
Syntax
ALTER ES
PAAS = 'pass_mode' |
CUSTOMERNAME = customer_name |
CUSTOMERDEPT = customer_dept
Arguments
You can modify the following attributes for the engineered system:
• PAAS : A boolean value, TRUE or FALSE, which specifies whether to enable PaaS
mode.
• CUSTOMERNAME : Specifies the customer name.
• CUSTOMERDEPT : Specifies the customer department.
4.3.9.2 DISCOVER ES
This command discovers an existing configuration of an engineered system.
Syntax
DISCOVER ES
HOSTNAMES = host_names
LOCATION = directory_name
Arguments
You can use the following arguments when discovering an engineered system
configuration:
• HOSTNAMES: Specifies the list of nodes to be discovered, with each host name
separated by a ',' or a space. The list must be enclosed in quotation marks, for
example, 'node1,node2' or 'node1 node2'. For virtual environments with user
domains, you need to provide a list of only management domain (dom0) host
names and storage servers.
• LOCATION: Specifies the target directory for file creation.
4.3.10 GUEST
You can clone or delete an Oracle VM guest.
• CLONE GUEST
This command clones an existing Oracle VM guest and creates a fully functional
new guest with storage, users, and Oracle RAC instances.
• DELETE GUEST
This command deletes an existing Oracle VM guest, and removes all of its
configuration: instances, software installations, storage, and users from the
cluster.
4-41
Chapter 4
OEDACLI Command Reference
Prerequisites
Before you can clone an Oracle VM node, you must download the appropriate
software images from My Oracle Support and extract the files. Place the extracted
"klone.zip" files for Oracle Grid Infrastructure and Oracle Database in the /
EXAVMIMAGES directory in the management domain (dom0) where the new guest
clone will be created.
Note:
Creating more than 8 VMs on Exadata Database Servers is not supported.
Syntax
Arguments
• SRCNAME is used to specify the name of an existing guest VM (DomU) from which
the new guest VM is derived.
• TGTNAME is used to specify the host name of the new guest VM that you are
creating with the clone operation. This argument is used with the WHERE STEPNAME
clause.
• The WHERE STEPNAME clause allows you to perform individual steps of the clone
operation. The value of stepname can be one of the following:
– CREATE_GUEST
– CREATE_USERS
– CELL_CONNECTIVITY
– ADD_NODE
– EXTEND_DBHOME
4-42
Chapter 4
OEDACLI Command Reference
– ADD_INSTANCE
• The SET clauses are used only when specifying CLONE GUEST with the WHERE
STEPNAME = CREATE_GUEST clause or when specifying CLONE GUEST without using
any WHERE STEPNAME clause. The SET clauses take the following additional
arguments:
– PARENT: Specifies the host name of the Dom0 used to host this new guest
– ADMINNET: NAME specifies the DNS name (with domain name) and IP specifies
the IP address to be used for the admin network
– BACKUP: NAME specifies the DNS name (with domain name) and IP specifies
the IP address to be used for the backup network
– PRIVNET: NAME1 specifies the DNS name (with domain name) and IP1 specifies
the IP address to be used for the first private network. NAME2 specifies the
DNS name (with domain name) and IP2 specifies the IP address to be used
for the second private network.
– INTERCONNECT: NAME1 specifies the DNS name (with domain name) and IP1
specifies the IP address to be used for the first private interconnect. NAME2
specifies the DNS name (with domain name) and IP2 specifies the IP address
to be used for the second private interconnect.
– CLIENTNET: NAME specifies the DNS name (with domain name) and IP specifies
the IP address to be used for the client network
– VIPNET: NAME specifies the DNS name (with domain name) and IP specifies
the IP address to be used for the VIP network
Usage Notes
• The SET INTERCONNECT clause is only required if the compute nodes are
configured with InfiniBand security (PKEYS).
• When you load the XML configuration file to use when cloning a guest domain, the
XML file should have the management domain (dom0) node of the source VM
defined but not allocated to the cluster that is being extended into the guest
domain.
• You should save the modified XML file after the actions are merged so that you
have a new XML file that reflects the addition of the new guest domain.
Example 4-19 Cloning a Guest VM
This example shows how to clone a new guest from an existing node in the cluster. In
this example, the source node name is exa01adm01vm01.example.com and the new
node is exa01adm03vm01.example.com. A series of SET commands are used to specify
the configuration for the new guest VM.
The XML file loaded at the beginning of this example has the dom0 node
(host01adm01.example.com) defined but not allocated to the cluster that is being
extended into the guest.
4-43
Chapter 4
OEDACLI Command Reference
Related Topics
• Adding New Nodes to existing Clusters on Exadata VM environments using OEDA
(My Oracle Support Doc ID 2286633.1)
Syntax
Arguments
• SRCNAME is used to specify the host name of an existing DomU that you want to
delete.
• The WHERE STEPNAME clause allows you to undo individual steps of the clone
operation.
The value of stepname can be one of the following:
– CREATE_GUEST
– CREATE_USERS
– CELL_CONNECTIVITY
– ADD_NODE
– EXTEND_DBHOME
– ADD_INSTANCE
When used with DELETE GUEST, the STEPNAME clauses should be used in the
reverse order of CLONE GUEST steps, and you should not skip any steps. For
example, if you want to undo the ADD_NODE and ADD_INSTANCE steps, you would
use the following commands:
4-44
Chapter 4
OEDACLI Command Reference
4.3.11 ILOM
You can alter or list the ILOMS in the loaded es.xml file.
• ALTER ILOM
• LIST ILOMS
Syntax
Arguments
You can specify the following attributes for the ILOM:
• DNSSERVERS : Specifies a comma-separated list of DNS servers that is enclosed in
single quotes.
• NTPSERVERS : Specifies a comma-separated list of NTP servers that is enclosed in
single quotes.
• TIMEZONE : Specifies a valid time zone for the ILOM.
The following arguments are available in the WHERE clause:
Syntax
LIST ILOMS
[ WHERE {
ID = ilom_id |
HOSTNAME = hostname |
ILOMNAME = ilom_hostname } ]
Arguments
The following arguments are available in the WHERE clause:
4-45
Chapter 4
OEDACLI Command Reference
Usage Notes
If you do not specify a WHERE clause, then this command lists all the ILOMs in the
es.xml file.
4.3.12 MACHINE
You can alter or list the machines in the es.xml file.
• ALTER MACHINE
• LIST MACHINES
Syntax
Arguments
You can specify the following attributes for the machine:
• DNSSERVERS : Specifies a comma-separated list of DNS servers that is enclosed in
single quotes.
• GATEWAYADAPTER : Specifies the network adapter to use as the machine gateway.
Valid values are ADMIN or CLIENT.
• HOSTNAMEADAPTER : Specifies the network adapter to use as the host name. Valid
values are ADMIN or CLIENT.
• NTPSERVERS : Specifies a comma-separated list of NTP servers that is enclosed in
single quotes.
• TIMEZONE : Specifies a valid time zone for the machine.
The following arguments are available in the WHERE clause:
4-46
Chapter 4
OEDACLI Command Reference
Syntax
LIST MACHINES
{ WHERE
TYPE = type |
ID = machine_id [ TYPE = type ] |
CLUSTERNUMBER = cluster_number [ TYPE = type ] |
CLUSTERNAME = cluster_name [ TYPE = type ] |
CLUSTERID = cluster_id [ TYPE = type ] }
Arguments
The following arguments are available in the WHERE clause:
• TYPE : Specifies the machine type. The valid values are COMPUTE, CELL, STORAGE,
DOM0, GUEST, or DOMU.
• ID : Specifies the es.xml ID for an individual machine
• CLUSTERNUMBER : Specifies the cluster number in the es.xml, starting at 1
• CLUSTERNAME : Specifies the name of the cluster
• CLUSTERID : Specifies the es.xml ID of the cluster
Usage Notes
If you do not specify a WHERE clause, then this command lists all the machines defined
in the es.xml file.
4.3.13 NETWORK
You can add, alter, delete, or list the networks defined in the XML configuration file.
• ADD NETWORK
• ALTER NETWORK
• DELETE NETWORK
• LIST NETWORKS
4-47
Chapter 4
OEDACLI Command Reference
Syntax
ADD NETWORK
NETWORKTYPE=network_type HOSTNAME=hostname IP=ip_addr
NETMASK=netmask DOMAINNAME=domain_name MASTER=master
[ GATEWAY=gateway] [ SSHENABLED=ssh_enabled ] [ MAC=mac_addr ]
[ NICSPEED=nic_speed [ SLAVE='slave'] [ PKEY=pkey ]
[ PKEYNAME=pkey_name ] [ STATUS = status ] [ LACP=lacp ]
[ VLANID=vlan_id ] [ NATHOSTNAME=nat_host_name ] [ NATIP=nat_ip_addr ]
[ NATDOMAINNAME=nat_domain_name ] [ NATNETMASK=nat_mask ]
WHERE {
HOSTNAME = hostname |
CLUSTERNAME = cluster_name COMPUTENUMBER=compute_number |
CLUSTERNAME = cluster_name STORAGENUMBER=storage_number |
CLUSTERNUMBER = cluster_number COMPUTENUMBER=compute_number |
CLUSTERNUMBER = cluster_number STORAGENUMBER=storage_number }
Arguments
You can specify the following attributes when adding a network:
• NETWORKTYPE : (Mandatory) Specifies the type of network, which can be ADMIN,
CLIENT, BACKUP, PRIVATE, OTHER, INGESTVIP, REPLICATIONVIP, or ILOM.
• HOSTNAME : (Mandatory) Specifies the short host name for the network
• IP : (Mandatory) Specifies the IP address of the network
• NETMASK : (Mandatory) Specifies the netmask of the network
• DOMAINNAME : (Mandatory) Specifies the domain name of the network
• MASTER : (Mandatory) Specifies the master adapter name
• GATEWAY : Specifies the network subnet gateway
• SSHENABLED : A Boolean variable where TRUE indicates SSH should be enabled for
this adapter
• MAC : Specifies the MAC address
• NICSPEED : (Only for X7 2 or later socket compute nodes), either 10000 or 25000
• SLAVE : Specifies a space-separated list of slave devices for a bonded network,
enclosed in single quotes
• PKEY : (For Private networks only) Specifies the pkey
• PKEYNAME : (For Private networks only) Specifies the pkey name
• STATUS : Specifies the status of the network
• LACP : A Boolean variable where TRUE indicates that LACP should be enabled
• VLANID : Specifies the VLAN Id if network is a VLAN network and not private
• NATHOSTNAME : Specifies the NAT host name
4-48
Chapter 4
OEDACLI Command Reference
Syntax
ALTER NETWORK {
[ HOSTNAME=hostname ] [ IP=ip_addr ] [ NETMASK=netmask ]
[ DOMAINNAME=domain_name] [ MASTER=master] [ GATEWAY=gateway]
[ SSHENABLED=ssh_enabled ] [ MAC=mac_addr ] [ NICSPEED=nic_speed]
[ SLAVE='slave'] [ PKEY=pkey ] [ PKEYNAME=pkey_name ]
[ STATUS = status ] [ LACP=lacp ] [ VLANID=vlan_id ]
[ NATHOSTNAME=nat_host_name ] [ NATIP=nat_ip_addr ]
[ NATDOMAINNAME=nat_domain_name ] [ NATNETMASK=nat_mask ] }
WHERE {
ID = network_id |
NETWORKHOSTNAME = network_hostname |
NATHOSTNAME = nat_hostname |
HOSTNAME = hostname NETWORKTYPE = network_type [PRIVATEID=private_id]|
CLUSTERNAME = cluster_name { COMPUTENUMBER=compute_number |
STORAGENUMBER=storage_number }
NETWORKTYPE = network_type [PRIVATEID=private_id] |
CLUSTERNUMBER = cluster_number { COMPUTENUMBER=compute_number |
STORAGENUMBER=storage_number }
NETWORKTYPE = network_type [PRIVATEID=private_id] }
Arguments
You can specify the following attributes when altering a network:
• HOSTNAME : Specifies the short host name for the network
• IP : Specifies the IP address of the network
• NETMASK : Specifies the netmask of the network
• DOMAINNAME : Specifies the domain name of the network
• MASTER : Specifies the master adapter name
• GATEWAY : Specifies the network subnet gateway
4-49
Chapter 4
OEDACLI Command Reference
• SSHENABLED : A Boolean variable where TRUE indicates SSH should be enabled for
this adapter
• MAC : Specifies the MAC address
• NICSPEED : (Only for X7 2 socket compute nodes), either 10000 or 25000
• SLAVE : Specifies a space-separated list of slave devices for a bonded network,
enclosed in single quotes
• PKEY : (For Private networks only) Specifies the pkey
• PKEYNAME : (For Private networks only) Specifies the pkey name
• STATUS : Specifies the status of the network
• LACP : A Boolean variable where TRUE indicates that LACP should be enabled
• VLANID : Specifies the VLAN Id if network is a VLAN network and not private
• NATHOSTNAME : Specifies the NAT host name
• NATIP : Specifies the NAT IP address
• NATDOMAINNAME : Specifies the NAT domain name
• NATNETMASK : Specifies the NAT netmask
The following arguments are available in the WHERE clause:
• ID : Specifies the ID for the target network in the XML configuration file.
• NETWORKHOSTNAME : Specifies the host name for an network object, not the machine
host name
• NATHOSTNAME : Specifies the NAT host name for an existing compute node
• HOSTNAME : Specifies the host name for an existing compute node
• NETWORKTYPE : Specifies the type of network, which can be ADMIN, CLIENT, BACKUP,
PRIVATE, OTHER, INGESTVIP, REPLICATIONVIP, or ILOM.
• PRIVATEID : Specifies the ID of the private network
• CLUSTERNUMBER : Specifies the cluster number in the XML configuration file,
starting at 1
• CLUSTERNAME : Specifies the name of an existing cluster
• COMPUTENUMBER : Specifies the number of an existing compute node in the cluster,
starting at 1
• STORAGENUMBER : Specifies the number of an existing storage cell in the cluster,
starting at 1
Syntax
DELETE NETWORK
WHERE {
ID = network_id |
HOSTNAME = network_hostname NETWORKTYPE = network_type |
4-50
Chapter 4
OEDACLI Command Reference
Arguments
The following arguments are available in the WHERE clause:
• ID : Specifies the ID for the network object in the XML configuration file.
• HOSTNAME : Specifies the host name for an existing compute node
• NETWORKTYPE : Specifies the type of network, which can be ADMIN, CLIENT, BACKUP,
PRIVATE, OTHER, INGESTVIP, REPLICATIONVIP, or ILOM.
• CLUSTERNAME : Specifies the name of an existing cluster
• CLUSTERNUMBER : Specifies the cluster number in the XML configuration file,
starting at 1
• CLUSTERID : Specifies the cluster ID in the XML configuration file
• COMPUTENUMBER : Specifies the number of an existing compute node in the cluster,
starting at 1
• STORAGENUMBER : Specifies the number of an existing storage cell in the cluster,
starting at 1
Syntax
LIST NETWORKS
[ WHERE {
ID = network_id |
HOSTNAME = network_hostname [ NETWORKTYPE = network_type ] |
CLUSTERNAME = cluster_name { COMPUTENUMBER=compute_number |
STORAGENUMBER=storage_number } [ NETWORKTYPE = network_type ] |
CLUSTERNUMBER = cluster_number { COMPUTENUMBER=compute_number |
STORAGENUMBER=storage_number } [ NETWORKTYPE = network_type ] }
CLUSTERID = cluster_ID { COMPUTENUMBER=compute_number |
STORAGENUMBER=storage_number } [ NETWORKTYPE = network_type ] } ]
Arguments
The following arguments are available in the WHERE clause:
• ID : Specifies the ID for the network object in the XML configuration file.
• HOSTNAME : Specifies the host name for an existing compute node
• NETWORKTYPE : Specifies the type of network, which can be ADMIN, CLIENT, BACKUP,
PRIVATE, or ILOM.
4-51
Chapter 4
OEDACLI Command Reference
4.3.14 SCAN
You can add, alter, delete, or list the SCANs for a cluster.
• ADD SCAN
• ALTER SCAN
• DELETE SCAN
• LIST SCANS
Syntax
Arguments
You can specify the following attributes for the new SCAN:
• SCANNAME : Specifies the DNS name for the SCAN
• SCANPORT : Specifies the port for the SCAN. The default value is 1521.
• SCANIPS : A comma-separated list of IP addresses for the SCAN, enclosed in
single quotes.
The following arguments are available in the WHERE clause:
4-52
Chapter 4
OEDACLI Command Reference
Syntax
Arguments
You can modify the following attributes for the SCAN:
• SCANNAME : Specifies the DNS name for the SCAN
• SCANPORT : Specifies the port for the SCAN.
• SCANIPS : A comma-separated list of IP addresses for the SCAN, enclosed in
single quotes.
The following arguments are available in the WHERE clause:
Syntax
DELETE SCAN
WHERE
{ CLUSTERNAME = cluster_name |
CLUSTERNUMBER = cluster_number |
CLUSTERID = cluster_id }
Arguments
The following arguments are available in the WHERE clause:
4-53
Chapter 4
OEDACLI Command Reference
Syntax
LIST SCANS
[ WHERE
{ SCANID = scan_id |
CLUSTERNAME = cluster_name |
CLUSTERNUMBER = cluster_number |
CLUSTERID = cluster_id } ]
Arguments
The following arguments are available in the WHERE clause:
• SCANID : Specifies the ID of the SCAN object in the XML configuration file
• CLUSTERNAME : Specifies the name of the cluster
• CLUSTERNUMBER : Specifies the cluster number in the XML configuration file,
starting at 1
• CLUSTERID : Specifies the ID of the cluster in the XML configuration file
Usage Notes
If you do not specify a WHERE clause, then this command lists details about all the
SCANS for all the clusters in the XML configuration file.
4.3.15 SWITCH
You can alter or list the switches.
• ALTER SWITCH
• LIST SWITCHES
Syntax
Arguments
You can modify the following attributes for a switch:
• DNSSERVERS : Specifies a comma-separated list of DNS servers that is enclosed in
single quotes.
• NTPSERVERS : Specifies a comma-separated list of NTP servers that is enclosed in
single quotes.
4-54
Chapter 4
OEDACLI Command Reference
Syntax
LIST SWITCHES
[ WHERE {
ID = switch_id |
HOSTNAME = switch_name } ]
Arguments
The following arguments are available in the WHERE clause:
Usage Notes
If you do not specify a WHERE clause, then this command lists the details for all
switches.
4.3.16 VIP
You can add, alter, delete, or list the VIPs for the clusters.
• ADD VIP
• ALTER VIP
• DELETE VIP
• LIST VIPS
Purpose
This command does not add additional VIPs. You should only use this command after
previously issuing a DELETE VIP command.
Syntax
4-55
Chapter 4
OEDACLI Command Reference
Arguments
You can specify the following attributes when adding a VIP:
• NAME : Specifies the short DNS name for the VIP
• DOMAINNAME : Specifies the domain name for the VIP
• IP : Specifies the IP address for the VIP
The following arguments are available in the WHERE clause:
• HOSTNAME : Specifies the host name for the compute node in the cluster
• CLUSTERNUMBER : Specifies the cluster number in the es.xml, starting at 1
• CLUSTERNAME : Specifies the name of the cluster
• CLUSTERID : Specifies the es.xml ID of the cluster
• COMPUTENUMBER : Specifies the compute node number in the cluster, starting at 1
Usage Notes
When adding a VIP to a compute node, the node must not already have a VIP defined.
Syntax
Arguments
You can modify the following attributes for the VIP:
• NAME : Specifies the short DNS name for the VIP
• DOMAINNAME : Specifies the domain name for the VIP
• IP : Specifies the IP address for the VIP
The following arguments are available in the WHERE clause:
• HOSTNAME : Specifies the host name for the compute node in the cluster
• CLUSTERNUMBER : Specifies the cluster number in the es.xml, starting at 1
• CLUSTERNAME : Specifies the name of the cluster
4-56
Chapter 4
OEDACLI Command Reference
Syntax
DELETE VIP
WHERE {
ID = vip_id |
HOSTNAME = hostname |
CLUSTERNAME = cluster_name COMPUTENUMBER = compute_number |
CLUSTERNUMBER = cluster_number COMPUTENUMBER = compute_number |
CLUSTERID = cluster_id COMPUTENUMBER = compute_number }
Arguments
The following arguments are available in the WHERE clause:
Syntax
LIST VIPS
[ WHERE {
HOSTNAME = hostname |
CLUSTERNAME = cluster_name [ COMPUTENUMBER = compute_number ] |
CLUSTERNUMBER = cluster_number [ COMPUTENUMBER = compute_number ] |
CLUSTERID = cluster_id [ COMPUTENUMBER = compute_number ] }
Arguments
The following arguments are available in the WHERE clause:
4-57
Chapter 4
OEDACLI Command Reference
Usage Notes
If you do not specify a WHERE clause, then this command lists the VIPs for all clusters.
4-58
5
Installing Oracle Exadata Database
Machine or Oracle Exadata Storage
Expansion Rack at the Site
This chapter describes how to move, install and configure the hardware through to
powering on the system.
Note:
For ease of reading, the name "Oracle Exadata Rack" is used when
information refers to both Oracle Exadata Database Machine and Oracle
Exadata Storage Expansion Rack.
5-1
Chapter 5
Reviewing Safety Guidelines
See Also:
5-2
Chapter 5
Unpacking Oracle Exadata Rack
5-3
Chapter 5
Unpacking Oracle Exadata Rack
Note:
The following items are not included in the shipping kit:
• No. 2 Phillips screwdriver
• Antistatic wrist strap
Note:
Oracle strongly recommends that you use professional movers when
unpacking and installing Oracle Exadata Rack.
Note:
Before unpacking the rack from the shipping carton, refer to the labels on
the carton and to the instructions that they provide.
5-4
Chapter 5
Placing Oracle Exadata Rack in Its Allocated Space
WARNING:
Rocking or tilting the rack can cause the rack to fall over and cause
serious injury or death.
Note:
Use care when removing the shipping brackets from underneath
Oracle Exadata Rack. Access to the inside shipping brackets might
be limited.
c. Roll the cabinet down the ramps to the level floor. Oracle recommends having
three people available to move the rack down the ramp: two people on both
sides to help guide the rack and one person in back.
5. Save the shipping brackets used to secure the rack to the shipping pallet. Do not
dispose of these brackets, because you cannot order replacement brackets.
6. Recycle the packaging properly. Follow local laws and guidelines to dispose of the
material.
See Also:
5-5
Chapter 5
Placing Oracle Exadata Rack in Its Allocated Space
Oracle recommends having two people to move the rack: one person in front and
one person in back to help guide the rack. When transporting configured racks
from one location to another, take care to move them slowly, 0.65 meters per
second (2.13 feet per second) or slower.
Carefully examine the transportation path. Avoid obstacles such as doorways or
elevator thresholds that can cause abrupt stops or shocks. Go around obstacles
by using ramps or lifts to enable smooth transport.
5-6
Chapter 5
Placing Oracle Exadata Rack in Its Allocated Space
WARNING:
Caution:
Shipping brackets are not for use for bracing or anchoring the rack during
seismic events.
You can stabilize the rack by extending the rack leveling feet.
• Stabilize Oracle Exadata Rack with Leveling Feet
• Stabilize Oracle Exadata Rack X7 and Later with Leveling Feet
The rack contains four leveling feet that can be lowered to stabilize the rack.
5-7
Chapter 5
Placing Oracle Exadata Rack in Its Allocated Space
• 1: Distance from the edge of the mounting feet to the side of the rack is 33.75
mm (1.33 inches)
• 2: Width from the outside edges of the leveling feet is 532.5 mm (20.96
inches)
• 3: Width from the inside edges of the leveling feet is 429 mm (16.89 inches)
• 4: Distance from the edge of the feet to the front rack surface is 73.75 m (2.90
inches)
• 5: Depth of the outside edges of the leveling feet is 1058.5 mm (41.67 inches)
• 6: Distance from the edge of the leveling feet to the rear rack surface is 32.5
mm (1.28 inches)
• 7: Distance from the center of front casters to the side of the rack is 86.7 mm
(3.41 inches)
• 8: Width between the center of the front casters is 426.6 mm (16.80 inches)
• 9: Distance from the center of the rear casters to the rear of the rack is 173.7
mm (6.83 inches)
• 10: Depth between the front and rear casters is 828.6 mm (32.62 inches)
• 11: Distance between the rear casters and the rear of the rack is 162.4 mm
(6.39 inches)
• 12: Distance from the center of rear casters to the side of the rack is 96.4 mm
(3.80 inches)
• 13: Width between the center of the rear casters is 407.2 mm (16.03 inches)
2. Lower the leveling feet to the floor to share the load with the casters, as shown in
Figure 5-4 using the SW 12 mm wrench.
5-8
Chapter 5
Placing Oracle Exadata Rack in Its Allocated Space
Figure 5-4 Securing Oracle Exadata Rack Using the Leveling Feet
5.3.2.2 Stabilize Oracle Exadata Rack X7 and Later with Leveling Feet
The rack contains four leveling feet that can be lowered to stabilize the rack.
The leveling feet can be used even when the rack is permanently secured to the floor.
The four leveling feet share the load with the casters. This increases the footprint of
the rack which improves stability and helps prevent rack movement.
To adjust the leveling feet, do the following:
1. Locate the four leveling feet located at the bottom corners of Oracle Exadata
Rack. The following figure shows the location of the leveling feet on the bottom of
Oracle Exadata Rack. The image dimensions include the doors attached to the
rack.
5-9
Chapter 5
Placing Oracle Exadata Rack in Its Allocated Space
• 1: Distance from the edge of the feet to the Front door surface is 58 mm (2.3
inches)
• 2: Depth of the outside edges of the leveling feet is 1113 mm (43.8 inches)
• 3: Distance from the edge of the leveling feet to the rear door surface is 26
mm (1.0 inches)
• 4: Distance from the center of rear casters to the side of the rack is 96.5 mm
(3.8 inches)
• 5: Width between the center of the rear casters is 407 mm (16.0 inches)
• 6: Distance from the center of the rear casters to the rear door surface is 142
mm (5.6 inches)
• 7: Depth between the front and rear casters is 889 mm (35.0 inches)
• 8: Distance between the center of the front casters and the Front door surface
is 166 mm (6.5 inches)
• 9: Width from the outside edges of the leveling feet is 583 mm (23.0 inches)
• 10: Width from the inside edges of the leveling feet is 513 mm (20.2 inches)
• 11: Distance from the edge of the mounting feet to the side of the rack is 8.5
mm (0.3 inches)
• 12: Width between the center of the front casters is 410 mm (16.1 inches)
• 13: Distance from the center of front casters to the side of the rack is 95 mm
(3.7 inches)
2. Stabilize the rack by lowering the four leveling feet to the floor, using a 6-mm hex
wrench or your fingers, as shown in the following image.
5-10
Chapter 5
Placing Oracle Exadata Rack in Its Allocated Space
Figure 5-6 Securing Oracle Exadata Rack Using the Leveling Feet
See Also:
Oracle Rack Cabinet 1242 User's Guide at http://docs.oracle.com/cd/
E85660_01/html/E87280/index.html for the rack specifications
WARNING:
The PDU power input lead cords and the ground cable must reference a
common earth ground. If they do not, then a difference in ground potential
can be introduced. If you are unsure of your facility's PDU receptacle
grounding, then do not install a ground cable until you confirm that there is a
proper PDU receptacle grounding. If a difference in ground potential is
apparent, then you must take corrective action.
5-11
Chapter 5
Acclimating the Oracle Exadata Database Machine
Note:
A grounding cable is not shipped with the system.
1. Ensure the installation site has properly grounded the power source in the data
center. The facility PDU must have earth ground.
2. Ensure all grounding points, such as raised floors and power receptacles,
reference the facility ground.
3. Ensure that direct, metal-to-metal contact is made for this installation. During
manufacturing, the ground cable attachment area might have been painted or
coated.
4. Attach the ground cable to one of the attachment points located at the bottom rear
of the system frame as shown in Figure 5-7. The attachment point is an adjustable
bolt that is inside the rear of the Oracle Exadata Rack cabinet on the right side.
See Also:
Oracle Exadata Database Machine Extending and Multi-Rack Cabling Guide
if Oracle Exadata Rack will be connected to another Oracle Exadata Rack.
5-12
Chapter 5
Powering on the System the First Time
5-13
Chapter 5
Powering on the System the First Time
Note:
Oracle Exadata Database Machine X2-8 Full Rack database servers may
take up to 15 minutes to start through the normal BIOS POST tests.
1. Switch on the PDU B circuit breakers, one at a time. PDU B is on the right side of
the rack when viewed from the rear. The circuit breakers are on the rear of the
Oracle Exadata Rack cabinet as shown in the following figure. Press the ON (|)
side of the toggle switch. When the breaker is in the ON position, the breakers are
flush with the side of the PDU.
5-14
Chapter 5
Powering on the System the First Time
2. Verify the expected power LEDs are on. The LEDs are located as follows:
• Database servers: Right-hand LED
• Storage Servers: Top LED
• Cisco Ethernet switch: Left LED (viewed from front) is green, and the other
LEDs are red
• RDMA over InfiniBand Network Fabric switches: Left LED (viewed from front)
labeled PS0, or right LED (viewed from front) labeled PS1
• RDMA over RoCE Network Fabric switches: Left LED (viewed from front)
labeled P1, or right LED (viewed from front) labeled P2
• KVM switch on Oracle Exadata Database Machine X2-2: Lower LED B
• KMM switch on Oracle Exadata Database Machine X2-2: Only supplied by
PDU B
3. Connect power to PDU A. Ensure the breaker switches are in the OFF position
before connecting the power cables.
4. Switch on the PDU A circuit breakers, one at a time.
5. Verify the expected LEDs are on.
6. Perform a visual check of all cable connections in the rack. Do not press every
connector to verify connection.
7. Verify the OK LED is blinking standby for all systems. The OK LED blinks on for
0.1 seconds, once every 3 seconds when in standby mode. The OK LED does not
blink when the ILOM is starting. The LED remains dark until it goes to standby
mode after 2 to 3 minutes.
Related Topics
• Reviewing Safety Guidelines
Before Oracle Exadata Rack arrives, the following safety precautions should be
reviewed to ensure the site is safe, as well as ready for delivery.
5-15
6
Configuring Oracle Exadata Database
Machine
This chapter describes how to configure the system, accounts, and software for Oracle
Exadata Database Machine.
Note:
• For ease of reading, the name "Oracle Exadata Rack" is used when
information refers to both Oracle Exadata Database Machine and Oracle
Exadata Storage Expansion Rack.
• The procedures in this chapter are applicable to Oracle Exadata Storage
Expansion Rack as well as Oracle Exadata Database Machine.
• The procedures in this chapter use the information from Oracle Exadata
Database Machine Deployment Assistant (OEDA). Be sure to run OEDA
before starting the procedures in this chapter.
6-1
Chapter 6
Verifying the Network Configuration Prior to Configuring the Rack
6-2
Chapter 6
Configuring the RDMA Network Fabric Switch
If the command is run from a Microsoft Windows machine, then the command is
checkip.cmd.
If this engineered system rack is an addition for an existing installation, then run
the checkip.sh script from an existing engineered system server. This enables the
script to identify in-use IP addresses in the fabric. Not identifying existing IP
addresses may cause IP collisions after installation of the new engineered system
rack. To create a checkip.sh that can run on an existing server, you must run
OEDA on a server or client that uses the same operating system as the existing
engineered system server.
The output from the script is a file that contains status messages such as GOOD or
ERROR.
If there are conflicts that you are unable to resolve, then work with your assigned
Oracle representative to correct the problems.
Note:
If you do not have the password for the root user, then contact Oracle
Support Services.
2. Use SSH to log in to the Sun Datacenter InfiniBand Switch 36 switch as the ilom-
admin user. Find the default IP address for the Sun Datacenter InfiniBand Switch
36 switch for your system in "Default IP Addresses". The following is an example
of the command:
6-3
Chapter 6
Configuring the RDMA Network Fabric Switch
3. Use spsh to open the Integrated Lights Out Manager (ILOM) command line
interface.
4. Configure the network interface using the following commands:
It is required that the second line has both fully-qualified and non-fully-qualified
names.
7. Use the ILOM interface to configure the IP address, host name, NTP servers, and
DNS servers.
8. Restart the switch.
9. Examine the firmware version using the following command:
# version
Refer to My Oracle Support Note 888828.1 for the current firmware version.
10. Check the health of the switch using the following command:
# showunhealthy
OK - No unhealthy sensors
# env_test
6-4
Chapter 6
Configuring the RDMA Network Fabric Switch
12. Enable the InfiniBand Subnet Manager using the following command:
# enablesm
Note:
If you get an error indicating the InfiniBand Subnet Manager is already
running, then restart it as follows:
# disablesm
# enablesm
# ifconfig eth0
6-5
Chapter 6
Configuring the RDMA Network Fabric Switch
14. Verify the host name is correct using the following command:
# hostname
dm01sw-ib2.example.com
15. Set the Subnet Manager Master as described in "Setting the Subnet Manager
Master on Oracle Exadata Database Machine Full Rack and Oracle Exadata
Database Machine Half Rack". This step is needed for Oracle Exadata Database
Machine Half Rack and Oracle Exadata Database Machine Full Rack.
16. Log out from the InfiniBand switch using the following command:
# exit
Note:
If the network settings did not appear after restart, then power cycle the
switch by removing both power cords for one minute.
Related Topics
• Exadata Database Machine and Exadata Storage Server Supported Versions (My
Oracle Support Doc ID 888828.1)
6-6
Chapter 6
Configuring the RDMA Network Fabric Switch
Note:
If you do not have the password for the admin user, then contact Oracle
Support Services.
dbm0sw-rocea0# reload
7. Switch to normal setup and, when asked if you want to enforce secure password
standard, enter no, then enter a new password for the admin user.
Running S93thirdparty-script...
Abort Auto Provisioning and continue with normal setup ? (yes/no) [n]:
yes
8. When the Basic System Configuration Dialog appears, choose to enter the basic
configuration dialog.
This setup utility will guide you through the basic configuration of
the system. Setup configures only enough connectivity for management
6-7
Chapter 6
Configuring the RDMA Network Fabric Switch
of the system.
Would you like to enter the basic configuration dialog (yes/no): yes
9. In the basic configuration, you can use the default inputs until asked to enter the
switch name.
In this example, the switch has a name of test123sw-rocea0.
12. Respond yes when asked to configure static route (this can be changed later).
13. Enter the destination prefix and mask, and other values as prompted.
6-8
Chapter 6
Configuring the RDMA Network Fabric Switch
15. Skip configuring the default domain name (this will be configured later).
16. Accept the default responses until asked to configure SSH and the NTP server.
17. Accept the default responses until asked to specify the CoPP system profile. Enter
strict.
[########################################] 100%
Copy complete.
6-9
Chapter 6
Configuring the RDMA Network Fabric Switch
21. Apply the golden configuration on the switch by using scp to transfer the file over
to the switch.
a. Find the golden configuration from the patchmgr switch bundle.
For example, for the 19.3.0.0.0 patch bundle, patch 29963277 contains the
files for the RDMA over RoCE Network Fabric switch. The files are located
within in the ZIP file in the roce_switch_templates/ directory.
The golden configuration files are:
• Single rack leaf: roce_leaf_switch.cfg
• Multi-rack leaf: roce_leaf_switch_multi.cfg
• Multi-rack spine: roce_spine_switch_multi.cfg
b. Copy the golden configuration file to the switch.
In the following example, 100.104.10.21 represents the IP address of the
switch you are configuring.
Note:
This command may take up to 1-2 minutes on a single-rack switch
and up to 3-4 minutes on a multi-rack switch.
6-10
Chapter 6
Setting the Subnet Manager Master on Oracle Exadata Database Machine Full Rack and Oracle Exadata Database Machine
Half Rack
Note:
This procedure does not apply to Oracle Exadata Database Machine X8M
racks with RDMA over RoCE Network Fabric.
The switch located in rack unit 1 (U1) is referred to as the spine switch. The other two
switches are referred to as the leaf switches. The location of the leaf switches is as
follows:
• Oracle Exadata Database Machine Two-Socket Systems (X3-2 and later): rack
unit 20 (U20) and rack unit 22 (U22)
• Oracle Exadata Database Machine X2-2 racks: rack unit 20 (U20) and rack unit 24
(U24)
• Oracle Exadata Database Machine Eight-Socket Systems (X2-8 and later) Full
Racks: Rack unit 21 (U21) and rack unit 23 (U23)
The spine switch is the Subnet Manager Master for the RDMA over InfiniBand Network
Fabric subnet. The Subnet Manager Master has priority 8, and can be verified using
the following procedure:
1. Log in to the spine switch as the root user.
2. Run the setsmpriority list command.
The command should show that smpriority has a value of 8. If smpriority has a
different value, then do the following:
a. Use the disablesm command to stop the Subnet Manager.
b. Use the setsmpriority 8 command to set the priority to 8.
c. Use the enablesm command to restart the Subnet Manager.
The leaf switches are the Standby Subnet Managers with a priority of 5. This can be
verified using the preceding procedure, substituting a value of 5 in the setsmpriority
command above.
6-11
Chapter 6
Setting the Subnet Manager Master on Oracle Exadata Database Machine Full Rack and Oracle Exadata Database Machine
Half Rack
Note:
Oracle Exadata Database Machine Half Rack with Sun Fire X4170 Oracle
Database Servers include two Sun Datacenter InfiniBand Switch 36
switches, which are set to priority 5.
To determine the Subnet Manager Master, log in as the root user on any RDMA over
InfiniBand Network Fabric switch, and run the getmaster command. The location of
the Subnet Manager Master is displayed. The following is an example of the output
from the getmaster command:
# getmaster
20100701 11:46:38 OpenSM Master on Switch : 0x0021283a8516a0a0 ports 36
Sun DCS 36
QDR switch dm01sw-ib1.example.com enhanced port 0 lid 1 lmc 0
The preceding output shows the proper configuration. The Subnet Master Manager is
running on spine switch dm01sw-ib1.example.com.
If the spine switch is not the Subnet Manager Master, then do the following procedure
to set the Subnet Manager Master:
1. Use the getmaster command to identify the current location of the Subnet
Manager Master.
2. Log in as the root user on the leaf switch that is the Subnet Manager Master.
3. Disable Subnet Manager on the switch. The Subnet Manager Master relocates to
another switch.
4. Use the getmaster command to identify the current location of the Subnet
Manager Master. If the spine switch is not Subnet Manager Master, then repeat
steps 2 and 3 until the spine switch is the Subnet Manager Master.
5. Enable Subnet Manager on the leaf switches that were disabled during this
procedure.
Note:
6-12
Chapter 6
Configuring the Cisco Ethernet Switch
See Also:
6-13
Chapter 6
Configuring the Cisco Ethernet Switch
Rack. This is to prevent any duplicate IP address conflicts which are possible due
to the default addresses set in the components when shipped.
Note that the Cisco 4948E-F switch supports multiple uplinks to the customer network
by utilizing ports 49 - 52. This is a more complicated switch setup due to the redundant
connectivity, and should be performed by the customer's network administrator.
The following procedure describes how to configure the Cisco Ethernet switch.
Configuration should be done with the network administrator.
1. Connect a serial cable from the Cisco switch console to a laptop or similar device.
An Oracle supplied rollover cable is pre-installed on the Cisco serial console port.
Obtain the appropriate adapter and connect it at the end of the rollover cable. An
Oracle P/N 530-3100 RJ45-DB9 adapter as used on ILOM ports will also work,
connected at the end of the network cable.
2. Ensure the terminal session is recorded on the laptop by logging the output. The
output can be used as a reference that the switch has been configured correctly.
The default serial port speed is 9600 baud, 8 bits, no parity, 1 stop bit, and no
handshake.
Switch> enable
Password: ******
Switch#
Note:
If you do not have the password, then contact Oracle Support Services.
ROM: 12.2(44r)SG12
zdlra1sw-ip uptime is 1 minute
System returned to ROM by reload
System image file is "bootflash:cat4500e-ipbasek9-mz.152-3.E2.bin"
Hobgoblin Revision 22, Fortooine Revision 1.40
...
Switch#
6-14
Chapter 6
Configuring the Cisco Ethernet Switch
The version of the Cisco 4948E-F switch firmware purchased and shipped by
Oracle with Oracle Exadata Database Machine X6 is IPBASEK9-MZ, which
includes telnet and ssh support. Currently the full release version string is
cat4500e-ipbasek9-mz.152-3.E2.bin.
5. Configure the network for a single VLAN. The following example assumes you are
using IPv4 addressing.
6. If IP routing is not used on the switch, this step is required. Disable the default IP
routing setting, and configure the default gateway.
Switch#configure terminal
Enter configuration commands,one per line.End with CNTL/Z.
Switch(config)#no ip routing
Switch(config)#ip default-gateway 10.7.7.1
Switch(config)#end
*Sep 15 14:12:46.309:%SYS-5-CONFIG_I:Configured from console by console
Switch#write memory
Building configuration...
Compressed configuration from 2492 bytes to 1070 bytes [OK ]
7. If IP routing is required on the switch, then leave the IP routing setting as the
default, and configure the default gateway. Replace 10.7.7.1 with the IP address of
the gateway for the installation:
Switch#configure terminal
Enter configuration commands,one per line.End with CNTL/Z.
Switch(config)#ip route 0.0.0.0 0.0.0.0 10.7.7.1
Switch(config)#end
*Sep 15 14:13:26.013:%SYS-5-CONFIG_I:Configured from console by console
Switch#write memory
Building configuration...
Compressed configuration from 2502 bytes to 1085 bytes [OK ]
Switch#configure terminal
Enter configuration commands,one per line.End with CNTL/Z.
Switch(config)#hostname exa1sw-ip
exa1sw-ip(config)#end
exa1sw-ip#write memory
6-15
Chapter 6
Configuring the Cisco Ethernet Switch
Building configuration...
Compressed configuration from 3789 bytes to 1469 bytes [OK ]
exa1sw-ip#configure terminal
Enter configuration commands,one per line.End with CNTL/Z.
exa1sw-ip(config)#ip domain-name example.com
exa1sw-ip(config)#ip name-server 10.7.7.3
exa1sw-ip(config)#ip name-server 198.51.100.5
exa1sw-ip(config)#ip name-server 10.8.160.1
exa1sw-ip(config)#end
*Sep 15 14:26:37.045:%SYS-5-CONFIG_I:Configured from console by console
exa1sw-ip#write memory
Building configuration...
Compressed configuration from 2603 bytes to 1158 bytes [OK ]
If you do not have DNS service available, you must still set the domain-name so
that you can configure the SSH keys.
10. (Optional) Set the password.
11. Verify telnet access is disabled. Telnet is not secure, and should not be enabled
unless there is a compelling reason. To enable telnet, set a password. To disable
it, remove the password.
exa1sw-ip#configure terminal
Enter configuration commands,one per line. End with CNTL/Z.
exa1sw-ip(config)#line vty 0 15
exa1sw-ip(config)#login
% Login disabled on line 1, until 'password' is set
% Login disabled on line 2, until 'password' is set
...
% Login disabled on line 16, until 'password' is set
exa1sw-ip(config)#end
6-16
Chapter 6
Configuring the Cisco Ethernet Switch
If the login command returns output as shown above, then telnet access has been
disabled. If instead you get a prompt, then telnet access is not yet disabled so
should be disabled now.
exa1sw-ip(config-line)#no password
exa1sw-ip(config-line)#end
exa1sw-ip#write memory
Building configuration...
Compressed configuration from 3786 bytes to 1468 bytes [OK ]
13. Set the clock and time zone. The switch keeps internal time in Coordinated
Universal Time (UTC) format.
• To use UTC, use the following command:
In the preceding command, zone is the time zone to display when standard
time in effect, hours-offset is the hours offset from UTC, and minutes-offset is
the minutes offset from UTC.
6-17
Chapter 6
Configuring the Cisco Ethernet Switch
• Daylight savings time (or summer time) is disabled by default. To set summer
time hours, use the following command:
In the preceding command, hh:mm:ss is the time in 24-hour format, day is the
day by date in the month, month is the name of the month, and year is the 4-
digit year.
The ordering of commands is important when setting the local time and time zone.
For example, to set the local time to US Eastern time:
14. After setting the local time zone, you can configure up to two NTP servers.
Replace the IP addresses used in this example with the values for the installation:
6-18
Chapter 6
Configuring the Cisco Ethernet Switch
The NTP server is synchronized to local time when you connect the Cisco switch
to the network and it has access to NTP.
Symbols that precede the show clock display indicate that the time is the
following:
• * Not authoritative
• . Authoritative, but NTP is not synchronized.
• Authoritative (blank space).
15. Verify the Ethernet configuration using the following command:
Note:
If any setting is incorrect, then repeat the appropriate step. To erase a
setting, enter no in front of the same command. For example, to erase
the default gateway, use the following commands:
exa1sw-ip#configure terminal
Enter configuration commands, one per line. End with CNTL/Z.
exa1sw-ip(config)# no ip default-gateway 10.7.7.1
exa1sw-ip(config)# end
exa1sw-ip#
*Sep 15 14:13:26.013: %SYS-5-CONFIG_I: Configured from console
by console
exa1sw-ip(config)# write memory
Building configuration...
Compressed configuration from 2502 bytes to 1085 bytes[OK]
6-19
Chapter 6
Configuring the Cisco Ethernet Switch
Building configuration...
Compressed configuration from 2654 bytes to 1189 bytes[OK]
exa1sw-ip# exit
The Cisco switch must not be connected to the management network at this stage.
The switch will be connected later after Oracle has configured the systems with
the necessary IP addresses and you have worked with the field service engineer
to make any additional changes necessary for connecting to the network.
19. To check the Cisco switch, attach a laptop computer to port 48, and ping the IP
address of the internal management network to check the configuration.
Related Topics
• Network Connection and IP Address Requirements for Oracle Exadata Database
Machine
• Network Configuration Checklist
Use this checklist to ensure that the network configuration requirements have
been addressed.
6-20
Chapter 6
Configuring the Cisco Ethernet Switch
6.4.2.1 Performing the Initial Switch Configuration for the Cisco Nexus
93108-1G or 9348 Ethernet Switch
During the initial configuration, you reset the switch and use the Basic System
Configuration Dialog to configure the switch.
Before configuring the switch, note the following:
• The Cisco Ethernet switch should not be connected until the running configuration
has been verified, and any necessary changes have been made by the network
administrator.
• The Cisco Ethernet switch should not be connected to the customer network until
the IP addresses on all components have been configured in Oracle Exadata
Rack. This is to prevent any duplicate IP address conflicts which are possible due
to the default addresses set in the components when shipped.
Configuration should be done with the network administrator.
1. Connect from the Cisco switch serial console to a laptop or similar device using
the available RJ45 cable.
2. Ensure the terminal session is recorded on the laptop by logging the output.
The output can be used as a reference that the switch has been configured
correctly. The default serial port speed is 9600 baud, 8 bits, no parity, 1 stop bit,
and no handshake.
3. Power on the switch.
4. Log in as the admin user.
Note:
If you do not have the password for the admin user, then contact Oracle
Support Services.
exadatax7-adm0# reload
6-21
Chapter 6
Configuring the Cisco Ethernet Switch
7. Switch to normal setup and, when asked if you want to enforce secure password
standard, enter no, then enter a new password for the admin user.
Running S93thirdparty-script...
Abort Auto Provisioning and continue with normal setup ? (yes/no) [n]:
yes
8. When the Basic System Configuration Dialog appears, choose to enter the basic
configuration dialog.
This setup utility will guide you through the basic configuration of
the system. Setup configures only enough connectivity for management
of the system.
Would you like to enter the basic configuration dialog (yes/no): yes
9. In the basic configuration, you can use the default inputs until asked to enter the
switch name.
In this example, the switch has a name of test123sw-adm0.
6-22
Chapter 6
Configuring the Cisco Ethernet Switch
12. Respond no when asked to configure static route (this will be configured later).
13. Enter the destination prefix and mask, and other values as prompted.
14. Skip configuring the DNS IPv4 addresses (this will be configured later).
15. Skip configuring the default domain name (this will be configured later).
16. Accept the default responses until asked to configure SSH and the NTP server.
17. Accept the default responses until asked to specify the CoPP system profile. Enter
lenient.
6-23
Chapter 6
Configuring the Cisco Ethernet Switch
[########################################] 100%
Copy complete.
20. Set the spanning tree port type for ports 1-47.
21. Set switchport on all 48 ports and set port 48 to a network port (instead of a host
port).
6-24
Chapter 6
Configuring the Power Distribution Units
6.4.2.2 Setting the Clock on the Cisco 93108-1G or 9348 Ethernet Switch
After you have performed the initial configuration, you can adjust the time used by the
switch.
1. Log in as the admin user.
2. View the current time.
6-25
Chapter 6
Configuring the Power Distribution Units
3. Select an unused LAN network connection from the available network connections
on the laptop as follows:
• For Oracle Solaris:
a. Log in as a super user.
b. Use the dladm show-link command to find an unused Ethernet interface.
c. Use the ifconfig -a command to determine which interface is being
used.
d. Use the following command to plumb the unused interface:
Note:
The network interfaces configured with the ifconfig command
do not persist across system restarts.
6-26
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
5. Connect the PDU power input lead to the power source. Only one PDU power
input lead needs to be connected, as follows:
• On PDUs with one power input lead, connect the one lead to the power
source.
• On PDUs with two power leads, connect the first power lead to the power
source. The first power lead is labeled 0.
• On PDUs with three power input leads, connect the middle power lead to the
power source. The middle power lead is labeled 1.
6. Use a Web browser to access the PDU metering unit by entering the factory
default IP address for the unit, 192.168.0.1, in the address line of the browser.
The Current Measurement page should appear.
7. Click Network Configuration in the upper left of the page.
8. Log in as the admin user on the PDU metering unit. Change the password after
configuring the network.
9. Confirm the DHCP Enable check box is not selected.
10. Enter the following network settings for the PDU metering unit:
• IP address
• Subnet mask address
• Default gateway
11. Click Submit to set the network settings, and reset the PDU metering unit.
12. Disconnect the PDU and laptop from the Cisco Management Switch.
13. Reconnect the two cables that were originally connected to the Cisco
Management Switch.
14. Connect an Ethernet cable to the PDU metering unit RJ-45 Ethernet port and to
the network.
15. Log in to the PDU metering unit using a Web browser. Use the PDU metering
unit's static IP address in the browser's address line. If the configuration was
successful, then the Current Measurement page is displayed.
16. Connect the remaining PDU power input leads to the power source.
6-27
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
Note:
The thresholds must be set in the Param Configuration section of the PDU
metering unit. Setting threshold values using the Oracle Enterprise Manager
Grid Control plug-in has no effect.
• PDU Thresholds for Oracle Exadata Database Machine X5-2 and Later
• PDU Thresholds for Oracle Exadata Database Machine X4-2
• PDU Thresholds for Oracle Exadata Database Machine X3-2
• PDU Thresholds for Oracle Exadata Database Machine X2-2 (with X4170 M2 and
X4270 M2 servers)
• PDU Thresholds for Oracle Exadata Database Machine X2-2 (with X4170 and
X4275 servers)
• PDU Thresholds for Oracle Exadata Database Machine X4-8 and Later
This section contains the PDU thresholds for Oracle Exadata Database Machine
Eight-Socket systems for X4-8 and later.
• PDU Thresholds for Oracle Exadata Database Machine X3-8 Full Rack
• PDU Thresholds for Oracle Exadata Database Machine X2-8 Full Rack
• PDU Thresholds for Oracle Exadata Storage Expansion Rack with Exadata
Storage Server with Sun Fire X4270 M2 Servers
See Also:
6-28
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
If for some reason you are unable to utilize OECA, contact Oracle Support.
Note:
The values listed here are reliable for use on systems in the configuration
received upon deployment and delivery from the Oracle Factory. Any
changes to this configuration should be modeled in Oracle Exadata
Configuration Assistant (OECA), and the PDU thresholds listed in OECA
should then be used. OECA is available on Oracle Technology Network.
• PDU Thresholds for Oracle Exadata Database Machine X4-2 Full Rack
• PDU Thresholds for Oracle Exadata Database Machine X4-2 Half Rack
• PDU Thresholds for Oracle Exadata Database Machine X4-2 Quarter Rack
6.6.2.1 PDU Thresholds for Oracle Exadata Database Machine X4-2 Full Rack
The following tables list the threshold values for Oracle Exadata Database Machine
X4-2 Full Rack:
• Table 6-1 Threshold Values for Oracle Exadata Database Machine X4-2 Full Rack
with Single-phase, Low-voltage PDU
• Table 6-2 Threshold Values for Oracle Exadata Database Machine X4-2 Full Rack
with Three-phase, Low-voltage PDU
• Table 6-3 Threshold Values for Oracle Exadata Database Machine X4-2 Full Rack
with Single-phase, High-voltage PDU
• Table 6-4 Threshold Values for Oracle Exadata Database Machine X4-2 Full Rack
with Three-phase, High-voltage PDU
Table 6-1 lists the threshold values for Oracle Exadata Database Machine X4-2 Full
Rack using a single-phase, low-voltage PDU.
Table 6-1 Threshold Values for Oracle Exadata Database Machine X4-2 Full
Rack with Single-phase, Low-voltage PDU
6-29
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
Table 6-1 (Cont.) Threshold Values for Oracle Exadata Database Machine X4-2
Full Rack with Single-phase, Low-voltage PDU
Table 6-2 lists the threshold values for Oracle Exadata Database Machine X4-2 Full
Rack using a three-phase, low-voltage PDU.
Table 6-2 Threshold Values for Oracle Exadata Database Machine X4-2 Full
Rack with Three-phase, Low-voltage PDU
Table 6-3 lists the threshold values for Oracle Exadata Database Machine X4-2 Full
Rack using a single-phase, high-voltage PDU.
Table 6-3 Threshold Values for Oracle Exadata Database Machine X4-2 Full
Rack with Single-phase, High-voltage PDU
Table 6-4 lists the threshold values for Oracle Exadata Database Machine X4-2 Full
Rack using a three-phase, high-voltage PDU.
6-30
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
Table 6-4 Threshold Values for Oracle Exadata Database Machine X4-2 Full
Rack with Three-phase, High-voltage PDU
6.6.2.2 PDU Thresholds for Oracle Exadata Database Machine X4-2 Half Rack
The following tables list the threshold values for Oracle Exadata Database Machine
X4-2 Half Rack:
• Table 6-5 Threshold Values for Oracle Exadata Database Machine X4-2 Half Rack
with Single-phase, Low-voltage PDU
• Table 6-6 Threshold Values for Oracle Exadata Database Machine X4-2 Half Rack
with Three-phase, Low-voltage PDU
• Table 6-7 Threshold Values for Oracle Exadata Database Machine X4-2 Half Rack
with Single-phase, High-voltage PDU
• Table 6-8 Threshold Values for Oracle Exadata Database Machine X4-2 Half Rack
with Three-phase, High-voltage PDU
Table 6-5 lists the threshold values for Oracle Exadata Database Machine X4-2 Half
Rack using a single-phase, low-voltage PDU.
Table 6-5 Threshold Values for Oracle Exadata Database Machine X4-2 Half
Rack with Single-phase, Low-voltage PDU
Table 6-6 lists the threshold values for Oracle Exadata Database Machine X4-2 Half
Rack using a three-phase, low-voltage PDU.
6-31
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
Table 6-6 Threshold Values for Oracle Exadata Database Machine X4-2 Half
Rack with Three-phase, Low-voltage PDU
Table 6-7 lists the threshold values for Oracle Exadata Database Machine X4-2 Half
Rack using a single-phase, high-voltage PDU.
Table 6-7 Threshold Values for Oracle Exadata Database Machine X4-2 Half
Rack with Single-phase, High-voltage PDU
Table 6-8 lists the threshold values for Oracle Exadata Database Machine X4-2 Half
Rack using a three-phase, high-voltage PDU.
Table 6-8 Threshold Values for Oracle Exadata Database Machine X4-2 Half
Rack with Three-phase, High-voltage PDU
6-32
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
6.6.2.3 PDU Thresholds for Oracle Exadata Database Machine X4-2 Quarter
Rack
The following tables list the threshold values for Oracle Exadata Database Machine
X4-2 Quarter Rack:
• Table 6-9 Threshold Values for Oracle Exadata Database Machine X4-2 Quarter
Rack with Single-phase, Low-voltage PDU
• Table 6-10 Threshold Values for Oracle Exadata Database Machine X4-2 Quarter
Rack with Three-phase, Low-voltage PDU
• Table 6-11 Threshold Values for Oracle Exadata Database Machine X4-2 Quarter
Rack with Single-phase, High-voltage PDU
• Table 6-12 Threshold Values for Oracle Exadata Database Machine X4-2 Quarter
Rack with Three-phase, High-voltage PDU
Table 6-9 lists the threshold values for Oracle Exadata Database Machine X4-2
Quarter Rack using a single-phase, low-voltage PDU.
Table 6-9 Threshold Values for Oracle Exadata Database Machine X4-2 Quarter
Rack with Single-phase, Low-voltage PDU
Table 6-10 lists the threshold values for Oracle Exadata Database Machine X4-2
Quarter Rack using a three-phase, low-voltage PDU.
Table 6-10 Threshold Values for Oracle Exadata Database Machine X4-2
Quarter Rack with Three-phase, Low-voltage PDU
6-33
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
Table 6-10 (Cont.) Threshold Values for Oracle Exadata Database Machine X4-2
Quarter Rack with Three-phase, Low-voltage PDU
Table 6-11 lists the threshold values for Oracle Exadata Database Machine X4-2
Quarter Rack using a single-phase, high-voltage PDU.
Table 6-11 Threshold Values for Oracle Exadata Database Machine X4-2
Quarter Rack with Single-phase, High-voltage PDU
Table 6-12 lists the threshold values for Oracle Exadata Database Machine X4-2
Quarter Rack using a three-phase, high-voltage PDU.
Table 6-12 Threshold Values for Oracle Exadata Database Machine X4-2
Quarter Rack with Three-phase, High-voltage PDU
6-34
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
Note:
The values listed here are reliable for use on systems in the configuration
received upon deployment and delivery from the Oracle Factory. Any
changes to this configuration should be modeled in Oracle Exadata
Configuration Assistant (OECA), and the PDU thresholds listed in OECA
should then be used. OECA is available on Oracle Technology Network.
• PDU Thresholds for Oracle Exadata Database Machine X3-2 Full Rack
• PDU Thresholds for Oracle Exadata Database Machine X3-2 Half Rack
• PDU Thresholds for Oracle Exadata Database Machine X3-2 Quarter Rack
6.6.3.1 PDU Thresholds for Oracle Exadata Database Machine X3-2 Full Rack
The following tables list the threshold values for Oracle Exadata Database Machine
X3-2 Full Rack:
• Table 6-13 Threshold Values for Oracle Exadata Database Machine X3-2 Full
Rack with Single-phase, Low-voltage PDU
• Table 6-14 Threshold Values for Oracle Exadata Database Machine X3-2 Full
Rack with Three-phase, Low-voltage PDU
• Table 6-15 Threshold Values for Oracle Exadata Database Machine X3-2 Full
Rack with Single-phase, High-voltage PDU
• Table 6-16
Threshold Values for Oracle Exadata Database Machine X3-2 Full Rack with
Three-phase, High-voltage PDU
Table 6-13 lists the threshold values for Oracle Exadata Database Machine X3-2 Full
Rack using a single-phase, low-voltage PDU.
Table 6-13 Threshold Values for Oracle Exadata Database Machine X3-2 Full
Rack with Single-phase, Low-voltage PDU
6-35
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
Table 6-14 lists the threshold values for Oracle Exadata Database Machine X3-2 Full
Rack using a three-phase, low-voltage PDU.
Table 6-14 Threshold Values for Oracle Exadata Database Machine X3-2 Full
Rack with Three-phase, Low-voltage PDU
Table 6-15 lists the threshold values for Oracle Exadata Database Machine X3-2 Full
Rack using a single-phase, high-voltage PDU.
Table 6-15 Threshold Values for Oracle Exadata Database Machine X3-2 Full
Rack with Single-phase, High-voltage PDU
Table 6-16 lists the threshold values for Oracle Exadata Database Machine X3-2 Full
Rack using a three-phase, high-voltage PDU.
Table 6-16 Threshold Values for Oracle Exadata Database Machine X3-2 Full
Rack with Three-phase, High-voltage PDU
6-36
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
6.6.3.2 PDU Thresholds for Oracle Exadata Database Machine X3-2 Half Rack
The following tables list the threshold values for Oracle Exadata Database Machine
X3-2 Half Rack:
• Table 6-17 Threshold Values for Oracle Exadata Database Machine X3-2 Half
Rack with Single-phase, Low-voltage PDU
• Table 6-18 Threshold Values for Oracle Exadata Database Machine X3-2 Half
Rack with Three-phase, Low-voltage PDU
• Table 6-19 Threshold Values for Oracle Exadata Database Machine X3-2 Half
Rack with Single-phase, High-voltage PDU
• Table 6-20 Threshold Values for Oracle Exadata Database Machine X3-2 Half
Rack with Three-phase, High-voltage PDU
Table 6-17 lists the threshold values for Oracle Exadata Database Machine X3-2 Half
Rack using a single-phase, low-voltage PDU.
Table 6-17 Threshold Values for Oracle Exadata Database Machine X3-2 Half
Rack with Single-phase, Low-voltage PDU
Table 6-18 lists the threshold values for Oracle Exadata Database Machine X3-2 Half
Rack using a three-phase, low-voltage PDU.
Table 6-18 Threshold Values for Oracle Exadata Database Machine X3-2 Half
Rack with Three-phase, Low-voltage PDU
6-37
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
Table 6-19 lists the threshold values for Oracle Exadata Database Machine X3-2 Half
Rack using a single-phase, high-voltage PDU.
Table 6-19 Threshold Values for Oracle Exadata Database Machine X3-2 Half
Rack with Single-phase, High-voltage PDU
Table 6-20 lists the threshold values for Oracle Exadata Database Machine X3-2 Half
Rack using a three-phase, high-voltage PDU.
Table 6-20 Threshold Values for Oracle Exadata Database Machine X3-2 Half
Rack with Three-phase, High-voltage PDU
6.6.3.3 PDU Thresholds for Oracle Exadata Database Machine X3-2 Quarter
Rack
The following tables list the threshold values for Oracle Exadata Database Machine
X3-2 Quarter Rack:
• Table 6-21 Threshold Values for Oracle Exadata Database Machine X3-2 Quarter
Rack with Single-phase, Low-voltage PDU
• Table 6-22 Threshold Values for Oracle Exadata Database Machine X3-2 Quarter
Rack with Three-phase, Low-voltage PDU
• Table 6-23 Threshold Values for Oracle Exadata Database Machine X3-2 Quarter
Rack with Single-phase, High-voltage PDU
6-38
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
• Table 6-24 Threshold Values for Oracle Exadata Database Machine X3-2 Quarter
Rack with Three-phase, High-voltage PDU
Table 6-21 lists the threshold values for Oracle Exadata Database Machine X3-2
Quarter Rack using a single-phase, low-voltage PDU.
Table 6-21 Threshold Values for Oracle Exadata Database Machine X3-2
Quarter Rack with Single-phase, Low-voltage PDU
Table 6-22 lists the threshold values for Oracle Exadata Database Machine X3-2
Quarter Rack using a three-phase, low-voltage PDU.
Table 6-22 Threshold Values for Oracle Exadata Database Machine X3-2
Quarter Rack with Three-phase, Low-voltage PDU
Table 6-23 lists the threshold values for Oracle Exadata Database Machine X3-2
Quarter Rack using a single-phase, high-voltage PDU.
Table 6-23 Threshold Values for Oracle Exadata Database Machine X3-2
Quarter Rack with Single-phase, High-voltage PDU
6-39
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
Table 6-23 (Cont.) Threshold Values for Oracle Exadata Database Machine X3-2
Quarter Rack with Single-phase, High-voltage PDU
Table 6-24 lists the threshold values for Oracle Exadata Database Machine X3-2
Quarter Rack using a three-phase, high-voltage PDU.
Table 6-24 Threshold Values for Oracle Exadata Database Machine X3-2
Quarter Rack with Three-phase, High-voltage PDU
Note:
The values listed here are reliable for use on systems in the configuration
received upon deployment and delivery from the Oracle Factory. Any
changes to this configuration should be modeled in Oracle Exadata
Configuration Assistant (OECA), and the PDU thresholds listed in OECA
should then be used. OECA is available on Oracle Technology Network.
• PDU Thresholds for Oracle Exadata Database Machine X2-2 (with X4170 M2 and
X4270 M2 servers) Full Rack
6-40
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
• PDU Thresholds for Oracle Exadata Database Machine X2-2 (with X4170 M2 and
X4270 M2 servers) Half Rack
• PDU Thresholds for Oracle Exadata Database Machine X2-2 (with X4170 M2 and
X4270 M2 servers) Quarter Rack
6.6.4.1 PDU Thresholds for Oracle Exadata Database Machine X2-2 (with
X4170 M2 and X4270 M2 servers) Full Rack
The following tables list the threshold values for Oracle Exadata Database Machine
X2-2 (with X4170 and X4275 servers) Full Rack:
• Table 6-25 Threshold Values for Oracle Exadata Database Machine X2-2 (with
X4170 M2 and X4270 M2 servers) Full Rack with Single-phase, Low-voltage PDU
• Table 6-26 Threshold Values for Oracle Exadata Database Machine X2-2 (with
X4170 M2 and X4270 M2 servers) Full Rack with Three-phase, Low-voltage PDU
• Table 6-27 Threshold Values for Oracle Exadata Database Machine X2-2 (with
X4170 M2 and X4270 M2 servers) Full Rack with Single-phase, High-voltage PDU
• Table 6-28 Threshold Values for Oracle Exadata Database Machine X2-2 (with
X4170 M2 and X4270 M2 servers) Full Rack with Three-phase, High-voltage PDU
Table 6-25 lists the threshold values for Oracle Exadata Database Machine Full Rack
using a single-phase, low-voltage PDU.
Table 6-25 Threshold Values for Oracle Exadata Database Machine X2-2 (with
X4170 M2 and X4270 M2 servers) Full Rack with Single-phase, Low-voltage PDU
Table 6-26 lists the threshold values for Oracle Exadata Database Machine Full Rack
using a three-phase, low-voltage PDU.
6-41
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
Table 6-26 Threshold Values for Oracle Exadata Database Machine X2-2 (with
X4170 M2 and X4270 M2 servers) Full Rack with Three-phase, Low-voltage PDU
Table 6-27 lists the threshold values for Oracle Exadata Database Machine Full Rack
using a single-phase, high-voltage PDU.
Table 6-27 Threshold Values for Oracle Exadata Database Machine X2-2 (with
X4170 M2 and X4270 M2 servers) Full Rack with Single-phase, High-voltage PDU
Table 6-28 lists the threshold values for Oracle Exadata Database Machine Full Rack
using a three-phase, high-voltage PDU.
Table 6-28 Threshold Values for Oracle Exadata Database Machine X2-2 (with
X4170 M2 and X4270 M2 servers) Full Rack with Three-phase, High-voltage PDU
6-42
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
6.6.4.2 PDU Thresholds for Oracle Exadata Database Machine X2-2 (with
X4170 M2 and X4270 M2 servers) Half Rack
The following tables list the threshold values for Oracle Exadata Database Machine
Half Rack:
• Table 6-29 Threshold Values for Oracle Exadata Database Machine X2-2 (with
X4170 M2 and X4270 M2 servers) Half Rack with Single-phase, Low-voltage PDU
• Table 6-30 Threshold Values for Oracle Exadata Database Machine X2-2 (with
X4170 M2 and X4270 M2 servers) Half Rack with Three-phase, Low-voltage PDU
• Table 6-31 Threshold Values for Oracle Exadata Database Machine X2-2 (with
X4170 M2 and X4270 M2 servers) Half Rack with Single-phase, High-voltage PDU
• Table 6-32 Threshold Values for Oracle Exadata Database Machine X2-2 (with
X4170 M2 and X4270 M2 servers) Half Rack with Three-phase, High-voltage PDU
Table 6-29 lists the threshold values for Oracle Exadata Database Machine Half Rack
using a single-phase, low-voltage PDU.
Table 6-29 Threshold Values for Oracle Exadata Database Machine X2-2 (with
X4170 M2 and X4270 M2 servers) Half Rack with Single-phase, Low-voltage PDU
Table 6-30 lists the threshold values for Oracle Exadata Database Machine Half Rack
using a three-phase, low-voltage PDU.
Table 6-30 Threshold Values for Oracle Exadata Database Machine X2-2 (with
X4170 M2 and X4270 M2 servers) Half Rack with Three-phase, Low-voltage PDU
6-43
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
Table 6-30 (Cont.) Threshold Values for Oracle Exadata Database Machine X2-2
(with X4170 M2 and X4270 M2 servers) Half Rack with Three-phase, Low-voltage
PDU
Table 6-31 lists the threshold values for Oracle Exadata Database Machine Half Rack
using a single-phase, high-voltage PDU.
Table 6-31 Threshold Values for Oracle Exadata Database Machine X2-2 (with
X4170 M2 and X4270 M2 servers) Half Rack with Single-phase, High-voltage PDU
Table 6-32 lists the threshold values for Oracle Exadata Database Machine Half Rack
using a three-phase, high-voltage PDU.
Table 6-32 Threshold Values for Oracle Exadata Database Machine X2-2 (with
X4170 M2 and X4270 M2 servers) Half Rack with Three-phase, High-voltage PDU
6-44
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
6.6.4.3 PDU Thresholds for Oracle Exadata Database Machine X2-2 (with
X4170 M2 and X4270 M2 servers) Quarter Rack
The following tables list the threshold values for Oracle Exadata Database Machine
Quarter Rack:
• Table 6-33 Threshold Values for Oracle Exadata Database Machine X2-2 (with
X4170 M2 and X4270 M2 servers) Quarter Rack with Single-phase, Low-voltage
PDU
• Table 6-34 Threshold Values for Oracle Exadata Database Machine X2-2 (with
X4170 M2 and X4270 M2 servers) Quarter Rack with Three-phase, Low-voltage
PDU
• Table 6-35 Threshold Values for Oracle Exadata Database Machine X2-2 (with
X4170 M2 and X4270 M2 servers) Quarter Rack with Single-phase, High-voltage
PDU
• Table 6-36 Threshold Values for Oracle Exadata Database Machine X2-2 (with
X4170 M2 and X4270 M2 servers) Quarter Rack with Three-phase, High-voltage
PDU
Table 6-33 lists the threshold values for Oracle Exadata Database Machine Quarter
Rack using a single-phase, low-voltage PDU.
Table 6-33 Threshold Values for Oracle Exadata Database Machine X2-2 (with
X4170 M2 and X4270 M2 servers) Quarter Rack with Single-phase, Low-voltage
PDU
Table 6-34 lists the threshold values for Oracle Exadata Database Machine Quarter
Rack using a three-phase, low-voltage PDU.
6-45
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
Table 6-34 Threshold Values for Oracle Exadata Database Machine X2-2 (with
X4170 M2 and X4270 M2 servers) Quarter Rack with Three-phase, Low-voltage
PDU
Table 6-35 lists the threshold values for Oracle Exadata Database Machine Quarter
Rack using a single-phase, high-voltage PDU.
Table 6-35 Threshold Values for Oracle Exadata Database Machine X2-2 (with
X4170 M2 and X4270 M2 servers) Quarter Rack with Single-phase, High-voltage
PDU
Table 6-36 lists the threshold values for Oracle Exadata Database Machine Quarter
Rack using a three-phase, high-voltage PDU.
Table 6-36 Threshold Values for Oracle Exadata Database Machine X2-2 (with
X4170 M2 and X4270 M2 servers) Quarter Rack with Three-phase, High-voltage
PDU
6-46
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
Table 6-36 (Cont.) Threshold Values for Oracle Exadata Database Machine X2-2
(with X4170 M2 and X4270 M2 servers) Quarter Rack with Three-phase, High-
voltage PDU
Note:
The values listed here are reliable for use on systems in the configuration
received upon deployment and delivery from the Oracle Factory. Any
changes to this configuration should be modeled in Oracle Exadata
Configuration Assistant (OECA), and the PDU thresholds listed in OECA
should then be used. OECA can be downloaded from Oracle Technology
Network.
• PDU Thresholds for Oracle Exadata Database Machine X2-2 (with X4170 and
X4275 servers) Full Rack
• PDU Thresholds for Oracle Exadata Database Machine X2-2 (with X4170 and
X4275 servers) Half Rack
• PDU Thresholds for Oracle Exadata Database Machine X2-2 (with X4170 and
X4275 servers) Quarter Rack
6.6.5.1 PDU Thresholds for Oracle Exadata Database Machine X2-2 (with
X4170 and X4275 servers) Full Rack
The following tables list the threshold values for Oracle Exadata Database Machine
X2-2 (with X4170 and X4275 servers) Full Rack:
• Table 6-37 Threshold Values for Oracle Exadata Database Machine X2-2 (with
X4170 and X4275 servers) Full Rack with Single-phase, Low-voltage PDU
• Table 6-38 Threshold Values for Oracle Exadata Database Machine X2-2 (with
X4170 and X4275 servers) Full Rack with Three-phase, Low-voltage PDU
• Table 6-39 Threshold Values for Oracle Exadata Database Machine X2-2 (with
X4170 and X4275 servers) Full Rack with Single-phase, High-voltage PDU
• Table 6-40 Threshold Values for Oracle Exadata Database Machine X2-2 (with
X4170 and X4275 servers) Full Rack with Three-phase, High-voltage PDU
6-47
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
Table 6-37 lists the threshold values for Oracle Exadata Database Machine Full Rack
using a single-phase, low-voltage PDU.
Table 6-37 Threshold Values for Oracle Exadata Database Machine X2-2 (with
X4170 and X4275 servers) Full Rack with Single-phase, Low-voltage PDU
Table 6-38 lists the threshold values for Oracle Exadata Database Machine Full Rack
using a three-phase, low-voltage PDU.
Table 6-38 Threshold Values for Oracle Exadata Database Machine X2-2 (with
X4170 and X4275 servers) Full Rack with Three-phase, Low-voltage PDU
Table 6-39 lists the threshold values for Oracle Exadata Database Machine Full Rack
using a single-phase, high-voltage PDU.
Table 6-39 Threshold Values for Oracle Exadata Database Machine X2-2 (with
X4170 and X4275 servers) Full Rack with Single-phase, High-voltage PDU
6-48
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
Table 6-39 (Cont.) Threshold Values for Oracle Exadata Database Machine X2-2
(with X4170 and X4275 servers) Full Rack with Single-phase, High-voltage PDU
Table 6-40 lists the threshold values for Oracle Exadata Database Machine Full Rack
using a three-phase, high-voltage PDU.
Table 6-40 Threshold Values for Oracle Exadata Database Machine X2-2 (with
X4170 and X4275 servers) Full Rack with Three-phase, High-voltage PDU
6.6.5.2 PDU Thresholds for Oracle Exadata Database Machine X2-2 (with
X4170 and X4275 servers) Half Rack
The following tables list the threshold values for Oracle Exadata Database Machine
Half Rack:
• Table 6-41 Threshold Values for Oracle Exadata Database Machine X2-2 (with
X4170 and X4275 servers) Half Rack with Single-phase, Low-voltage PDU
• Table 6-42 Threshold Values for Oracle Exadata Database Machine X2-2 (with
X4170 and X4275 servers) Half Rack with Three-phase, Low-voltage PDU
• Table 6-43 Threshold Values for Oracle Exadata Database Machine X2-2 (with
X4170 and X4275 servers) Half Rack with Single-phase, High-voltage PDU
• Table 6-44 Threshold Values for Oracle Exadata Database Machine X2-2 (with
X4170 and X4275 servers) Half Rack with Three-phase, High-voltage PDU
Table 6-41 lists the threshold values for Oracle Exadata Database Machine Half Rack
using a single-phase, low-voltage PDU.
6-49
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
Table 6-41 Threshold Values for Oracle Exadata Database Machine X2-2 (with
X4170 and X4275 servers) Half Rack with Single-phase, Low-voltage PDU
Table 6-42 lists the threshold values for Oracle Exadata Database Machine Half Rack
using a three-phase, low-voltage PDU.
Table 6-42 Threshold Values for Oracle Exadata Database Machine X2-2 (with
X4170 and X4275 servers) Half Rack with Three-phase, Low-voltage PDU
Table 6-43 lists the threshold values for Oracle Exadata Database Machine Half Rack
using a single-phase, high-voltage PDU.
Table 6-43 Threshold Values for Oracle Exadata Database Machine X2-2 (with
X4170 and X4275 servers) Half Rack with Single-phase, High-voltage PDU
6-50
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
Table 6-43 (Cont.) Threshold Values for Oracle Exadata Database Machine X2-2
(with X4170 and X4275 servers) Half Rack with Single-phase, High-voltage PDU
Table 6-44 lists the threshold values for Oracle Exadata Database Machine Half Rack
using a three-phase, high-voltage PDU.
Table 6-44 Threshold Values for Oracle Exadata Database Machine X2-2 (with
X4170 and X4275 servers) Half Rack with Three-phase, High-voltage PDU
6.6.5.3 PDU Thresholds for Oracle Exadata Database Machine X2-2 (with
X4170 and X4275 servers) Quarter Rack
The following tables list the threshold values for Oracle Exadata Database Machine
Quarter Rack:
• Table 6-45
Threshold Values for Oracle Exadata Database Machine X2-2 (with X4170 and
X4275 servers) Quarter Rack with Single-phase, Low-voltage PDU
• Table 6-46
Threshold Values for Oracle Exadata Database Machine X2-2 (with X4170 and
X4275 servers) Quarter Rack with Three-phase, Low-voltage PDU
• Table 6-47
Threshold Values for Oracle Exadata Database Machine X2-2 (with X4170 and
X4275 servers) Quarter Rack with Single-phase, High-voltage PDU
• Table 6-48
Threshold Values for Oracle Exadata Database Machine X2-2 (with X4170 and
X4275 servers) Quarter Rack with Three-phase, High-voltage PDU
6-51
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
Table 6-45 lists the threshold values for Oracle Exadata Database Machine Quarter
Rack using a single-phase, low-voltage PDU.
Table 6-45 Threshold Values for Oracle Exadata Database Machine X2-2 (with
X4170 and X4275 servers) Quarter Rack with Single-phase, Low-voltage PDU
Table 6-46 lists the threshold values for Oracle Exadata Database Machine Quarter
Rack using a three-phase, low-voltage PDU.
Table 6-46 Threshold Values for Oracle Exadata Database Machine X2-2 (with
X4170 and X4275 servers) Quarter Rack with Three-phase, Low-voltage PDU
Table 6-47 lists the threshold values for Oracle Exadata Database Machine Quarter
Rack using a single-phase, high-voltage PDU.
Table 6-47 Threshold Values for Oracle Exadata Database Machine X2-2 (with
X4170 and X4275 servers) Quarter Rack with Single-phase, High-voltage PDU
6-52
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
Table 6-47 (Cont.) Threshold Values for Oracle Exadata Database Machine X2-2
(with X4170 and X4275 servers) Quarter Rack with Single-phase, High-voltage
PDU
Table 6-48 lists the threshold values for Oracle Exadata Database Machine Quarter
Rack using a three-phase, high-voltage PDU.
Table 6-48 Threshold Values for Oracle Exadata Database Machine X2-2 (with
X4170 and X4275 servers) Quarter Rack with Three-phase, High-voltage PDU
6-53
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
• Table 6-50 Threshold Values for Oracle Exadata Database Machine X3-8 Full
Rack with Three-phase, Low-voltage 24 kVA PDU
• Table 6-51 Threshold Values for Oracle Exadata Database Machine X3-8 Full
Rack with Single-phase, High-voltage 22 kVA PDU
• Table 6-52 Threshold Values for Oracle Exadata Database Machine X3-8 Full
Rack with Three-phase, High-voltage 24 kVA PDU
Table 6-49 lists the threshold values for Oracle Exadata Database Machine X3-8 Full
Rack using a single-phase, low-voltage 22 kVA PDU.
Table 6-49 Threshold Values for Oracle Exadata Database Machine X3-8 Full
Rack with Single-phase, Low-voltage 22 kVA PDU
Table 6-50 lists the threshold values for Oracle Exadata Database Machine X3-8 Full
Rack using a three-phase, low-voltage 24 kVA PDU.
Table 6-50 Threshold Values for Oracle Exadata Database Machine X3-8 Full
Rack with Three-phase, Low-voltage 24 kVA PDU
6-54
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
Table 6-50 (Cont.) Threshold Values for Oracle Exadata Database Machine X3-8
Full Rack with Three-phase, Low-voltage 24 kVA PDU
Table 6-51 lists the threshold values for Oracle Exadata Database Machine X3-8 Full
Rack using a single-phase, high-voltage 22 kVA PDU.
Table 6-51 Threshold Values for Oracle Exadata Database Machine X3-8 Full
Rack with Single-phase, High-voltage 22 kVA PDU
Table 6-52 lists the threshold values for Oracle Exadata Database Machine X3-8 Full
Rack using a three-phase, high-voltage 24 kVA PDU.
Table 6-52 Threshold Values for Oracle Exadata Database Machine X3-8 Full
Rack with Three-phase, High-voltage 24 kVA PDU
6-55
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
Table 6-52 (Cont.) Threshold Values for Oracle Exadata Database Machine X3-8
Full Rack with Three-phase, High-voltage 24 kVA PDU
Table 6-53 Threshold Values for Oracle Exadata Database Machine X2-8 Full
Rack with Single-phase, Low-voltage 22 kVA PDU
6-56
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
Table 6-53 (Cont.) Threshold Values for Oracle Exadata Database Machine X2-8
Full Rack with Single-phase, Low-voltage 22 kVA PDU
Table 6-54 lists the threshold values for Oracle Exadata Database Machine X2-8 Full
Rack using a three-phase, low-voltage 24 kVA PDU.
Table 6-54 Threshold Values for Oracle Exadata Database Machine X2-8 Full
Rack with Three-phase, Low-voltage 24 kVA PDU
Table 6-55 lists the threshold values for Oracle Exadata Database Machine X2-8 Full
Rack using a single-phase, high-voltage 22 kVA PDU.
Table 6-55 Threshold Values for Oracle Exadata Database Machine X2-8 Full
Rack with Single-phase, High-voltage 22 kVA PDU
Table 6-56 lists the threshold values for Oracle Exadata Database Machine X2-8 Full
Rack using a three-phase, high-voltage 24 kVA PDU.
6-57
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
Table 6-56 Threshold Values for Oracle Exadata Database Machine X2-8 Full
Rack with Three-phase, High-voltage 24 kVA PDU
6.6.9.1 PDU Thresholds for Oracle Exadata Storage Expansion Full Rack with
Exadata Storage Server with Sun Fire X4270 M2 Servers
The following tables list the threshold values for Oracle Exadata Storage Expansion
Full Rack with Exadata Storage Server with Sun Fire X4270 M2 Servers Full Rack:
• Table 6-57 Threshold Values for Oracle Exadata Storage Expansion Full Rack
with Exadata Storage Server with Sun Fire X4270 M2 Servers with Single-phase,
Low-voltage PDU
• Table 6-58 Threshold Values for Oracle Exadata Storage Expansion Full Rack
with Exadata Storage Server with Sun Fire X4270 M2 Servers with Three-phase,
Low-voltage PDU
• Table 6-59 Threshold Values for Oracle Exadata Storage Expansion Full Rack
with Exadata Storage Server with Sun Fire X4270 M2 Servers with Single-phase,
High-voltage PDU
• Table 6-60 Threshold Values for Oracle Exadata Storage Expansion Full Rack
with Exadata Storage Server with Sun Fire X4270 M2 Servers with Three-phase,
High-voltage PDU
Table 6-57 lists the threshold values for Oracle Exadata Storage Expansion Full Rack
with Exadata Storage Server with Sun Fire X4270 M2 Servers using a single-phase,
low-voltage PDU.
6-58
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
Table 6-57 Threshold Values for Oracle Exadata Storage Expansion Full Rack
with Exadata Storage Server with Sun Fire X4270 M2 Servers with Single-phase,
Low-voltage PDU
Table 6-58 lists the threshold values for Oracle Exadata Storage Expansion Full Rack
with Exadata Storage Server with Sun Fire X4270 M2 Servers using a three-phase,
low-voltage PDU.
Table 6-58 Threshold Values for Oracle Exadata Storage Expansion Full Rack
with Exadata Storage Server with Sun Fire X4270 M2 Servers with Three-phase,
Low-voltage PDU
Table 6-59 lists the threshold values for Oracle Exadata Storage Expansion Full Rack
with Exadata Storage Server with Sun Fire X4270 M2 Servers using a single-phase,
high-voltage PDU.
Table 6-59 Threshold Values for Oracle Exadata Storage Expansion Full Rack
with Exadata Storage Server with Sun Fire X4270 M2 Servers with Single-phase,
High-voltage PDU
6-59
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
Table 6-59 (Cont.) Threshold Values for Oracle Exadata Storage Expansion Full
Rack with Exadata Storage Server with Sun Fire X4270 M2 Servers with Single-
phase, High-voltage PDU
Table 6-60 lists the threshold values for Oracle Exadata Storage Expansion Full Rack
with Exadata Storage Server with Sun Fire X4270 M2 Servers using a three-phase,
high-voltage PDU.
Table 6-60 Threshold Values for Oracle Exadata Storage Expansion Full Rack
with Exadata Storage Server with Sun Fire X4270 M2 Servers with Three-phase,
High-voltage PDU
6.6.9.2 PDU Thresholds for Oracle Exadata Storage Expansion Half Rack with
Exadata Storage Server with Sun Fire X4270 M2 Servers
The following tables list the threshold values for Oracle Exadata Storage Expansion
Half Rack with Exadata Storage Server with Sun Fire X4270 M2 Servers:
• Table 6-61 Threshold Values for Oracle Exadata Storage Expansion Half Rack
with Exadata Storage Server with Sun Fire X4270 M2 Servers with Single-phase,
Low-voltage PDU
• Table 6-62 Threshold Values for Oracle Exadata Storage Expansion Half Rack
with Exadata Storage Server with Sun Fire X4270 M2 Servers with Three-phase,
Low-voltage PDU
• Table 6-63 Threshold Values for Oracle Exadata Storage Expansion Half Rack
with Exadata Storage Server with Sun Fire X4270 M2 Servers with Single-phase,
High-voltage PDU
6-60
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
• Table 6-64 Threshold Values for Oracle Exadata Storage Expansion Half Rack
with Exadata Storage Server with Sun Fire X4270 M2 Servers with Three-phase,
High-voltage PDU
Table 6-61 lists the threshold values for Oracle Exadata Storage Expansion Half Rack
with Exadata Storage Server with Sun Fire X4270 M2 Servers using a single-phase,
low-voltage PDU.
Table 6-61 Threshold Values for Oracle Exadata Storage Expansion Half Rack
with Exadata Storage Server with Sun Fire X4270 M2 Servers with Single-phase,
Low-voltage PDU
Table 6-62 lists the threshold values for Oracle Exadata Storage Expansion Half Rack
with Exadata Storage Server with Sun Fire X4270 M2 Servers using a three-phase,
low-voltage PDU.
Table 6-62 Threshold Values for Oracle Exadata Storage Expansion Half Rack
with Exadata Storage Server with Sun Fire X4270 M2 Servers with Three-phase,
Low-voltage PDU
Table 6-63 lists the threshold values for Oracle Exadata Storage Expansion Half Rack
with Exadata Storage Server with Sun Fire X4270 M2 Servers using a single-phase,
high-voltage PDU.
6-61
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
Table 6-63 Threshold Values for Oracle Exadata Storage Expansion Half Rack
with Exadata Storage Server with Sun Fire X4270 M2 Servers with Single-phase,
High-voltage PDU
Table 6-64 lists the threshold values for Oracle Exadata Storage Expansion Half Rack
with Exadata Storage Server with Sun Fire X4270 M2 Servers using a three-phase,
high-voltage PDU.
Table 6-64 Threshold Values for Oracle Exadata Storage Expansion Half Rack
with Exadata Storage Server with Sun Fire X4270 M2 Servers with Three-phase,
High-voltage PDU
6.6.9.3 PDU Thresholds for Oracle Exadata Storage Expansion Quarter Rack
with Exadata Storage Server with Sun Fire X4270 M2 Servers
The following tables list the threshold values for Oracle Exadata Storage Expansion
Quarter Rack with Exadata Storage Server with Sun Fire X4270 M2 Servers:
• Table 6-65 Threshold Values for Oracle Exadata Storage Expansion Quarter Rack
with Exadata Storage Server with Sun Fire X4270 M2 Servers with Single-phase,
Low-voltage PDU
• Table 6-66 Threshold Values for Oracle Exadata Storage Expansion Quarter Rack
with Exadata Storage Server with Sun Fire X4270 M2 Servers with Three-phase,
Low-voltage PDU
6-62
Chapter 6
Configuring the Threshold Settings for the Power Distribution Units
• Table 6-67 Threshold Values for Oracle Exadata Storage Expansion Quarter Rack
with Exadata Storage Server with Sun Fire X4270 M2 Servers with Single-phase,
High-voltage PDU
• Table 6-68 Threshold Values for Oracle Exadata Storage Expansion Quarter Rack
with Exadata Storage Server with Sun Fire X4270 M2 Servers with Three-phase,
High-voltage PDU
Table 6-65 lists the threshold values for Oracle Exadata Storage Expansion Quarter
Rack with Exadata Storage Server with Sun Fire X4270 M2 Servers using a single-
phase, low-voltage PDU.
Table 6-65 Threshold Values for Oracle Exadata Storage Expansion Quarter
Rack with Exadata Storage Server with Sun Fire X4270 M2 Servers with Single-
phase, Low-voltage PDU
Table 6-66 lists the threshold values for Oracle Exadata Storage Expansion Quarter
Rack with Exadata Storage Server with Sun Fire X4270 M2 Servers using a three-
phase, low-voltage PDU.
Table 6-66 Threshold Values for Oracle Exadata Storage Expansion Quarter
Rack with Exadata Storage Server with Sun Fire X4270 M2 Servers with Three-
phase, Low-voltage PDU
Table 6-67 lists the threshold values for Oracle Exadata Storage Expansion Quarter
Rack with Exadata Storage Server with Sun Fire X4270 M2 Servers using a single-
phase, high-voltage PDU.
6-63
Chapter 6
Checking Exadata Storage Servers
Table 6-67 Threshold Values for Oracle Exadata Storage Expansion Quarter
Rack with Exadata Storage Server with Sun Fire X4270 M2 Servers with Single-
phase, High-voltage PDU
Table 6-68 lists the threshold values for Oracle Exadata Storage Expansion Quarter
Rack with Exadata Storage Server with Sun Fire X4270 M2 Servers using a three-
phase, high-voltage PDU.
Table 6-68 Threshold Values for Oracle Exadata Storage Expansion Quarter
Rack with Exadata Storage Server with Sun Fire X4270 M2 Servers with Three-
phase, High-voltage PDU
6-64
Chapter 6
Checking Exadata Storage Servers
Note:
• (X2-2 only) When using the KVM switch, and pressing the ESC key, the
BIOS may receive two ESC characters, and prompt to exit. Select
CANCEL.
• If you need to connect to the ILOM serial management port, then the
baud rate setting on Oracle Exadata Storage Servers is changed from
the default ILOM setting 9600 to 115200 baud, 8 bits, no parity, and 1
stop bit.
Note:
If you do not have the password for the root user, then contact Oracle
Support Services.
2. Verify the SysSN label for the storage server matches the product_serial_number
value using the following command:
# /opt/oracle.SupportTools/CheckHWnFWProfile
If output does not show success, then examine the output for mismatched
hardware or firmware and take steps to correct those as explained in the following
steps.
4. Verify the disks on the server are visible and online using the following command.
The disks are numbered slot 0 to slot 11.
• If you are using Oracle Exadata System Software release 19c or later, then
get the enclosure ID:
# cd /opt/MegaRAID/storcli
# ./storcli64 /c0/eall show
Controller = 0
Status = Success
Description = None
Properties :
6-65
Chapter 6
Checking Exadata Storage Servers
==========
--------------------------------------------------------------------
---------------------
EID State Slots PD PS Fans TSs Alms SIM Port#
ProdID VendorSpecific
--------------------------------------------------------------------
---------------------
8 OK 14 12 0 0 0 0 0 Port 0 - 3 & Port 4 - 7 x8
X5-2L SPMS v`
252 OK 8 0 0 0 0 0 1 Internal
SGPIO
--------------------------------------------------------------------
---------------------
# cd /opt/MegaRAID/storcli
# ./storcli64 /c0/e8/sall show all | grep "8:"
8:0 16 Onln 0 7.151 TB SAS HDD N N 512B H7280A520SUN8.0T
U
8:1 17 Onln 1 7.151 TB SAS HDD N N 512B H7280A520SUN8.0T
U
8:2 20 Onln 2 7.151 TB SAS HDD N N 512B H7280A520SUN8.0T
U
8:3 15 Onln 3 7.151 TB SAS HDD N N 512B H7280A520SUN8.0T
U
8:4 12 Onln 4 7.151 TB SAS HDD N N 512B H7280A520SUN8.0T
U
8:5 18 Onln 5 7.151 TB SAS HDD N N 512B H7280A520SUN8.0T
U
8:6 11 Onln 6 7.151 TB SAS HDD N N 512B H7280A520SUN8.0T
U
8:7 9 Onln 7 7.151 TB SAS HDD N N 512B H7280A520SUN8.0T
U
8:8 14 Onln 8 7.151 TB SAS HDD N N 512B H7280A520SUN8.0T
U
8:9 21 Onln 11 7.151 TB SAS HDD N N 512B H7280B520SUN8.0T
U
8:10 13 Onln 9 7.151 TB SAS HDD N N 512B H7280A520SUN8.0T
U
8:11 10 Onln 10 7.151 TB SAS HDD N N 512B H7280A520SUN8.0T
U
The rows displayed are from a table that displays the following information:
6-66
Chapter 6
Checking Exadata Storage Servers
---
...
EID-Enclosure Device ID|Slt-Slot No.|DID-Device ID|DG-DriveGroup
DHS-Dedicated Hot Spare|UGood-Unconfigured Good|GHS-Global Hotspare
UBad-Unconfigured Bad|Onln-Online|Offln-Offline|Intf-Interface
Med-Media Type|SED-Self Encryptive Drive|PI-Protection Info
SeSz-Sector Size|Sp-Spun|U-Up|D-Down|T-Transition|F-Foreign
UGUnsp-Unsupported|UGShld-UnConfigured shielded|HSPShld-Hotspare
shielded
CFShld-Configured shielded|Cpybck-CopyBack|CBShld-Copyback Shielded
• If you are using Oracle Exadata System Software release 18c or earlier, then
use the following command:
#cd /opt/MegaRAID/MegaCli
#./MegaCli64 -Pdlist -aAll |grep "Slot \|Firmware"
Slot Number:0
Firmware state:Online, Spun Up
Slot Number:1
Firmware state:Online, Spun Up
Slot Number:2
Firmware state:Online, Spun Up
Slot Number:3
Firmware state:Online, Spun Up
Slot Number:4
Firmware state:Online, Spun Up
Slot Number:5
Firmware state:Online, Spun Up
Slot Number:6
Firmware state:Online, Spun Up
Slot Number:7
Firmware state:Online, Spun Up
Slot Number:8
Firmware state:Online, Spun Up
Slot Number:9
Firmware state:Online, Spun Up
Slot Number:10
Firmware state:Online, Spun Up
Slot Number:11
Firmware state:Online, Spun Up
[root@cell01 ~]#
6. Verify the flash modules are visible. The number of cards and modules varies
depending on the model.
If any flash modules are missing, then power cycle the system, and wait 10
minutes after restarting before checking again. If this does not resolve the
6-67
Chapter 6
Checking Oracle Exadata Database Servers
problem, then reseat the module and flash card. If the problem continues, then
replace the card with the on-site spare.
7. Check the rear of the rack to ensure the flash card LEDs are green all the way
across. If any LED is amber, then check again after the next step. If the LED is still
amber after restart, then reseat the card and ESM or flash module. If the problem
continues, then replace the card with the on-site spare.
Note:
This step can be done when all systems are on. It does not have to be
done on a per-server basis.
# logout
9. (X2-2 systems) Return to the User Interface on the KVM switch by pressing the
Ctrl key on the left to return to the KVM switch, and select Disconnect Session, if
using the KVM switch to access the server.
10. (X2-2 systems) Select Target Devices from Unit View, if using the KVM switch to
access the server.
11. Proceed to the next Oracle Exadata Storage Server.
Note:
If you do not have the password for the root user, then contact Oracle
Support Services.
2. Verify the SysSN label for the server matches the product_serial_number value
using the following command:
/SYS
Properties:
product_serial_number =093ABCD5001
->Session closed
Disconnected
6-68
Chapter 6
Checking Oracle Exadata Database Servers
cd /opt/oracle.SupportTools/firstconf
4. Create a group file with the list of server IP addresses to use in the dcli utility
commands, if required.
If you are configuring Oracle Exadata Rack X8M, then you must manually create a
file and add the IP addresses.
On racks that use RDMA over InfiniBand Network Fabric, you can use the
following command to identify the servers and copy the results into a text file.
In the preceding command, group_file is name of the file to create with the server
IP addresses.
5. Verify the hardware profile is correct using the following command. The command
checks CPU type and count, component firmware, and so on.
# more /tmp/checkhwfw.out
If a profile check fails and the firmware needs to be refreshed, then run the
following command from the system with the problem.
# /opt/oracle.SupportTools/CheckHWnFWProfile -U /opt/oracle.cellos/iso/
cellbits
Now updating the ILOM and the BIOS …
The command must be entered on a single line. After running the command,
power off the system, reset the Integrated Lights Out Manager (ILOM), and wait 10
minutes before powering on the system.
6. Verify the disks on the server are visible and online.
6-69
Chapter 6
Checking Oracle Exadata Database Servers
• If you are using Oracle Exadata System Software release 19c or later, then
use the following command:
# cd /opt/MegaRAID/storcli
# ./storcli64 /call show | grep "Physical Drives" -A 25
Physical Drives = 8
PD LIST :
=======
--------------------------------------------------------------------
----------
EID:Slt DID State DG Size Intf Med SED PI SeSz
Model Sp Type
--------------------------------------------------------------------
----------
39:0 31 Onln 0 278.464 GB SAS HDD N N 512B
ST930003SSUN300G U -
39:1 35 Onln 0 278.464 GB SAS HDD N N 512B
ST930003SSUN300G U -
39:2 41 Onln 0 278.464 GB SAS HDD N N 512B
H103030SCSUN300G U -
39:3 37 Onln 0 278.464 GB SAS HDD N N 512B
ST930003SSUN300G U -
39:4 38 Onln 0 278.464 GB SAS HDD N N 512B
ST930003SSUN300G U -
39:5 44 Onln 0 278.464 GB SAS HDD N N 512B
H109030SESUN300G U -
39:6 33 Onln 0 278.464 GB SAS HDD N N 512B
ST930003SSUN300G U -
39:7 43 Onln 0 278.464 GB SAS HDD N N 512B
ST930003SSUN300G U -
--------------------------------------------------------------------
----------
• If you are using Oracle Exadata System Software release 18c or earlier, then
use the following command:
#cd /opt/MegaRAID/MegaCli
#./MegaCli64 -Pdlist -aAll |grep "Slot \|Firmware"
Slot Number:0
Firmware state:Online, Spun Up
Slot Number:1
Firmware state:Online, Spun Up
Slot Number:2
6-70
Chapter 6
Checking Oracle Exadata Database Servers
• If you are using Oracle Exadata System Software release 18c or earlier, then
you can use the following command:
8. (Oracle Exadata Database Machine based on Sun Fire X4170 Oracle Database
Servers only) Check that the ILOM is configured for the proper fan cooling on each
database server using the following command:
• If the policy is present and enabled, then no additional steps are needed.
• If the policy is present and disabled, then enable the policy using the following
command:
# logout
6-71
Chapter 6
Performing Additional Checks and Configuration
10. (X2-2 racks) Return to the User Interface on the KVM switch by pressing the Ctrl
key on the left to return to the KVM switch, and select Disconnect Session, if
using the KVM switch to access the server.
11. (X2-2 racks) Select Target Devices from Unit View, and proceed to the next
database server, if using the KVM switch to access the server.
12. Verify that NTP servers are configured the same for all servers using the following
command. The command is run on each database server individually.
ntpq -p
# cd /opt/oracle.SupportTools/firstconf
3. Create a group file with the list of IP addresses to use in the dcli utility
commands, if you want to query multiple racks.
4. Verify the rack master serial number is set correctly using the following command:
# more /tmp/show-rack-msn.out
If none of the serial numbers are set, then contact Oracle Support Services. If one
serial number is not set correctly, then run the following command to correct it,
where rack_type is the rack designation, such as X8-8 and the string
serial_number represents the serial number:
5. If you are running an Oracle Exadata System Software release earlier than 18.1,
then ensure disk cache policy is set to Disabled using the following command as
the root user on the first database server in the cluster:
6-72
Chapter 6
Verifying the RDMA over RoCE Network Fabric Configuration
If any server shows different output, then identify the LUN and use the following
command to reset the policy to Disabled, where LUNn is the LUN number, such
as L2:
1. Verify the proper oracle-rdma-release software versions are being used on the
database servers.
3. Visually check all the RDMA Network Fabric cable connections within the rack.
The port lights should be on, and the LEDs should be on. Do not press each
connector to verify connectivity.
4. Complete the steps described in My Oracle Support Doc ID 2587717.1
Related Topics
• Verify RoCE Cabling on Oracle Exadata Database Machine X8M-2 and X8M-8
Servers (My Oracle Support Doc ID 2587717.1)
6-73
Chapter 6
Verifying the RDMA over InfiniBand Network Fabric Network
# cd /opt/oracle.SupportTools/ibdiagtools
# ./verify-topology [-t rack_size]
The following example shows the output when the network components are
correct.
In the preceding command, rack_size is the size of the rack. The -t rack_size
option is needed if the rack is Oracle Exadata Database Machine Half Rack or
Oracle Exadata Database Machine Quarter Rack. Use the value halfrack or
quarterrack, if needed.
The following example shows the output when there is a bad RDMA Network
Fabric switch to cable connection:
#./verify-topology
[DB Machine Infiniband Cabling Topology Verification Tool ]
Is every external switch connected to every internal switch......
[SUCCESS ]
Are any external switches connected to each other................
[SUCCESS ]
Are any hosts connected to spine switch..........................
[SUCCESS ]
Check if all hosts have 2 CAs to different switches..............
6-74
Chapter 6
Verifying the RDMA over InfiniBand Network Fabric Network
[SUCCESS ]
Leaf switch check:cardinality and even distribution..............
[SUCCESS ]
Check if each rack has an valid internal ring....................
[ERROR ]
The following example shows the output when there is a bad RDMA Network
Fabric cable on a database server:
#./verify-topology
[DB Machine Infiniband Cabling Topology Verification Tool ]
Is every external switch connected to every internal switch......
[SUCCESS ]
Are any external switches connected to each other................
[SUCCESS ]
Are any hosts connected to spine switch..........................
[SUCCESS ]
Check if all hosts have 2 CAs to different switches..............
[ERROR ]
Node db01 has 1 endpoints.(Should be 2)
Port 2 of this node is not connected to any switch
--------fattree End Point Cabling verification failed-----
Leaf switch check:cardinality and even distribution..............
[ERROR ]
Internal QDR Switch 0x21283a87b8a0a0 has fewer than 4 compute nodes
It has only 3 links belonging to compute nodes
[SUCCESS ]
Check if each rack has an valid internal ring...................
[SUCCESS ]
The following example shows the output when there is a bad connection on the
switch and the system:
#./verify-topology
[DB Machine Infiniband Cabling Topology Verification Tool ]
Is every external switch connected to every internal switch......
[SUCCESS ]
Are any external switches connected to each other................
[SUCCESS ]
Are any hosts connected to spine switch..........................
[SUCCESS ]
Check if all hosts have 2 CAs to different switches..............
[ERROR ]
6-75
Chapter 6
Imaging a New System
6-76
Chapter 6
Imaging a New System
in 12.1.2.2.0 and above. You are no longer required to build the ISO files using
imagemaker. Patches are available for both database nodes and cells. You can use the
ISO images to boot the server using a virtual media device on the ILOM (from the
Devices menu of the ILOM console). For example, the two ISO images available for
12.1.2.1.1 are listed in the following table.
To prepare a new Exadata system for deployment using ISO images, perform the
following steps:
1. Obtain the latest Oracle Exadata Deployment Assistant (OEDA).
2. Run the OEDA configuration tool to generate the configuration files. You will need
the configuration files when you run applyElasticConfig.sh later.
3. Power on all the servers.
a. Database nodes and cells will automatically assign to themselves unused IP
addresses on eth0 in the 172.16 range.
b. Host names of the nodes will be of the format nodeN, where N is a number.
4. After booting from the ISO, follow the prompts and imaging will start automatically.
You will be prompted to enter IP addresses.
You can use a preconf.csv by following the steps in Using ISO to Image a New
System to mount the image on an NFS repository. You need to place the
preconf.csv file in the same NFS directory.
5. If you are using Oracle VM, run switch_to_ovm.sh on each database server. The
database servers will reboot.
For example:
# /opt/oracle.SupportTools/switch_to_ovm.sh
2014-12-07 11:58:36 -0800 [INFO] Switch to DOM0 system partition /dev/
VGExaDb/LVDbSys3 (/dev/mapper/VGExaDb-LVDbSys3)
6-77
Chapter 6
Imaging a New System
Caution:
Do not skip this step. Skipping this step results in unused space that can
no longer be reclaimed by reclaimdisks.sh.
[ Minimal BASH-like line editing is supported. For the first word, TAB
lists possible command completions. Anywhere else TAB lists the
possible
completions of a device/filename.]
grub> root (hd0,0)
Filesystem type is ext2fs, partition type 0x83
grub> setup (hd0)
Checking if "/boot/grub/stage1" exists... no
Checking if "/grub/stage1" exists... yes
Checking if "/grub/stage2" exists... yes
Checking if "/grub/e2fs_stage1_5" exists... yes
Running "embed /grub/e2fs_stage1_5 (hd0)"... failed (this is not fatal)
Running "embed /grub/e2fs_stage1_5 (hd0,0)"... failed (this is not
fatal)
Running "install /grub/stage1 (hd0) /grub/stage2 p /grub/grub.conf
"... succeeded
6-78
Chapter 6
Imaging a New System
Done.
grub> quit
7. If you have an Oracle Exadata Rack X8 or earlier, then run ibhosts and verify that
all nodes show the correct IP addresses and host names. There should be no
nodes with elasticNode in the description.
8. Run the OEDA tool to deploy.
Related Topics
• Exadata 12.1.2.1.1 release and patch (20240049) (My Oracle Support Doc ID
1959143.1)
6-79
Chapter 6
Imaging a New System
# /opt/oracle.SupportTools/switch_to_ovm.sh
2014-12-07 11:58:36 -0800 [INFO] Switch to DOM0 system partition /dev/
VGExaDb/LVDbSys3 (/dev/mapper/VGExaDb-LVDbSys3)
2014-12-07 11:58:36 -0800 [INFO] Active system device: /dev/mapper/
VGExaDb-LVDbSys1
2014-12-07 11:58:36 -0800 [INFO] Active system device in boot
area: /dev/mapper/VGExaDb-LVDbSys1
2014-12-07 11:58:36 -0800 [INFO] Set active systen device to /dev/
VGExaDb/LVDbSys3 in /boot/I_am_hd_boot
2014-12-07 11:58:36 -0800 [INFO] Reboot has been initiated to switch to
the DOM0 system partition
Caution:
Do not skip this step. Skipping this step results in unused space that can
no longer be reclaimed by reclaimdisks.sh.
[ Minimal BASH-like line editing is supported. For the first word, TAB
lists possible command completions. Anywhere else TAB lists the
possible
6-80
Chapter 6
Imaging a New System
completions of a device/filename.]
grub> root (hd0,0)
Filesystem type is ext2fs, partition type 0x83
grub> setup (hd0)
Checking if "/boot/grub/stage1" exists... no
Checking if "/grub/stage1" exists... yes
Checking if "/grub/stage2" exists... yes
Checking if "/grub/e2fs_stage1_5" exists... yes
Running "embed /grub/e2fs_stage1_5 (hd0)"... failed (this is not fatal)
Running "embed /grub/e2fs_stage1_5 (hd0,0)"... failed (this is not
fatal)
Running "install /grub/stage1 (hd0) /grub/stage2 p /grub/grub.conf
"... succeeded
Done.
grub> quit
6-81
Chapter 6
Imaging a New System
orhb42-b08-01,example.com,db,eth0,eth0,Management,00:10:E0:69:34:52,
10.196.3.106,255.255.224.0,10.196.31.250,orhb42-b08-01-priv,Private:ac
tive-bond-ib,192.168.10.15,255.255.255.0,,,America/Los_Angeles
8. Run ipconf to verify the generated preconf.csv file. This can be done on any
Exadata server, and although not required, it is useful to ensure the preconf.csv
is valid before proceeding.
compute_12.1.2.2.0_LINUX.X64_150917-1.x86_64.iso
6-82
Chapter 6
Imaging a New System
cell_12.1.2.2.0_LINUX.X64_150917-1.x86_64.iso
10. (For 12.1.2.2.0 and above) Follow the steps in the patch README.txt to copy the
ISO file and optional preconf.csv file into place.
a. After download, unzip the file as root user for the following ISO image.
b2d6d9ac61e2e673d05fba11ec65107d
compute_12.1.2.2.0_LINUX.X64_150917-1.x
86_64.iso
Note:
b. Proceed to step 15, and boot the system with the ISO image and follow
installation prompts. The ISO can be made available with a preconf.csv
following the steps in the Note box above, or as virtual media on the ILOM of
the node to be re-imaged when a preconf.csv is not used.
Steps 11 to 14, which create the image files, can be skipped.
11. Download the imagemaker kit to prepare and create the files for the USB drive.
# unzip V75080-01.zip
# unzip cellImageMaker_12.1.2.1.1_LINUX.X64_150316.2-1.x86_64.zip
6-83
Chapter 6
Imaging a New System
For ISO imaging, note that you must run makeImageMedia.sh from an Oracle
Exadata database server if you are using the -preconf option.
For example:
6-84
Chapter 6
Imaging a New System
14. Attach the ISO as virtual media to the ILOM of the database server to be re-
imaged, and select CDROM as the next boot device.
15. Reboot the database node or cell to start the imaging process from the ISO.
16. If you are using Oracle VM, run switch_to_ovm.sh on each database server. The
database servers will reboot.
For example:
# /opt/oracle.SupportTools/switch_to_ovm.sh
2014-12-07 11:58:36 -0800 [INFO] Switch to DOM0 system partition /dev/
VGExaDb/LVDb
Sys3 (/dev/mapper/VGExaDb-LVDbSys3)
2014-12-07 11:58:36 -0800 [INFO] Active system device: /dev/mapper/
VGExaDb-LVDbSys
1
2014-12-07 11:58:36 -0800 [INFO] Active system device in boot
area: /dev/mapper/VG
ExaDb-LVDbSys1
2014-12-07 11:58:36 -0800 [INFO] Set active systen device to /dev/
VGExaDb/LVDbSys3
6-85
Chapter 6
Imaging a New System
in /boot/I_am_hd_boot
2014-12-07 11:58:36 -0800 [INFO] Reboot has been initiated to switch to
the DOM0 s
ystem partition
Caution:
Do not skip this step. Skipping this step results in unused space that can
no longer be reclaimed by reclaimdisks.sh.
[ Minimal BASH-like line editing is supported. For the first word, TAB
lists possible command completions. Anywhere else TAB lists the
possible
completions of a device/filename.]
grub> root (hd0,0)
Filesystem type is ext2fs, partition type 0x83
grub> setup (hd0)
Checking if "/boot/grub/stage1" exists... no
Checking if "/grub/stage1" exists... yes
Checking if "/grub/stage2" exists... yes
Checking if "/grub/e2fs_stage1_5" exists... yes
Running "embed /grub/e2fs_stage1_5 (hd0)"... failed (this is not fatal)
Running "embed /grub/e2fs_stage1_5 (hd0,0)"... failed (this is not
fatal)
Running "install /grub/stage1 (hd0) /grub/stage2 p /grub/grub.conf
"... succeeded
Done.
grub> quit
18. Run ibhosts and verify that all nodes show the correct IP addresses and host
names. There should be no nodes with elasticNode in the description.
6-86
Chapter 6
Imaging a New System
Related Topics
• Oracle Software Delivery Cloud
• Exadata 12.1.2.2.0 release and patch (20131726) (My Oracle Support Doc ID
2038073.1)
• Exadata Database Machine and Exadata Storage Server Supported Versions (My
Oracle Support Doc ID 888828.1)
6.12.4.1 Using PXE to Image a New System Using Release 12.1.2.2.0 or Later
You can use PXE to prepare a new Exadata system running Oracle Exadata System
Software release 12.1.2.2.0 or later for deployment using a simplified method.
1. Obtain the latest Oracle Exadata Deployment Assistant (OEDA) from http://
www.oracle.com/technetwork/database/exadata/oeda-download-2076737.html.
2. Run the OEDA configuration tool to generate the configuration files.
3. Power on all the servers.
6-87
Chapter 6
Imaging a New System
orhb42-b08-01,example.com,db,eth0,eth0,Management,
00:10:E0:69:34:52,10.196.3.
106,255.255.224.0,10.196.31.250,orhb42-b08-01-priv,Private:active-bond-
ib,192.1
68.10.15,255.255.255.0,,,America/Los_Angeles
kernel vmlinux-iso-file-name
append initrd=img_file pxe factory stit reboot-on-success
notests=diskgroup dhcp
preconf=n.n.n.n:/directory/preconf.csv iso-uri=http://web_server/
x86_64/iso/image_n
ame.iso console=ttyS0,115200n8
6-88
Chapter 6
Imaging a New System
Note: For image version 12.1.2.2.0 the format of the downloadable image
files has changed.
The downloaded zip file contains four image files:
• For 12.1.2.2.0 up to 12.2.1.1.0:
kernel: vmlinux-version-ImageName-{DL180|DL360}
initrd: initrd-version-ImageName-{DL180|DL360}.img
image: nfsimg-version-ImageName-{DL180|DL360}.tar
image: nfsimg-version-ImageName-{DL180|DL360}.tar.md5
kernel: vmlinux-iso-ImageName-{cell|compute}
initrd: initrd-iso-ImageName-{cell|compute}.img
image: vmlinux-iso-ImageName-{cell|compute}.tar
10. Change the boot order using the ILOM to boot from PXE and then restart the
server to start the imaging process.
For example, from the Oracle Linux prompt on the host:
# shutdown -r now
11. If you are using Oracle VM, run switch_to_ovm.sh on all Oracle VM database
servers before running the OEDA installation tool.
When you run this command, the database servers will reboot.
# /opt/oracle.SupportTools/switch_to_ovm.sh
2014-12-07 11:58:36 -0800 [INFO] Switch to DOM0 system partition /dev/
VGExaDb/LV
DbSys3 (/dev/mapper/VGExaDb-LVDbSys3)
2014-12-07 11:58:36 -0800 [INFO] Active system device: /dev/mapper/
VGExaDb-LVDbS
ys1
2014-12-07 11:58:36 -0800 [INFO] Active system device in boot
area: /dev/mapper/
VGExaDb-LVDbSys1
2014-12-07 11:58:36 -0800 [INFO] Set active systen device to /dev/
VGExaDb/LVDbSy
s3 in /boot/I_am_hd_boot
2014-12-07 11:58:36 -0800 [INFO] Reboot has been initiated to switch to
the DOM0
system partition
6-89
Chapter 6
Imaging a New System
Caution:
Do not skip this step. Skipping this step results in unused space that can
no longer be reclaimed by reclaimdisks.sh.
[ Minimal BASH-like line editing is supported. For the first word, TAB
lists possible command completions. Anywhere else TAB lists the
possible
completions of a device/filename.]
grub> root (hd0,0)
Filesystem type is ext2fs, partition type 0x83
grub> setup (hd0)
Checking if "/boot/grub/stage1" exists... no
Checking if "/grub/stage1" exists... yes
Checking if "/grub/stage2" exists... yes
Checking if "/grub/e2fs_stage1_5" exists... yes
Running "embed /grub/e2fs_stage1_5 (hd0)"... failed (this is not fatal)
Running "embed /grub/e2fs_stage1_5 (hd0,0)"... failed (this is not
fatal)
Running "install /grub/stage1 (hd0) /grub/stage2 p /grub/grub.conf
"... succeeded
Done.
grub> quit
13. Run ibhosts and verify that all nodes show the correct IP addresses and host
names.
There should be no nodes with elasticNode in the description.
14. Run the OEDA tool to deploy.
6-90
Chapter 6
Imaging a New System
Related Topics
• Exadata Database Machine and Exadata Storage Server Supported Versions (My
Oracle Support Doc ID 888828.1)
6.12.4.2 Using PXE to Image a New System for Releases Earlier than
12.1.2.2.0
You can use PXE to prepare a new Exadata system running an Oracle Exadata
System Software release earlier than 12.1.2.2.0 for deployment.
1. Obtain the latest Oracle Exadata Deployment Assistant (OEDA) from http://
www.oracle.com/technetwork/database/exadata/oeda-download-2076737.html.
2. Run the OEDA configuration tool to generate the configuration files.
3. Power on all the servers.
When the system is first started, the following conditions exist:
a. Database nodes and cells will automatically assign to themselves unused IP
addresses on eth0 in the 172.16 range.
b. Host names of the nodes will be of the format nodeN, where N is a number.
4. Run OEDA to generate the preconf.csv file that you will use to image the
system.
5. Connect to the first database node.
You can do this by connecting a laptop to the ILOM serial management port (9600,
8, N, 1). Then you can connect to the console and log in to the database node.
6. Obtain the eth0 MAC address for each database node.
The eth0 MAC address is the fru_macaddress field from /SYS/MB/NET0 in the
ILOM (or from ip addr if logged into the console).
a. Connect to the each database node through SSH from the console.
b. Run ibhosts to get a list of node names and IP addresses.
7. Insert the MAC addresses using uppercase characters in the seventh field of the
preconf.csv file for each node.
This field should be empty, that is, you should see two consecutive comma
characters (,,).
6-91
Chapter 6
Imaging a New System
For example:
orhb42-b08-01,example.com,db,eth0,eth0,Management,
00:10:E0:69:34:52,10.196.3.
106,255.255.224.0,10.196.31.250,orhb42-b08-01-priv,Private:active-bond-
ib,192.1
68.10.15,255.255.255.0,,,America/Los_Angeles
Below are the recommended options for PXE imaging of versions prior to release
12.1.2.2.0. The line starting with append should be entered as a single line with no
line breaks.
9. Download the ImageMaker kit to prepare and create the files for the PXE server.
The kit is available publicly on the Oracle Software Delivery Cloud (edelivery) site
under “Oracle Database Products -> Linux x86-64”. There are separate
ImageMaker files for database nodes and cells.
10. After downloading the kit, as the root user, unzip the first file that has a name
similar to V75080-01.zip, and then unzip the subsequent ZIP file. Finally, untar the
file.
# unzip V75080-01.zip
# unzip cellImageMaker_12.1.2.1.1_LINUX.X64_150316.2-1.x86_64.zip
Place the image files in the relevant directories on the PXE server. These files will
be sent at boot time to the node being imaged.
• Change directory to the dl180 or dl360 directory and make the PXE build
using:
If the dl180 or dl360 directory are not available, then change directory to the
cell or compute directory.
The makeImageMedia.sh command creates four files in the ./PXE subdirectory:
kernel: vmlinux-version-ImageName-{DL180|DL360}
initrd: initrd-version-ImageName-{DL180|DL360}.img
6-92
Chapter 6
Imaging a New System
image: nfsimg-version-ImageName-{DL180|DL360}.tar
image: nfsimg-version-ImageName-{DL180|DL360}.tar.md5
12. Change the boot order using the ILOM to boot from PXE and then restart the
server to start the imaging process.
For example, from the Oracle Linux prompt on the host:
# shutdown -r now
13. If you are using Oracle VM run switch_to_ovm.sh on all Oracle VM database
servers before running the OEDA installation tool.
When you run this command, the database servers will reboot.
# /opt/oracle.SupportTools/switch_to_ovm.sh
2014-12-07 11:58:36 -0800 [INFO] Switch to DOM0 system partition /dev/
VGExaDb/LV
DbSys3 (/dev/mapper/VGExaDb-LVDbSys3)
2014-12-07 11:58:36 -0800 [INFO] Active system device: /dev/mapper/
VGExaDb-LVDbS
ys1
2014-12-07 11:58:36 -0800 [INFO] Active system device in boot
area: /dev/mapper/
VGExaDb-LVDbSys1
2014-12-07 11:58:36 -0800 [INFO] Set active systen device to /dev/
VGExaDb/LVDbSy
s3 in /boot/I_am_hd_boot
2014-12-07 11:58:36 -0800 [INFO] Reboot has been initiated to switch to
the DOM0
system partition
Caution:
Do not skip this step. Skipping this step results in unused space that can
no longer be reclaimed by reclaimdisks.sh.
6-93
Chapter 6
Imaging a New System
[ Minimal BASH-like line editing is supported. For the first word, TAB
lists possible command completions. Anywhere else TAB lists the
possible
completions of a device/filename.]
grub> root (hd0,0)
Filesystem type is ext2fs, partition type 0x83
grub> setup (hd0)
Checking if "/boot/grub/stage1" exists... no
Checking if "/grub/stage1" exists... yes
Checking if "/grub/stage2" exists... yes
Checking if "/grub/e2fs_stage1_5" exists... yes
Running "embed /grub/e2fs_stage1_5 (hd0)"... failed (this is not fatal)
Running "embed /grub/e2fs_stage1_5 (hd0,0)"... failed (this is not
fatal)
Running "install /grub/stage1 (hd0) /grub/stage2 p /grub/grub.conf
"... succeeded
Done.
grub> quit
15. Run ibhosts and verify that all nodes show the correct IP addresses and host
names.
There should be no nodes with elasticNode in the description.
16. Run the OEDA tool to deploy.
Related Topics
• Oracle Software Delivery Cloud
6-94
Chapter 6
Imaging a New System
orhb42-b08-01,example.com,db,eth0,eth0,Management,00:10:E0:69:34:52,
10.196.3.106,255.255.224.0,10.196.31.250,orhb42-b08-01-
priv,Private:active-bond-ib,
192.168.10.15,255.255.255.0,,,America/Los_Angeles
7. Run ipconf to verify the generated preconf.csv file. This can be done on any
Oracle Exadata server, and although not required, it is useful to ensure the
preconf.csv file is valid before proceeding.
6-95
Chapter 6
Imaging a New System
Note: For image version 12.1.2.2.0 the format of the downloadable image
files has changed.
There will be an image file in the downloaded zip file. For example, the database
node zip file will contain
computeImageMaker_12.1.2.2.0_LINUX.X64_150917.x86_64.img. For cell images,
the file will be similar to
cellImageMaker_12.1.2.2.0_LINUX.X64_150917.x86_64.img.
9. (For 12.1.2.2.0 and above) Follow the steps in the patch README.txt file to copy
the file and optional preconf.csv file onto the USB drive.
a. Place the computeImageMaker_12.1.2.2.0_LINUX.X64_150917.x86_64.img
file in a directory on an Oracle Linux server.
b. Verify that the md5sums match: f3daae6a9757d4feb4a0f4262e610945
computeImageMaker_12.1.2.2.0_LINUX.X64_150917.x86_64.img
c. Prepare the USB drive using a command similar to the following,
where /dev/sdd is the name of the inserted USB drive:
You can determine the exact name of the USB drive by looking in /var/log/
messages after inserting the USB drive.
d. Write the .img file to the USB drive. This may take 15 minutes or more and no
output is shown during the operation.
e. Rescan the partition table on Oracle Linux to recognize the new partition:
# partprobe
f. Verify that the USB is mountable as long as the system supports ext4 file
system. This must be an Oracle Linux 6 system for this step even if the
previous dd command was run on an Oracle Linux 5 system.
g. (Optional) Prepare and place the preconf.csv file on the USB drive. The file
name must be preconf.csv on the USB drive. The preconf.csv file must
contain MAC addresses for each node in the order to be used during the
image. If no preconf.csv file is used during imaging, the node will prompt for
its network configuration the first time it boots up.
# cp /path/preconf.csv /mnt/preconf.csv
# umount /mnt
The umount command above ensures that the file system is synchronized.
h. Proceed to step 15. Steps 11 to 14, which create the image files, can be
skipped.
6-96
Chapter 6
Imaging a New System
10. Download the ImageMaker kit to prepare and create the files for the USB drive.
This kit is available publicly on the Oracle Software Delivery Cloud (edelivery) site
under “Oracle Database Products -> Linux x86-64”. There are separate
ImageMaker files for database nodes and cells.
11. After downloading ImageMaker, unzip the first file, which is named similar to
V75080-01.zip, and then also unzip the subsequent file. Perform the unzip as the
root user. Then untar the file.
# unzip V75080-01.zip
# unzip cellImageMaker_12.1.2.1.1_LINUX.X64_150316.2-1.x86_64.zip
16. If you are using Oracle VM, run switch_to_ovm.sh on each database server. The
database servers will reboot.
For example:
# /opt/oracle.SupportTools/switch_to_ovm.sh
2014-12-07 11:58:36 -0800 [INFO] Switch to DOM0 system partition /dev/
VGExaDb/LVDbSys3 (/dev/mapper/VGExaDb-LVDbSys3)
6-97
Chapter 6
Imaging a New System
Caution:
Do not skip this step. Skipping this step results in unused space that can
no longer be reclaimed by reclaimdisks.sh.
[ Minimal BASH-like line editing is supported. For the first word, TAB
lists possible command completions. Anywhere else TAB lists the
possible
completions of a device/filename.]
grub> root (hd0,0)
Filesystem type is ext2fs, partition type 0x83
grub> setup (hd0)
Checking if "/boot/grub/stage1" exists... no
Checking if "/grub/stage1" exists... yes
Checking if "/grub/stage2" exists... yes
Checking if "/grub/e2fs_stage1_5" exists... yes
Running "embed /grub/e2fs_stage1_5 (hd0)"... failed (this is not fatal)
Running "embed /grub/e2fs_stage1_5 (hd0,0)"... failed (this is not
fatal)
Running "install /grub/stage1 (hd0) /grub/stage2 p /grub/grub.conf
"... succeeded
6-98
Chapter 6
Imaging a New System
Done.
grub> quit
18. Run ibhosts and verify that all nodes show the correct IP addresses and host
names. There should be no nodes with "elasticNode" in the description.
19. Run the OEDA tool to deploy.
Related Topics
• Oracle Software Delivery Cloud
• Exadata 12.1.2.2.0 release and patch (20131726) (My Oracle Support Doc ID
2038073.1)
• Exadata reimaging using USB fails to boot USB (My Oracle Support Doc ID
1919001.1)
• Exadata Database Machine and Exadata Storage Server Supported Versions (My
Oracle Support Doc ID 888828.1)
6-99
Chapter 6
Performing Initial Elastic Configuration of Oracle Exadata Database Machine
• factory
The meaning of the factory keyword has changed as of 12.1.2.1.0. The use of
"factory" now enforces additional options such as "ovs=yes". This should be used
for all imaging, regardless of the ultimate system configuration (Oracle VM,
Physical etc.)
• OVS=yes|no
This option defaults to "no". However it is not recommended to use this at all
because it may change in the future. In its place, use the "factory" option which will
override some default options.
There are some additional command line options which may be useful:
• To create a hot spare on dbnodes, use the enable_hot_spare option.
– makeImageMedia.sh option: -enable_hot_spare
– PXE option: enable_hot_spare
• To force active bond or no active bond for InfiniBand interfaces (mainly for
expansion rack cases), use the active-bond-ib option.
– makeImageMedia.sh option: -active-bond-ib <yes|no>
– PXE option: active-bond-ib=<yes|no>
The README_FOR_FACTORY.txt file shipped with the imagemaker software explains
each option in more detail.
Related Topics
• Exadata 12.1.2.2.0 release and patch (20131726) (My Oracle Support Doc ID
2038073.1)
• Reimaging Exadata Cell Node Guidance (My Oracle Support Doc ID 2151671.1)
6-100
Chapter 6
Performing Initial Elastic Configuration of Oracle Exadata Database Machine
Note:
1. Open a console session to the first database server. The first database server is
the lowest database server in the rack, which is rack position U16. In the case of
an expansion involving only cells, the procedure should be run from a storage
server instead of a database node.
Note:
The network connection and configuration for Oracle Exadata Database
Machine has not occurred yet.
Note:
If you do not have the password for the root user, then contact Oracle
Support Services.
6-101
Chapter 6
Performing Initial Elastic Configuration of Oracle Exadata Database Machine
3. (Not for X8M racks) Verify all servers are configured with the 172.16.* IP address
for the eth0 interface using the following command:
# ibhosts
Note:
It is not possible or supported to switch between physical and Oracle VM
configuration.
# /opt/oracle.SupportTools/switch_to_ovm.sh
# /opt/oracle.SupportTools/reclaimdisks.sh -check
6-102
Chapter 6
Performing Initial Elastic Configuration of Oracle Exadata Database Machine
If the system is a physical (bare metal) deployment, the last line of output will be
the following:
If the system is an Oracle VM deployment, the last line of output will be the
following:
7. Copy the OEDA configuration files to the database server using one of the
following methods. If adding only storage servers, the steps can be run from a
storage server.
• Using a USB flash drive:
a. Copy the configuration file to a USB flash drive.
b. Connect the USB drive to the database server or storage server.
c. Locate the USB drive using the following command:
/dev/sdb1
Note:
If an Oracle Exadata Storage Server X6 or X5 Extreme Flash
(EF) is used, the command will also return the two internal USB
drives, usually /dev/sda1 and /dev/sdb1. The newly inserted
USB drive will be the additional device, usually /dev/sdc1.
The expected output is similar to:
/dev/sda1
/dev/sdb1
/dev/sdc1
6-103
Chapter 6
Performing Initial Elastic Configuration of Oracle Exadata Database Machine
# mkdir /mnt/usb
# mkdir /opt/oracle.SupportTools/onecommand
Note:
Do not use a directory under /u01 or /EXAVMIMAGES because
reclaimdidsks.sh will fail if there is content in those directories.
f. Mount the device. Use the device name given in step 7.c. The following is
an example of the command.
g. Copy OEDA and the configuration files from the USB flash drive to the
onecommand directory on the database server or storage server using the
following command:
# cp /mnt/usb/path_to_file/*.* /opt/oracle.SupportTools/
onecommand
# umount /mnt/usb
i. Remove the USB flash drive from the database server or storage server.
• Using a temporary network connection:
This option is only needed if there were IP address conflicts, and Oracle
Exadata Database Machine is not already connected to the network.
a. Connect a network cable to the Ethernet port labeled NET0 on the back of
the first database server.
b. Bring up the eth0:1 interface as follows:
6-104
Chapter 6
Performing Initial Elastic Configuration of Oracle Exadata Database Machine
Note:
It is not necessary to reconfigure the network because the
network is reconfigured automatically during the restart step.
8. (Not for X8M racks) Verify all servers are configured with the 172.16.* IP address
for the eth0 interface using the following command:
# ibhosts
For example, if you unzipped the OEDA ZIP file into the /opt/
oracle.SupportTools/onecommand/linux-x64 directory, then use the following
commands:
# cd /opt/oracle.SupportTools/onecommand/linux-x64
6-105
Chapter 6
Adding Additional Elastic Nodes to an Existing Rack
14. Log in to the first database server (or storage server, if only storage servers were
added for expansion) to verify network connectivity using the following commands:
# cd /opt/oracle.SupportTools/onecommand/linux-x64
Note:
15. Use OEDA to install and configure the software for Oracle Exadata Database
Machine.
Related Topics
• Cabling Information for Oracle Exadata Database Machine
• Powering On and Off Oracle Exadata Rack
• Adding Additional Elastic Nodes to an Existing Rack
You can add nodes to an existing rack using elastic configuration.
Note:
On database servers (excluding X8M-2 and higher), run reclaimdisks.sh
before running the applyElasticConfig.sh script.
6-106
Chapter 6
Adding Additional Elastic Nodes to an Existing Rack
If you are adding only storage servers, then you can run the applyElasticConfig.sh
script from a storage server rather than a database server.
The overall process for adding a new server to an existing rack is:
1. Use Oracle Exadata Deployment Assistant (OEDA) to add the new server to the
rack configuration and generate the configuration files.
2. Download and unzip the OEDA archive to an existing server in the rack where you
are adding the new server.
3. Install the new server into the rack.
4. Review the OEDAconfiguration file for the rack to determine the location within the
rack (the ulocation) for the new server. For example:
<uLocation>16</uLocation>
5. Log in to the ILOM on the new server using the local serial management
connection (SER MGT port), and review the system location in the SP.
For example:
/SP
Properties:
system_location = ru_06
->
6. If the location in the ILOM SP is different from the OEDA location, then modify the
location in the ILOM SP to match the value from OEDAILOM.
Note:
Ensure that there are no duplicate locations in the OEDA rack
configuration XML file.
Set the system location in the ILOM SP with the following command:
-> set /SP/ system_location=RU16
7. Log in to the server where you unzipped the OEDA configuration files and run the
applyElasticConfig.sh script.
For example, if you unzipped the OEDA ZIP file into the /opt/
oracle.SupportTools/onecommand/linux-x64 directory, then use the following
commands:
# cd /opt/oracle.SupportTools/onecommand/linux-x64
6-107
Chapter 6
Loading the Configuration Information and Installing the Software
Note:
$ export LANG=preferred_language
$ export LC_ALL=preferred_language
• To copy the database image to a USB drive, use the procedure in the
database maintenance chapter of Oracle Exadata Database Machine
Maintenance Guide For releases 12.1.2.1.0 and later, the system used
to create the image must be running Oracle Linux 6 or later.
See Also:
Using Oracle Exadata Deployment Assistant for descriptions of the
configuration files generated by OEDA.
6-108
Chapter 6
Loading the Configuration Information and Installing the Software
Note:
Running OEDA from a client machine outside of the rack means the software
image files are transferred over the network, causing the process to be
slower.
You must have completed the other tasks described in Overview of Oracle Exadata
Deployment Assistant before starting this task.
1. If you are installing Oracle VMs on the database servers, then run /opt/
oracle.SupportTools/switch_to_ovm.sh on each database server.
2. Disk space for unused system partitions must be reclaimed before installing
software on all database servers (except KVM environments on X8M servers).
Use the following script to reclaim the disk space: /opt/oracle.SupportTools/
reclaimdisks.sh -free -reclaim.
3. Create a directory for the extracted OEDA files on the host where you will run
install.sh.
OEDA will not run if staged on the root file system (/)of any database server.
Create a directory to store the latest version of OEDA and all required files on a
file system that has at least 30 GB of available free space.
• For bare-metal database servers, create a directory on the /u01 file system,
for example /u01/onecommand or /u01/oeda.
• For Oracle VM servers, create a directory on the /EXAVMIMAGES file system.
4. Download the latest version of OEDA for the operating system of the client or
server where you will run install.sh.
Unzip the downloaded file into the OEDA home directory you created. This will
create a directory like /u01/onecommand/linux-x64. This directory is referred
to as the OEDA home directory.
5. Download the required image files for the Oracle software.
OEDA requires patches available from My Oracle Support or Oracle Software
Delivery Cloud ( https://edelivery.oracle.com). Review the README file for OEDA
to determine the file name or patch number, which is based on the version of
Oracle software being installed. Place the files in the WorkDir sub-directory in the
OEDA home directory.
• If you are installing on a bare-metal database server, then download the
patches, as specified in Section 2 of the OEDA README file. After
downloading the patch ZIP file, extract the contents into the WorkDir sub-
directory.
• If you are configuring Oracle VM on the database servers, then download the
gold image files as indicated in the topic "Oracle Exadata Deployment
Assistant Support for Oracle Virtual Machines" in the OEDA README file.
After downloading the gold image ZIP files, extract the contents into the
WorkDir sub-directory.
A gold image is a copy of a software-only, installed Oracle home. It is used to
copy an image of an Oracle home to a new host on a new file system to serve
as an active, usable Oracle home.
6-109
Chapter 6
Loading the Configuration Information and Installing the Software
6. Copy the required OEDA configuration files to the WorkDir sub-directory on the
database server or Oracle VM.
When you used OEDA to specify the configuration details for your new engineered
system, it created several configuration files and a ZIP file that contains all the
generated files. The required files are also listed at the bottom of the
InstallationTemplate.html file that was generated by OEDA. You can copy the
ZIP file and extract it into the WorkDir sub-directory, or copy the required files
directly into the WorkDir sub-directory.
7. Log in to the database server or Oracle VM and go to the OEDA home directory.
8. Run the install.sh script to install and deploy the software on your new
engineered system.
In the following command syntax, configuration_file is the full path name for the
master configuration file, CustomerName-rackname.xml
You can use the following options with the install.sh script:
• -cf file: Configuration file name
• -h: Help output for the script
• -l: List the steps of OEDA
• -r {n-N | n }: Run steps n through N of OEDA, or run the specified step.
• -s n: Run step n of OEDA.
• -u {n-N | n }: Undo steps n through N, or one step.
Note:
Always use the latest OEDA patch listed in My Oracle Support note
888828.1. Refer to the README in the patch for the latest steps.
The following steps are performed by the OEDA deployment script. However, the
actual steps for a specific deployment may differ depending on the deployment options
chosen. For example, the "Update Nodes for Eighth Rack" step is performed only if
you are deploying an Eighth Rack configuration.
6-110
Chapter 6
Loading the Configuration Information and Installing the Software
Related Topics
• Oracle Exadata Deployment Assistant Downloads
• Exadata Database Machine and Exadata Storage Server Supported Versions (My
Oracle Support Doc ID 888828.1)
Note:
To fully utilize the Hardware Assisted Resilient Data (HARD) features,
ensure the DB_BLOCK_CHECKSUM initialization parameter is set to TYPICAL
(default) or FULL.
When installing Oracle Database, you must select the Oracle ASM storage option. If
you are installing Oracle Real Application Clusters (Oracle RAC), then refer to the
platform-specific Oracle Clusterware and Oracle RAC installation guides, such as
Oracle Grid Infrastructure Installation and Upgrade Guide and Oracle Real Application
Clusters Installation Guide.
If you are consolidating databases and need to have more than one database with the
same DB_UNIQUE_NAME on the Oracle Exadata Database Machine, then you must
configure Oracle ASM clusters on the storage cells and configure ASM-scoped
security.
Note:
For Oracle RAC, you must shut down the entire cluster, and then restart the
cluster after the database and cell software have been installed, and the cell
configuration files are in place.
The recommended procedure is to install the latest version of the Oracle software on
Oracle Exadata Database Machine using Oracle Exadata Deployment Assistant
(OEDA). If you choose to install the software manually, then do the following:
6-111
Chapter 6
Loading the Configuration Information and Installing the Software
Note:
Disk space for unused system partitions must be reclaimed before installing
software on all database servers (except KVM environments on X8M
servers). Use the following script to reclaim the disk space: /opt/
oracle.SupportTools/reclaimdisks.sh -free -reclaim.
1. Install Oracle Grid Infrastructure for a cluster software as described in Oracle Grid
Infrastructure Installation and Upgrade Guide for Linux.
2. Install Oracle Database software as described in Oracle Real Application Clusters
Installation Guide for Linux and UNIX.
3. Apply the latest patches for Oracle Database software and Oracle Exadata
System Software.
After the cells are configured as described in Oracle Exadata System Software User's
Guide, and the database and Oracle ASM instances are created, the instances must
be configured to use the cells as part of an Oracle ASM disk group. The required
configuration involves updating the initialization parameter file of both the database
and Oracle ASM instances. Additionally, Oracle ASM disk groups must be created to
access storage cells.
You can update the initialization parameter file of the Oracle ASM or the database
instance while the instance is running, but the instance must be restarted if you
manually update the initialization parameter file. If you update an initialization
parameter dynamically using the SQL ALTER SYSTEM or ALTER SESSION commands,
then there is no need to restart the instance.
In addition, for the database, you can configure a new Oracle Database Resource
Manager plan, rather than using the default plans.
• Configuring the Compatible Parameter for a Database Instance
Oracle recommends using the best practices for Oracle Exadata System Software
available at My Oracle Support.
• Configuring Initialization Parameters for an Oracle ASM Instance
• Using the Same DB_UNIQUE_NAME for Multiple Database Instances
You can create database instances that use the same DB_UNIQUE_NAME value if the
databases are associated with separate Oracle ASM clusters.
Related Topics
• Setting Up Oracle ASM-Scoped Security on Oracle Exadata Storage Servers
• Setting Up Configuration Files for a Database Server Host
• Managing I/O Resources
• Administering Oracle ASM Instances
• Configuring DBFS on Oracle Exadata Database Machine (My Oracle Support Doc
ID 1054431.1)
6-112
Chapter 6
Loading the Configuration Information and Installing the Software
COMPATIBLE='18.0.0'
The COMPATIBLE parameter cannot be changed dynamically. If you change the value in
the initialization parameter file, then the database must be shut down and restarted for
the change to take effect.
Related Topics
• COMPATIBLE
For example:
ASM_DISKSTRING = 'o/*/data*'
– To discover non-Exadata Storage Server disks and all grid disks on all the
cells specified in the cellip.ora file, use a wildcard pattern for Exadata
Storage Server grid disks. For example:
ASM_DISKSTRING = '/dev/rdsk/disk*', 'o/*/*'
6-113
Chapter 6
Loading the Configuration Information and Installing the Software
You can change the ASM_DISKSTRING initialization parameter when the Oracle ASM
instance is running with the SQL ALTER SYSTEM command. If you edit the
ASM_DISKSTRING initialization parameter in the initialization parameter file when the
Oracle ASM instance is running, then the Oracle ASM instance must be shut down
and restarted for the change to take effect.
See Also:
WARNING:
If you configure databases to have the same DB_UNIQUE_NAME, then those
databases cannot be backed up to Oracle Zero Data Loss Recovery
Appliance.
1. Create Oracle ASM clusters for the database clusters that use identical
DB_UNIQUE_NAME values for the database instances.
Each database instance that uses the same DB_UNIQUE_NAME must be in a
separate Oracle ASM cluster. The Oracle ASM cluster name is used to qualify the
DB_UNIQUE_NAME in I/O Resource Management (IORM), Exadata Smart Flash
Cache, and Exadata Smart Scan Offload operations.
2. Configure ASM-scoped security for each cluster database.
When configuring ASM-scoped security, the Oracle ASM client must be configured
as an ASMCLUSTER client.
If you already have ASM-scoped security configured, but the Oracle ASM client is
not configured as an ASMCLUSTER client, then you can use the ASSIGN KEY
command upgrade the key to an ASMCLUSTER key.
3. Create the databases in each cluster using the same DB_UNIQUE_NAME.
6-114
Chapter 6
Installing Oracle Enterprise Manager Cloud Control
Related Topics
• Setting Up Oracle ASM-Scoped Security on Oracle Exadata Storage Servers
• Upgrading ASM-Scoped Security Key for ASMCLUSTER
6-115
A
Site Checklists
Complete the checklists in this appendix to ensure the site is prepared for Oracle
Exadata Database Machine or Oracle Exadata Cloud Machine.
Note:
For ease of reading, the name "Oracle Exadata Rack" is used when
information refers to both Oracle Exadata Database Machine and Oracle
Exadata Storage Expansion Rack.
A-1
Appendix A
System Components Checklist
Note:
Every Oracle
Exadata Rack
X8M requires a
spine switch
when connecting
multiple racks.
A-2
Appendix A
Data Center Room Checklist
See Also:
Oracle Exadata Rack Restrictions in Oracle Exadata Database Machine
System Overview for more details on allowed hardware modifications
A-3
Appendix A
Data Center Environment Checklist
Related Topics
• Space Requirements
The space requirements for Oracle Exadata Database Machine depend on the
hardware rack that is supplied with the system.
• Flooring Requirements
Oracle recommends that Oracle Exadata Rack be installed on raised flooring.
• Stabilize Oracle Exadata Rack with Leveling Feet
A-4
Appendix A
Data Center Environment Checklist
Related Topics
• Temperature and Humidity Requirements
Excessive internal temperatures may result in full or partial shut down of Oracle
Exadata Database Machine.
A-5
Appendix A
Access Route Checklist
A-6
Appendix A
Access Route Checklist
A-7
Appendix A
Facility Power Checklist
Related Topics
• Table: Access Route Requirements.
• Rack Weights for Oracle Exadata Database Machine
Review the net and shipping weights for your Oracle Exadata Rack to ensure it
can be delivered safely.
• Rack Weights for Oracle Exadata Storage Expansion Rack
• Flooring Requirements
Oracle recommends that Oracle Exadata Rack be installed on raised flooring.
A-8
Appendix A
Facility Power Checklist
A-9
Appendix A
Safety Checklist
Related Topics
• Temperature and Humidity Requirements
Excessive internal temperatures may result in full or partial shut down of Oracle
Exadata Database Machine.
A-10
Appendix A
Logistics Checklist
See Also:
"Powering On and Off Oracle Exadata Rack" in the Oracle Exadata
Database Machine Maintenance Guide
A-11
Appendix A
Logistics Checklist
A-12
Appendix A
Logistics Checklist
A-13
Appendix A
Network Configuration Checklist
Related Topics
• Space Requirements
The space requirements for Oracle Exadata Database Machine depend on the
hardware rack that is supplied with the system.
A-14
Appendix A
Network Configuration Checklist
Related Topics
• Understanding the Network Requirements for Oracle Exadata Database Machine
Review the network requirements for Oracle Exadata Database Machine before
installing or configuring the hardware.
A-15
Appendix A
Auto Service Request Checklist
A-16
Appendix A
Reracking Checklists
See Also:
"Understanding Auto Service Request" in the Oracle Exadata Database
Machine Maintenance Guide
Note:
• Customer must purchase both the Oracle Reracking Service and Oracle
Installation Service.
• Oracle does not provide support for customer-supplied equipment.
A-17
Appendix A
Reracking Checklists
A-18
Appendix A
Reracking Checklists
A-19
Appendix A
Reracking Checklists
The following checklist is specific to the power distribution units (PDUs) when using
the reracking service.
A-20
Appendix A
Recycling the Racks
A-21
Appendix A
Recycling the Racks
Related Topics
• Product Take Back and Recycling website
A-22
B
Database High Availability Checklist
Use this checklist to ensure the requirements for high availability are met for Oracle
Exadata Database Machine.
B-1
Appendix B
Related Topics
• Oracle Database High Availability Overview
• Exadata Patching Overview and Patch Testing Guidelines (My Oracle Support
Doc ID 1262380.1)
• Oracle Maximum Availability Architecture website
• Oracle Exadata Database Machine exachk or HealthCheck (My Oracle Support
Doc ID 1070954.1)
• Exadata Health and Resource Usage Monitoring White Paper (My Oracle Support
Doc ID 1920255.1)
• Exadata Database Machine and Exadata Storage Server Supported Versions (My
Oracle Support Doc ID 888828.1)
• Oracle Exadata Best Practices (My Oracle Support Doc ID 757552.1)
B-2
Index
A circuit breakers for PDU, 5-14
Cisco switch
access route requirements, 1-31 configuring default gateway, 6-13, 6-15, 6-21
ADD ACFSVOLUME, 4-11 configuring host name, 6-13, 6-21
ADD DATABASE, 4-23 default port speed, 6-13, 6-14
ADD DATABASEHOME setting password, 6-13, 6-21
OEDACLI command, 4-29 client access network, 2-1
ADD DISKGROUP, 4-34 CLONE CELL, 4-14
ADD NETWORK, 4-48 CLONE COMPUTE, 4-19
ADD SCAN, 4-52 CLONE GUEST, 4-42
ADD VIP, 4-55 configuration files
additional networks, 2-1 /etc/hosts, 6-3
airflow, 1-48 configuring
ALTER ACFSVOLUME, 4-12 cell alerts, 3-64
ALTER CLUSTER, 4-15 database, 6-111
ALTER DATABASE, 4-25 InfiniBand interface, 6-3
OEDACLI command, 4-5 initialization parameter files, 6-111
ALTER DATABASEHOME, 4-31 instances, 6-111
ALTER DISKGROUP, 4-35 Oracle Automatic Storage Management
ALTER DISKGROUPS, 4-38 (Oracle ASM), 6-111
ALTER ES, 4-40 PDUs, 6-25
ALTER ILOM, 4-45 conventions for naming, 3-3
ALTER MACHINE, 4-46 CREATE CLUSTER, 4-16
ALTER NETWORK, 4-49
ALTER SCAN, 4-52
ALTER SWITCH, 4-54
D
ALTER VIP, 4-56 database machine prefix, 3-48
ambient relative humidity range, 1-48 database server weight
ambient temperature ranges, 1-48 X*-2, net, 1-32
ASM_DISKSTRING initialization parameter, X*-2, shipping, 1-32
6-113 X*-8, net, 1-34
ASM-scoped security, 6-114 X*-8, shipping, 1-34
databases
B configuring for cell storage, 6-111
configuring initialization parameter file, 6-111
backup methods, 3-3 DB_BLOCK_CHECKSUM, 6-111
BONDETH0, 2-1 DB_UNIQUE_NAME, 6-114
BONDIB0, 2-1 default IP addresses, 2-25
default serial port speed
Cisco switch, 6-13, 6-14
C DELETE ACFSVOLUME, 4-12
cellaffinity.ora, 2-1 DELETE CELL, 4-14
checking DELETE COMPUTE, 4-22
firmware, 6-64 DELETE DATABASE, 4-26
InfiniBand switch health, 6-3 DELETE DATABASEHOME, 4-32
Index-1
Index
E L
earth ground cable, 5-11 leaf switches, 6-11
elasticConfig.sh script, 6-100 leveling feet, 5-7, 5-9
electrostatic discharge, 1-48 LIST ACFSVOLUME, 4-13
enablesm command, 6-3 LIST CELLS, 4-14
enabling InfiniBand Subnet Manager, 6-3 LIST CLUSTERS, 4-17
LIST DATABASEHOMES, 4-33
LIST DATABASES, 4-28
F LIST DISKGROUPS, 4-40
files LIST ILOMS, 4-45
configuration, 3-1 LIST MACHINES, 4-47
firewalls LIST NETWORKS, 4-51
port assignments, 2-43 LIST SCANS, 4-53
firmware checks, 6-64 LIST STEPS, 4-9
first database server location, 6-100 LIST SWITCHES, 4-55
LIST VIPS, 4-57
LIST XMLACTIONS, 4-11
G LOAD FILE, 4-7
getmaster command, 6-11 locating
GNS first database server, 6-100
configuring, 1-54 PDU circuit breakers, 5-14
grid naming service, 1-54
ground cable, 5-11 M
management network, 2-1
H MERGE ACTIONS, 4-8
high redundancy, 3-3 minimum ceiling height, 1-30
humidity range, 1-48 minimum subnet mask, 1-55
I N
IB0, 2-1 naming conventions, 3-3
IB1, 2-1 net weights
ILOM Oracle Exadata Database Machine, 1-31
network, 2-1, 2-23 Oracle Exadata Storage Expansion Rack,
InfiniBand 1-31
commands NET0, 2-1
version, 6-3 NET1, 2-1
switch health, 6-3 NET2, 2-1, 2-22
NET3, 2-1, 2-22
Index-2
Index
3
Index
V verifying (continued)
RDMA over InfiniBand Network Fabric
verify-topology utility, 6-74 topology, 6-74
verifying version command, 6-3
disk cache policy, 6-72 VIP addresses, 1-54, 2-1, 2-14, 3-53
InfiniBand switch host name, 6-3 VLAN tagging, 2-23
rack master serial number, 6-72 VLANs, 6-13
Index-4