ECS - ObjectScale SolVe Generator

Version: 3.0.2.19 Generated on July 26 2025 11:46 AM

Topic
ECS Miscellaneous 'How To' Service Procedures

Selections
Choose Activity: Certificate Renewal
Select Certificate Renewal Information Based on ECS Version?: ECS 3.2.x.x - 3.5.x.x Fabric SSL
Certificate Renewal Guide

If you find any errors in this procedure or have comments regarding this application, send
email to [email protected]

Copyright © 2025 Dell Inc. or its subsidiaries. All Rights Reserved. Dell Technologies, Dell, EMC, Dell EMC and other trademarks are
trademarks of Dell Inc. or its subsidiaries. Other trademarks may be trademarks of their respective owners.

The information in this publication is provided “as is.” Dell Inc. makes no representations or warranties of any kind with respect to the
information in this publication, and specifically disclaims implied warranties of merchantability or fitness for a particular purpose.

Use, copying, and distribution of any software described in this publication requires an applicable software license.

This document may contain certain words that are not consistent with Dell's current language guidelines. Dell plans to update the
document over subsequent future releases to revise these words accordingly.

This document may contain language from third party content that is not under Dell's control and is not consistent with Dell's current
guidelines for Dell's own content. When such third party content is updated by the relevant third parties, this document will be revised
accordingly.
Dell Technologies – Restricted Use – Confidential & Subject to NDA

Page 1 of 56
 Contents
Preliminary Activity Tasks .......................................................................................................3
Read, understand, and perform these tasks.................................................................................................3
Notes, cautions, and warnings......................................................................................................................4
How to renew certificate using Service Console...........................................................................................4
Connect to the ECS appliance......................................................................................................................4
Connect from a remote location....................................................................................................................4
Connect a service laptop to a U-Series or D-Series rack on site..................................................................4
Connect a service laptop to the EX Series rack............................................................................................4
Install the Service Console and generate the cluster.ini file .........................................................................6
Automated Service Console procedure for certificate refreshment ..............................................................8
Troubleshooting information .......................................................................................................................10
Output examples.........................................................................................................................................11
Document feedback ....................................................................................................................................56

Dell Technologies – Restricted Use – Confidential & Subject to NDA

Page 2 of 56
Preliminary Activity Tasks
This section may contain tasks that you must complete before performing this procedure.

Read, understand, and perform these tasks

1. Table 1 lists tasks, cautions, warnings, notes, and/or knowledgebase (KB) solutions that you need to
be aware of before performing this activity. Read, understand, and when necessary perform any
tasks contained in this table and any tasks contained in any associated knowledgebase solution.

Table 1 List of cautions, warnings, notes, and/or KB solutions related to this activity

• Renewing Fabric SSL Certificate on ECS 3.5 and below cannot be performed using the latest
Service Console. The renewal has to be performed using Service Console 8.2.0.1. Refer to KB
218618.

Dell Technologies – Restricted Use – Confidential & Subject to NDA

Page 3 of 56
Notes, cautions, and warnings

NOTE: A NOTE indicates important information that helps you make better use of your product.

CAUTION: A CAUTION indicates either potential damage to hardware or loss of data and tells
you how to avoid the problem.

WARNING: A WARNING indicates a potential for property damage, personal injury, or death.

How to renew certificate using Service Console

The fabric installer supports expired and not expired certificates renewal, and old certificates restoration.
Connect to the ECS appliance

This section outlines how to connect to the ECS appliance (Node1 Rack1) locally onsite or remotely.
Connect from a remote location

Use Secure Remote Services to connect remotely. See the ECS Software Installation Guide for
procedures.
Connect a service laptop to a U-Series or D-Series rack on site

Access the U-Series or D-Series rack using the private network (192.168.219.XXX) from the laptop.
Steps
1. Connect your laptop to port 24 of the 1 GbE Turtle switch.
2. Configure your laptop with the following network parameters:
o IP: 192.168.219.99
o Netmask: 255.255.255.0
o No Gateway
3. Validate and ping node1 or the rack that you connected.
4. Ping the node 1 or the rack at: 192.168.219.1 so that later you can ssh to the node1 or that rack
later in the procedure.

ping 192.168.219.1

NOTE: If 192.168.219.1 does not answer, try 192.168.219.2. If there is no response, verify the
laptop IP/subnet mask, network connection, and switch port connection. If the service laptop is
connected to Dell VPN, ping to 192.168.219.x does not return a response.

Connect a service laptop to the EX Series rack

Access an ECS EX Series rack using the private (192.168.219.XXX) network from a laptop.
Prerequisites
• Access to private network IP addresses (192.168.219.1 to 16 and 192.168.219.101 to 116) are
limited to the nodes connected in the rack backend 1/10/25GbE fox management switch.

Dell Technologies – Restricted Use – Confidential & Subject to NDA

Page 4 of 56
 • Private.4 (NAN) network IP addresses (169.254.x.x) of all nodes in all racks in the ECS Virtual
Data Center (VDC) are accessible from any node in the ECS VDC once you SSH in to a node
using a private IP address (192.168.219.x).

• If security lock down is not enabled, access to public network IP addresses for all ECS racks are
available once you SSH to one of the ECS nodes .

• Two Switches Fox and Hound are used for the private network, or Nile Area Network (NAN). For
example, node 8 must connect to Hound port 8 and Fox port 8. For more information, see ECS
EX Series Hardware Guide.
Steps
1. Connect your service laptop to the VDC.

Option Description

If the cabinet contains a service shelf Open the service shelf, and connect the red network cable to
with a red network cable... the service laptop.
The red cable connects to port 34 on the fox switch. The fox
switch is the bottom back-end switch in a dual switch
configuration.

If the cabinet does not contain a From the rear of the rack, connect directly to either port 34 or
service shelf with a red network cable... 36 on the fox switch, whichever port contains a 1GB SFP.

If you want to connect a service laptop Locate port 36 on the fox switch. The fox switch is the
to the rear of the rack... bottom back-end switch in a dual switch configuration.
Port 36 has a 1GB SFP that you can connect your service
laptop to with a Cat6 cable.

Figure 1. Fox switch

1 - Port 34 for service tray connection

2 - Port 36 for connection from rear

2. Set the network interface on the laptop to the static address 192.168.219.99, subnet mask
255.255.255.0, with no gateway required.
3. Verify that the temporary network between the laptop and rack's private management network is
functioning by using the ping command.

NOTE: If 192.168.219.1 does not answer, try 192.168.219.2. If neither responds, verify the laptop
IP/subnet mask, network connection, and switch port connection. If the service laptop is
connected to Dell's VPN, ping to 192.168.219.x may not return a response.

C:\>ping 192.168.219.1

Dell Technologies – Restricted Use – Confidential & Subject to NDA

Page 5 of 56
 Pinging 192.168.219.1 with 32 bytes of data:
Reply from 192.168.219.1: bytes=32 time<1ms TTL=64
Reply from 192.168.219.1: bytes=32 time<1ms TTL=64
Reply from 192.168.219.1: bytes=32 time<1ms TTL=64
Reply from 192.168.219.1: bytes=32 time<1ms TTL=64
Ping statistics for 192.168.219.1:
Packets: Sent = 4, Received = 4, Lost = 0 (0% loss),
Approximate round trip times in milli-seconds:
Minimum = 0ms, Maximum = 0ms, Average = 0ms

Install the Service Console and generate the cluster.ini file

Install the Service Console and generate the cluster.ini file on the installer node of Rack 1 of the
VDC.
Prerequisites
If you have an existing cluster.ini file, Service Console takes a backup of the existing file to retain
any customizations and for comparison with the generated cluster.ini file after you run the
Cluster_Config command.
Steps
1. On the installer node of Rack 1 of the VDC, extract the Service Console package by running the
following command:

cd /tmp/service_console
tar -xf service-console-<service_console_version><service_console_build_number>.tgz

2. Upgrade the Service Console by running the following command:

./service-console upgrade

If the Service Console is not installed, it installs when you run this upgrade command.
3. On the installer node of Rack 1 of the VDC, run the following command to generate the
cluster.ini file:

service-console run Cluster_Config

The generated cluster.ini file is on the installer node at

/opt/emc/config/local/cluster.ini and includes the private.4 IP addresses for all
nodes in all racks in the VDC.

NOTE: If the credentials are incorrect, expect a minute delay per node for command execution as
observed in /opt/emc/caspian/service-console/log/ logs.

4. Verify whether the nodes are grouped correctly in the rack, and that the rack names in the
cluster.ini file correspond to rack colors. The cluster.ini file contains the list of node
Private.4 (NAN) addresses, rack names, and VDC names that might be called in commands as
part of the procedure.
5. Verify that the cluster.ini file does not contain any WARNING and vdc_<x>_unknown
entries by running the following command.

sudo cat /opt/emc/config/local/cluster.ini

Dell Technologies – Restricted Use – Confidential & Subject to NDA

Page 6 of 56
Sample output: WARNING and vdc_<x>_unknown errors display similar to the following:

######
# This file was automatically generated by the Service Console.
# Please verify that it reflects the actual cluster topology.
# Credentials (BMC, Mgmt API, etc) should be set in separate files.
# Use file group_vars/datanodes to set cluster-wide variables.
# Use file host_vars/HOST_IP to set node-specific variables.
######

[datanodes:children]
vdc_1

[vdc_1:children]
red

[red:vars]
rack_id=1
rack_name=red
rack_psnt=PSNT
rack_dns_server=8.8.8.8
rack_dns_search=ecs.test.com,test.com
rack_ntp_server=9.9.9.9,10.10.10.10
rack_ns_switch=files,mdns4_minimal,[NOTFOUND=return],dns,mdns4
sc_collected=True

[red:children]
node_169_254_1_1 # Installer / SC node
node_169_254_1_2
node_169_254_1_3
node_169_254_1_5

[node_169_254_1_1]
169.254.1.1

[node_169_254_1_1:vars]
bmc_ip=192.168.219.101
public_ip=10.10.200.50
public_fqdn=provo-red.ecs.test.com
public_subnet=255.255.255.0
public_gateway=10.10.200.1
public_vlan=None
public_interface=None
.
.
.
[node_169_254_1_5]
169.254.1.5

[node_169_254_1_5:vars]
bmc_ip=192.168.219.105
public_ip=10.10.200.66
public_layton-red.ecs.test.com
public_subnet=255.255.255.0
public_gateway=10.10.200.1
public_vlan=None
public_interface=None

Dell Technologies – Restricted Use – Confidential & Subject to NDA

Page 7 of 56
 #
# WARNING: The Service Console failed to find
# the corresponding rack(s) for nodes
# in the [vdc_1_unknown] section.
# Edit the cluster.ini file and map
# these nodes to rack(s) manually.
#
[vdc_1_unknown]
169.254.1.4

Automated Service Console procedure for certificate refreshment

The procedure automates expired and not expired certificates refreshment. It supports ECS 3.2, 3.3, 3.4,
and 3.5 versions.
Prerequisites
• You must obtain customer permission before starting the procedure. Alert the customer if an
offline window is needed, depending on the following load balancer use cases.
o If the customer is using a load balancer:
▪ The certificate renewal process can be done without taking the Dell
Technologies storage system offline, but still requires a maintenance window to
restart the services.
▪ During service restarts, some performance impact is to be expected.
o If the customer is not using a load balancer or using protocols other than S3 such as
CAS:
▪ The certificate renewal process requires an offline window as read or write
issues are expected. It would not be possible to read or write properly until all
the services are restarted.
▪ This is because the connections are being made to specific IPs. These IPs may
not be available for the read or write operations until the renewal procedure is
completed, and the services are restarted.

• The procedure performs health checks before and after the certificate renewal.

• End to end time to complete the procedure depends on the number of nodes. Estimation is
about 10 minutes for certificate renewal plus 7-10 minutes per node.

• Ensure that the latest Service Console (SC) version is installed on the installer node.

• The certinstaller is packed together with SC.

• SC invokes fabric installer to performs certificate renewal procedure. Fabric installer can use
either the existing installer on the node or use a temporary installer certinstaller which is
uninstalled after certificate renewal.
Steps
1. Run the refresh certificates service procedure using the following command.

service-console run Refresh_Certificates

Dell Technologies – Restricted Use – Confidential & Subject to NDA

Page 8 of 56
 The command can be run along with arguments that are listed in the List of Arguments for
Refresh Certificates command table. For example, to refresh expired certificates add --renew-
expired true at the end of the command.

The command performs the following actions:

o Installs the certinstaller on any non installer node where Zoo Keeper (ZK) is running.
o Checks if all the nodes have the same operating system and object version.
o Checks the fabric health
o Invokes the fabric installer
o Checks the Fabric Health again to ensure that the certificates are refreshed.
o Uninstalls the certinstaller as needed

Table 1. List of Arguments for Refresh Certificates command

Name Value Required Default Description

--dry-run true | false no false Perform service procedure dry run. It runs
the health checks but installer is not called
and certificates are not changed.

--cancel- true | false no false Cancel service procedure and restart it from
and- the beginning.
restart

--skip- true | false no false Force skip all Health Check.

health-
check

--skip- HC_NAME1,HC_NAME2 no - Comma-separated list of Health Checks to

check skip

--skip- true | false no false Skip service procedure version compatibility

version- check.
compat-
check

--target- private IP of the node no - If set, SC uses this node if not set, SC looks
node for an appropriate node.

--exclude node1_ip, node2_ip no false Excludes the given node from SC Health
Checks and from the renewal process.

--renew- true | false no - Enforces corresponding installer program:

expired RENEW_EXPIRED_CERTIFICATES (for
true) and
RENEW_NON_EXPIRED_CERTIFICATES
(for false). If not passed, the program is
selected automatically.

o If the target node is given, the SC uses the given target node. The operation fails if the
target node has no ZK running or if there is lower version of the installer. Certinstaller is
uninstalled after completing the procedure.
o If the target node is not given, SC checks the local node and uses the certinstaller
present on local node (non-installer node). If not, SC checks the other nodes for
certinstaller. If not found, SC looks for a node with running ZK and without any installer

Dell Technologies – Restricted Use – Confidential & Subject to NDA

Page 9 of 56
 on it and installs integrated certinstaller. Certinstaller is uninstalled after completing the
procedure.
o If the certinstaller is already installed on any other nodes running ZK, SC picks the node
that already has installer that is installed on it and invokes the refresh procedure.
See appendix for usage example scenarios.

2. Run the following command to check the validation of the renewal process. This is an optional
step.

service-console run Health_Check --specific-check "Verify Fabric Certificate"

Service console version: 6.1.0.0-21168.5d2917cafd

For output examples, see the appendix section.

Troubleshooting information

• The procedure works only when entire cluster is running the same version of ECS. If you run it
on a cluster having mixed ECS versions, where only few nodes are upgraded, the procedure
fails.
• When the refresh procedure is interrupted, on rerun the refresh procedure starts from the last
step where the procedure failed or was stopped. For example, procedure that is interrupted after
prehealth check, skips the prehealth check on rerun and proceeds with renewal of certificates.
• Use the cancel and restart true option to rerun the procedure from the beginning.
Consult the engineering before using the --cancel-and-restart true option.

NOTE: Do not skip checks unless there is an escalation and there is an instruction to do so from
the engineering. For example see Appendix. The example that is shown in Appendix is for
reference purpose only.

• All nodes in a cluster must be up and running for the procedure to work. In case any node is
down, the SC procedure would fail.
o When the node that is pending renewal is down, SC precheck fails.
o When a node goes down during the renewal procedure, the renewal procedure fails.
o Run the refresh procedure with --exclude option, to exclude the node when a node is
down. Once the node is back online, you can rerun the procedure to renew all the
nodes. If the old certificates have not expired, then it is recommended to wait until all the
nodes are online. For example: service-console run Refresh_Certificates
--exclude <<node ip>> --renew-expired true. If the node is down, run the
procedure with --exclude <<offline nodes private ips separated by
comma>>, and it is not required to provide the parameter --renew-expired true.
o Once you bring up the node that was down, run the refresh procedure with options --
renew-expired true, -- skip-health-check true, and --exclude
<<offline nodes private ips separated by comma , if any other
nodes are still in offline>>, as the node that missed renewal is not
functional.
• The fabric installer is idempotent. If the expired and not expired renewal procedure fails when
running the service-console run Refresh_Certificates command, then rerun the
refresh procedure with --renew-expired true option.
• If the certificates are expired, then use the --renew-expired true option, by default the --
renew-expired is set to false.
• If the renewal procedure is interrupted and the certificates are not expired but LifeCycle Manager
is unavailable, run SC procedure with --renew-expired false option.

Dell Technologies – Restricted Use – Confidential & Subject to NDA

Page 10 of 56
Output examples

The output scenarios for certificate renewal using Service Console is covered in this section.

• Non-expired certificates renewal:

admin@provo-shamrock:~> service-console run Refresh_Certificates

2020-12-13 22:45:41 main#1405 INFO: Redirecting console output to

/opt/emc/caspian/service-
console/log//20201213_224541_run_Refresh_Certificates/output.log

Procedure is running inside a 'screen' session. If you are disconnected, the procedure
will continue to run. To reconnect to your running procedure session in the future,
run 'screen -r service-console'

provo-shamrock 12/13 22:45

Service console version: 6.1.0.0-21205.0de50ff176

Debug log: /opt/emc/caspian/service-

console/log/20201213_224541_run_Refresh_Certificates/dbg_robot.log

================================================================================

Refresh Certificates Setup

20201213 22:46:13.164: Check Refresh Certificates options

Target node is not set

The local node 169.254.173.1 has installer installer-3.6.1.0-4218.3f6d49f.x86_64 on

it.

The node 169.254.173.1 already has manifest on it.

Using the local node as target.

20201213 22:46:14.837: | PASS (1 sec)

Refresh Certificates Pre Check

20201213 22:46:23.106: Run health check

20201213 22:46:23.109: | Check Object version across the cluster

20201213 22:46:47.562: | | PASS (24 sec)

20201213 22:46:47.566: | Validate that OS version is equal between nodes

20201213 22:46:51.750: | | PASS (4 sec)

20201213 22:46:51.752: | PASS (28 sec)

20201213 22:46:51.753: Run health check

20201213 22:46:51.756: | Validate zookeeper

Dell Technologies – Restricted Use – Confidential & Subject to NDA

Page 11 of 56
20201213 22:47:10.827: | | PASS (19 sec)

20201213 22:47:10.828: | Validate that all nodes are available - Fabric

20201213 22:47:10.830: | | PASS

20201213 22:47:10.830: | Confirm that docker health is GOOD and docker exec works on
all nodes

20201213 22:47:26.188: | | PASS (15 sec)

20201213 22:47:26.190: | Validate the number of CPU cores

20201213 22:47:26.986: | | PASS

20201213 22:47:26.987: | Validate the amount of available physical RAM

20201213 22:47:27.812: | | PASS

20201213 22:47:27.813: | Validate swap space consumers

20201213 22:47:27.820: | | PASS

20201213 22:47:27.821: | Validate the required number and capacity of disks

20201213 22:47:30.914: | | PASS (3 sec)

20201213 22:47:30.916: | Validate that the internal/system disk is SSD

20201213 22:47:38.775: | | PASS (7 sec)

20201213 22:47:38.777: | Validate disks serial number uniqueness

20201213 22:47:38.791: | | PASS

20201213 22:47:38.792: | Validate that provisioned drives are GOOD

20201213 22:47:50.562: | | PASS (11 sec)

20201213 22:47:50.564: | Validate that expected number of drives is formatted for

Object

20201213 22:47:50.577: | | PASS

20201213 22:47:50.578: | Validate metadata/btree SSD read cache consistency

20201213 22:48:09.002: | | PASS (18 sec)

20201213 22:48:09.004: | Validate that the correct number of disks are mounted
inside the object container

20201213 22:48:16.102: | | PASS (7 sec)

20201213 22:48:16.104: | Validate file system and blockBins on formatted disks

20201213 22:48:17.787: | | PASS (1 sec)

Dell Technologies – Restricted Use – Confidential & Subject to NDA

Page 12 of 56
20201213 22:48:17.789: | Validate that ports for fabric services are open

20201213 22:48:21.003: | | PASS (3 sec)

20201213 22:48:21.005: | Validate that all partitions are under control

20201213 22:49:32.959: | | PASS (1 min 11 sec)

20201213 22:49:32.961: | Validate that all lifecycles are active

20201213 22:49:34.481: | | PASS (1 sec)

20201213 22:49:34.483: | Validate applications and services health

20201213 22:49:50.703: | | PASS (16 sec)

20201213 22:49:50.704: | Validate object configuration files between nodes

20201213 22:49:53.263: | | PASS (2 sec)

20201213 22:49:53.265: | Validate application role operational mode

Skipped: unnecessary for ECS version 3.6.1.0.126650.5c60d3b2b8f

20201213 22:49:57.209: | | PASS (3 sec)

20201213 22:49:57.210: | Validate that diskset is the same for all disks and cache
files

20201213 22:50:01.292: | | PASS (4 sec)

20201213 22:50:01.293: | Validate HAL version

20201213 22:50:02.391: | | PASS (1 sec)

20201213 22:50:02.393: | Validate agent version

20201213 22:50:03.306: | | PASS

20201213 22:50:03.308: | Validate number of nodes with zookeeper

20201213 22:50:09.329: | | PASS (6 sec)

20201213 22:50:09.331: | Validate zookeeper database size

20201213 22:50:16.965: | | PASS (7 sec)

20201213 22:50:16.967: | Verify BIOS version

20201213 22:50:19.695: | | PASS (2 sec)

20201213 22:50:19.697: | Check ZK version consistency

20201213 22:50:20.819: | | PASS (1 sec)

20201213 22:50:20.821: | PASS (3 min 29 sec)

Dell Technologies – Restricted Use – Confidential & Subject to NDA

Page 13 of 56
20201213 22:50:20.823: Check if fabric certificates are already expired

Certificate expiration date: Dec 13 21:52:02 2025 GMT

20201213 22:50:39.024: | PASS (18 sec)

20201213 22:50:39.026: Run health check

20201213 22:50:39.028: | Validate docker containers are running where they should be

20201213 22:50:48.143: | | PASS (9 sec)

20201213 22:50:48.145: | Validate API availability of fabric services

20201213 22:51:02.449: | | PASS (14 sec)

20201213 22:51:02.450: | Validate that there is cluster master

20201213 22:51:08.465: | | PASS (6 sec)

20201213 22:51:08.467: | Validate services owner and that realized goalstates are
equal on LM and agents

20201213 22:51:51.839: | | PASS (43 sec)

20201213 22:51:51.840: | Validate services owner and that goalstates are equal on LM
and agents

20201213 22:52:32.217: | | PASS (40 sec)

20201213 22:52:32.218: | Validate event streams by sending agent health

20201213 22:52:52.056: | | PASS (19 sec)

20201213 22:52:52.058: | Validate cluster compliance status

20201213 22:52:58.108: | | PASS (6 sec)

20201213 22:52:58.109: | Validate ESRS connection

20201213 22:53:10.139: | | PASS (12 sec)

20201213 22:53:10.141: | PASS (2 min 31 sec)

20201213 22:53:10.143: Validate that disks states are okay in SSM

20201213 23:01:02.346: | PASS (7 min 52 sec)

Refresh Certificates Install Installer

20201213 23:01:11.789: Install Installer if needed

Not needed

20201213 23:01:11.859: | PASS

Dell Technologies – Restricted Use – Confidential & Subject to NDA

Page 14 of 56
Refresh Certificates Run Installer

20201213 23:01:20.231: Check if fabric certificates are already expired

Certificate expiration date: Dec 13 21:52:02 2025 GMT

20201213 23:01:36.027: | PASS (15 sec)

20201213 23:01:36.028: Refresh Certificates Run Installer

Initializing...

Executing Program: RENEW_NOT_EXPIRED_CERTIFICATES

|-Check is previous run was finished

| +-[0.0.0.0] CheckPreviousRun PASS (1/35)

|-Check silent nodes

| +-[0.0.0.0] CheckSilentNodes PASS (2/35)

|-Store current agent certificates

| |-[169.254.173.1] StoreAgentCertificates PASS (3/35, 1

sec)

| |-[169.254.173.3] StoreAgentCertificates PASS (4/35, 1

sec)

| |-[169.254.173.4] StoreAgentCertificates PASS (5/35, 1

sec)

| +-[169.254.173.2] StoreAgentCertificates PASS (6/35, 1

sec)

|-Store current LM certificates

| |-[169.254.173.4] StoreLMCertificates PASS (7/35)

| |-[169.254.173.1] StoreLMCertificates PASS (8/35, 1

sec)

| |-[169.254.173.2] StoreLMCertificates PASS (9/35, 1

sec)

| +-[169.254.173.3] StoreLMCertificates PASS (10/35, 1

sec)

|-Store cluster certificates from ZK

| +-[0.0.0.0] CertRenewStoreClusterCertificatesFromZK PASS (11/35)

Dell Technologies – Restricted Use – Confidential & Subject to NDA

Page 15 of 56
 |-Checking whether a backup copy of agent and LM certificates correct

| +-[0.0.0.0] CheckStoredCertsHash PASS (12/35,

16 sec)

|-Remove cluster certificates from ZK

| +-[0.0.0.0] CertRenewRemoveClusterCertificatesFromZK PASS (13/35, 1

sec)

|-Check agent port

| |-[169.254.173.1] CheckIfAgentPortIsOpen PASS (14/35)

| |-[169.254.173.3] CheckIfAgentPortIsOpen PASS (15/35)

| |-[169.254.173.2] CheckIfAgentPortIsOpen PASS (16/35)

| +-[169.254.173.4] CheckIfAgentPortIsOpen PASS (17/35)

|-Setup Installation SSL

| |-[0.0.0.0] Clean up installer security data folder

| |-[0.0.0.0] Create Cluster/Root CA

| |-[0.0.0.0] Sign installer cert

| |-[169.254.173.1] Put combined certs into agent TS

| |-[169.254.173.1] Put signed agent CA cert

| |-[169.254.173.1] Put root cert into agent trust store

| |-[169.254.173.4] Put combined certs into agent TS

| |-[169.254.173.4] Put signed agent CA cert

| |-[169.254.173.4] Put root cert into agent trust store

| |-[169.254.173.3] Put combined certs into agent TS

| |-[169.254.173.3] Put signed agent CA cert

| |-[169.254.173.3] Put root cert into agent trust store

| |-[169.254.173.2] Put combined certs into agent TS

| |-[169.254.173.2] Put signed agent CA cert

| |-[169.254.173.2] Put root cert into agent trust store

| |-[0.0.0.0] Fetch installer cert

| +-[0.0.0.0] CertRenewSetupInstallationSsl PASS (18/35, 1

min 15 sec)

Dell Technologies – Restricted Use – Confidential & Subject to NDA

Page 16 of 56
 |-Restart Agent on all nodes

| |-[169.254.173.3] RestartAgent PASS (19/35)

| |-[169.254.173.1] RestartAgent PASS (20/35)

| |-[169.254.173.2] RestartAgent PASS (21/35)

| +-[169.254.173.4] RestartAgent PASS (22/35)

|-Remove LM containers on all nodes

| +-[0.0.0.0] RemoveLMContainers PASS (23/35, 3

sec)

|-Validate Agent health

| |-[169.254.173.4] ValidateAgentHealth PASS (24/35,

32 sec)

| |-[169.254.173.2] ValidateAgentHealth PASS (25/35,

32 sec)

| |-[169.254.173.3] ValidateAgentHealth PASS (26/35,

32 sec)

| +-[169.254.173.1] ValidateAgentHealth PASS (27/35,

32 sec)

|-Validate LM health

| +-[0.0.0.0] ValidateLMHealth PASS (28/35,

32 sec)

|-Put new root cert into lm

| |-[0.0.0.0] Clean fcli ssl files

| |-[0.0.0.0] Put root cert into LM

| |-[0.0.0.0] Set identity into LM

| |-[0.0.0.0] Fetch installer certs

| |-[0.0.0.0] Clean fcli ssl files

| +-[0.0.0.0] PutNewRootCertIntoLM PASS (29/35, 4

sec)

|-Validate Agent health

| |-[169.254.173.2] ValidateAgentHealth PASS (30/35, 1

sec)

| |-[169.254.173.4] ValidateAgentHealth PASS (31/35, 1

sec)

Dell Technologies – Restricted Use – Confidential & Subject to NDA

Page 17 of 56
 | |-[169.254.173.1] ValidateAgentHealth PASS (32/35, 1
sec)

| +-[169.254.173.3] ValidateAgentHealth PASS (33/35, 1

sec)

|-Validate LM health

| +-[0.0.0.0] ValidateLMHealth PASS (34/35, 1

sec)

+-Finish renew certificates procedure

+-[0.0.0.0] FinishRenewCertificates PASS (35/35)

Elapsed time is 2 min 53 sec.

RENEW_NOT_EXPIRED_CERTIFICATES completed successfully

20201213 23:04:46.638: | PASS (3 min 10 sec)

Refresh Certificates Restart Services

20201213 23:04:58.903: Refresh Certificates Restart Fabric Agent

20201213 23:04:58.905: | PASS

20201213 23:04:58.905: Refresh Certificates Restart Eventsvc

20201213 23:04:58.906: | PASS

20201213 23:04:58.907: Refresh Certificates Restart Telegraf

20201213 23:05:10.145: | PASS (11 sec)

20201213 23:05:10.146: Refresh Certificates Restart Service

Restarting objcontrolsvc

20201213 23:05:12.085: | PASS (1 sec)

Refresh Certificates Post Check

20201213 23:05:21.569: Run health check

20201213 23:05:21.573: | Validate zookeeper

20201213 23:05:39.362: | | PASS (17 sec)

20201213 23:05:39.364: | Validate that all nodes are available - Fabric

20201213 23:05:39.365: | | PASS

20201213 23:05:39.366: | Confirm that docker health is GOOD and docker exec works on
all nodes

Dell Technologies – Restricted Use – Confidential & Subject to NDA

Page 18 of 56
20201213 23:05:54.824: | | PASS (15 sec)

20201213 23:05:54.826: | Validate docker containers are running where they should be

20201213 23:06:03.975: | | PASS (9 sec)

20201213 23:06:03.979: | Validate the number of CPU cores

20201213 23:06:05.161: | | PASS (1 sec)

20201213 23:06:05.162: | Validate the amount of available physical RAM

20201213 23:06:06.385: | | PASS (1 sec)

20201213 23:06:06.386: | Validate swap space consumers

20201213 23:06:06.391: | | PASS

20201213 23:06:06.392: | Validate the required number and capacity of disks

20201213 23:06:09.600: | | PASS (3 sec)

20201213 23:06:09.602: | Validate that the internal/system disk is SSD

20201213 23:06:19.368: | | PASS (9 sec)

20201213 23:06:19.369: | Validate disks serial number uniqueness

20201213 23:06:19.387: | | PASS

20201213 23:06:19.388: | Validate that provisioned drives are GOOD

20201213 23:06:33.146: | | PASS (13 sec)

20201213 23:06:33.148: | Validate that expected number of drives is formatted for

Object

20201213 23:06:33.165: | | PASS

20201213 23:06:33.166: | Validate metadata/btree SSD read cache consistency

20201213 23:06:53.442: | | PASS (20 sec)

20201213 23:06:53.444: | Validate that the correct number of disks are mounted
inside the object container

20201213 23:06:59.514: | | PASS (6 sec)

20201213 23:06:59.515: | Validate file system and blockBins on formatted disks

20201213 23:07:01.215: | | PASS (1 sec)

20201213 23:07:01.217: | Validate that ports for fabric services are open

20201213 23:07:04.834: | | PASS (3 sec)

Dell Technologies – Restricted Use – Confidential & Subject to NDA

Page 19 of 56
20201213 23:07:04.835: | Validate API availability of fabric services

20201213 23:07:20.203: | | PASS (15 sec)

20201213 23:07:20.204: | Validate that there is cluster master

20201213 23:07:26.225: | | PASS (6 sec)

20201213 23:07:26.226: | Validate that all partitions are under control

20201213 23:08:41.108: | | PASS (1 min 14 sec)

20201213 23:08:41.110: | Validate services owner and that realized goalstates are
equal on LM and agents

20201213 23:09:26.698: | | PASS (45 sec)

20201213 23:09:26.700: | Validate services owner and that goalstates are equal on LM
and agents

20201213 23:10:07.056: | | PASS (40 sec)

20201213 23:10:07.058: | Validate that all lifecycles are active

20201213 23:10:08.638: | | PASS (1 sec)

20201213 23:10:08.640: | Validate applications and services health

20201213 23:10:24.849: | | PASS (16 sec)

20201213 23:10:24.851: | Validate object configuration files between nodes

20201213 23:10:27.326: | | PASS (2 sec)

20201213 23:10:27.328: | Validate event streams by sending agent health

20201213 23:10:46.265: | | PASS (18 sec)

20201213 23:10:46.268: | Validate application role operational mode

Skipped: unnecessary for ECS version 3.6.1.0.126650.5c60d3b2b8f

20201213 23:10:49.962: | | PASS (3 sec)

20201213 23:10:49.964: | Validate cluster compliance status

20201213 23:10:58.026: | | PASS (8 sec)

20201213 23:10:58.027: | Validate that diskset is the same for all disks and cache
files

20201213 23:11:02.907: | | PASS (4 sec)

20201213 23:11:02.908: | Validate ESRS connection

20201213 23:11:14.949: | | PASS (12 sec)

Dell Technologies – Restricted Use – Confidential & Subject to NDA

Page 20 of 56
20201213 23:11:14.950: | Validate HAL version

20201213 23:11:16.130: | | PASS (1 sec)

20201213 23:11:16.131: | Validate agent version

20201213 23:11:17.053: | | PASS

20201213 23:11:17.055: | Validate number of nodes with zookeeper

20201213 23:11:23.074: | | PASS (6 sec)

20201213 23:11:23.076: | Validate zookeeper database size

20201213 23:11:29.721: | | PASS (6 sec)

20201213 23:11:29.723: | Verify BIOS version

20201213 23:11:32.319: | | PASS (2 sec)

20201213 23:11:32.321: | Verify Fabric certificate

Certificate expiration date: Dec 13 23:02:15 2025 GMT

20201213 23:12:04.494: | | PASS (32 sec)

20201213 23:12:04.495: | Check ZK version consistency

20201213 23:12:05.906: | | PASS (1 sec)

20201213 23:12:05.909: | PASS (6 min 44 sec)

20201213 23:12:05.912: Validate that disks states are okay in SSM

20201213 23:18:24.881: | PASS (6 min 18 sec)

20201213 23:18:24.891: Run health check

20201213 23:18:24.897: | Check DT status

Checking DT status (with timeout 10 min).

20201213 23:18:48.026: | | PASS (23 sec)

20201213 23:18:48.028: | PASS (23 sec)

Refresh Certificates Remove Installer

20201213 23:18:56.492: Remove Installer if needed

Not needed.

20201213 23:18:56.528: | PASS

Refresh Certificates Teardown

================================================================================

Dell Technologies – Restricted Use – Confidential & Subject to NDA

Page 21 of 56
 Status: PASS

Time Elapsed: 33 min 41 sec

Debug log: /opt/emc/caspian/service-

console/log/20201213_224541_run_Refresh_Certificates/dbg_robot.log

HTML log: /opt/emc/caspian/service-

console/log/20201213_224541_run_Refresh_Certificates/log.html

================================================================================

[screen is terminating]

This command runs existing certinstaller or installs integrated certinstaller on an appropriate

node, which is the last node with Zoo Keeper(ZK) and without installer.
• Expired certificates renewal

admin@provo-shamrock:~> service-console run Refresh_Certificates --skip-check

'Validate that disks states are okay in SSM'

2026-12-14 00:13:35 main#1405 INFO: Redirecting console output to

/opt/emc/caspian/service-
console/log//20261214_001333_run_Refresh_Certificates/output.log

Procedure is running inside a 'screen' session. If you are disconnected, the procedure
will continue to run. To reconnect to your running procedure session in the future,
run 'screen -r service-console'

provo-shamrock 12/14 00:13

Service console version: 6.1.0.0-21205.0de50ff176

Debug log: /opt/emc/caspian/service-

console/log/20261214_001333_run_Refresh_Certificates/dbg_robot.log

================================================================================

Refresh Certificates Setup

20261214 00:14:21.937: Check Refresh Certificates options

Target node is not set

The local node 169.254.173.1 has installer installer-3.6.1.0-4218.3f6d49f.x86_64 on

it.

The node 169.254.173.1 already has manifest on it.

Using the local node as target.

20261214 00:14:24.290: | PASS (2 sec)

Refresh Certificates Pre Check

20261214 00:14:35.962: Run health check

Dell Technologies – Restricted Use – Confidential & Subject to NDA

Page 22 of 56
20261214 00:14:35.965: | Check Object version across the cluster

20261214 00:15:11.572: | | PASS (35 sec)

20261214 00:15:11.575: | Validate that OS version is equal between nodes

20261214 00:15:18.535: | | PASS (6 sec)

20261214 00:15:18.537: | PASS (42 sec)

20261214 00:15:18.537: Run health check

20261214 00:15:18.540: | Validate zookeeper

20261214 00:15:46.166: | | PASS (27 sec)

20261214 00:15:46.170: | Validate that all nodes are available - Fabric

20261214 00:15:46.172: | | PASS

20261214 00:15:46.172: | Confirm that docker health is GOOD and docker exec works on
all nodes

20261214 00:16:15.694: | | PASS (29 sec)

20261214 00:16:15.699: | Validate the number of CPU cores

20261214 00:16:17.196: | | PASS (1 sec)

20261214 00:16:17.197: | Validate the amount of available physical RAM

20261214 00:16:19.009: | | PASS (1 sec)

20261214 00:16:19.010: | Validate swap space consumers

20261214 00:16:19.016: | | PASS

20261214 00:16:19.017: | Validate the required number and capacity of disks

20261214 00:16:22.746: | | PASS (3 sec)

20261214 00:16:22.748: | Validate that the internal/system disk is SSD

20261214 00:16:32.954: | | PASS (10 sec)

20261214 00:16:32.955: | Validate disks serial number uniqueness

20261214 00:16:32.969: | | PASS

20261214 00:16:32.972: | Validate that provisioned drives are GOOD

20261214 00:16:48.287: | | PASS (15 sec)

20261214 00:16:48.289: | Validate that expected number of drives is formatted for

Object

Dell Technologies – Restricted Use – Confidential & Subject to NDA

Page 23 of 56
20261214 00:16:48.306: | | PASS

20261214 00:16:48.307: | Validate metadata/btree SSD read cache consistency

20261214 00:17:19.159: | | PASS (30 sec)

20261214 00:17:19.241: | Validate that the correct number of disks are mounted
inside the object container

20261214 00:17:29.760: | | PASS (10 sec)

20261214 00:17:29.761: | Validate file system and blockBins on formatted disks

20261214 00:17:33.265: | | PASS (3 sec)

20261214 00:17:33.267: | Validate that ports for fabric services are open

20261214 00:17:38.380: | | PASS (5 sec)

20261214 00:17:38.381: | Validate that all partitions are under control

20261214 00:19:27.371: | | PASS (1 min 48 sec)

20261214 00:19:27.378: | Validate that all lifecycles are active

20261214 00:19:29.395: | | PASS (2 sec)

20261214 00:19:29.397: | Validate applications and services health

20261214 00:19:51.893: | | PASS (22 sec)

20261214 00:19:51.896: | Validate object configuration files between nodes

20261214 00:19:55.801: | | PASS (3 sec)

20261214 00:19:55.803: | Validate application role operational mode

Skipped: unnecessary for ECS version 3.6.1.0.126650.5c60d3b2b8f

20261214 00:20:01.956: | | PASS (6 sec)

20261214 00:20:01.958: | Validate that diskset is the same for all disks and cache
files

20261214 00:20:08.238: | | PASS (6 sec)

20261214 00:20:08.239: | Validate HAL version

20261214 00:20:09.964: | | PASS (1 sec)

20261214 00:20:09.965: | Validate agent version

20261214 00:20:11.197: | | PASS (1 sec)

20261214 00:20:11.198: | Validate number of nodes with zookeeper

20261214 00:20:17.232: | | PASS (6 sec)

Dell Technologies – Restricted Use – Confidential & Subject to NDA

Page 24 of 56
20261214 00:20:17.233: | Validate zookeeper database size

20261214 00:20:22.237: | | PASS (5 sec)

20261214 00:20:22.239: | Verify BIOS version

20261214 00:20:25.938: | | PASS (3 sec)

20261214 00:20:25.939: | Check ZK version consistency

20261214 00:20:28.034: | | PASS (2 sec)

20261214 00:20:28.036: | PASS (5 min 9 sec)

20261214 00:20:28.037: Check if fabric certificates are already expired

[WARN] Can't get LM identity. Probably Fabric certificate was expired

[WARN] Most probably fabric certificates are expired.

20261214 00:20:32.460: | PASS (4 sec)

20261214 00:20:32.462: Validate that disks states are okay in SSM

Skipped as requested by the user

20261214 00:20:32.464: | PASS

Refresh Certificates Install Installer

20261214 00:20:40.171: Install Installer if needed

Not needed

20261214 00:20:40.236: | PASS

Refresh Certificates Run Installer

20261214 00:20:47.856: Check if fabric certificates are already expired

[WARN] Can't get LM identity. Probably Fabric certificate was expired

[WARN] Most probably fabric certificates are expired.

20261214 00:20:52.308: | PASS (4 sec)

20261214 00:20:52.316: Refresh Certificates Run Installer

Initializing...

ALARM: Silent node provo-shamrock.ecs.lab.emc.com [169.254.173.1] detected.

Dell Technologies – Restricted Use – Confidential & Subject to NDA

Page 25 of 56
 ALARM: Silent node ogden-shamrock.ecs.lab.emc.com [169.254.173.4] detected.

ALARM: Silent node orem-shamrock.ecs.lab.emc.com [169.254.173.3] detected.

ALARM: Silent node sandy-shamrock.ecs.lab.emc.com [169.254.173.2] detected.

Executing Program: RENEW_EXPIRED_CERTIFICATES

|-Check is previous run was finished

| +-[0.0.0.0] CheckPreviousRun PASS (1/37)

|-Stop Agent on all nodes

| |-[169.254.173.4] StopAgent PASS (2/37)

| |-[169.254.173.2] StopAgent PASS (3/37, 1

sec)

| |-[169.254.173.1] StopAgent PASS (4/37, 1

sec)

| +-[169.254.173.3] StopAgent PASS (5/37, 1

sec)

|-Remove LM containers on all nodes

| +-[0.0.0.0] RemoveLMContainers PASS (6/37, 5

sec)

|-Clean agent certificates files

| |-[169.254.173.2] CleanAgentCertificatesFiles PASS (7/37)

| |-[169.254.173.4] CleanAgentCertificatesFiles PASS (8/37)

| |-[169.254.173.1] CleanAgentCertificatesFiles PASS (9/37)

| +-[169.254.173.3] CleanAgentCertificatesFiles PASS (10/37, 1

sec)

Dell Technologies – Restricted Use – Confidential & Subject to NDA

Page 26 of 56
 |-Remove cluster certificates from ZK directly

| +-[0.0.0.0] CertRenewRemoveClusterCertificatesFromZKDirectly PASS (11/37)

|-Create empty serial.json file

| |-[169.254.173.2] CreateEmptySerialJson PASS (12/37)

| |-[169.254.173.4] CreateEmptySerialJson PASS (13/37)

| |-[169.254.173.1] CreateEmptySerialJson PASS (14/37)

| +-[169.254.173.3] CreateEmptySerialJson PASS (15/37)

|-Start Agent on all nodes

| |-[169.254.173.2] StartAgent PASS (16/37)

| |-[169.254.173.1] StartAgent PASS (17/37)

| |-[169.254.173.4] StartAgent PASS (18/37)

| +-[169.254.173.3] StartAgent PASS (19/37)

|-Check agent port

| |-[169.254.173.2] CheckIfAgentPortIsOpen PASS (20/37,

20 sec)

| |-[169.254.173.4] CheckIfAgentPortIsOpen PASS (21/37,

20 sec)

| |-[169.254.173.1] CheckIfAgentPortIsOpen PASS (22/37,

30 sec)

| +-[169.254.173.3] CheckIfAgentPortIsOpen PASS (23/37,

40 sec)

|-Setup Installation SSL

| |-[0.0.0.0] Clean up installer security data folder

| |-[0.0.0.0] Create Cluster/Root CA

| |-[0.0.0.0] Sign installer cert

| |-[169.254.173.1] Put combined certs into agent TS

| |-[169.254.173.1] Put signed agent CA cert

| |-[169.254.173.1] Put root cert into agent trust store

| |-[169.254.173.4] Put combined certs into agent TS

| |-[169.254.173.4] Put signed agent CA cert

| |-[169.254.173.4] Put root cert into agent trust store

Dell Technologies – Restricted Use – Confidential & Subject to NDA

Page 27 of 56
 | |-[169.254.173.3] Put combined certs into agent TS

| |-[169.254.173.3] Put signed agent CA cert

| |-[169.254.173.3] Put root cert into agent trust store

| |-[169.254.173.2] Put combined certs into agent TS

| |-[169.254.173.2] Put signed agent CA cert

| |-[169.254.173.2] Put root cert into agent trust store

| |-[0.0.0.0] Fetch installer cert

| +-[0.0.0.0] CertRenewSetupInstallationSsl PASS (24/37, 1

min 20 sec)

|-Validate Agent health

| |-[169.254.173.1] ValidateAgentHealth PASS (25/37, 2

sec)

| |-[169.254.173.4] ValidateAgentHealth PASS (26/37, 2

sec)

| |-[169.254.173.2] ValidateAgentHealth PASS (27/37, 2

sec)

| +-[169.254.173.3] ValidateAgentHealth PASS (28/37, 2

sec)

|-Remove LM containers on all nodes

| +-[0.0.0.0] RemoveLMContainers PASS (29/37, 5

sec)

|-Validate LM health

| +-[0.0.0.0] ValidateLMHealth PASS (30/37, 1

min 32 sec)

|-Put new root cert into lm

| |-[0.0.0.0] Clean fcli ssl files

| |-[0.0.0.0] Put root cert into LM

| |-[0.0.0.0] Set identity into LM

| |-[0.0.0.0] Fetch installer certs

| |-[0.0.0.0] Clean fcli ssl files

| +-[0.0.0.0] PutNewRootCertIntoLM PASS (31/37, 2

sec)

Dell Technologies – Restricted Use – Confidential & Subject to NDA

Page 28 of 56
 |-Validate Agent health

| |-[169.254.173.1] ValidateAgentHealth PASS (32/37, 1

sec)

| |-[169.254.173.2] ValidateAgentHealth PASS (33/37, 1

sec)

| |-[169.254.173.4] ValidateAgentHealth PASS (34/37, 1

sec)

| +-[169.254.173.3] ValidateAgentHealth PASS (35/37, 1

sec)

|-Validate LM health

| +-[0.0.0.0] ValidateLMHealth PASS (36/37, 1

sec)

+-Finish renew certificates procedure

+-[0.0.0.0] FinishRenewCertificates PASS (37/37)

Elapsed time is 3 min 55 sec.

RENEW_EXPIRED_CERTIFICATES completed successfully

20261214 00:25:13.336: | PASS (4 min 21 sec)

Refresh Certificates Restart Services

20261214 00:25:24.594: Refresh Certificates Restart Fabric Agent

20261214 00:25:24.595: | PASS

20261214 00:25:24.596: Refresh Certificates Restart Eventsvc

20261214 00:25:24.596: | PASS

20261214 00:25:24.597: Refresh Certificates Restart Telegraf

20261214 00:25:38.777: | PASS (14 sec)

20261214 00:25:38.778: Refresh Certificates Restart Service

Restarting objcontrolsvc

20261214 00:25:40.623: | PASS (1 sec)

Refresh Certificates Post Check

20261214 00:25:50.055: Run health check

20261214 00:25:50.058: | Validate zookeeper

Dell Technologies – Restricted Use – Confidential & Subject to NDA

Page 29 of 56
20261214 00:26:07.881: | | PASS (17 sec)

20261214 00:26:07.883: | Validate that all nodes are available - Fabric

20261214 00:26:07.884: | | PASS

20261214 00:26:07.885: | Confirm that docker health is GOOD and docker exec works on
all nodes

20261214 00:26:23.303: | | PASS (15 sec)

20261214 00:26:23.305: | Validate docker containers are running where they should be

20261214 00:26:32.415: | | PASS (9 sec)

20261214 00:26:32.417: | Validate the number of CPU cores

20261214 00:26:33.551: | | PASS (1 sec)

20261214 00:26:33.552: | Validate the amount of available physical RAM

20261214 00:26:34.675: | | PASS (1 sec)

20261214 00:26:34.677: | Validate swap space consumers

20261214 00:26:34.682: | | PASS

20261214 00:26:34.683: | Validate the required number and capacity of disks

20261214 00:26:37.898: | | PASS (3 sec)

20261214 00:26:37.899: | Validate that the internal/system disk is SSD

20261214 00:26:45.574: | | PASS (7 sec)

20261214 00:26:45.576: | Validate disks serial number uniqueness

20261214 00:26:45.590: | | PASS

20261214 00:26:45.591: | Validate that provisioned drives are GOOD

20261214 00:26:55.544: | | PASS (9 sec)

20261214 00:26:55.546: | Validate that expected number of drives is formatted for

Object

20261214 00:26:55.558: | | PASS

20261214 00:26:55.559: | Validate metadata/btree SSD read cache consistency

20261214 00:27:14.727: | | PASS (19 sec)

20261214 00:27:14.730: | Validate that the correct number of disks are mounted
inside the object container

20261214 00:27:20.723: | | PASS (5 sec)

Dell Technologies – Restricted Use – Confidential & Subject to NDA

Page 30 of 56
20261214 00:27:20.725: | Validate file system and blockBins on formatted disks

20261214 00:27:22.634: | | PASS (1 sec)

20261214 00:27:22.636: | Validate that ports for fabric services are open

20261214 00:27:25.945: | | PASS (3 sec)

20261214 00:27:25.947: | Validate API availability of fabric services

20261214 00:27:38.247: | | PASS (12 sec)

20261214 00:27:38.249: | Validate that there is cluster master

20261214 00:27:43.281: | | PASS (5 sec)

20261214 00:27:43.283: | Validate that all partitions are under control

20261214 00:28:50.094: | | PASS (1 min 6 sec)

20261214 00:28:50.100: | Validate services owner and that realized goalstates are
equal on LM and agents

20261214 00:29:31.359: | | PASS (41 sec)

20261214 00:29:31.365: | Validate services owner and that goalstates are equal on LM
and agents

20261214 00:30:09.682: | | PASS (38 sec)

20261214 00:30:09.685: | Validate that all lifecycles are active

20261214 00:30:11.343: | | PASS (1 sec)

20261214 00:30:11.344: | Validate applications and services health

20261214 00:30:26.496: | | PASS (15 sec)

20261214 00:30:26.498: | Validate object configuration files between nodes

20261214 00:30:28.739: | | PASS (2 sec)

20261214 00:30:28.740: | Validate event streams by sending agent health

20261214 00:30:46.382: | | PASS (17 sec)

20261214 00:30:46.384: | Validate application role operational mode

Skipped: unnecessary for ECS version 3.6.1.0.126650.5c60d3b2b8f

20261214 00:30:49.901: | | PASS (3 sec)

20261214 00:30:49.902: | Validate cluster compliance status

WARNING Compliance status is: NON_COMPLIANT

20261214 00:30:56.952: | | PASS (7 sec)

Dell Technologies – Restricted Use – Confidential & Subject to NDA

Page 31 of 56
20261214 00:30:56.954: | Validate that diskset is the same for all disks and cache
files

20261214 00:31:00.828: | | PASS (3 sec)

20261214 00:31:00.830: | Validate ESRS connection

20261214 00:31:12.870: | | PASS (12 sec)

20261214 00:31:12.872: | Validate HAL version

20261214 00:31:13.953: | | PASS (1 sec)

20261214 00:31:13.954: | Validate agent version

20261214 00:31:14.808: | | PASS

20261214 00:31:14.810: | Validate number of nodes with zookeeper

20261214 00:31:19.827: | | PASS (5 sec)

20261214 00:31:19.829: | Validate zookeeper database size

20261214 00:31:25.418: | | PASS (5 sec)

20261214 00:31:25.419: | Verify BIOS version

20261214 00:31:27.814: | | PASS (2 sec)

20261214 00:31:27.816: | Verify Fabric certificate

Certificate expiration date: Dec 14 00:22:07 2031 GMT

20261214 00:31:56.503: | | PASS (28 sec)

20261214 00:31:56.510: | Check ZK version consistency

20261214 00:31:57.892: | | PASS (1 sec)

20261214 00:31:57.894: | PASS (6 min 7 sec)

20261214 00:31:57.898: Validate that disks states are okay in SSM

Skipped as requested by the user

20261214 00:31:57.899: | PASS

20261214 00:31:57.901: Run health check

20261214 00:31:57.903: | Check DT status

Checking DT status (with timeout 10 min).

20261214 00:32:18.443: | | PASS (20 sec)

20261214 00:32:18.446: | PASS (20 sec)

Dell Technologies – Restricted Use – Confidential & Subject to NDA

Page 32 of 56
 Refresh Certificates Remove Installer

20261214 00:32:26.775: Remove Installer if needed

Not needed.

20261214 00:32:26.785: | PASS

Refresh Certificates Teardown

================================================================================

Status: PASS

Time Elapsed: 19 min 13 sec

Debug log: /opt/emc/caspian/service-

console/log/20261214_001333_run_Refresh_Certificates/dbg_robot.log

HTML log: /opt/emc/caspian/service-

console/log/20261214_001333_run_Refresh_Certificates/log.html

================================================================================

[screen is terminating]

This command installs certinstaller on the given node, which is the node with ZK and without
installer.

• Output with --exclude option

/opt/emc/bin/service-console run Refresh_Certificates --exclude 169.254.173.3

Service Console is running on node 169.254.173.1 (suite

20260607_014114_Refresh_Certificates)

Service console version: 6.3.0.0-21226.63b0f97cee

Debug log: /opt/emc/caspian/service-

console/log/20260607_014111_run_Refresh_Certificates/dbg_robot.log

================================================================================

Refresh Certificates Setup

20260607 01:41:47.636: Check Refresh Certificates options

Target node is not set

The local node 169.254.173.1 has installer installer-3.6.1.0-4224.f693543.x86_64 on

it.

The node 169.254.173.1 already has manifest on it.

Using the local node as target.

Dell Technologies – Restricted Use – Confidential & Subject to NDA

Page 33 of 56
20260607 01:41:49.134: | PASS (1 sec)

Refresh Certificates Pre Check

20260607 01:41:55.369: Run health check

20260607 01:41:55.371: | Check Object version across the cluster

20260607 01:42:24.121: | | PASS (28 sec)

20260607 01:42:24.123: | Validate that OS version is equal between nodes

20260607 01:42:27.313: | | PASS (3 sec)

20260607 01:42:27.315: | PASS (31 sec)

20260607 01:42:27.316: Run health check

20260607 01:42:27.319: | Validate zookeeper

20260607 01:42:44.153: | | PASS (16 sec)

20260607 01:42:44.154: | Validate that all nodes are available - Fabric

20260607 01:42:44.156: | | PASS

20260607 01:42:44.156: | Confirm that docker health is GOOD and docker exec works on
all nodes

20260607 01:42:59.403: | | PASS (15 sec)

20260607 01:42:59.405: | Validate the number of CPU cores

20260607 01:43:00.072: | | PASS

20260607 01:43:00.074: | Validate the amount of available physical RAM

20260607 01:43:00.699: | | PASS

20260607 01:43:00.700: | Validate swap space consumers

20260607 01:43:00.706: | | PASS

20260607 01:43:00.707: | Validate the required number and capacity of disks

20260607 01:43:02.736: | | PASS (2 sec)

20260607 01:43:02.737: | Validate that the internal/system disk is SSD

20260607 01:43:07.176: | | PASS (4 sec)

20260607 01:43:07.177: | Validate disks serial number uniqueness

20260607 01:43:07.188: | | PASS

20260607 01:43:07.189: | Validate that provisioned drives are GOOD

Dell Technologies – Restricted Use – Confidential & Subject to NDA

Page 34 of 56
[WARN] On node 169.254.173.2, Disk /dev/sdd is SUSPECT, skipping its validation

[WARN] On node 169.254.173.2, Disk /dev/sde is SUSPECT, skipping its validation

[WARN] On node 169.254.173.1, Disk /dev/sdg is FAILED, skipping its validation

[WARN] On node 169.254.173.1, Disk /dev/sdo is FAILED, skipping its validation

20260607 01:43:14.709: | | PASS (7 sec)

20260607 01:43:14.710: | Validate that expected number of drives is formatted for

Object

20260607 01:43:14.723: | | PASS

20260607 01:43:14.724: | Validate metadata/btree SSD read cache consistency

20260607 01:43:44.633: | | PASS (29 sec)

20260607 01:43:44.634: | Validate that the correct number of disks are mounted
inside the object container

20260607 01:43:50.022: | | PASS (5 sec)

20260607 01:43:50.028: | Validate file system and blockBins on formatted disks

20260607 01:43:51.341: | | PASS (1 sec)

20260607 01:43:51.342: | Validate that all lifecycles are active

20260607 01:43:53.144: | | PASS (1 sec)

20260607 01:43:53.146: | Validate applications and services health

20260607 01:44:09.284: | | PASS (16 sec)

20260607 01:44:09.286: | Validate object configuration files between nodes

20260607 01:44:11.270: | | PASS (1 sec)

20260607 01:44:11.273: | Validate application role operational mode

Skipped: unnecessary for ECS version 3.6.1.0.126794.5fc9fc1e5a7

20260607 01:44:28.305: | | PASS (17 sec)

20260607 01:44:28.307: | Validate that diskset is the same for all disks and cache
files

20260607 01:44:33.094: | | PASS (4 sec)

20260607 01:44:33.096: | Validate HAL version

20260607 01:44:33.843: | | PASS

20260607 01:44:33.844: | Validate agent version

Dell Technologies – Restricted Use – Confidential & Subject to NDA

Page 35 of 56
20260607 01:44:34.558: | | PASS

20260607 01:44:34.560: | Validate number of nodes with zookeeper

20260607 01:44:39.582: | | PASS (5 sec)

20260607 01:44:39.584: | Validate zookeeper database size

20260607 01:44:46.019: | | PASS (6 sec)

20260607 01:44:46.020: | Verify BIOS version

20260607 01:44:48.142: | | PASS (2 sec)

20260607 01:44:48.144: | Check ZK version consistency

20260607 01:44:49.002: | | PASS

20260607 01:44:49.004: | PASS (2 min 21 sec)

20260607 01:44:49.004: Check if fabric certificates are already expired

[WARN] Can't get LM identity. Probably Fabric certificate was expired

[WARN] Most probably fabric certificates are expired.

20260607 01:44:53.856: | PASS (4 sec)

20260607 01:44:53.859: Validate that disks states are okay in SSM

[WARN] Mismatch in disk UUID between HAL and Fabric 0c2c2bee-995d-458e-b97b-

d13185e1e306

[WARN] Mismatch in disk UUID between HAL and Fabric e1339315-8e97-4aa5-b34f-

7256fefa70d3

[WARN] On node 169.254.173.1, the partition 0c2c2bee-995d-458e-b97b-d13185e1e306 has

state PD Removed/PD Removed

[WARN] On node 169.254.173.1, the partition e1339315-8e97-4aa5-b34f-7256fefa70d3 has

state PD Removed/PD Removed

[WARN] On node 169.254.173.1, the partition 7a2372cb-216b-4015-a097-a044cdcd5576 has

state PD Removed/PD Removed

[WARN] Mismatch in disk UUID between HAL and Fabric b416624a-0370-4658-ac55-

446bfe3c7eac

[WARN] Mismatch in disk UUID between HAL and Fabric 05d67a9f-d31a-475f-9f36-

ee99d76d6135

[WARN] On node 169.254.173.2, the partition b416624a-0370-4658-ac55-446bfe3c7eac has

state PD Removed/PD Removed

[WARN] On node 169.254.173.2, the partition 94ac609b-2a04-43ef-a05b-a1d3e4369690 has

state PD Removed/PD Removed

Dell Technologies – Restricted Use – Confidential & Subject to NDA

Page 36 of 56
[WARN] On node 169.254.173.2, the partition 05d67a9f-d31a-475f-9f36-ee99d76d6135 has
state PD Removed/PD Removed

[WARN] On node 169.254.173.4, the partition d5c9baff-2b44-44bf-83ec-2051b8649fa8 has

state PD Removed/PD Removed

20260607 01:49:51.680: | PASS (4 min 57 sec)

Refresh Certificates Install Installer

20260607 01:49:58.906: Install Installer if needed

Not needed

20260607 01:49:58.919: | PASS

Refresh Certificates Run Installer

20260607 01:50:08.181: Check if fabric certificates are already expired

[WARN] Can't get LM identity. Probably Fabric certificate was expired

[WARN] Most probably fabric certificates are expired.

20260607 01:50:14.153: | PASS (5 sec)

20260607 01:50:14.155: Refresh Certificates Run Installer

Initializing...

ALARM: Silent node ogden-shamrock.ecs.lab.emc.com [169.254.173.4] detected.

ALARM: Silent node provo-shamrock.ecs.lab.emc.com [169.254.173.1] detected.

ALARM: Silent node sandy-shamrock.ecs.lab.emc.com [169.254.173.2] detected.

ALARM: Silent node orem-shamrock.ecs.lab.emc.com [169.254.173.3] detected.

Executing Program: RENEW_EXPIRED_CERTIFICATES

Dell Technologies – Restricted Use – Confidential & Subject to NDA

Page 37 of 56
 |-Check excluded nodes

| +-[0.0.0.0] CheckExcludedNodes PASS (1/38, 11

sec)

|-Check is previous run was finished

| +-[0.0.0.0] CheckPreviousRun PASS (2/38)

|-Stop Agent on all nodes

| |-[169.254.173.4] StopAgent PASS (3/38)

| |-[169.254.173.1] StopAgent PASS (4/38)

| +-[169.254.173.2] StopAgent PASS (5/38, 1

sec)

|-Remove LM containers on all nodes

| +-[0.0.0.0] RemoveLMContainers PASS (6/38, 2

sec)

|-Clean agent certificates files

| |-[169.254.173.2] CleanAgentCertificatesFiles PASS (7/38)

| |-[169.254.173.1] CleanAgentCertificatesFiles PASS (8/38)

| +-[169.254.173.4] CleanAgentCertificatesFiles PASS (9/38)

|-Remove cluster certificates from ZK directly

| +-[0.0.0.0] CertRenewRemoveClusterCertificatesFromZKDirectly PASS (10/38)

|-Create empty serial.json file

| |-[169.254.173.1] CreateEmptySerialJson PASS (11/38)

| |-[169.254.173.4] CreateEmptySerialJson PASS (12/38)

| +-[169.254.173.2] CreateEmptySerialJson PASS (13/38)

|-Start Agent on all nodes

| |-[169.254.173.2] StartAgent PASS (14/38)

| |-[169.254.173.4] StartAgent PASS (15/38)

| +-[169.254.173.1] StartAgent PASS (16/38)

|-Check agent port

Dell Technologies – Restricted Use – Confidential & Subject to NDA

Page 38 of 56
 | |-[169.254.173.1] CheckIfAgentPortIsOpen PASS (17/38,
20 sec)

| |-[169.254.173.2] CheckIfAgentPortIsOpen PASS (18/38,

20 sec)

| +-[169.254.173.4] CheckIfAgentPortIsOpen PASS (19/38,

20 sec)

|-Setup Installation SSL

| |-[0.0.0.0] Clean up installer security data folder

| |-[0.0.0.0] Create Cluster/Root CA

| |-[0.0.0.0] Sign installer cert

| |-[169.254.173.4] Put combined certs into agent TS

| |-[169.254.173.4] Put signed agent CA cert

| |-[169.254.173.4] Put root cert into agent trust store

| |-[169.254.173.1] Put combined certs into agent TS

| |-[169.254.173.1] Put signed agent CA cert

| |-[169.254.173.1] Put root cert into agent trust store

| |-[169.254.173.2] Put combined certs into agent TS

| |-[169.254.173.2] Put signed agent CA cert

| |-[169.254.173.2] Put root cert into agent trust store

| |-[0.0.0.0] Fetch installer cert

| +-[0.0.0.0] CertRenewSetupInstallationSsl PASS (20/38,

47 sec)

|-Validate Agent health

| |-[169.254.173.1] ValidateAgentHealth PASS (21/38, 1

sec)

| |-[169.254.173.2] ValidateAgentHealth PASS (22/38, 2

sec)

| +-[169.254.173.4] ValidateAgentHealth PASS (23/38, 2

sec)

|-Remove LM containers on all nodes

| +-[0.0.0.0] RemoveLMContainers PASS (24/38, 2

sec)

|-Validate LM health

Dell Technologies – Restricted Use – Confidential & Subject to NDA

Page 39 of 56
 | +-[0.0.0.0] ValidateLMHealth PASS (25/38, 1
min 32 sec)

|-Put new root cert into lm

| |-[0.0.0.0] Clean fcli ssl files

| |-[0.0.0.0] Put root cert into LM

| |-[0.0.0.0] Set identity into LM

| |-[0.0.0.0] Fetch installer certs

| |-[0.0.0.0] Clean fcli ssl files

| +-[0.0.0.0] PutNewRootCertIntoLM PASS (26/38, 1

sec)

|-Validate Agent health

| |-[169.254.173.4] ValidateAgentHealth PASS (27/38)

| |-[169.254.173.2] ValidateAgentHealth PASS (28/38)

| +-[169.254.173.1] ValidateAgentHealth PASS (29/38)

|-Validate LM health

| +-[0.0.0.0] ValidateLMHealth PASS (30/38, 1

sec)

+-Finish renew certificates procedure

+-[0.0.0.0] FinishRenewCertificates PASS (31/38)

Elapsed time is 3 min 5 sec.

RENEW_EXPIRED_CERTIFICATES completed successfully

20260607 01:53:42.591: | PASS (3 min 28 sec)

Refresh Certificates Restart Services

20260607 01:53:51.641: Refresh Certificates Restart Fabric Agent

20260607 01:53:51.642: | PASS

20260607 01:53:51.642: Refresh Certificates Restart Eventsvc

20260607 01:53:51.643: | PASS

20260607 01:53:51.644: Refresh Certificates Restart Telegraf

20260607 01:54:06.786: | PASS (15 sec)

Dell Technologies – Restricted Use – Confidential & Subject to NDA

Page 40 of 56
20260607 01:54:06.787: Refresh Certificates Restart Service

Restarting objcontrolsvc

20260607 01:54:08.126: | PASS (1 sec)

Refresh Certificates Post Check

20260607 01:54:16.432: Run health check

20260607 01:54:16.435: | Validate zookeeper

20260607 01:54:32.550: | | PASS (16 sec)

20260607 01:54:32.551: | Validate that all nodes are available - Fabric

20260607 01:54:32.553: | | PASS

20260607 01:54:32.554: | Confirm that docker health is GOOD and docker exec works on
all nodes

20260607 01:54:48.841: | | PASS (16 sec)

20260607 01:54:48.842: | Validate docker containers are running where they should be

20260607 01:54:56.927: | | PASS (8 sec)

20260607 01:54:56.929: | Validate the number of CPU cores

20260607 01:54:57.665: | | PASS

20260607 01:54:57.667: | Validate the amount of available physical RAM

20260607 01:54:58.373: | | PASS

20260607 01:54:58.375: | Validate swap space consumers

20260607 01:54:58.379: | | PASS

20260607 01:54:58.380: | Validate the required number and capacity of disks

20260607 01:55:00.511: | | PASS (2 sec)

20260607 01:55:00.513: | Validate that the internal/system disk is SSD

20260607 01:55:05.964: | | PASS (5 sec)

20260607 01:55:05.965: | Validate disks serial number uniqueness

20260607 01:55:05.975: | | PASS

20260607 01:55:05.976: | Validate that provisioned drives are GOOD

[WARN] On node 169.254.173.2, Disk /dev/sdd is SUSPECT, skipping its validation

[WARN] On node 169.254.173.2, Disk /dev/sde is SUSPECT, skipping its validation

Dell Technologies – Restricted Use – Confidential & Subject to NDA

Page 41 of 56
[WARN] On node 169.254.173.1, Disk /dev/sdg is FAILED, skipping its validation

[WARN] On node 169.254.173.1, Disk /dev/sdo is FAILED, skipping its validation

20260607 01:55:13.040: | | PASS (7 sec)

20260607 01:55:13.041: | Validate that expected number of drives is formatted for

Object

20260607 01:55:13.050: | | PASS

20260607 01:55:13.051: | Validate metadata/btree SSD read cache consistency

20260607 01:55:42.020: | | PASS (28 sec)

20260607 01:55:42.023: | Validate that the correct number of disks are mounted
inside the object container

20260607 01:55:45.956: | | PASS (3 sec)

20260607 01:55:45.957: | Validate file system and blockBins on formatted disks

20260607 01:55:46.987: | | PASS (1 sec)

20260607 01:55:46.988: | Validate that ports for fabric services are open

20260607 01:55:48.920: | | PASS (1 sec)

20260607 01:55:48.922: | Validate API availability of fabric services

20260607 01:56:00.154: | | PASS (11 sec)

20260607 01:56:00.156: | Validate that there is cluster master

20260607 01:56:06.174: | | PASS (6 sec)

20260607 01:56:06.176: | Validate that all partitions are under control

20260607 01:57:14.120: | | PASS (1 min 7 sec)

20260607 01:57:14.122: | Validate services owner and that realized goalstates are
equal on LM and agents

[WARN] Agent UUIDs diff between manifest and cluster level realizedgoalstate:
d8c4e34f-cd53-4275-b248-957103c674b5

20260607 01:57:46.480: | | PASS (32 sec)

20260607 01:57:46.482: | Validate services owner and that goalstates are equal on LM
and agents

[WARN] Agent UUIDs diff between manifest and cluster level goalstate: d8c4e34f-cd53-
4275-b248-957103c674b5

20260607 01:58:16.707: | | PASS (30 sec)

Dell Technologies – Restricted Use – Confidential & Subject to NDA

Page 42 of 56
20260607 01:58:16.709: | Validate that all lifecycles are active

20260607 01:58:18.104: | | PASS (1 sec)

20260607 01:58:18.105: | Validate applications and services health

20260607 01:58:29.230: | | PASS (11 sec)

20260607 01:58:29.231: | Validate object configuration files between nodes

20260607 01:58:31.009: | | PASS (1 sec)

20260607 01:58:31.011: | Validate event streams by sending agent health

20260607 01:58:47.856: | | PASS (16 sec)

20260607 01:58:47.858: | Validate application role operational mode

Skipped: unnecessary for ECS version 3.6.1.0.126794.5fc9fc1e5a7

20260607 01:59:05.916: | | PASS (18 sec)

20260607 01:59:05.917: | Validate cluster compliance status

20260607 01:59:11.967: | | PASS (6 sec)

20260607 01:59:11.969: | Validate that diskset is the same for all disks and cache
files

20260607 01:59:14.595: | | PASS (2 sec)

20260607 01:59:14.596: | Validate ESRS connection

20260607 01:59:24.627: | | PASS (10 sec)

20260607 01:59:24.628: | Validate HAL version

20260607 01:59:25.339: | | PASS

20260607 01:59:25.340: | Validate agent version

20260607 01:59:25.995: | | PASS

20260607 01:59:25.996: | Validate number of nodes with zookeeper

20260607 01:59:31.018: | | PASS (5 sec)

20260607 01:59:31.021: | Validate zookeeper database size

20260607 02:02:47.630: | | PASS (3 min 16 sec)

20260607 02:02:47.631: | Verify BIOS version

20260607 02:02:49.477: | | PASS (1 sec)

20260607 02:02:49.479: | Verify Fabric certificate

Dell Technologies – Restricted Use – Confidential & Subject to NDA

Page 43 of 56
Certificate expiration date: Jun 7 01:51:14 2031 GMT

20260607 02:03:13.561: | | PASS (24 sec)

20260607 02:03:13.563: | Check ZK version consistency

20260607 02:03:14.360: | | PASS

20260607 02:03:14.362: | PASS (8 min 57 sec)

20260607 02:03:14.366: Validate that disks states are okay in SSM

[WARN] Mismatch in disk UUID between HAL and Fabric 0c2c2bee-995d-458e-b97b-

d13185e1e306

[WARN] Mismatch in disk UUID between HAL and Fabric e1339315-8e97-4aa5-b34f-

7256fefa70d3

[WARN] On node 169.254.173.1, the partition 0c2c2bee-995d-458e-b97b-d13185e1e306 has

state PD Removed/PD Removed

[WARN] On node 169.254.173.1, the partition e1339315-8e97-4aa5-b34f-7256fefa70d3 has

state PD Removed/PD Removed

[WARN] On node 169.254.173.1, the partition 7a2372cb-216b-4015-a097-a044cdcd5576 has

state PD Removed/PD Removed

[WARN] Mismatch in disk UUID between HAL and Fabric b416624a-0370-4658-ac55-

446bfe3c7eac

[WARN] Mismatch in disk UUID between HAL and Fabric 05d67a9f-d31a-475f-9f36-

ee99d76d6135

[WARN] On node 169.254.173.2, the partition b416624a-0370-4658-ac55-446bfe3c7eac has

state PD Removed/PD Removed

[WARN] On node 169.254.173.2, the partition 94ac609b-2a04-43ef-a05b-a1d3e4369690 has

state PD Removed/PD Removed

[WARN] On node 169.254.173.2, the partition 05d67a9f-d31a-475f-9f36-ee99d76d6135 has

state PD Removed/PD Removed

[WARN] On node 169.254.173.4, the partition d5c9baff-2b44-44bf-83ec-2051b8649fa8 has

state PD Removed/PD Removed

20260607 02:07:08.767: | PASS (3 min 54 sec)

20260607 02:07:08.771: Run health check

20260607 02:07:08.774: | Check DT status

Checking DT status (with timeout 10 min).

20260607 02:07:26.531: | | PASS (17 sec)

20260607 02:07:26.532: | PASS (17 sec)

Dell Technologies – Restricted Use – Confidential & Subject to NDA

Page 44 of 56
 Refresh Certificates Remove Installer

20260607 02:07:33.808: Remove Installer if needed

Not needed.

20260607 02:07:33.829: | PASS

Refresh Certificates Teardown

================================================================================

Status: PASS

Time Elapsed: 26 min 45 sec

Debug log: /opt/emc/caspian/service-

console/log/20260607_014111_run_Refresh_Certificates/dbg_robot.log

HTML log: /opt/emc/caspian/service-

console/log/20260607_014111_run_Refresh_Certificates/log.html

================================================================================

• Output with --skip-health-check true --renew-expired true option

/opt/emc/bin/service-console run Refresh_Certificates --skip-health-check true --

renew-expired true

Service Console is running on node 169.254.173.1 (suite

20260608_152212_Refresh_Certificates)

Service console version: 6.3.0.0-21226.63b0f97cee

Debug log: /opt/emc/caspian/service-

console/log/20260608_152209_run_Refresh_Certificates/dbg_robot.log

================================================================================

Refresh Certificates Setup

20260608 15:22:37.162: Check Refresh Certificates options

Using node '169.254.173.1' as target

20260608 15:22:37.169: | PASS

Refresh Certificates Pre Check

Action Succeeded on Previous Run

Refresh Certificates Install Installer

Action Succeeded on Previous Run

Refresh Certificates Run Installer

Dell Technologies – Restricted Use – Confidential & Subject to NDA

Page 45 of 56
20260608 15:22:57.668: Check if fabric certificates are already expired

Certificate expiration date: Jun 7 01:51:14 2031 GMT

20260608 15:23:11.486: | PASS (13 sec)

20260608 15:23:11.487: Refresh Certificates Run Installer

Initializing...

ALARM: Silent node orem-shamrock.ecs.lab.emc.com [169.254.173.3] detected.

Executing Program: RENEW_EXPIRED_CERTIFICATES

|-Check excluded nodes

| +-[0.0.0.0] CheckExcludedNodes PASS (1/38)

|-Check is previous run was finished

| +-[0.0.0.0] CheckPreviousRun PASS (2/38)

|-Stop Agent on all nodes

| |-[169.254.173.3] StopAgent PASS (3/38)

| |-[169.254.173.1] StopAgent PASS (4/38)

| |-[169.254.173.4] StopAgent PASS (5/38)

| +-[169.254.173.2] StopAgent PASS (6/38)

|-Remove LM containers on all nodes

| +-[0.0.0.0] RemoveLMContainers PASS (7/38, 3

sec)

|-Clean agent certificates files

| |-[169.254.173.1] CleanAgentCertificatesFiles PASS (8/38)

| |-[169.254.173.3] CleanAgentCertificatesFiles PASS (9/38)

| |-[169.254.173.2] CleanAgentCertificatesFiles PASS (10/38)

| +-[169.254.173.4] CleanAgentCertificatesFiles PASS (11/38)

|-Remove cluster certificates from ZK directly

Dell Technologies – Restricted Use – Confidential & Subject to NDA

Page 46 of 56
 | +-[0.0.0.0] CertRenewRemoveClusterCertificatesFromZKDirectly PASS (12/38)

|-Create empty serial.json file

| |-[169.254.173.1] CreateEmptySerialJson PASS (13/38)

| |-[169.254.173.4] CreateEmptySerialJson PASS (14/38)

| |-[169.254.173.2] CreateEmptySerialJson PASS (15/38)

| +-[169.254.173.3] CreateEmptySerialJson PASS (16/38)

|-Start Agent on all nodes

| |-[169.254.173.3] StartAgent PASS (17/38)

| |-[169.254.173.1] StartAgent PASS (18/38)

| |-[169.254.173.2] StartAgent PASS (19/38)

| +-[169.254.173.4] StartAgent PASS (20/38)

|-Check agent port

| |-[169.254.173.1] CheckIfAgentPortIsOpen PASS (21/38,

10 sec)

| |-[169.254.173.3] CheckIfAgentPortIsOpen PASS (22/38,

10 sec)

| |-[169.254.173.2] CheckIfAgentPortIsOpen PASS (23/38,

20 sec)

| +-[169.254.173.4] CheckIfAgentPortIsOpen PASS (24/38,

20 sec)

|-Setup Installation SSL

| |-[0.0.0.0] Clean up installer security data folder

| |-[0.0.0.0] Create Cluster/Root CA

| |-[0.0.0.0] Sign installer cert

| |-[169.254.173.4] Put combined certs into agent TS

| |-[169.254.173.4] Put signed agent CA cert

| |-[169.254.173.4] Put root cert into agent trust store

| |-[169.254.173.1] Put combined certs into agent TS

| |-[169.254.173.1] Put signed agent CA cert

| |-[169.254.173.1] Put root cert into agent trust store

| |-[169.254.173.2] Put combined certs into agent TS

Dell Technologies – Restricted Use – Confidential & Subject to NDA

Page 47 of 56
 | |-[169.254.173.2] Put signed agent CA cert

| |-[169.254.173.2] Put root cert into agent trust store

| |-[169.254.173.3] Put combined certs into agent TS

| |-[169.254.173.3] Put signed agent CA cert

| |-[169.254.173.3] Put root cert into agent trust store

| |-[0.0.0.0] Fetch installer cert

| +-[0.0.0.0] CertRenewSetupInstallationSsl PASS (25/38, 1

min 10 sec)

|-Validate Agent health

| |-[169.254.173.1] ValidateAgentHealth PASS (26/38, 2

sec)

| |-[169.254.173.4] ValidateAgentHealth PASS (27/38, 2

sec)

| |-[169.254.173.2] ValidateAgentHealth PASS (28/38, 2

sec)

| +-[169.254.173.3] ValidateAgentHealth PASS (29/38, 2

sec)

|-Remove LM containers on all nodes

| +-[0.0.0.0] RemoveLMContainers PASS (30/38, 4

sec)

|-Validate LM health

| +-[0.0.0.0] ValidateLMHealth PASS (31/38, 1

min 33 sec)

|-Put new root cert into lm

| |-[0.0.0.0] Clean fcli ssl files

| |-[0.0.0.0] Put root cert into LM

| |-[0.0.0.0] Set identity into LM

| |-[0.0.0.0] Fetch installer certs

| |-[0.0.0.0] Clean fcli ssl files

| +-[0.0.0.0] PutNewRootCertIntoLM PASS (32/38, 3

sec)

|-Validate Agent health

Dell Technologies – Restricted Use – Confidential & Subject to NDA

Page 48 of 56
 | |-[169.254.173.4] ValidateAgentHealth PASS (33/38, 1
sec)

| |-[169.254.173.2] ValidateAgentHealth PASS (34/38, 1

sec)

| |-[169.254.173.1] ValidateAgentHealth PASS (35/38, 1

sec)

| +-[169.254.173.3] ValidateAgentHealth PASS (36/38, 1

sec)

|-Validate LM health

| +-[0.0.0.0] ValidateLMHealth PASS (37/38, 1

sec)

+-Finish renew certificates procedure

+-[0.0.0.0] FinishRenewCertificates PASS (38/38)

Elapsed time is 3 min 24 sec.

RENEW_EXPIRED_CERTIFICATES completed successfully

20260608 15:26:50.294: | PASS (3 min 38 sec)

Refresh Certificates Restart Services

20260608 15:27:04.397: Refresh Certificates Restart Fabric Agent

20260608 15:27:04.398: | PASS

20260608 15:27:04.398: Refresh Certificates Restart Eventsvc

20260608 15:27:04.399: | PASS

20260608 15:27:04.400: Refresh Certificates Restart Telegraf

20260608 15:27:17.625: | PASS (13 sec)

20260608 15:27:17.628: Refresh Certificates Restart Service

Restarting objcontrolsvc

20260608 15:27:19.709: | PASS (2 sec)

Refresh Certificates Post Check

Refresh Certificates Remove Installer

20260608 15:27:39.844: Remove Installer if needed

Not needed.

Dell Technologies – Restricted Use – Confidential & Subject to NDA

Page 49 of 56
 20260608 15:27:39.880: | PASS

Refresh Certificates Teardown

================================================================================

Status: PASS

Time Elapsed: 6 min 2 sec

Debug log: /opt/emc/caspian/service-

console/log/20260608_152209_run_Refresh_Certificates/dbg_robot.log

HTML log: /opt/emc/caspian/service-

console/log/20260608_152209_run_Refresh_Certificates/log.html

================================================================================

• Renewal with target node:

================================================================================
Refresh Certificates Setup
20201123 17:43:12.761: Check Refresh Certificates options
Target node is '169.254.106.13'
The cert installer will be installed on this node.
20201123 17:43:13.518: | PASS
Refresh Certificates Pre Check
20201123 17:43:17.610: Run health check
20201123 17:43:17.612: | Check Object version across the cluster
[WARN] Unable to get object version installed in the cluster.
20201123 17:43:27.427: | | PASS (9 sec)
20201123 17:43:27.429: | Validate that OS version is equal between nodes
20201123 17:43:28.563: | | PASS (1 sec)
20201123 17:43:28.565: | PASS (10 sec)
20201123 17:43:28.567: Run health check
20201123 17:43:28.569: | Validate zookeeper
20201123 17:43:42.427: | | PASS (13 sec)
20201123 17:43:42.428: | Validate that all nodes are available - Fabric
20201123 17:43:42.429: | | PASS
20201123 17:43:42.430: | Confirm that docker health is GOOD and docker exec works on
all nodes
20201123 17:43:54.515: | | PASS (12 sec)
20201123 17:43:54.516: | Validate docker containers are running where they should be
20201123 17:43:59.597: | | PASS (5 sec)
20201123 17:43:59.600: | Validate the number of CPU cores
20201123 17:43:59.755: | | PASS
20201123 17:43:59.757: | Validate the amount of available physical RAM
20201123 17:43:59.907: | | PASS
20201123 17:43:59.908: | Validate swap space consumers
20201123 17:43:59.911: | | PASS
20201123 17:43:59.911: | Validate the required number and capacity of disks
[WARN] The node meets only the minimal requirements (3 x 279.4 GiB)
20201123 17:44:00.065: | | PASS
20201123 17:44:00.067: | Validate that the internal/system disk is SSD
[WARN] The SSD disk capacity 120.0 GiB is less than recommended 200 GiB on node with
IP 169.254.106.13 and FQDN dallas-rosewood.ecs.lab.emc.com
20201123 17:44:00.740: | | PASS

Dell Technologies – Restricted Use – Confidential & Subject to NDA

Page 50 of 56
20201123 17:44:00.741: | Validate disks serial number uniqueness
20201123 17:44:00.744: | | PASS
20201123 17:44:00.744: | Validate that provisioned drives are GOOD
20201123 17:44:03.309: | | PASS (2 sec)
20201123 17:44:03.311: | Validate that expected number of drives is formatted for
Object
20201123 17:44:03.314: | | PASS
20201123 17:44:03.315: | Validate SSD disks consistency
20201123 17:44:07.830: | | PASS (4 sec)
20201123 17:44:07.832: | Validate that the correct number of disks are mounted
inside the object container
20201123 17:44:10.351: | | PASS (2 sec)
20201123 17:44:10.352: | Validate file system and blockBins on formatted disks
20201123 17:44:10.632: | | PASS
20201123 17:44:10.634: | Validate that ports for fabric services are open
20201123 17:44:11.308: | | PASS
20201123 17:44:11.310: | Validate API availability of fabric services
20201123 17:44:17.475: | | PASS (6 sec)
20201123 17:44:17.476: | Validate that there is cluster master
20201123 17:44:21.489: | | PASS (4 sec)
20201123 17:44:21.492: | Validate that all partitions are under control
20201123 17:45:16.056: | | PASS (54 sec)
20201123 17:45:16.057: | Validate services owner and that realized goalstates are
equal on LM and agents
20201123 17:45:43.206: | | PASS (27 sec)
20201123 17:45:43.207: | Validate services owner and that goalstates are equal on LM
and agents
20201123 17:46:08.446: | | PASS (25 sec)
20201123 17:46:08.447: | Validate that all lifecycles are active
20201123 17:46:09.545: | | PASS (1 sec)
20201123 17:46:09.547: | Validate applications and services health
20201123 17:46:20.599: | | PASS (11 sec)
20201123 17:46:20.600: | Validate object configuration files between nodes
20201123 17:46:22.430: | | PASS (1 sec)
20201123 17:46:22.433: | Validate event streams by sending agent health
20201123 17:46:34.057: | | PASS (11 sec)
20201123 17:46:34.059: | Validate application role operational mode
Skipped: unnecessary for ECS version 3.5.1.2.121852.bf943bdbe1b
20201123 17:46:36.562: | | PASS (2 sec)
20201123 17:46:36.563: | Validate cluster compliance status
Skipped as requested by the user
20201123 17:46:36.564: | | PASS
20201123 17:46:36.565: | Validate that diskset is the same for all disks and cache
files
20201123 17:46:38.737: | | PASS (2 sec)
20201123 17:46:38.739: | Validate ESRS connection
20201123 17:46:44.763: | | PASS (6 sec)
20201123 17:46:44.765: | Validate HAL version
20201123 17:46:45.430: | | PASS
20201123 17:46:45.433: | Validate agent version
20201123 17:46:46.064: | | PASS
20201123 17:46:46.067: | Validate number of nodes with zookeeper
20201123 17:46:49.081: | | PASS (3 sec)
20201123 17:46:49.082: | Validate zookeeper database size
20201123 17:46:52.555: | | PASS (3 sec)
20201123 17:46:52.557: | Verify BIOS version
20201123 17:46:53.230: | | PASS

Dell Technologies – Restricted Use – Confidential & Subject to NDA

Page 51 of 56
20201123 17:46:53.231: | Check ZK version consistency
20201123 17:46:53.424: | | PASS
20201123 17:46:53.426: | PASS (3 min 24 sec)
20201123 17:46:53.428: Validate that disks states are okay in SSM
20201123 17:47:53.796: | PASS (1 min)
Refresh Certificates Install Installer
20201123 17:47:57.888: Install Installer if needed
The installer package installer-3.6.0.0-4172.60d016a-x86_64.rpm is going to be
installed on node 169.254.106.13
Installing the installer
20201123 17:48:01.305: | PASS (3 sec)
Refresh Certificates Run Installer
20201123 17:48:05.409: Check if fabric certificates are already expired
Fabric certificates aren't expired.
20201123 17:48:13.322: | PASS (7 sec)
20201123 17:48:13.322: Refresh Certificates Run Installer
Initializing...

Executing Program: RENEW_NOT_EXPIRED_CERTIFICATES

|-Check silent nodes

| +-[0.0.0.0] CheckSilentNodes PASS (1/34)
|-Store current agent certificates
| |-[169.254.106.16] StoreAgentCertificates PASS (2/34)
| |-[169.254.106.14] StoreAgentCertificates PASS (3/34)
| |-[169.254.106.15] StoreAgentCertificates PASS (4/34)
| +-[169.254.106.13] StoreAgentCertificates PASS (5/34)
|-Store current LM certificates
| |-[169.254.106.14] StoreLMCertificates PASS (6/34)
| |-[169.254.106.13] StoreLMCertificates PASS (7/34)
| +-[169.254.106.15] StoreLMCertificates PASS (8/34)
|-Store cluster certificates from ZK
| +-[0.0.0.0] CertRenewStoreClusterCertificatesFromZK PASS (9/34)
|-Checking whether a backup copy of agent and LM certificates correct
| +-[0.0.0.0] CheckStoredCertsHash PASS (10/34,
11 sec)
|-Stop Agent on all nodes
| +-[0.0.0.0] StopAgentOnAllNodes PASS (11/34, 2
sec)
|-Remove LM containers on all nodes
| +-[0.0.0.0] RemoveLMContainers PASS (12/34, 2
sec)
|-Clean agent certificates files
| |-[169.254.106.16] CleanAgentCertificatesFiles PASS (13/34)
| |-[169.254.106.14] CleanAgentCertificatesFiles PASS (14/34)
| |-[169.254.106.15] CleanAgentCertificatesFiles PASS (15/34)
| +-[169.254.106.13] CleanAgentCertificatesFiles PASS (16/34)
|-Remove cluster certificates from ZK directly
| +-[0.0.0.0] CertRenewRemoveClusterCertificatesFromZKDirectly PASS (17/34)
|-Replace serial.json with empty file
| |-[169.254.106.15] CreateEmptySerialJson PASS (18/34)
| |-[169.254.106.13] CreateEmptySerialJson PASS (19/34)
| |-[169.254.106.16] CreateEmptySerialJson PASS (20/34)
| +-[169.254.106.14] CreateEmptySerialJson PASS (21/34)
|-Start Agent on all nodes
| +-[0.0.0.0] StartAgentOnAllNodes PASS (22/34, 1
sec)

Dell Technologies – Restricted Use – Confidential & Subject to NDA

Page 52 of 56
 |-Check agent port
| |-[169.254.106.13] CheckIfAgentPortIsOpen PASS (23/34,
10 sec)
| |-[169.254.106.16] CheckIfAgentPortIsOpen PASS (25/34,
10 sec)
| |-[169.254.106.14] CheckIfAgentPortIsOpen PASS (26/34,
10 sec)
| +-[169.254.106.15] CheckIfAgentPortIsOpen PASS (26/34,
10 sec)
|-Setup Installation SSL
| +-[0.0.0.0] CertRenewSetupInstallationSsl PASS (27/34,
37 sec)
|-Validate Agent health
| +-[0.0.0.0] ValidateAgentHealth PASS (28/34, 1
sec)
|-Remove LM containers on all nodes
| +-[0.0.0.0] RemoveLMContainers PASS (29/34, 2
sec)
|-Validate LM health
| +-[0.0.0.0] ValidateLMHealth PASS (30/34, 1
min 1 sec)
|-Put new root cert into lm
| +-[0.0.0.0] PutNewRootCertIntoLM PASS (31/34, 2
sec)
|-Validate Agent health
| +-[0.0.0.0] ValidateAgentHealth PASS (32/34)
|-Validate LM health
| +-[0.0.0.0] ValidateLMHealth PASS (33/34)
+-Finish renew certificates procedure
+-[0.0.0.0] FinishRenewCertificates PASS (34/34)
Elapsed time is 2 min 15 sec.

RENEW_NOT_EXPIRED_CERTIFICATES completed successfully

20201123 17:50:35.693: | PASS (2 min 22 sec)
Refresh Certificates Restart Services
20201123 17:50:41.675: Refresh Certificates Restart Fabric Agent
20201123 17:50:46.783: | PASS (5 sec)
20201123 17:50:46.784: Refresh Certificates Restart Eventsvc
Restarting eventsvc
20201123 17:50:48.052: | PASS (1 sec)
20201123 17:50:48.053: Refresh Certificates Restart Telegraf
20201123 17:51:02.175: | PASS (14 sec)
20201123 17:51:02.176: Refresh Certificates Restart Service
Restarting objcontrolsvc
20201123 17:51:03.456: | PASS (1 sec)
Refresh Certificates Post Check
20201123 17:51:07.556: Run health check
20201123 17:51:07.559: | Validate zookeeper
20201123 17:51:21.323: | | PASS (13 sec)
20201123 17:51:21.324: | Validate that all nodes are available - Fabric
20201123 17:51:21.325: | | PASS
20201123 17:51:21.326: | Confirm that docker health is GOOD and docker exec works on
all nodes
20201123 17:51:33.403: | | PASS (12 sec)
20201123 17:51:33.405: | Validate docker containers are running where they should be
20201123 17:51:38.463: | | PASS (5 sec)
20201123 17:51:38.464: | Validate the number of CPU cores

Dell Technologies – Restricted Use – Confidential & Subject to NDA

Page 53 of 56
20201123 17:51:38.619: | | PASS
20201123 17:51:38.620: | Validate the amount of available physical RAM
20201123 17:51:38.775: | | PASS
20201123 17:51:38.776: | Validate swap space consumers
20201123 17:51:38.779: | | PASS
20201123 17:51:38.779: | Validate the required number and capacity of disks
[WARN] The node meets only the minimal requirements (3 x 279.4 GiB)
20201123 17:51:38.939: | | PASS
20201123 17:51:38.940: | Validate that the internal/system disk is SSD
[WARN] The SSD disk capacity 120.0 GiB is less than recommended 200 GiB on node with
IP 169.254.106.13 and FQDN dallas-rosewood.ecs.lab.emc.com
20201123 17:51:39.627: | | PASS
20201123 17:51:39.628: | Validate disks serial number uniqueness
20201123 17:51:39.630: | | PASS
20201123 17:51:39.631: | Validate that provisioned drives are GOOD
20201123 17:51:42.206: | | PASS (2 sec)
20201123 17:51:42.207: | Validate that expected number of drives is formatted for
Object
20201123 17:51:42.209: | | PASS
20201123 17:51:42.210: | Validate SSD disks consistency
20201123 17:51:46.746: | | PASS (4 sec)
20201123 17:51:46.747: | Validate that the correct number of disks are mounted
inside the object container
20201123 17:51:49.242: | | PASS (2 sec)
20201123 17:51:49.243: | Validate file system and blockBins on formatted disks
20201123 17:51:49.502: | | PASS
20201123 17:51:49.503: | Validate that ports for fabric services are open
20201123 17:51:50.176: | | PASS
20201123 17:51:50.177: | Validate API availability of fabric services
20201123 17:51:56.341: | | PASS (6 sec)
20201123 17:51:56.343: | Validate that there is cluster master
20201123 17:51:59.354: | | PASS (3 sec)
20201123 17:51:59.355: | Validate that all partitions are under control
20201123 17:52:54.505: | | PASS (55 sec)
20201123 17:52:54.507: | Validate services owner and that realized goalstates are
equal on LM and agents
20201123 17:53:21.616: | | PASS (27 sec)
20201123 17:53:21.618: | Validate services owner and that goalstates are equal on LM
and agents
20201123 17:53:46.847: | | PASS (25 sec)
20201123 17:53:46.848: | Validate that all lifecycles are active
20201123 17:53:47.928: | | PASS (1 sec)
20201123 17:53:47.930: | Validate applications and services health
20201123 17:53:58.983: | | PASS (11 sec)
20201123 17:53:58.985: | Validate object configuration files between nodes
20201123 17:54:00.793: | | PASS (1 sec)
20201123 17:54:00.795: | Validate event streams by sending agent health
20201123 17:54:13.426: | | PASS (12 sec)
20201123 17:54:13.428: | Validate application role operational mode
Skipped: unnecessary for ECS version 3.5.1.2.121852.bf943bdbe1b
20201123 17:54:16.071: | | PASS (2 sec)
20201123 17:54:16.072: | Validate cluster compliance status
Skipped as requested by the user
20201123 17:54:16.073: | | PASS
20201123 17:54:16.074: | Validate that diskset is the same for all disks and cache
files
20201123 17:54:18.238: | | PASS (2 sec)

Dell Technologies – Restricted Use – Confidential & Subject to NDA

Page 54 of 56
 20201123 17:54:18.240: | Validate ESRS connection
20201123 17:54:25.260: | | PASS (7 sec)
20201123 17:54:25.262: | Validate HAL version
20201123 17:54:25.926: | | PASS
20201123 17:54:25.928: | Validate agent version
20201123 17:54:26.594: | | PASS
20201123 17:54:26.595: | Validate number of nodes with zookeeper
20201123 17:54:29.607: | | PASS (3 sec)
20201123 17:54:29.608: | Validate zookeeper database size
20201123 17:54:33.088: | | PASS (3 sec)
20201123 17:54:33.089: | Verify BIOS version
20201123 17:54:33.760: | | PASS
20201123 17:54:33.762: | Verify Fabric certificate
20201123 17:54:49.305: | | PASS (15 sec)
20201123 17:54:49.306: | Check ZK version consistency
20201123 17:54:49.498: | | PASS
20201123 17:54:49.499: | PASS (3 min 41 sec)
20201123 17:54:49.502: Validate that disks states are okay in SSM
20201123 17:55:45.308: | PASS (55 sec)
20201123 17:55:45.311: Run health check
20201123 17:55:45.314: | Check DT status
Checking DT status (with timeout 10 min).
20201123 17:55:51.843: | | PASS (6 sec)
20201123 17:55:51.844: | PASS (6 sec)
Refresh Certificates Remove Installer
20201123 17:55:55.964: Remove Installer if needed
Installer is removed from node 169.254.106.13
20201123 17:55:56.466: | PASS
Refresh Certificates Teardown

• Validation of the renewal process:

service-console run Health_Check --specific-check "Verify Fabric Certificate"

Service console version: 6.1.0.0-21168.5d2917cafd
Debug log: /opt/emc/caspian/service-
console/log/20201215_132401_run_Health_Check/dbg_robot.log
================================================================================
Health Check
20201215 13:24:15.089: Execute Specific Health Checks
20201215 13:24:15.090: | Verify Fabric certificate
Certificate expiration date: Apr 20 15:15:01 2025 GMT
20201215 13:24:52.039: | | PASS (36 sec)
20201215 13:24:52.040: | PASS (36 sec)
================================================================================
Status: PASS
Time Elapsed: 53 sec
Debug log: /opt/emc/caspian/service-
console/log/20201215_132401_run_Health_Check/dbg_robot.log
HTML log: /opt/emc/caspian/service-
console/log/20201215_132401_run_Health_Check/log.html

Dell Technologies – Restricted Use – Confidential & Subject to NDA

Page 55 of 56
Document feedback

To provide any feedback or suggestions on the document, go to Content Feedback Router portal. For
more information, see Content Feedback Router - Support.

Dell Technologies – Restricted Use – Confidential & Subject to NDA

Page 56 of 56