Session 2 Cooling Systems

Cooling Systems

Session 2 Cooling Systems

Nominal Capacity: 300 GPM

300 300 300

N= 300 GPM NN+2N

+N1:
1=300
300GPM,
GPM,Redundant
Redundant
(gallons per minute)

150 150 150 150 150

N + 1= 300 GPM, Redundant

Basic Redundant

22
Session 2 Cooling Systems

Single Distribution Path

Basic
Capacity

N= 300 GPM

Redundant
Components

Session 2 Cooling Systems

Redundant Distribution Path

Concurrently
Maintainable
N= 300 GPM

23
Session 2 Cooling Systems

Redundant Distribution Path

A A A A A A

Fault
Tolerant
N= 300 GPM

A A A A A A

au·ton·o·mous: (adj.) Not controlled by others or outside forces; independent

Session 2 Cooling Systems

Compromised Distribution Path

A A A A A A

Basic
Capacity
N= 330 GPM

A A A A A A

24
Session 2 Cooling Systems

Valves are a Risk

• A common “rule of
thumb” is to avoid
valves whenever
possible
› Engineers for nuclear
power plants and
submarines minimize
valves where possible
• Both nuclear plants and
submarines are shut
down for an extended
period on a regular
basis for maintenance
(Tier II equivalent)
Tier III and Tier IV data centers are NOT shut down on
a regular basis for maintenance!

Session 2 Cooling Systems

Dual Distribution Path

Concurrently
Maintainable
N= 300 GPM

System A System B

25
Session 2 Cooling Systems

Dual Distribution Path

Compartmentalization
Fault
Tolerant
N= 300 GPM

System A System B

Session 2 Cooling Systems

Basic Capacity (Tier I)

Computer Room Cooling

26
Session 2 Cooling Systems

Redundant Components (Tier II)

Computer Room Cooling

Session 2 Cooling Systems

Concurrently Maintainable (Tier III)

Computer Room Cooling

27
Session 2 Cooling Systems

Concurrently Maintainable (Tier III)

Computer Room Cooling

Session 2 Cooling Systems

Concurrently Maintainable (Tier III)

Computer Room Cooling

Concurrently Maintainable Dual-Coil

28
Session 2 Cooling Systems

Concurrently Maintainable (Tier III)

Computer Room Cooling

Concurrently Maintainable 4-Pipe

Session 2 Cooling Systems

Fault Tolerant (Tier IV)

Computer Room Cooling

29
Session 2 Cooling Systems

Fault Tolerant (Tier IV)

Chilled Water Distribution
• The topology may look like Tier III solutions
• Tier IV must autonomously respond to failures— such as leaky
valves or fittings—to prevent further impact to the site
• Compartmentalization of chilled water pipes and control
elements outside the computer room is required

Session 2 Cooling Systems

Concurrently Maintainable (Tier III)

Chilled Water System

30
Session 2 Cooling Systems

Fault Tolerant (Tier IV)

Chilled Water System

Session 2 Cooling Systems

Tie Valves in a Chilled Water System

Compliant

31
 Session 2 Cooling Systems

Glycol Systems

CRAC CRAC CRAC

Session 2 Cooling Systems

Glycol System Tier Progression

Basic Capacity N Components

CRAC

32
 Session 2 Cooling Systems

Glycol System Tier Progression

Redundant
Components CRAC CRAC N+1 Components

Session 2 Cooling Systems

Glycol System Tier Progression

Concurrently
Maintainable CRAC CRAC N+1 Components

33
 Session 2 Cooling Systems

Glycol System Tier Progression

Add Capacity

Larger Capacity
Pumps

Concurrently
Maintainable CRAC CRAC CRAC N+1 Components

Session 2 Cooling Systems

Split-System CRAC Cooling

• Avoids issues of multiple
valves and piping systems
• Integrity of power sources
is a significant design and
Certification consideration
(Session 3)
• Ambient (outdoor) design
temperatures have a large
affect on capacity (Session
5) CRAC CRAC
• Continuous Cooling,
required for
Tier IV, has proven difficult
to achieve

34
Session 2 Cooling Systems

Continuous Cooling
• Continuous Cooling is the capability to maintain steady state in
the critical environments without site power until the mechanical
system is providing rated cooling at the extreme ambient
conditions
> Computer rooms, network rooms, UPS rooms. . .

• To complement uninterrupted power for IT devices

• Continuous Cooling is required to meet Tier IV criteria
> Part of the Uptime Institute Tier Standard

Session 2 Cooling Systems

Why Continuous Cooling?

• Provides IT devices thermal stability without site power until the
mechanical system is providing rated cooling to the IT devices at
the extreme ambient conditions
• Lockouts occur frequently
› Chillers/CRACs /Switchgear relays
› Consider a UPS battery plant is often designed for 15 minutes or more
• “Normal” Sequence of Operations can take several minutes
› Programmed engine-generator start delay
› Start and parallel sequence
› Switchgear transfer
› Chiller or CRAC restart sequence

35
Session 2 Cooling Systems

Continuous Cooling Case Study

ASHRAE 2011 Recommendations
• Recommended operating envelope for IT equipment
› Temperature
64.4‒80.6°F dry bulb
(18‒27°C)
› Temperature Rate-of-Change
9°F per hour
(5°C)
› Moisture
≤ 60% relative humidity (RH) and
41.9‒59°F dew point
(5.5‒15°C)

Session 2 Cooling Systems

Continuous Cooling Case Study

ASHRAE 2015 Recommendations
• Recommended operating envelope for IT equipment
› Temperature
64.4‒80.6°F dry bulb
(18‒27°C)
› Temperature Rate-of-Change
32°F per hour
(20°C, but no more than 5°C in any 15 minutes)
› Moisture
≤ 60% relative humidity (RH) and
15.8‒59°F dew point
(-9°C – 15°C)

36
Session 2 Cooling Systems

Temperature Rate-of-Change Test

Test Protocol
• Steady state configuration and conditions
› Load = 250 cabinets at 6 kW average or 1,500 kW
› Temperature sensors indicate ≤ 80°F (27°C)
› Power and cooling system normal
• Shut down all (14) CRAH units
• Record temperature rate-of-rise to 90°F (32°C)
• Recover

Session 2 Cooling Systems

Temperature Rate-of-Change Results

• First Data Point ~ 1 Minute
› Temperature sensor at 7 feet AFF = 90°F (32°C)
› Temperature sensor at ceiling = 110°F (43°C)

Owner aborts test!

• Last Data Point ~ 20 Minutes

› Temperature sensor at 7 feet AFF returns to 78°F (25.5°C)

37
Session 2 Cooling Systems

Tier IV Continuous Cooling

• Cooling technology drives the solution
• Requires, as appropriate for cooling solution
> Uninterruptible power for cooling fans
> Uninterruptible power secondary chilled water pumps or glycol system
pumps
> Thermal storage or uninterruptible refrigeration
• Uninterruptible CRAC-based Continuous Cooling is conceivable

Session 2 Cooling Systems

Noncritical Functions
• Some facility infrastructure components do not directly impact
availability of critical environments
• These systems may be isolated on failure or for maintenance for
extended periods
• Duration of “extended period” is equivalent to on-site stores of
engine-generator fuel and makeup water

38
Session 2 Cooling Systems

Common Noncritical Functions

• Building pressurization (makeup air systems)
• Humidification
• Fuel polishing (fuel storage filtration systems)
• Reverse-osmosis systems
• “Free cooling” or economizer systems
• Building automation (Tier I, Tier II, Tier III)
• Support area comfort HVAC
• Battery room ventilation

Session 2 Cooling Systems

Unintended Impacts
• Noncritical system connections to critical systems may create
noncompliant topology

• Cautions
∅ Chilled water connections for building air handlers
∅ Free cooling heat exchanger integration
∅ Fuel polishing system isolation

39
Session 2 Cooling Systems

Utility Sources
• Tier I‒IV data center systems must be able to autonomously
respond to a loss of external cooling generation, such as district
cooling
• This is similar to how engine generators must be able to
autonomously respond to loss of utility power from the grid

Session 2 Cooling Systems

Cooling Systems Recap

• Chilled water and glycol systems require careful attention to
piping and valve configurations
• Direct expansion (DX) systems simplify (avoid) piping
challenges, but require careful attention to power and
Continuous Cooling solutions
• Integration of noncritical systems can create
Concurrent Maintainability and Fault Tolerance discrepancies

40