55
Time: April 4, 2014, 9:45-10:45 a.m.
Venue: Crystal 1-2
Speaker: John Peterson
Data Center Design
and Commissioning
Data Center Trends • Design alterations based on density
improvements
• In 2016, the same floor space will be able to house 22% more equipment than in 2011
• More efficient data center design through modularity adoption
• According to the 2012 Uptime Institute survey, 80% of respondents have built a new data center or upgraded an existing facility within the past five years, and 30% of respondents ran out of data center capacity at one of their sites in 20122
• Between 2011–16 more than 11,000 new data centers will be constructed globally
• High enterprise relevancy for addressing space, power, and cooling, as well as costs and skills for environments
• Large and enterprise-scale data center growth of 11% and 7% respectively, 2011–16
Critical facilities design
Critical facilities implementation
Critical facilities strategy
Available
Optimized
Critical facilities assurance
Critical facilities energy
• A poorly designed data center may reduce IT and business agility
• Periodic refurbishment costs to upgrade and replace aging equipment, such as chillers and battery systems, driving TCO decisions
• An alarming inaccuracy for data center operators managing the thermal conditions at the room level, not the rack inlet level
• When building a new data center, around half of the respondents are interested in pursuing some kind of green certification, with the leading option being the U.S. Green Building Council’s LEED program
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
“Forward-thinking companies have realized that to run data centers efficiently, and to extend their lives indefinitely, it is not logical to treat data center facilities and IT assets separately, because without one the other can’t operate.”
David J. Cappuccino, Gartner, Inc. August 2011
®
Aiming for the data center of the future
• Efficient and effective
• Self-regulating
• Mature standardized processes
• Fully available and resilient
• Real-time monitoring & control
• Fully service-oriented
• Green
• Business-centric
• Integrated
• Modular and elastic
• Shared resource pools
• Policy-based
• Fully automated
• Right sourcing
IT to Facilities: Why can’t facilities fix my air problem?
Facilities to IT: Why don’t you just do this?
How inefficiency can cost business Business impact related to cooling issues
Server or system downtime
Increased operational costs
Data center outage
Inability to add capacity
Fail to support business growth
Loss of revenue
Lowered customer
satisfaction
IT failure rates and facility longevity
The data center lifecycle
CFD Analysis
Energy Audit & Optimization Report Recirculation-Impact of Blanking Panels
Outside Air Economizer & Humidity
13 16 April 2014
PUE (Power Usage Effectiveness) CUE (Carbon Usage Effectiveness);WUE (Water Usage Effectiveness)
ERE(Energy Reuse Effectiveness); ERF(Energy Reuse Factor)
Emergency generator
Utility transforme
r
Total data center energy
PUE Total data center energy from all fuels
(kWh) Total IT energy (kWh)
Ma
in
po
we
r
Hou
se
p
ow
er
Mis
c.
po
we
r
IT
po
we
r In
Me
ch
. p
ow
er
Total data center energy
House energy
=
Data center
Main service
PP-Gen service
Lighting panel
Generator block Heaters
& lighting
Lighting, Exit
lights, BMS,
EPMS & security
House panels
UPS
STS
PDUs
RPPs
Mech. Swgear
Data center CRAC units,
AHUs, Chillers & Dry coolers
Fuel
Misc. support
Mech. support
Pow
er
To
IT
IT-critical load District
chilled water
District steam
Natural gas
CO2
NOx
WUE Total Direct Water Consumption
CUE
Fuel
ERF
ERE
14 16 April 2014
Facilities
Cooling and Power Systems Affect PUE Two system design concepts compared
Max PUE = 1.63 Average PUE = 1.56 Annual Energy = 49 million kWH
Max PUE = 1.45 Average PUE = 1.41 Annual Energy = 44 million kWH
Difference is 5 million kWH ($500,000 at $0.10/kWH)
15
Indoor Temperature and Moisture Levels ASHRAE recommendations at computer equipment air intakes
MAXIMUM 80°F dry-bulb 67°F wet-bulb 60°F dew point
MINIMUM 65°F dry-bulb 53°F wet-bulb 43°F dew point
Climate Zone Optimization
HVAC-CRAH data & measurements
HVAC System Power Measurements
Air Management measurements & analysis
Air Management measurements & analysis
Data Centre Average Power Consumption
0
100
200
300
400
500
600
CO
OLI
NG
SY
STE
MS
CRA
C F
AN
S
HU
M /
DEH
UM
FUEL
OTH
ER
MEC
H IT
UPS L
OSSES
GEN
PRE-
HEA
TER
LIG
HTS
OTH
ER E
LEC
kW
• Too many CRAHs/Turn CRACs off!
• Controlled on return air!
• Low air temp & %RH set points!
• Controls fighting!
• Fixed speed fans, no VFDs!
• Old fan motors with low efficiency!
• Dual filters!
Common issues
Energy Audit & Optimization Report CRAC/CRAH fan power optimization
0
5
10
15
20
25
30
35
40
45
<15 15-20 20-25 25-32.2 32.2-40 >40
<59F 59-68F 68-77F 77-90F 90-104F >104F
Hot Spots
Overcooling
Energy Audit & Optimization Report Identification of overcooling & hot spots
Energy Audit & Optimization Report Optimizing Air Management
• Consider return air plenum and ductwork for the CRAC units
• Remove obstructions under the floor that restrict cold air to supply the server inlets
• Ensure as best as possible the adequate supply of cold air to the server inlets
• Ensure air velocities and flows from floor grilles are sufficient to reach the top of cabinet servers
• Fit blanking plates in cabinets where servers are not installed
• Close gaps between cabinets (where warm air can make its way to the server inlet)
• Avoid installing highly loaded servers at the end of cabinet row or at the top where recirculation is easier
• Consider means to physically isolate the supply (cold) and return (hot) air streams
Supply air
CRAC
Server
Return air
Recirculated air (if servers need more air than supplied)
Recirculation: results in hot spots and wastes fan energy
Server
Energy Audit & Optimization Report Optimizing Air Management
• Locate floor air grills so that they supply the inlet of servers, i.e. remove floor air grills from hot aisles and other useless areas
• Ensure air velocities from floor grilles are not too high and overshoot the cabinet height
• Seal air gaps in the raised floor
• CRAC units turned off are a source of air bypass (consider air isolation with dampers)
Bypass: Starves servers from air and wastes fan energy
Bypass
Floor tiles and
racks badly
located/oriented
High exit velocity
CRAC
Return air
Server
Energy Audit & Optimization Report Optimizing Air Management
Negative flow: Venturi flow
Return air
Negative flow if high underfloor air velocity
CRAC
Energy Audit & Optimization Report Air Management Metrics-Practical Applications
Legacy D C, particularly if not well managed, tend to have high levels of both bypass and recirculation flow rates. Cold aisle – hot aisle arrangements can address the main problems of recirculation. However, particularly at low loads, there will be high levels of bypass air, unless the CRAC units have some type of variable air-flow control.
BP
OPPORTUNITY
Energy Audit & Optimization Report Perforated Tiles Locations
Poor location and unnecessary
CR
AC
2
CR
AC
1
28
Implementing ASHRAE conditions ASHRAE recommended & allowable ranges
R R
ASHRAE PSYCHROMETRIC CHART NO.1
NORMAL TEMPERATURE
BAROMETRIC PRESSURE: 29.073 INCHES OF MERCURY
Copyright 1992
AMERICAN SOCIETY OF HEATING, REFRIGERATING AND AIR-CONDITIONING ENGINEERS, INC.
794 FEET
Weather Data Location:
SAN_ANTONIO, TEXAS, USA
Weather Hours
11 to 1
22 to 12
33 to 23
44 to 34
55 to 45
66 to 56
77 to 67
88 to 78
99 to 89
Class A4
Class A3
Class A2
Class A1
Recommended
-15
-10
-5 0 5 10
15
20
25
30
35
40
45
50
55
60
65
70
75
80
85
90
95
100
105
110
115
120
DR
Y B
ULB
TE
MP
ER
AT
UR
E -
°F
10% RELATIVE HUMIDITY20%
30%
40%
50%
60%
70%
80%
90%
-15 -10 -5 0 0 5
5 10
10 15
15 20
20 25
25 30
30 35
35 40
40 45
45 50
5055
55
6060
65
6570
70
75 WET B
ULB
TEM
PERATU
RE - °F
75
80
R R
ASHRAE PSYCHROMETRIC CHART NO.1
NORMAL TEMPERATURE
BAROMETRIC PRESSURE: 29.073 INCHES OF MERCURY
Copyright 1992
AMERICAN SOCIETY OF HEATING, REFRIGERATING AND AIR-CONDITIONING ENGINEERS, INC.
794 FEET
29
Implementing ASHRAE conditions ASHRAE recommended & allowable ranges
• Annual energy cost savings $165,892 • Total incentives-PG&E $232,249.14 • SPB 4.4 years • NPV +28k • IRR 12%
• Annual energy Savings 1,658,922 kWh • Demand reduction 111 kW • Carbon reduction 498 Metric Tons • PUE improvement 10%
• SAT reset control from 61 to 74 °F • Hot/cold aisle rack layout, over head cooling. • High eff 483 Ton WCC (CH-1), NPLV 0.405. • VFD PCHWP-1- premium efficiency motor. • VFD CWP-1-premium efficiency motor. • VFD CT-1- premium efficiency motor. • VFD WC CRAH-17 to CAH-24-prem eff motor • ASE motorized damper intake hoods, VFD, premium efficiency motors.
• Networking provider
• IT/Communication industry
• 5,000 SF raised floor
• Perceived UTI Tier 3 Data Center
• San Francisco bay area
The Implemented Solution The Client
Case study: HVAC system upgrades & Air Side Econ.
The Metrics The Financials
• Annual energy cost savings $57,816 • Total incentives-PG&E $46,216 • SPB 3.8 years • NPV +35k • IRR 16%
• Annual energy Savings 525,600 kWh • Demand reduction 58 kW • Annual Carbon reduction 158 Metric Tons • PUE improvement 4%
• National Company
• Communication industry
• 10,000 SF raised floor
• Perceived UTI-Tier 2 Data Center
• San Francisco bay area
The Implemented Solution The Client
Case study-Air management via hot aisle containment
The Metrics The Financials
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Thank you
Time: April 4, 2014, 9:45-10:45 a.m.
Venue: Crystal 1-2
Speaker: Raja Natarajan
Data Center Design
and Commissioning
The Commissioning Process
Define Owners Project Requirements
• Building Due Diligence
• Identify Performance Outcomes
• Lessons Learned Review
• Clients Brief
• Draft Commissioning Plan
The Process
Commissionability & Maintainability
• Single Points of Failure Elimination
• 1:10:100 Potential Cost Savings
• Avoid ‘Blind’ Value Engineering
• Thought for the Facility Manager
The Process
Clear & Concise Tender Instructions
• Give the contractor a fighting chance
• Avoid unnecessary variations
• Identify on and offsite requirements
The Process
Built for Commissioning
• Early Installation Fault Identification
• Logical Integration into Construction Schedule
• Clear identification of approved processes
• Off-Site Factory Tests
The Process
Task Tracking and Verification
• All tasks identified and tracked
• Proactive support not bullying
• Aim to minimize repeat testing
• Witness verification
The Process
Testing of Major Equipment
Mechanical
Chillers, CRAC Units
Electrical
UPS, STS, Generators
Fire Protection Systems
Gaseous suppression systems, Pre-action Systems
BMS & Controls
Provide absolute confidence…
• Demonstrate of performance and integration
• Fire and Life Safety
• Secure Power and Cooling
• Documented Audit Trail
• Trained to Operate
The Process
Heat Load Tests (HLT)
• To demonstrate the performance of the cooling system
using a substitute load to simulate actual conditions
• To monitor/record the effects of simulated failures and
changeover of system operation on the cooling system
• All testing of individual equipment to be complete prior
to HLT
Integrated Systems Tests
(IST)
Failure conditions are simulated to ensure systems react
in a manner to which they are designed
Used to verify the correct integrated operation of the Data
Center in various cause and effect modes of failure
Tests conducted during IST
Simulate failure of
Main Utility Power and
demostrate operation
of generator
Simulate failure of
generator power and
demonstrate battery
operation of UPS
system
Simulate failure of UPS
System and
demonstrate operation
of STS System
Electrical
Tests conducted during IST
Simulate failure of
Chiller / Chillers and
demonstrate capability
of chiller control
system
Simulate failure of
CRAC units and
demonstrate capability
of CRAC control
system
Carry out simulation of
fire alarms and effect
on data center
Mechanical
Adjust to Suit
• Observe use – Tune to suit
• Educate to avoid override
The Process
Continuous Commissioning
• Defect Resolution
• Seasonal Adjustment
• Fit for purpose
• Transitional Commissioning
The Process
Commissioning
Management Process
Copyright: BSRIA
Energy Efficiency of
Data Centers
• Due to technological advances, demand for data center
space throughout the developed world will remain high.
• Amount of electricity consumed will be exceptionally
high due to the high power demands of data centers
• It is important to monitor and improve the energy
efficiencies of the data centers
Recent Government
Developments
• Early appointment of Commissioning
Agent to discuss and agree strategies
to optimize energy efficiencies within
data center
• Proper sealing of the data center
environment
• Optimizing air flow
• Increasing cooling system efficiencies
• System of monitoring and tracking of
energy efficiency parameters
Improving Energy
Efficiency through Commissioning
Management
Effective commissioning has been shown to improve the operating
efficiency and environmental performance of a building over its life cycle.
Commissioning is growing in importance due to the growing complexity
of buildings
Continuous commissioning has been proven to save energy and costs
throughout the life of the building
Thank You
Raja Natarajan
Commissioning Manager
Commtech Asia
Mobile (852) 98152939
Tel (852) 2523 4411
11A, W Square, 318 Hennessey Road,
Wanchai, Hong Kong
