ELECTRONICS MANUFACTURING SERVICES
Communications • Computing • Multimedia & Consumer • Industrial & Semiconductor • Defense & Aerospace • Medical • Automotive
ECOBAY: Closed loop water cooled
server cabinet for data centers
Mirko Stevanovic, M.A.Sc. Mech. Eng.New Product DesignSanmina-SCI Enclosure SystemsToronto, Canada
IBM Power and Cooling Technology Symposium, September 2008
Sanmina-SCI Confidential
Preamble: Clear Market Trends
“We are currently in the biggest data center construction boom in history. At the same time, this boom is dramatically weakening the future flexibility and financial performance of Information Technology. How can this be?
It's the old domino effect at work again.” The new “must know”topic for senior executives responsible for the energy consumption and costs of today’s increasingly high-density computing environments is the true economic and environmental costs of enterprise computing and what steps must be taken, beginning now, to control them”.
Source: Ken Brill, Director of “The Uptime Institute” Sept 2008
Sanmina-SCI Confidential
Market Need
Current Requirement:
• Integrated enclosures with 30kW thermal management systems thatprovide optimum environment for high density “clustered computing”.
• Scalable systems deployable in large or small quantities in new or existing sites.
• Simple, efficient & highly reliable thermal management technology that enables cost savings in infrastructure, real estate and power.
• “Green” products with low acoustic output, built in ‘fail safe’ devices and appropriate redundancy of critical systems.
• Optional power distribution, environmental monitoring, smoke detection & fire suppression.
Sanmina-SCI Confidential
High Density Blade Servers introduce new considerations:
� Heat Loads continue to Rise
� Heat Densities continue to Increase
� Conventional Cooling can not cope (see next slide)
� Efficiency and reliability of traditional Data Center declines and “De-population” of room occurs when input power exceeds values >3.5kW per enclosure
� Data Centers with raised floor (Plenum) cooling systems cannot support input power values of >7kW per enclosure without overheating problems
� New generation processors in high density configurations can require as much as 25kW+ input power per enclosure
What is The Problem?
Sanmina-SCI Confidential
Sanmina’s ECOBAY Solution
Our Solution:
� An integrated enclosure using chilled water in a closed loop system to provide cooling & facilitate heat removal at a rate3630 times greater than the same volume of air.
History
� Sanmina was the first to develop & market a product of this type.
Update
� In December 2007 the last of 5 ECOBAY Patents was granted by the USPTO providing Sanmina with greatly increased protection against Infringement of key elements of it’s design.
Sanmina-SCI Confidential
ECOBAY Thermal Management System
Chilled Water ►
from Chiller
◄ Warmed Water
to Chiller
Cooling Air Heated Air
Thermal Core
� High Performance, Closed Loop Water Cooled Cabinet.
� Heat generated inside the cabinet is removed by chilled water.
� Minimal stress on room cooling system.
� 42RU of useable space.
� Constant air temperature in front of servers.
� Uniform air distribution in front of servers.
What is ECOBAY?
Sanmina-SCI Confidential
What Ecobay Offers
Solution for Customer Needs:
� Improved Cooling
� Sealed system
� Noise Reduction
� Dense packing/heat density per area
� Lower energy cost
� Smoke Detection/Fire suppression
� Monitoring
� Improved work area
RELIABILITY
PERFORMANCE
SECURITY
COST
Sanmina-SCI Confidential
ECOBAY Solution
For Blade Servers
7 kW 35 kW24 kW1 kW
Low Density Solution Current Generation High Density Blades
NGR Blade’s & MultiProcessor Enterprise
Air Cooled Racks
For Current Servers
ECOBAY New Generation
ECOBAY Thermal Management System
Sanmina-SCI Confidential
ECOBAY Thermal Management System
� Five Blade Chassis operating at full power ~ 18 kW
� 0.76 l/s (12 gpm) Water at 14°C (57°F)
� Blades operated within manufacturers specs.
� RH 40% - 60% inside cabinet
� Acoustic performance – “very good”
Sanmina-SCI Confidential
W 700Fan Power
Varies by manufacturerCFM1680Server Fans Background
kPa48.3psi7.0Water ∆P
°C19.9°F67.8Water Disch
°C7.1°F12.8Water Rise
°C23.4°F42.1Air ∆T
°C49.8°F115.5Hot Air Disch
°C22.8°F73.0Cold Air SupplyResults
l/sec0.76USgpm12Water Flow
degC12.8°F55Water Temp
kW24.0kW24Heat LoadInputs
SI unitsPerformance Table (in US units)
ECOBAY Thermal Management System
Sanmina-SCI Confidential
ECOBAY For Smaller Projects- 324 KW LOAD
225 kVA/pdu
4 Power Distribution Units
18# of Cabinets @ 18kW each
324.0 kWELECTRICAL
910 FT2TOTAL ROOM FT2
ECOBAY 1-18 High Density Enclosures
225 kVA/pdu4 Power Distribution Units
65# of Cabinets @ 5kW each
324.0 kWELECTRICAL
2170 FT2TOTAL ROOM FT2
Traditional Air-Cooled Cabinets
Sanmina-SCI Confidential
Cabinet Monitoring
�Temperature in front and back of servers
�Fans/Power Supply Status
�Humidity
�Actual water leakage
�Door security
�Incipient Smoke Detection
�Fire Suppression Activation
To Central Monitor or Building BMS
Sanmina-SCI Confidential
Closed-Loop Water-Cooled SystemRESILIENCY
How do we make the Cabinet Cooling System Reliable ?
� Redundant Pumps, Heat Exchangers, and Chillers� Matrix piping system� Redundant Fans� Redundant power supplies� Preemptive Monitoring & Alarm System
Fall Back Strategy
� If the cooling in a cabinet fails for any reason:� Automatic door release. � Room air temporarily removes heat. � Door release has dual power & dual thermostats