24
IBM Technology Symposium 2012 Roger Schmidt Nov , 2012 Data Center Trends and Challenges Roger Schmidt, IBM Fellow Chief Engineer - Data Center Energy Efficiency
IBM Technology Symposium 2012Roger SchmidtNov , 2012
Data Center Trends and Challenges
Roger Schmidt, IBM FellowChief Engineer - Data Center Energy Efficiency
IBM Technology Symposium 2012Roger SchmidtNov , 2012
6x
69x
Growth in serverand storageshipments thisdecade.
85% Of distributedcomputingcapacity sitsidle.
18%
75% Of CIO’santicipate astronglycentralizedinfrastructurein 5 years.
20x Technology densityincrease in serversthis decade.
71% Of data centers > 7years old.
5-60%Of IT workloads maybe cloud-enabled.
Increasing IT demand Continued cost pressure Responsive to change
Increase indata centerenergy costsin next year.
Customers’ challenges are driven by the following…
IBM Technology Symposium 2012Roger SchmidtNov , 2012
Everyone Has A “Computer Room”
Branch Office Enterprise Data Center
IBM Technology Symposium 2012 Roger SchmidtNov, 2012
Data centers use electricityHow much?
More video was uploaded to YouTube in the past 2 months
than if ABC, CBS and NBC had been airing content 24/365 since 1948
IBM Technology Symposium 2012Roger SchmidtNov , 2012
Typical Data Center Energy End Use
ServerLoad
/ComputingOperations
CoolingEquipment
Power Conversions
& Distribution
100Units
33 UnitsDelivered
35 Units
IT Equipment50.0%
Cooling33.3%
Power16.7%
Data Center Energy Breakdown
30 Units
X86 average utilization5 – 12%
Power Usage Effectiveness(PUE) = (Infrastructure Power + IT Power)/IT Power = 2
IBM Technology Symposium 2012Roger SchmidtNov , 2012
Data Center Energy Use Trends
IBM Technology Symposium 2012Roger SchmidtNov , 2012
Total Electricity Usage by State (MkWhr/year)
US Data Centers
WorldData Centers
IBM Technology Symposium 2012 Roger SchmidtNov, 2012
Information Technology isbecoming more energy
efficient at a furious pace
The computer in your cell phone today is a million times cheaper,
and a thousand times more powerful and about a hundred thousand time smaller
than the one computer installed at MIT in 1965
IBM Technology Symposium 2012Roger SchmidtNov , 2012
Incredible performance improvements
Energy perTransistor goes
DOWN
~ 1 Million Factor Reduction In Energy/Transistor Over 30+ Years’’7070 ‘‘8080 ‘‘9090 ’’0000 ‘‘1010
Nu
mb
ero
ftran
sistors
Incredible performance improvements
IBM Technology Symposium 2012Roger SchmidtNov , 2012
Moore’s Law: Delivering DC Performance
2004
79 TFlops
118 racks
10,000 ft2
3.5 MW
2008
79 TFlops
9 racks
300 ft2
0.5 MW
power5 575 power6 575 power7 775
2012
79+ TFlops
1 racks
30 ft2
0.15 MW
IBM Technology Symposium 2012Roger SchmidtNov , 2012
Overview of “ASHRAE’s Thermal Guidelines Book – third edition”
Chapter 1 – Introduction
Chapter 2 – Air Cooled Equipment EnvironmentalSpecifications
Chapter 3 – Liquid Cooled EquipmentEnvironmental Specifications
Chapter 4 – Facility Temperature & HumidityMeasurement
Chapter 5 – Equipment Placement & AirflowPatterns
Chapter 6 – Equipment Manufacturers Heat &Airflow Reporting
Appendices A - J
Can obtain book @ http://tc99.ashraetcs.org/
IBM Technology Symposium 2012Roger SchmidtNov , 2012
IT Equipment Environment – Measurement at Inlet
AIR INLET to datacom equipment IS the important specification to meet.
OUTLET temperature is NOT important to datacom equipment.
Four Key Environmental Requirements
1. Inlet Air Temperature
2. Inlet Humidity
3. Inlet Particulate Contamination
4. Inlet Gaseous Contamination
IBM Technology Symposium 2012Roger SchmidtNov , 2012
Thermal Guidelines –Third Edition (2011)
Drivers for Updated Thermal Guidelines – Improve Energy Efficiency
• Expand use of the allowable range
- Reduce chiller hours
• Expand the limits of the allowable range
- Enable greater economizer usage
ASHRAE TC 9.9 Response – Create Opportunity for Innovation
• Defined two new classes with wider environmental envelopes
• Created guidance to evaluate operation outside existingrecommended range
- Educate users on reliability, IT equipment power consumptionand other factors
IBM Technology Symposium 2012Roger SchmidtNov , 2012
New Classes A1 and A2 are EXACTLYthe SAME as previous Classes 1 & 2
Classes A1 and A2 apply to new andlegacy equipment
New Classes A3 and A4 do NOTinclude legacy equipment
IT Equipment Environmentals– ASHRAE Psychrometric Chart – 2011
These are the ITEquipment inletrequirements!!
IBM Technology Symposium 2012Roger SchmidtNov , 2012
Overview of “ASHRAE’s Power Trends & Cooling Book”
Chapter 1— Introduction
Chapter 2— Background
Chapter 3— Component Power Trends
Chapter 4 --- Load Trends and Their Application
Chapter 5— Air Cooling of Computer Equipment
Chapter 6— Liquid Cooling of Computer Equipment
Chapter 7 – Practical Application of Trends to DataCenter Design
Appendices A – C
ASHRAE TC 9.9 Websitewww.tc99.ashraetcs.org
IBM Technology Symposium 2012Roger SchmidtNov , 2012
Volume Server Power Trends to 2020
Market Requirements force IT manufacturers to maximizeperformance/volume creating high heat load/rack
These rack heat loads will result in increased focus on improving data centerventilation solutions and localized liquid cooling solutions
IBM Technology Symposium 2012Roger SchmidtNov , 2012
Leibniz Rechenzentrum, Garching, GermanySuperMUC: Warm-Water Cooled 3 PFLOPS System
1Q12—2Q12: ~10000 IBM System x iDataPlex Water Cooled dx360 M4
IBM Technology Symposium 2012Roger SchmidtNov , 2012
iDataplex Rack w/ watercooled nodes
•Hot Water Cooled Node with 90% heatrecovery.
•Power advantage over air cooled node by5-7%. {Due to lower CPU temps andabsence of fans}
•Water inlet 18°C to 450C @ 0.5 liters/minper Node {37 liters/min Rack}
dx360 M4 - Water Cooling design
IBM Technology Symposium 2012Roger SchmidtNov , 2012
2nd Day of Power Failures Cripples Wide Swath of India
The world’s largest blackout ever crippled much of northern India for a secondconsecutive day on Tuesday(July 31, 2012), spreading across 22 of 28 states,an area of 670 million people(10% of the planet). An estimated 32 gigawattswas taken off line.
IBM Technology Symposium 2012Roger SchmidtNov , 2012
Sandy's mammoth wake: millions without power, transit
A half dozen nuclear power plants were shut down orotherwise affected, while the nation's oldest facilitydeclared a rare "alert" after the record storm surgepushed flood waters high enough to endanger a keycooling system.
More than 6.6 million homes and businesses werewithout electricity, about two-thirds of them in NewYork and New Jersey.
IBM Technology Symposium 2012Roger SchmidtNov , 2012
Energy Savings from Tri/Co-Generation
OTHERLOSSES 4.8%
INP
UT
100%
LOSSES25.8%
EXHAUSTLOSSES 21%
THERMALOUTPUT
44.5%
ELECTRICALOUTPUT 29.7%
USEFUL ENERGY74.2%
100Units
30 UnitsDelivered
35 Units
Offset building thermal loads by recycling thewaste heat energy available at site
Reduces costs and increases reliability
Increases efficiency and reduces fossil fuelcombustion
IBM Technology Symposium 2012Roger SchmidtNov , 2012
Syracuse University Green Data Center
Green Data Center Facility
Micro-Turbines Absorption Chillers
Water cooled raised floor
IBM Technology Symposium 2012Roger SchmidtNov , 2012
Big Issues
IT demand continues to grow rapidly
IT energy efficiency continues to dramatically improve
Low IT equipment utilization
Low infrastructure efficiency improvements remain
Energy cost will continue to be #1 business concern
IBM Technology Symposium 2012 Roger SchmidtNov, 2012
Thank you for yourattention
