System x Power Development
5/4/2011
IBM x3850 X5 Energy Efficiency Leadership
Ted Howard
2 5/4/2011
System x Power Development
x3850 Has Demonstrated Leadership With Energy Consumption and Efficiency Performance Over The Predecessor Product and Major Competitors
Summarize Power Hardware That Helped Enable This Differentiation
Discuss System Implementation, Design Challenges and Tradeoffs, and Supplier Interaction
Provide Comparison Data
x3850 X5 Energy Efficiency Leadership
3 5/4/2011
System x Power Development
x3850 X5: Internal view• Scalable 4-socket 4U server• 8, 6, or 4-core Intel Xeon 7500 CPU’s• 64 Dimms, 1066MHz DDR3• 8 HD’s, or 2 eXFlash Packs• 7 PCIe Gen2 slots• 2 PS’s 3U (1975W / 875W)• 6 Fan’s
Scalable•x3850 4U + MAX5 1U 96 Dimms•8-socket, x3850 4U + x3850 4U
4 5/4/2011
System x Power Development
eX5 is the top performer for business critical applications
x3850 X5
TPC-C: #1 highest ever 4-socket score
TPC-H: #1 world record price performance#1 highest ever 4-socket score
SPECvirt: #1 world record score with 8S
SPECjEnterprise: #1 single node x86
SAP-SD: #1 8-socket score
Top Performance Across Enterprise Workloads
5 5/4/2011
System x Power Development
Power Subsystem Design Focus
Cost Space Efficiency
Requirements (Schedule)
Non-Competitive Competitive Leadership
6 5/4/2011
System x Power Development
Power Supply
– 1975W / 875W (230Vac / 115Vac)
– 3U Form factor (120mm H x 125mm W x 200mm L) • Density 15.5W/cuin (Useable Space)
– Rear Access, Orthogonal Docking
– System 120mm Fan Embedded
– N+N = 2 PS (Redundant at High Line)
– Single Main 12V Output (162A / 72A dc)• Auxiliary Voltages (3.3Vco 200mA and 5Vco 300mA)
– C13/14 AC Inlet
– Equivalent Cost $/W To Athena
Ghidorah Power Subsystem
7 5/4/2011
System x Power Development
8 5/4/2011
System x Power Development
PS Efficiency - Comparison to Athena
70
75
80
85
90
95
100
10 20 30 40 50 60 70 80 90 100
Load (%)
Effic
ienc
y (%
)
1440W 1975W
Ghidorah Comparison
9 5/4/2011
System x Power Development
Ghidorah Power SubsystemPower SupplyPS Design
• Optimized Efficiency For Redundant Operating Range• Focused For Significant Improvement At Light Load
(10A to 30A)• Dual Secondary Converters, Shedding One At Light Load• Reduces Bulk Voltage At Light Load• Reduced No Load PS ‘On’ Power By 59%, 44W 18W
Enhanced Light Load / Operating Load Efficiency• 10% Load, +16% Eff. Improvement Over Athena• 20% Load, +6% Eff. Over Athena• 30% Load, +4% Eff. Over Athena
10 5/4/2011
System x Power Development
Ghidorah Power Subsystem
Power Supply
– Allowed System To Reduce Fan Count To 6 Total, Less Than Other System Competitors
– 230V Efficiency Load 10% 20% 50% 100% Peak 40%(Avg of 50 PS's) 91.7 93.7 94.1 91.9 94.1%
– 115V Efficiency Load 10% 20% 45% Peak 25%(Avg of 50 PS's) 89.8 92.1 90.6 92.1%
11 5/4/2011
System x Power Development
12 5/4/2011
System x Power Development
13 5/4/2011
System x Power Development
Ghidorah Power Subsystem Ghidorah CPU Vcore Efficiency - Peak 92.1%
CPU Vcore Regulator Efficiency
75
77
79
81
83
85
87
89
91
93
95
0 10 20 30 40 50 60 70 80 90 100 110 120 130
Io A)
Effic
ienc
y (%
)
EffInd
14 5/4/2011
System x Power Development
Ghidorah Power Subsystem Ghidorah CPU Vcache Efficiency - Peak 92.2%
CPU3_Vcache Regulator Efficiency Pass4
75
77
79
81
83
85
87
89
91
93
95
0.000 10.000 20.000 30.000 40.000 50.000 60.000
Io A)
Effic
ienc
y (%
)
EffInd3.3VPowMsrd
15 5/4/2011
System x Power Development
Ghidorah Power Subsystem Ghidorah Memory VDimm Efficiency - Peak 92.8% (SIT)
60.00%
65.00%
70.00%
75.00%
80.00%
85.00%
90.00%
95.00%
0 10 20 30 40 50 60 70 80 90 100 110
Load Current(A)
Effic
ienc
y
Grimlock 3 PhaseGrimlock 2 Phases
16 5/4/2011
System x Power Development
Voltage DC/DC Regulators - Improved Efficiencies Ghidorah Over Athena
– Memory Vddq (At 1.5V)• +5% Over Athena At 1.8V, 92.8% 88%
• Additionally Optimized At Operating Range, Light Load
– CPU Vcore (At 1.2V)• +4% Over Athena, 92.1% 88%
• Additionally Optimize At Operating Range, Light Load
• Resolved Space Challenges– Developed New Inductor 220nH In 11mmx7mm Footprint For Ghidorah Space Limitations– Added Holes In I/O Planar To Accommodate Heat Sink
• PCB Etch Added To Minimize Distribution Loss, and Efficiency Loss
– Implemented Static Phase Shedding• MEM Vddq 3ph 2ph Based On Type and Number of Dimm’s• CPU Vcore PSI# (CPU’s 2, 3, 4)
Voltage Regulators – Significant Cost Improvements Over Athena
Ghidorah Power Subsystem
17 5/4/2011
System x Power Development
Willingness of Suppliers To Improve / Brainstorm / Partnership
Significantly Improved PS Efficiency Pass2 BBFV Pass4 SIT
Resolved PS Mechanical Challenge – Telescopic Connector– Hard Work, Multiple Passes
Significantly Improved PS No-Load ‘On’ Wattage
Added Static Phase Shedding for CPUVcore and MemVddq, (Late At SIT Pass4)
Moved From Pass1 Coupled Inductor To Discrete Inductor, w/Slower Fsw
Selected Technologies (Topologies) Significantly Improved Over Predecessor Product
Defined Targeted Operating Points and Tradeoffs For Peak Efficiency
18 5/4/2011
System x Power Development
Base System IDLE Power Comparisons Ghidorah
2x130W CPUs, 4x2GB Dimms– 211Wac2x95W CPUs, 8x2GB Dimms– 218WacBase Configuration 2CPU Idle (95W/105W/130W)– 210-218Wac
Athena2x130W CPUs, 8x2GB Dimms– 373Wac
2x80W CPUs, 8x2GB Dimms– 378Wac
1x80W CPU, 8x2GB Dimms– 347Wac
160Wac Reduction - Base System Idle 2CPU Operating Cost Savings
• 160Wac x 24Hrs x 365 Days x 1/1000 = 1402kWh/Yr $140/Yr(at $0.10/kWh)
• Data Center Total Savings x2 $280/Yr
19 5/4/2011
System x Power Development
PS Efficiency Comparison To Competition
2PS IBM / 4PS Competitor 'A' For 2000W System Load (Fully Redundant)
708090
100
0 10 20 30 40 50 60 70 80 90 100
Load (%)
Effic
ienc
y (%
)
'A' 1200W Platinum IBM 1975W 'A' 1200W Silver
• IBM PS/System Better At Idle and Operating Load Range• Penalty For 4PS Scalability• Significant Disadvantage For Silver PS
20 5/4/2011
System x Power Development
PS Efficiency Comparison – IBM vs. Competitor ‘A’
1PS Efficiency Comparison To Each Individual Max. Design Load
7580859095
100
0 10 20 30 40 50 60 70 80 90 100
Load (%)
Effic
ienc
y (%
)
'A' 1200W Platinum IBM 1975W 'A' 1200W Silver
• IBM PS Design More Optimized At Light Load, and Redundant Operating Range Below 50% PS Load, Compared To Competitor A’s Best
• Competitor ‘A’ Offers High Efficient and Low Efficient PS Option
21 5/4/2011
System x Power Development
PS Efficiency Comparison
1PS Efficiency Comparison To 1200W System Load
7580859095
100
0 10 20 30 40 50 60 70 80 90 100
Load (%)
Effic
ienc
y (%
)
'A' 1200W Platinum IBM 1975W 'A' 1200W Silver
• IBM 1975W Performance Equivalent Over 1200W System Load Range, To Competitor A’s Best, Even With Larger Capacity
22 5/4/2011
System x Power Development
System Consumption – Medium Configuration
4x130W CPUs, 32x16Gb Memory Dimms
579
11411194
658
1093
530
1106
526
300500700900
11001300
Idle 2PS/1PS MpX 2PS/1PS Idle 4PS/2PS MpX 4PS/2PS
System Configuration
AC
Wat
tage
'A' Silver 1200W IBM 1975W
• Significant IBM Advantage Across All Configurations, Compared ToCompetitor ‘A’ Silver PS (Delivered With Our System)
• Idle Savings (53W – 128W)• Operating MPx (35W – 101W)
23 5/4/2011
System x Power Development
System Consumption – Light Configuration
4x95W CPUs, 8x4Gb Memory Dimms
430598 673
517 553391
553380
200
400
600
800
Idle 2PS/1PS MpX 2PS/1PS Idle 4PS/2PS MpX 4PS/2PS
Configuration
AC
Wat
tage
'A' Silver 1200W IBM 1975W
• Significant IBM Advantage Across All Configurations, Compared ToSilver PS (Delivered With Our System)
• Idle Savings (50W – 126W)• Operating MPx (45W – 120W)
24 5/4/2011
System x Power Development
Energy Efficiency / Consumption Leadership
PS Efficiency Leadership
System Power Consumption Leadership
Significant Reduction In System Idle Power
DC/DC Memory and CPU Power Consumption Leadership
Resultant Estimated Customer Operating Savings– Comparing 2PS IBM / 4PS Silver Competitor (Most Common Redundant
Configuration)
• 125Wac x 24Hrs x 365 Days x 1/1000 = 1095kWh/Yr $110 / Yr• Data Center Savings x2 $220 / Yr
– Significant Idle Power Savings (160W) From Athena $280 / Yr
25 5/4/2011
System x Power Development
Acknowledgements:
Trung Nguyen - Power Procurement
Nick Celenza - Power Development
Kevin Linen - Power Development
DongHong Li - Power Development
Ellis O’Neal - Power Development
Dipak Tailor - Power Development
Ted Howard - Power Development
Alfred Burress - Mgr. Power Development
Michelle Brunk - Marketing
26 5/4/2011
System x Power Development
Questions or Discussion?
Thank You
Ghidorah Power Subsystem
Ted Howard
(919)254-2611