All Rights Reserved, Copyright © GIPC 2012
Global Harmonization ofDatacenter Energy Efficiency Metrics
Takeshi Ueoro (NTT Data Corp.)
October, 2012
1All Rights Reserved, Copyright © GIPC 2012
1. The Need for Energy Efficiency Metrics
2. Efforts for Metrics Development in Japan
3. Harmonizing Global Metrics forData Center Energy Efficiency
Table of Contents
2All Rights Reserved, Copyright © GIPC 2012
1. The Need for Energy Efficiency Metrics
3All Rights Reserved, Copyright © GIPC 2012
1.1 Forecast of Energy Consumption by Data Centers (Global)
Source)Based on Green IT Promotion Council FY2009 Report
2005 2025 2050
7,186
29,810
3,1552,0061,425
9,192
32,965
Energy C
onsumption (100 m
illion Kw
h/year)
During technological revolution
Baseline
4All Rights Reserved, Copyright © GIPC 2012
PUE Total data center power consumption
Power consumed by IT equipment(Power Usage Effectiveness)Existing metric =
However, PUE is a metric that measures the facility efficiency of the data center.
There is a need for a metric that can evaluate the data center itself!
PUE is already being utilized by many companies.
1.2 Existing Evaluation Metrics
5All Rights Reserved, Copyright © GIPC 2012
2. Efforts for Metrics Development in Japan
6All Rights Reserved, Copyright © GIPC 2012
2.1 Policies of Metrics Development
■A data center energy efficiency metric(1)Can easily compute the energy efficiency of a data center(2)Can make side-by-side comparisons between data centers (3)Can continue to make energy conservation condition
comparisons throughout the year
■Incorporate principal factors that improve data center energy efficiency
(1)Operation efficiency (2)IT equipment efficiency (3)Facility efficiency (4)Green energy utility
7All Rights Reserved, Copyright © GIPC 2012
2.2 Concept of the New DPPE Metric
Data Center
Air-conditioners, power supply devices, power generators, lighting
ElectricityGasFuelCold water
Exhaust heat
Input energy Output
Photovoltaic energyWind energy
Energy
GREEN energy
Facility
IT
equipment
Servers, storage, network devices
WorkOperations, virtualization, power conserving operations
WorkInput energy (excl. renewable energy)
DPPE=
DPPE
(Datacenter Performance Per Energy)This metric is the data center workload per CO2-emitting energy
Operation
Note) DC : Data Center
8All Rights Reserved, Copyright © GIPC 2012
DPPE =
IT equipment work rate
IT equipment work capacity
DC energy
IT equipmentenergy
DC energy
DCenergy
IT equipmentenergy
DC Work
DC energy – Green energy
=
=
DC energy – Green energy
IT equipment work rate
IT equipment work Capacity
Greenenergy
-
① ② ③ ④
If data center workload (“DC Work”) is defined as IT equipment work rate × IT equipment work capacity, DPPE can be broken down to 4 factors below.
2.3 Breakdown of DPPE to 4 factors
2.5 Definition of DPPE and its 4 Sub-metrics
9All Rights Reserved, Copyright © GIPC 2012
IT Equipment Utilization (ITEU)
IT Equipment Energy Efficiency(ITEE)
Power Usage Effectiveness
Green Energy Coefficient
(PUE)
(GEC)
Sub-metric Name Basic Definition Corresponding action
=• Effective operation of IT equipment
(IT equipment rated capacity)(Rated Energy Consumption of IT equipment)
=• Installation of energy efficient IT equipment
DC Total Energy Consumption
(Energy Consumption of IT Equipment) =• Energy saving in facility
=Green energy
DC Total Energy Consumption
• Use of GreenEnergy
DPPE=ITEU×ITEE×(1/PUE)×(1/(1-GEC))
IT energy measured
IT energy max
10All Rights Reserved, Copyright © GIPC 2012
IT Equipment Utilization (ITEU)
Measuring ITEU
RangeITEU=0~1(MAX)
Total energy consumption of IT equipment [kWh]Total rated energy consumption of IT equipment [kWh]
ITEU =
2.8 Definition of ITEU
・Ratio of the total rated power of IT equipment written on their specification sheet to the actual measured power of IT equipment is used.
・The trend of the entire data center can be obtained although the ratio of the actual energy consumption to rated energy varies for each equipment.
・Though it is currently difficult for many data centers, it is desirable to measure it by monitoring servers, NW equipment and storage usage.
11All Rights Reserved, Copyright © GIPC 2012
GIPC and JDCC compiled detailed PUE measurement guidelines and took measurements in Japan.
As the discussion over the definition of PUE is ongoing, these measurements were conducted by adding a definition of non-electric energy to the conventional PUE (site energy).
Consider all the energy related to the data centerMeasure the energy consumption of IT equipment at PDU output.When accumulated power (kWh) is not measurable, the effect of power
factor be considered.
2.9 Summary of PUE Measurement
DC Total Energy Consumption
(Energy Consumption of IT Equipment) PUE=
12All Rights Reserved, Copyright © GIPC 2012
ITEE: IT Equipment Energy Efficiency
Measuring ITEE・ITEE is given by dividing the IT equipment capacity by its energy consumption・How is IT equipment capacity calculated?Multiplication of the energy efficiency of the IT equipment (capacity/rated
power) by rated power・Sum of server capacity, storage capacity, network equipment capacity:
Adjusted by coefficients since the units differ for each capacity■Range
ITEE =
0 ~
∞
(server capacity) +
(storage capacity) +
(NW equipment capacity)
Total rated power [W] of IT equipment (servers, storage, NW equipment)ITEE =
= 7.72 [W / GTOPS]
= 0.0933 [W / Gbyte]
= 7.14 [W / Gbps]
2.10 Definition of ITEE
Server capacity
Energy consumption efficiency
Storage capacity
Energy consumption efficiency
NW equipment capacity
Energy consumption efficiency
13
2.11 Reference Computation of Capacity Used Through ITEEThe capacity of equipment used under ITEE engages the energy consumption efficiency outlined in Japan’s Law Regarding the Rationalization of Energy Use. Multiply the rated power by the reciprocal of energy consumption efficiency, and set the result as the substitute for capacity.
(Server capacity) +
(Storage capacity) + (NW
equipment capacity)ITEE =
Note: See http://www.eccj.or.jp/top_runner/index.html#eng for more detailed definitions of Energy Consumption Efficiency
(W1 + W2) / 2
Q
W1: Idle time Power consumption [W]W2: Power saving mode consumption [W]Q: Combined Theoretical Performance
(See next page for details of CTP)
Power consumption [W]
Storage capacity [GB]
WTransmission speed [Gbps]
W: Power Consumption at the Maximum Data Transmission Speed achieved [W]
All Rights Reserved, Copyright © GIPC 2012
Capacity = Rated power [W]
Energy Consumption Efficiency [W/MTOPS]
Capacity = Rated power [W]
Energy Consumption Efficiency [W/GB]
Capacity = Rated power [W]
Energy Consumption Efficiency [W/Gbps]
Total rated power of IT equipment [W]
14All Rights Reserved, Copyright © GIPC 2012
Measuring GEC
Green energy generated and consumed at data center [kWh]Data center’s total consumed energy [kWh]
GEC =
Green Energy Coefficient (GEC)
2.12 Definition of GEC
・Measure the energy generated on site using renewable energy
-Scope of green energy and how to treat energy generated on site/off site-How to treat green energy certificates
・To be defined in detail in the guideline
■Range
GEC = 0 ~ 1(MAX)
15All Rights Reserved, Copyright © GIPC 2012
2.6 Datacenter Energy Flow and Boundary of Metrics
Power Plant
Solar. Wind. etc
Local GreenPower
Grid PowerData Center Environment
Air conditioner.
Power Supply.
Lightings etc.
Hardware
ITEEPUE ITEUGEC
Data Center
Efficiency of Energy Procurement Efficiency of FacilityEfficiency ofHardware
Efficiency of Software and Operation
Software
and
Operation
IT Equipment
DPPE
Gas, Fuels
Other
Energy
16All Rights Reserved, Copyright © GIPC 2012
By the separate application of DPPE’s 4 sub metrics for each line of responsibilities, the entire effort for the Energy Efficiency of the Data Center could be divided into 4 different responsibilities.
Entire Data Center Efficiency must be doubled!
So, we need to double the DPPE number.
CIO
We need to make
ITEE 40% better
We need to make ITEU 20% better
We need to make
PUE 20% better
We need to make
GEC x 1.1
CIO CIO CIO CIO
Operations Purchasing Facility Dept. Facility Dept.
We could buy Equipments
with 40% improvements.
We could improve
operations by ……..
We could improve AC efficiency by
xx %
We could use xx KW
of PV
1. CIO determines total goal of DPPE
2. CIO decides goals of sub-metrics and tells them to managers
3. Managers determine plans to achieve each goal.
1.2 x 1.4 x 1.2 x 1.1=2.2 > 2
2.7 Useful use of the DPPE explained
* the mean value of ITEE in 2005 is assumed. ** the mean value of ITEE in 2010 (CAGR of 45 % is assumed.)
Assumed range of sub metrics for 2010
ITEU
ITEE
PUE
GEC
Worst Best
0.2 0.7
1.00* 6.41**
2.5 1.2
0 0.3
Estimated range of DPPE in 2010
0.08 5.34-
0.2×1.00×1/2.5×1/(1-0)
0.7×6.41×1/1.2×1/(1-0.3)
Worst Best
17All Rights Reserved, Copyright © GIPC 2012
Estimated potential range of DPPE in 2010 is consistent with the observation.
2.13 The estimated range of DPPE and sub-metrics
2.14 Example of a Monitoring System Utilizing the DPPEA Japanese company is trying to develop a data center monitoring system based on the holistic approach.
Values of the metrics are shown in a spider chart.
ITEE
GEC
PUE
ITEU
DPPE
All Rights Reserved, Copyright © GIPC 2012 18
Note: This trial system currently shows instantaneous values.
19All Rights Reserved, Copyright © GIPC 2012
データセンタ A B C D E F ベトナム シンガポール
ITEU 0.57 0.26 0.42 0.36 0.42 0.31 0.4 0.74
ITEE 2.14 1.08 0.48 3.68 1.32 1.41 0.84 3.59
PUE 1.89 1.42 1.76 2.12 1.82 1.71 1.77 2.2
GEC 0 0 0 0.004 0 0 0 0
DPPE 0.64 0.2 0.11 0.63 0.31 0.26 0.18 1.2
Measured values as of September 2010
2.14 Summary of DPPE Measurement
Data Center
Vietnam Singapore
20
3. Harmonizing Global Metrics forData Center Energy Efficiency
All Rights Reserved, Copyright © GIPC 2012
【Goal】Share global lessons and practices with an objective of arriving at a set of metrics, indices, and measurement protocols that can be formally endorsed or adopted by each participant organization to improve data center energy efficiency globally.
3.1 The “Global Harmonization” Task Force
21All Rights Reserved, Copyright © GIPC 2012
A task force (composed of public and private sector representatives from Japan, US and Europe) was founded to discuss the global harmonization of data center energy efficiency metrics.
1st Workshop Continuous Discussion
• F2F workshop (twice a year)• Bi-weekly Tele-conference
Goal of Harmonization:• A set of metrics, indices and
measurement protocols to improve data center energy efficiency globally
Date and Venue:• March 26, 2009, Washington DCMembers• The Green Grid• U.S Department of Energy• U.S Environmental Protection Agency• European Commission Joint Research
Center (Data Centers Code of Conduct)• Japan’s Ministry of Economy Trade and
Industry• Japan’s Green IT Promotion Council
3.2 Progress of the Global Harmonization Task Force
22All Rights Reserved, Copyright © GIPC 2012
TGG, U.S., EU and Japanese entities (both from private and public sectors) continuously held bi-annual “Face to Face” workshops and biweekly teleconferences.
2009 2010 2011 2012
F2F
Workshop
Tele-conference
1st
WS(March, Washington DC)
2nd
WS(Feb, San Jose)
3rd
WS(Oct, Milan)
4th
WS(Feb., Tokyo)
5th
WS(Oct, Washington DC)
6th
WS(Feb, Milan)
Introduction by Each Economy’s Participants
Definition of Desired Outcomes
Proposal of DPPE Metrics Calculation
PUE, GEC
Productivity Proxies
ITEE, ITEU (Introduction of the guideline and the trial measurement)
PUE Measurement,
DPPE Feedback (From TGG, EU, DOE, EPA)
Carbon metric
IT productivity metric including ITEE x ITEU
Carbon metric
Holistic Approach
Biweekly teleconference
Desired Outcome
PUEGEC, CUE, ERF
7th
WS(Oct, Tokyo)
2nd Workshop on Feb. 2010: Desired Outcomes
23All Rights Reserved, Copyright © GIPC 2012
At Feb. 2010 Face to Face Workshop meeting, Desired Outcomes were agreed and defined to achieve the determination of Total Data Center Energy Efficiency.
Source: “Harmonizing Global Metrics for Data Center Energy Efficiency”(http://www.greenit-pc.jp/topics/release/pdf/dppe_j_20100416.pdf, http://www.greenit-pc.jp/topics/release/pdf/dppe_j_20110228.pdf)
Green Energy
Infra- structure
Ope- ration
Target
Hardware
4th Workshop on Feb 2011: PUE Measurement Protocol
24All Rights Reserved, Copyright © GIPC 2012
At Feb. 2010 Face to Face Workshop meeting, the detailed measurement method of PUE was defined with a standardization in mind.
DesiredOutcomes
(1a)
(1b)
(2)
Holistic Framework
Metrics/Proxies Status
DefinitionCalculationMethodology
CalculationExample
Document/Agreement
PUE
Discussed
GEC/CUE/ERF etc. Discussed Discussed
DiscussedGIPC’sITEE & ITEU,TGG’ s Proxy #1 - #8
Discussed Discussed
Agreed Agreed Agreed Completed
-
Reached Agreements on PUE
25All Rights Reserved, Copyright © GIPC 2012
“Measurement Guideline” of PUE, recommended Electrical Measurement points, and considerations for non-Standalone Data Center co-located within a large building complex site were discussed and agreed.
For Facility Energy usage determination, PUE was recommended.
IT Energy Measurement Points at PDU were strongly recommended.
Consideration for non-
Electrical Energy usage and measurements were thought.
Source: “Harmonizing Global Metrics for Data Center Energy Efficiency” (http://www.greenit-pc.jp/topics/release/pdf/dppe_j_20110228.pdf)
Reached Agreements on PUE
26All Rights Reserved, Copyright © GIPC 2012
PUE=Measurement of the total energy of the data center
the IT energy consumption
Type of energy
Weighting Factor*
Electricity 1.0Natural gas 0.35Fuel (oil) 0.35Fuel (other) 0.35Cold water 0.40Warm water 0.40Steam 0.40
Total energy is calculated by multiplying the weighting factor of each type of energy.
UPS PDUElectricity
1,100,000kWh
Cold water
1,600,000kWh
IT energy 1,000,000kWh
Data Center
Cold water
1,600,000kWh
Example of PUE computation in the case that cold water is used for air-conditioners.
PUE = (1,100,000*1+1,600,000*0.4) / (1,000,000*1)PUE = 1.58
6th Workshop on Feb. 2012: GEC/CUE/ERF
27All Rights Reserved, Copyright © GIPC 2012
At Feb. 2012 Face to Face Workshop meeting, “GEC”, “CUE”, “ERF” and holistic framework were discussed.
DesiredOutcomes
(1a)
(1b)
(2)
Holistic Framework
Metrics/Proxies Status
DefinitionCalculationMethodology
CalculationExample
Document/Agreement
PUE
Agreed
GEC/CUE/ERF
Agreed Agreed
DiscussedGIPC’sITEE, ITEUTGG’s Proxy #4 - #6
Discussed Discussed
-
Agreed Completed
Agreed Agreed Agreed Completed
Completed
Metrics for Carbon Reductions
28All Rights Reserved, Copyright © GIPC 2012
For the Desired Outcome 2 – “GEC”, “CUE” and “ERF” metrics were defined.
In order to promote and accredit the usage of Renewable Energy
GEC
Determine and performance measure the CO2 output from the Data Center
CUE
In order to promote the reuse/renew the wasted heat source from the Data Center.
ERF
Purpose
Ratio comparison of the Green Energy Source out of the Total Energy Consumption of a Data Center. Determined by the Green Energy Certificate ownership.
Ratio Comparison of the IT equipment Energy usages with a Data Center’s Total CO2 outputs.
Ratio between Total Data Center Energy Wastes vs. Reused/Renewed Wasted Energy by recovery.Unnecessary extended Waste Heat Output must be avoided. (PUE may go worsened)
Details
GEC CUE ERFBasic
Definition= = =Green energy consumed by the data center
Total energy consumed by the data center Reuse energy outside of the data center Total energy consumed by the data centerCEF x PUE
Where: CEF is the Carbon Dioxide Emission Factor (kgCO2eq/kWh) of the site.
Green EnergyCoefficient
Carbon Usage Effectiveness
Energy ReuseFactor
Reached Agreements on GEC
29All Rights Reserved, Copyright © GIPC 2012
GEC=Green energy consumed by the data center
total energy consumed by the data center
Regio n
Regional Authority / Issuer(s)
Link
E.U. Association of Issuing Bodies
Department of Energy and
Climate Change
http://www.aib- net.org/portal/page/portal/AIB_HOME/EECS/ Fact sheets(See Fact sheet 4)
http://www.decc.gov.uk/en/content/cms/meeti ng_energy/renewable_ener/renew_obs/eligibili ty/eligibility.aspx
Japan The Green Energy Certification Center
http://eneken.ieej.or.jp/greenpower/eng/index. htm
U.S.A U.S. EPA Green Power Partnership Green-e
http://www.epa.gov/greenpower
http://www.green-e.org/
Each country’s websites for information on green energy certificates.
Power Station Grid Powerdistribution
Utility meter
DC Purchased Green Energy Certificates for 20% of energy used.
100GWh
GEC=20/100=0.2
Certificate20GWh
Example: If 20GWh of renewable energy is purchased through green energy certificates or generated on site.
Reached Agreements on CUE
30All Rights Reserved, Copyright © GIPC 2012
CUE=Total CO2 emissions caused by the total data center energy
Total IT equipment energy
(1)If electricity is the only energy source for the data center
CUE is calculated as CEF × PUE*CUE value of each country/region is used.
CEF is the Carbon Emission Factor (kgCO2eq/kWh) of the site. PUE is the annual PUE for the data center.
(2)If energy source(s) other than electricity is used CO2 emissions are calculated for each type of energy.CUE=CO2 emissions of a data center/Energy
consumed by IT equipment
・Excludes purchased green energy and carbon offsets.(Purchase rights are not allowed to be deducted for zero emission buildings)
Reached Agreements on ERF
31All Rights Reserved, Copyright © GIPC 2012
ERF=Reuse energy outside of the data center Total energy consumed by the data center
・Does not include reuse of waste energy generated within the data center. (It will be reflected in the PUE.)・ERF includes not only waste heat but also reuse of electricity and cold water.
Holistic Framework
32All Rights Reserved, Copyright © GIPC 2012
33All Rights Reserved, Copyright © GIPC 2012
7th Workshop on Oct. 2012: Outcome 1.a
・IT Productivity・Maturity Model for IT Productivity・DC Productivity Proxy Approach・Others
The taskforce discussed subjects Outcome(1) and (1.a), the final issues for the group to discuss, on Oct. 2 and 3.
Metric for Desired Outcome 1a (IT Productivity)
34All Rights Reserved, Copyright © GIPC 2012
Current 9 Productivity Proxy proposals, including most recent “ITEE x ITEU” proxy, 4 Proxies are current finalists on the discussion at the Task Force.
# Type of Proxy (Proposal)
Evaluation
Accuracy Ease of Use
Both Points
1 Useful Work Self-Assessment and Reporting + - +
2 DCeP Subset by Productivity Link + - +
3 DCeP Subset by Sample Workload + - +
4 Bits Per Kilowatt-Hour + ++ +++
5 Weighted CPU Utilization –
SPECint_rate + + ++
6 Weighted CPU Utilization -
SPECpower + + ++
7 Compute Units Per Second Trend Curve - + +
8 Operations System Workload Efficiency - + +
9 IT Capacity x IT Utilization (ITEE x ITEU) + ++ +++
TGG
GIPC
Proposal
35All Rights Reserved, Copyright © GIPC 2012
Conclusion
The global harmonization taskforce was initiated in 2009 and it has released many statements since then.It is currently continuing discussions seeking to reach an agreement by 2013.
We hope that the metrics and measurement standards to be established by the task force will be widely utilized and contribute to the improvement of energy efficiency in data centers throughout the world.
All Rights Reserved, Copyright © GIPC 2012
Thank you
http://www.greenit-pc.jp/activity/dppe/index.htmlGIPC- “Green IT Promotion Council” of Japan
Contact: Takeshi UeoroE-mail: [email protected]