Measuring Environmental Performance A Survey Overview

EFCOG – Environmental ISM WG

Judy McLemoreWashington Group InternationalWashington Regulatory and Environmental Services

Judy McLemoreWashington Group InternationalWashington Regulatory and Environmental Services

2

Why A Survey?Why A Survey?

Collect information on environmental performance metrics used by EFCOG member companies Emphasize leading metrics Identify other metrics as well Determine how are metrics used Quantify frequency of measuring/reporting

Supplement EFCOG performance analysis task group's information on current state of environmental metrics

What can we learn from analyzing the data?

3

What was requested?What was requested?

Key environmental measures / metrics used by sites

Frequency Leading measures or indicators Use

Site: Date: Submitted By:Email Address:

What is the Measure

(including units)

Include definition & why measure was selected?

Media FrequencyMeasured (daily, monthly, etc.)

Reported - To Whom & Frequency

Measure is collected to monitor

Is this a leading

indicator?

Describe how indicator data is

used?Impacts

√ EMS

Effectiveness

√

4

Survey Responses Survey Responses

Nine sites One hundred twenty five measures Average of fourteen per site

1212

21

11204

20

5

20

KCP - FM&T

Idaho CP

INL Battelle

LANL

NREL

Pantex

SNL CA

Hanford - WC

WIPP

5

Media

16%

48%

24%

12%

Air Waste Water Other

What do we measure? What do we measure?

Fifty eight are measures related to environmental

media

0 20 40 60 80 100

Compliance

P2

EMS

Impacts

EMS Effectiveness

Indicators Related to

EMS effectiveness and impacts categories

determined by sites

6

What do we measure ?What do we measure ?

EMS Effectiveness Impacts Examples EMS P2

Sample Management Percentage

Mobil Sources Emissions

Emergency Sampling Requests

Develop energy and fuel conservation plan

7

Good Environmental Performance Metrics WillGood Environmental Performance Metrics Will

Demonstrate progress toward goals

Be linked to corporate objectives

Improve company performance

Motivate changes in behavior

High quality, consistent and accurate

Relatively easy to collect at a reasonable cost

Clearly stated and understood

Focus on materials, energy, water, waste, emissions

Based on benchmarking by Global Environmental Management Initiative http://www.gemi.org/

8

Demonstrate Progress Toward GoalsDemonstrate Progress Toward Goals

Survey examples:

EMS target to reduce mobile source emissions by 10% by the end of 2008 versus 2004 baseline.

Maintain an internal RCRA violation rate of <2% of inspections not meeting criteria.

Increase total materials recycled / total materials generated

Environmental Release Severity Index – Target 0.3

Increase the percentage of environmentally preferred products purchased

“Thirty-five percent of our indicators measure progress toward internal objectives.”

9

Linked to “Corporate” ObjectivesLinked to “Corporate” Objectives

All support one or more of DOE’s environmental protection goals

Waste prevention

Reduction of environmental releases

Environmentally preferable purchasing

Environmental stewardship in program planning and operational design

Post Consumer Materials Recycling

10

Measure to Improve PerformanceMeasure to Improve Performance

Leading measure environmental practices or operations that are expected to lead to improved performance.

Lagging measure results of environmental practices or operations currently in place

11

Measure to Improve Performance Measure to Improve Performance

Leading Lagging

Measure: Process Input End-of-Process or Output

Approach:

Strength:

Weakness:

Quantitative or Qualitative Quantitative

Reflect Current or FutureRather than Past Performance

Easy to Quantifyand Understand

Often Difficult to Quantifyand Evaluate

Root Causes Not Identified

Examples: Toxic Materials EliminatedTons of High Sulfur Coal

Criteria Air PollutantsEnforcement Actions, Fines

12

•Manufacturing•Maintenance & Repair•Infrastructure Support•Storage•Testing•Training & Fielding•Transportation•Demilitarization•Administration & Housing

Measure to Improve Performance

• Air Emissions• Water Discharges• Solid Wastes• Hazardous Wastes

• Hazardous Raw Materials• Non-Hazardous Raw

Materials• Energy Resources • Water Resources

Pollution Prevention Emphasis

End-of-Pipe Emphasis

Leading Indicators Lagging Indicators

OutputInput Processes

Framework

13

Improving Performance / Changing Behaviors Improving Performance / Changing Behaviors

Leading33%

Lagging67%

Most companies use leading indicators but there is no

consensus on them across industry

0

5

10

15

20

25

KC

P-F

M&

T

Idah

o C

P

INL

Bat

telle

LAN

L

NR

EL

Pan

Tex

SN

L-C

A

Han

ford

-WC

WIP

P

Two of the greatest barriers in using leading indicators are finding the

right mix and not adding extra collection / reporting burden.

14

We mostly use….We mostly use….

Survey Examples - Qualitative

Recommend environmental language to incorporate into contract specifications for FY 07 contracts

Evaluate fresh water usage and develop water use profile

Materials Management - improve management and disposition of excess materials and equipment and improve implementation of vacating space requirements

Qualitative

Quantitative

15

A few use EPI’s!A few use EPI’s!

Environmental Performance Indice - a score representing an aggregation of environmental performance benchmarked against a baseline.

–

Environmental Index Washington Closure – Hanford

Weighting

Score 1 - Air Compliance (AC)calibrations complete / total required

0.25

Score 2 - SPCC Complianceplans in compliance vs. plans reviewed

0.25

Score 3 - Ecological and Cultural Clearancespermits/clearances implemented correctly vs. permits/clearances initiated

0.25

Score 4 - Sample Management 0.25

Ideal Score = 1

16

Other EPI’s usedOther EPI’s used

Environmental Release Severity Index

Environmental Document Timeliness Index

Regulatory Inspection Index

Environmental Document Quality Index

17

How about ECI’s? How about ECI’s?

Environmental Condition Indicators

measurement of a quantity or property of a component of the environment (e.g. contaminant concentrations in air, water, groundwater, soil, changes in crop yield or species population size).

Only one reported in survey Wildlife Species Richness

18

Who receives the metrics and how often?Who receives the metrics and how often?

0

10

20

30

40

50

60

Annual Quarterly Monthly Other

Frequency

0

10

20

30

40

50

60

70

Internal DOE Other Govmt No One

Audience

19

NormalizationNormalization

Can make measures more useful for comparison over space / time

Common factors for normalizing are man - hours, units of production, revenue

Nineteen of our measures have been normalized Per employee Per capita Calibrations completed vs. required Samples meeting requirements vs. reviewed

20

Is there a "right" number of measures ?Is there a "right" number of measures ?

Our average - 14 per siteGEMI Benchmarking - 7 per company

One size does not fit all

More is not necessarily better

Managers say greatest barriers to change are keeping metrics to a few critical, meaningful measures and reaching agreement on the most important ones to track, record

and report

21

OpportunitiesOpportunities

Develop a shared, common understanding of “leading” indicators and how to better identify and use them.

Evaluate site's indicators, are they "good" indicators? meaningful few (14 / site vs. 7 / company) material to our operation drive performance improvements/behavior changes normalize to make indicators more useful, particularly where

scopes change (expand, contract) routinely.

Learn more about using EPI’s Hanford - Washington Closure Idaho Completion Project

22

Background Background

23

Resources Resources

Global Environmental Management Initiative (GEMI) Benchmarking Survey – Sustainable Development Metrics

(January, 2005)

Survey – EHS Metrics and Processes (January, 2003)

Measuring Environmental Performance: A Primer and Survey of Metrics in Use (1998)

Environmental Performance Indicators, Presentation by Maureen Sullivan, Office of the Deputy Under Secretary of Defense (Environmental Security)