Metzenbaum Shelley

Information about Metzenbaum Shelley

Published on October 23, 2007

Author: funnyside

Source: authorstream.com

Content

No Longer Flying Blind:  No Longer Flying Blind Progress and Promising New Paths in Performance Measurement Environmental Compliance Consortium, www.complianceconsortium.org Facility Reporting Project www.facilityreporting.org Shelley Metzenbaum, April 2004, [email protected] Two Topics:  Two Topics Facility Reporting Project (FRP): measurement for facilities Internal assessment and diagnostics, external analysis and accountability: performance track, performance contracts, EMSs, benchmarking, diagnostics, int’l mgt. www.facilityreporting.org Environmental Compliance Consortium: measurement for government Assessment and diagnostic measurement avail now for compliance assistance programs, enforcement, compliance info www.complianceconsortium.org I. Facility Performance Reporting:  I. Facility Performance Reporting Promising New Path: the Facility Reporting Project Emerging/Promising Practices Among Regulated Parties:  Emerging/Promising Practices Among Regulated Parties Attitude transition from opposition to management to strategic opportunity (Hoffman) Reputational concerns: better community relations (e.g., Shell) Leading to: EMS adoption ISO certification Balanced Scorecard with “beyond finance” measurement Government Response to Regulated Community Change:  Government Response to Regulated Community Change Performance Track, Green Tier, performance contracts, EMS as permit alternative, EMS mandate in compliance agreements, sectoral agreements But… Little public reporting from these mechanisms Hard to assess/learn from non-standardized info The Facility Reporting Project (FRP):  The Facility Reporting Project (FRP) The FRP is a multi-stakeholder initiative developing a: Generally accepted, Credible, Comparable, and Consistent facility-level environmental and social sustainability reporting framework. Guiding principles:  Guiding principles The framework will be: Legitimized by a multistakeholder and broadly consultative development process Informed by best current knowledge and practice Useful to the public, the private sector & gov’t A product that improves and evolves as experience is gained with facility-level reporting US-based to simplify initial implementation Upward compatible with the GRI What We Have Accomplished: Benchmarking/Baseline Analysis:  What We Have Accomplished: Benchmarking/Baseline Analysis www.facilityreporting.org Implementation Steps:  Implementation Steps Benchmark Research on the “state of facility reporting” Constitute Multi-Stakeholder Steering Panel Develop reporting framework via a multistakeholder process Communications program/stakeholder engagement; facility beta-testing; revisions Institutionalize Formal endorsements, institutional transition, ongoing evaluation and improvement Status:  Status Discussion draft out to “Fast Feedback” group (done) Comments discussed at late October Steering Panel meeting (done) Global Reporting Initiative MOA (in process) Public Exposure draft (May 15, 04) Combined hearing re FRP and MSWG Extl Value EMS (summer 04) Revise and pilot test (Fall 04) II. Government Performance Reporting:  II. Government Performance Reporting Progress: Advancing Positive Outcomes What Questions Do We Want Govt Measurement to Answer?:  What Questions Do We Want Govt Measurement to Answer? What problems need attention? Did an intervention work – raise compliance levels and improve environmental quality? Did a compliance assistance program raise compliance levels, lessen env. impacts, increase env. quality? Which interventions/actions work best and warrant replication? Which don’t work, so should be curtailed? Informed public, so know if govt has right priorities and reasonably trying to address them Regulatory Objectives :  Regulatory Objectives Making Good Things Happen Human and Environmental Health Compliance Adoption of Good Practices Awareness of Legal Obligations Preventing Bad Things from Happening Harmful incidents Accidents Bad Practices Pre-cursor events Fresh & Frequent Ambient Data Rich CA Measure – Diagnostic: When and where problems occur/whether intervention worked:  Fresh & Frequent Ambient Data Rich CA Measure – Diagnostic: When and where problems occur/whether intervention worked Charles River – MA/EPA R1 Discharge/Emissions Trends Valuable CA/P2 Measure when::  Discharge/Emissions Trends Valuable CA/P2 Measure when: Date of CA also tracked and shown (for small project) Date of Compliance Initiative Tons/year CO Emissions Compliance Rates Valuable CA/P2 Measure (Program) if::  Compliance Rates Valuable CA/P2 Measure (Program) if: Also Show Inspection Data Fresh & Frequent Date of Initiative Slide17:  (10) Leak Checks (18-19) Controls (36i) Emergency Procedures Diagnostics: MA ERP Self-Audit Data 1997 & 1998 Self-Reported, Categorized Compliance Trends Valuable MA ERP “Critical Compliance Indicators” Valuable CA Measure when::  “Critical Compliance Indicators” Valuable CA Measure when: Fresh and Frequent (enough) Statistically valid or large percentage of total NH, CO Survey Data Valuable CA Measure:  Survey Data Valuable CA Measure Awareness of regulatory obligations Awareness of other enforcement actions (pre-req. for deterrence effect) Awareness of best practices not mandated by law Relatively low cost, very informative Oregon II. Government Performance Reporting:  II. Government Performance Reporting (b) An Additional Path Forward: Preventing Negative Outcomes Measure Unwanted Incidents to Manage Them Down:  Measure Unwanted Incidents to Manage Them Down Lessons from Other Fields – Big/Common to Small/Rare: Fire:  Lessons from Other Fields – Big/Common to Small/Rare: Fire Every major fire studied for key characteristics (cost of damage, injuries, cause of fire, building materials, etc.) Data base created and studied Cooperation with insurance industry Patterns identified Control methods tested Model codes created Model codes adopted Firefighters now primarily EMTs Lessons from Other Fields: (Reduce Level of Harm)Transportation Accidents:  Lessons from Other Fields: (Reduce Level of Harm)Transportation Accidents Percentage of Fatalities Related to Speeding (top) and Alcohol (bottom), 1999 - 2000 Fatality Rates/ 100 mm 50 % 30 % Lessons from Other Fields: Flight, Medical, Food Safety:  Lessons from Other Fields: Flight, Medical, Food Safety Pilots set up NASA near-miss tracking program Identifies problematic patterns, while it Protects those being measured with anonymity. VA replicated system to reduce medical errors. Post-hoc plane accident analysis to look for possible causes Tarmac incursion program to prevent pre-cursor events FDA centralized adverse event reporting system PA Complaint Analysis: An Adverse Event Reporting System:  PA Complaint Analysis: An Adverse Event Reporting System What were they looking for?:  What were they looking for? Common Occurrences: Organize and Analyze Data to Find It Anomalies in Data Patterns: They Trigger Focused Follow-Up Questions Leading to Problem and Solution Identification Contributing (explanatory, pre-cursor) factors for future tracking and prevention Correlations Possible Applications in Environmental Protection:  Possible Applications in Environmental Protection Accidents (Wharton, TX A&M, LEPCs) Study/track frequency of past accidents Study/track characteristics with post-hoc analysis Excedences Non-compliance characteristics Practices Professional certification Complaints (adverse event reporting system) Other? Effective Measurement Systems emphasize::  Effective Measurement Systems emphasize: Learning/diagnostics over accountability Performance over punishment Create “Safe” Measurement Systems for those Being Measured, so will not implode system Pilots: Personal Stake Third-party reporting without attribution Veteran’s Admin hospital staff Workers Caveats::  Caveats: Don’t Get Tied up in the Quest for Perfect Information Tie data accuracy level to intended use Diagnostics < Evaluation < Rule-writing and enforcement (a suggested hierarchy): Need Better Diagnostic Measurement Systems Don’t worry about claiming credit, It will get in your way. If performance linked to rewards, create teams and reward teams. Better yet, don’t create direct links between rewards and performance measures. Use reputational motivation. Accountability for what?:  Accountability for what? Relentless attention to outcomes Mastery of measurement information Cogent strategies Intelligent experimentation Continual analysis of experience to guide future action Time to Stop Flying Blind :  Time to Stop Flying Blind No reason to run a compliance assurance program without outcome measures – outcomes attained and harms prevented Without measurement, like throwing darts without being able to see if hit the target. Why bother?

Related presentations


Other presentations created by funnyside

HCM Luzern
18. 06. 2007
0 views

HCM Luzern

lecture12
12. 10. 2007
0 views

lecture12

basketball
01. 08. 2007
0 views

basketball

Atacama Large Millimeter Array
15. 06. 2007
0 views

Atacama Large Millimeter Array

gen mtgmar07 slides
18. 06. 2007
0 views

gen mtgmar07 slides

THAKKAR ANJALI artificial blood
16. 10. 2007
0 views

THAKKAR ANJALI artificial blood

20030815 RepICFA HN
27. 09. 2007
0 views

20030815 RepICFA HN

Owen
03. 10. 2007
0 views

Owen

14BBlackHoles
07. 10. 2007
0 views

14BBlackHoles

Noda06
09. 10. 2007
0 views

Noda06

reptile
10. 10. 2007
0 views

reptile

leskov
15. 10. 2007
0 views

leskov

461
17. 10. 2007
0 views

461

Europe Presentation
19. 10. 2007
0 views

Europe Presentation

RadOnc
22. 10. 2007
0 views

RadOnc

schnittsysteme
23. 10. 2007
0 views

schnittsysteme

ch1 10 part2
23. 10. 2007
0 views

ch1 10 part2

firma end Presentation
19. 10. 2007
0 views

firma end Presentation

sta291 5c
29. 10. 2007
0 views

sta291 5c

ACM India Studies 2005
26. 11. 2007
0 views

ACM India Studies 2005

Mirabel
01. 12. 2007
0 views

Mirabel

ghana
10. 12. 2007
0 views

ghana

DanishCitationEventJB final
15. 10. 2007
0 views

DanishCitationEventJB final

aleynikov
26. 10. 2007
0 views

aleynikov

ShortageChicago Seago 2
29. 10. 2007
0 views

ShortageChicago Seago 2

Daylight Saving Time
07. 11. 2007
0 views

Daylight Saving Time

unity
21. 08. 2007
0 views

unity

Fad Diets
21. 08. 2007
0 views

Fad Diets

NACADA Combined Workshop
21. 08. 2007
0 views

NACADA Combined Workshop

TeraGrid SC06 1
22. 10. 2007
0 views

TeraGrid SC06 1

plane parallel 2 1
24. 10. 2007
0 views

plane parallel 2 1

cronologia storia contemporanea
13. 11. 2007
0 views

cronologia storia contemporanea

IDitarod
16. 11. 2007
0 views

IDitarod

Axiome Von Neumann Morgenstern
19. 11. 2007
0 views

Axiome Von Neumann Morgenstern

Dog bite sepsis
19. 11. 2007
0 views

Dog bite sepsis

Girish
21. 11. 2007
0 views

Girish

EcoValidity
17. 12. 2007
0 views

EcoValidity

matthew
29. 12. 2007
0 views

matthew

Cyatheaceae Classification
02. 01. 2008
0 views

Cyatheaceae Classification

RFF Shinnecock
03. 01. 2008
0 views

RFF Shinnecock

AustralianPoetry
03. 01. 2008
0 views

AustralianPoetry

dbl dutch
22. 11. 2007
0 views

dbl dutch

Lecture10 overheads
21. 08. 2007
0 views

Lecture10 overheads

Deborah Russell Presentation
14. 11. 2007
0 views

Deborah Russell Presentation

AAPT v3
01. 08. 2007
0 views

AAPT v3

EScannapieco
15. 11. 2007
0 views

EScannapieco

Successful  Case  Studies
29. 09. 2007
0 views

Successful Case Studies

Interv Hajji
23. 10. 2007
0 views

Interv Hajji

khelif edson rep
09. 10. 2007
0 views

khelif edson rep

aadcrocodile
11. 10. 2007
0 views

aadcrocodile

matricole
16. 10. 2007
0 views

matricole

the three little pigs
14. 02. 2008
0 views

the three little pigs

Exon HKSB
30. 10. 2007
0 views

Exon HKSB

June06SPCCUpdateJVan voorhis
07. 11. 2007
0 views

June06SPCCUpdateJVan voorhis

cultural impact hispanics tn
24. 02. 2008
0 views

cultural impact hispanics tn

SE 05 Punctuation I
29. 02. 2008
0 views

SE 05 Punctuation I

GaryCorbett e
04. 03. 2008
0 views

GaryCorbett e

Radiation Hazards
06. 03. 2008
0 views

Radiation Hazards

Portoroz
04. 10. 2007
0 views

Portoroz

jdean c10
25. 03. 2008
0 views

jdean c10

SoS
25. 03. 2008
0 views

SoS

MVestergaard SantaFe06
29. 11. 2007
0 views

MVestergaard SantaFe06

PowerPointTour
02. 11. 2007
0 views

PowerPointTour

tal daly
10. 04. 2008
0 views

tal daly

matz011
16. 04. 2008
0 views

matz011

installaware faq
17. 04. 2008
0 views

installaware faq

ATMSELong
18. 04. 2008
0 views

ATMSELong

36329938
22. 04. 2008
0 views

36329938

ITCan
10. 03. 2008
0 views

ITCan

kejian4
11. 10. 2007
0 views

kejian4

061213 dialog north korea petrov
11. 10. 2007
0 views

061213 dialog north korea petrov

Session6 Adm Wilcocks
07. 11. 2007
0 views

Session6 Adm Wilcocks

high technology surgery
30. 04. 2008
0 views

high technology surgery

Robot Convoy final presentation
07. 01. 2008
0 views

Robot Convoy final presentation

harry truman
18. 06. 2007
0 views

harry truman

goldrush
18. 06. 2007
0 views

goldrush

GMK
18. 06. 2007
0 views

GMK

gatech
18. 06. 2007
0 views

gatech

fusion be
18. 06. 2007
0 views

fusion be

Fun Facts updated 3 05
18. 06. 2007
0 views

Fun Facts updated 3 05

Geomatic AAU 07032007 forkortet
18. 06. 2007
0 views

Geomatic AAU 07032007 forkortet

General Spring Intro
18. 06. 2007
0 views

General Spring Intro

intervento Ambrosi Legge125
18. 06. 2007
0 views

intervento Ambrosi Legge125

insostegno
18. 06. 2007
0 views

insostegno

Inhalts angabe
18. 06. 2007
0 views

Inhalts angabe

Implant Simulations
18. 06. 2007
0 views

Implant Simulations

implantate berlin
18. 06. 2007
0 views

implantate berlin

Imber stud
18. 06. 2007
0 views

Imber stud

hsm bend2
18. 06. 2007
0 views

hsm bend2

history mat storia dei diritti
18. 06. 2007
0 views

history mat storia dei diritti

headquarters structure
18. 06. 2007
0 views

headquarters structure

Department Of Conservation
23. 10. 2007
0 views

Department Of Conservation

Hippo
18. 07. 2008
0 views

Hippo

pa3 disare ppt
28. 09. 2007
0 views

pa3 disare ppt

Sudan Polio Update 03 05
21. 10. 2007
0 views

Sudan Polio Update 03 05

bradford ancer
21. 08. 2007
0 views

bradford ancer

Delaunay Triangulations
15. 06. 2007
0 views

Delaunay Triangulations

Bayesian analysis and problems
15. 06. 2007
0 views

Bayesian analysis and problems

Biofuels - Think Big
15. 06. 2007
0 views

Biofuels - Think Big

AVO  - Virtual Observatory
15. 06. 2007
0 views

AVO - Virtual Observatory

PHOBOS Collaboration
15. 06. 2007
0 views

PHOBOS Collaboration

gennaipm
18. 06. 2007
0 views

gennaipm

sigcse2003
07. 12. 2007
0 views

sigcse2003

Introductionto Kyrgyzstan
26. 11. 2007
0 views

Introductionto Kyrgyzstan

HIT SAN
18. 06. 2007
0 views

HIT SAN

ppt CHAP018
24. 02. 2008
0 views

ppt CHAP018

lesson3 warm up
07. 04. 2008
0 views

lesson3 warm up

shelving with lcc
19. 02. 2008
0 views

shelving with lcc

25ConnectionsV5 p2
18. 10. 2007
0 views

25ConnectionsV5 p2

2506043
15. 11. 2007
0 views

2506043

TravelChapter7 3
27. 03. 2008
0 views

TravelChapter7 3

french rfp
18. 06. 2007
0 views

french rfp

BEFxii Coronado
09. 04. 2008
0 views

BEFxii Coronado

spectrumastrotalk
28. 11. 2007
0 views

spectrumastrotalk

metadata frames
05. 10. 2007
0 views

metadata frames

Dancefinal
27. 11. 2007
0 views

Dancefinal