AOOS Project Selection criteria061407

Information about AOOS Project Selection criteria061407

Published on September 25, 2007

Author: Nickel

Source: authorstream.com

Content

Alaska Ocean Observing System:  Alaska Ocean Observing System Conceptual Design Development June 18, 2007 Ginny Fay Meghan Wilson Slide2:  Realism Capability Flexibility Ease of use Cost Easy Computerization Criteria for Project Ranking Systems Slide3:  Realism Reflect the reality of the decision making circumstances, including the multiple objectives of agencies and stakeholders. Common measurement system to evaluate projects. Take into account limitations on facilities, capital, personnel. Include a risk factor. Capability Address multiple timeframes Simulate various situations Internal situations (e.g., changes in staff) External situations (e.g., interest rates, appropriations) Optimize the decision Criteria for Project Ranking Systems Criteria for Project Ranking Systems :  Criteria for Project Ranking Systems Flexibility Provide valid results within a range of conditions. Easily modified or self-adjusting to changes in circumstances. Ease of Use Convenient, low execution time, easy to use and understand. Needs no special interpretation, no hard-to-acquire data, no excessive personnel or unavailable equipment. Parameters match one to one with real world variables that are significant to the project. Expected outcomes should be easily simulated. Criteria for Project Ranking Systems:  Criteria for Project Ranking Systems Cost Data gathering and modeling costs should be low relative to the project cost. All costs should be considered, and their total should definitely not be greater than the potential benefits of the project. Easy Computerization Convenient to gather and store information in a computer database. Easy to manipulate the data in the model such as through a spreadsheet. The Nature of the Project Ranking Systems:  Two basic model or ranking types Numeric - use numbers as inputs. Nonnumeric - don't use numbers as inputs. Important model facts to remember: Models don't make decisions; people do. Models only partially reflect reality. The Nature of the Project Ranking Systems Slide7:  First step -- develop model categories based on program goals and objectives. Categories generated at arms length (blind to potential projects) by agencies and stakeholders. Categories should be weighted to represent their relative importance to achieving program goals. Resulting project scores reflect how much their predicted outcomes contribute to goals achievement. Some AOOS identified categories: Ecosystem health Marine operations Public health Living resources Homeland security Weather andamp; climate Natural hazards Project Ranking Systems Project Ranking Systems:  Project Ranking Systems Some factors are recurring, others have one-time impact. Ranges of uncertainty are helpful for hard-to-estimate factors. Thresholds or critical values of acceptance or rejection can be assigned. Items will contain differing levels of specificity. Avoid category overlap to avoid double counting. Type of Project Ranking Systems:  Type of Project Ranking Systems Nonnumeric Models The Sacred Cow Suggested by a senior and powerful official Stopped at successful conclusion or when suggesting official realizes it was a mistake The Operating Necessity Project is required to keep the system going Ask if system is still worth operating The Competitive Necessity Needed to compete Operating necessity projects take precedence over competitive necessity projects Slide10:  Program Leverage Judged on potential match or partnerships, filling a gap, strengthening a weak link or extending into a new desirable direction. Comparative Benefit Model Sort Divide a list of projects into groups of good - fair - poor. Rank projects within groups. One person or a selection committee picks projects. Models widely used. Peer review - outside referee picks projects. Type of Project Ranking Systems Slide11:  Unweighted 0-1 Factor Model List relevant factors on a preprinted form and have top management evaluators determine whether or not the project qualifies for each of the factors. Sum the responses and see if the project qualifies for enough factors to accept. Weighs all factors as equally important. No gradation of degree to which factor is met. Unweighted Factor Scoring Model Grade how well a factor is met by a project on a scale, usually 5 pt. (e.g., 5 - very good, 1 - very bad). All factors still weighted equally Numeric Systems - Scoring Slide12:  Weighted Factor Scoring Model Add weights reflecting the relative importance of the factors and multiply the weight of each factor by its score. Sum these values and compare to a threshold value. This method can provide a sensitivity analysis to identify an component for project improvement. Don't include marginally relevant factors Constrained Weighted Factor Model Similar to above except additional criteria enter the model as constraints (things that must be present or absent in order for the project to be acceptable) rather than as weighted factors Numeric Systems - Scoring Slide13:  Advantages of Numeric Scoring Models Allow multiple criteria to be used for evaluation and decision. Structurally simple and easy to use. A direct reflection of management policy. Easily altered to meet changes in the environment and in management policy. Weighted scoring models acknowledge that some factors are more important than others. Easy sensitivity analysis to see trade-offs between several criteria. Numeric Systems - Scoring Slide14:  Disadvantages of Numeric Scoring Models Output is a relative measure, no utility is reflected, thus no direct indication of project support. Generally linear, elements are assumed to be independent. Tendency to include too many criteria. Unweighted models assume equal importance of all criteria. Numeric Systems - Scoring Analysis Under High Uncertainty:  Analysis Under High Uncertainty Uncertainty in Organizations Most uncertainty is about the timing and the costs. Three areas of uncertainty Timing of project and cash flows. What the project will accomplish. Side effects or unforeseen consequences. Pro-forma documents help reduce uncertainty. Slide16:  Focuses decision maker's attention on the nature and the extent of the uncertainty of some variables in the decision-making process. Uses probability distributions for each of the uncertain variables, instead of the point estimates that financial analysis utilizes. Decision Analysis. General Simulation Analysis Only count costs and times that result from new proposed project. Risk Analysis Slide17:  Subjective vs. Objective Objective - Measurement taken by reference to an external system. Subjective - Reference to a standard that is internal to the system. Quantitative vs. Qualitative Difference is that one may apply the law of addition to quantitative data and not to qualitative. Reliable vs. Unreliable Data source is reliable if repetitions of a measurement vary by less than a pre-specified amount. Comments on Measurements Slide18:  Suggestions on Ranking Systems-Examples 2006 – 2008 Project Evaluation Criteria (Alaska Department of Transportation) Puget Sound Near Shore PartnershipEstuary and Salmon Restoration Programhttp://pugetsoundnearshore.org/esrp/esrp_proposalrequest.pdf:  Puget Sound Near Shore Partnership Estuary and Salmon Restoration Program http://pugetsoundnearshore.org/esrp/esrp_proposalrequest.pdf Center for Neighborhood Technology – Project Scoring Criteria (multiple projects)http://www.cnt.org/tsp/pdf/Criteria%20Project%20Scoring%20-%202003.pdf:  Center for Neighborhood Technology – Project Scoring Criteria (multiple projects) http://www.cnt.org/tsp/pdf/Criteria%20Project%20Scoring%20-%202003.pdf Belize – National Protected Areas System (bio-physical and land use characteristics)http://biological-diversity.info/Downloads/NPAPSP/Site_scoring.pdf:  Belize – National Protected Areas System (bio-physical and land use characteristics) http://biological-diversity.info/Downloads/NPAPSP/Site_scoring.pdf NOAA – Risk and Vulnerability Assessment Tool (RVAT):  NOAA – Risk and Vulnerability Assessment Tool (RVAT) (Frequency + Area Impact) x Magnitude = Total Score Slide23:  Ecosystem Health Ocean conditions 3-D models of oil spill trajectories Maritime Operations Collision avoidance system Uncharted rocks, reefs and shoals Weather and wave conditions Surface current velocities and direction Improve vessel safety and maximize transportation efficiency Vessel icing conditions Ocean forecast models for currents and shears Tidal predictions in time and space Hazardous icing conditions Slide24:  Public Health Harmful plankton blooms Contamination of cultured shellfish Living Resources Effects of eddies on mixing Fish survival as a function of ocean conditions Effects of large eddies on fish migration Fish habitat State of the ocean data Fisheries variability Climate variability Ocean circulation and mixing Ocean productivity estimates Fish habitat locations and extents Forecast of important food web components Forage fish abundances and distributions Inventory of marine habitats Slide25:  Homeland Security Vessel tracking Search and rescue times are lengthy Vessel locations Weather and Climate Satellite: SAR and QuikSCAT Weather conditions Limited weather observations in Alaska Surface observations of wind and waves in real time Climate variability Wind and wave observations Natural Hazards Storm surge models Vessel icing Vessel safety in winter Coastal flowing Coastal flooding Coastal erosion Prediction of erosion events Contact us:  Contact us Steve Colt, ISER [email protected] 786-1753 Ginny Fay, EcoSystems [email protected] 333-3568 Meghan Wilson, ISER - [email protected] - 786-5408 website: www.iser.uaa.alaska.edu

Related presentations


Other presentations created by Nickel

Final Capital Budgeting
18. 06. 2007
0 views

Final Capital Budgeting

culturaldiversity
15. 06. 2007
0 views

culturaldiversity

copyright
19. 09. 2007
0 views

copyright

Skamarock
25. 09. 2007
0 views

Skamarock

Heynderickx sampex
25. 09. 2007
0 views

Heynderickx sampex

regression
25. 09. 2007
0 views

regression

toke wci fragmodel 3
25. 09. 2007
0 views

toke wci fragmodel 3

PACIS05
25. 09. 2007
0 views

PACIS05

WSC06
25. 09. 2007
0 views

WSC06

bh us 02 veeneman wireless
25. 09. 2007
0 views

bh us 02 veeneman wireless

NOAAg
25. 09. 2007
0 views

NOAAg

phrase EM NAACL presentation
25. 09. 2007
0 views

phrase EM NAACL presentation

LCmodels
25. 09. 2007
0 views

LCmodels

models in geography
25. 09. 2007
0 views

models in geography

hawaii 0401
23. 08. 2007
0 views

hawaii 0401

Albrecht Durer
23. 08. 2007
0 views

Albrecht Durer

Brian McClaren Seminar
17. 08. 2007
0 views

Brian McClaren Seminar

Parables of Jesus
17. 08. 2007
0 views

Parables of Jesus

Girish Sant
17. 08. 2007
0 views

Girish Sant

Safer PI ISIS May 00 Seattle
25. 09. 2007
0 views

Safer PI ISIS May 00 Seattle

DOOR South Asia
07. 08. 2007
0 views

DOOR South Asia

8 2 Participants Maldives
07. 08. 2007
0 views

8 2 Participants Maldives

Maldives Country Presentation
07. 08. 2007
0 views

Maldives Country Presentation

Tsunami Relief Efforts
07. 08. 2007
0 views

Tsunami Relief Efforts

safta2
07. 08. 2007
0 views

safta2

maldives khaleel3
07. 08. 2007
0 views

maldives khaleel3

193
07. 08. 2007
0 views

193

Lay sermon Jesus is the only way
17. 08. 2007
0 views

Lay sermon Jesus is the only way

Eschatology 2
17. 08. 2007
0 views

Eschatology 2

AFD 060714 020
23. 08. 2007
0 views

AFD 060714 020

Finder Workshop
18. 06. 2007
0 views

Finder Workshop

acctpresentation
23. 08. 2007
0 views

acctpresentation

Mobile Fun for a New Generation
18. 06. 2007
0 views

Mobile Fun for a New Generation

Medwoche
18. 06. 2007
0 views

Medwoche

MAGIC
18. 06. 2007
0 views

MAGIC

Lezione 2
18. 06. 2007
0 views

Lezione 2

leonardo
18. 06. 2007
0 views

leonardo

Kostenbetrachtung
18. 06. 2007
0 views

Kostenbetrachtung

kore einfuehrung
18. 06. 2007
0 views

kore einfuehrung

KBSBCH d Dez2003
18. 06. 2007
0 views

KBSBCH d Dez2003

13 triossi
18. 06. 2007
0 views

13 triossi

Foot Ankle Injuries
18. 06. 2007
0 views

Foot Ankle Injuries

Jesus as Messiah
17. 08. 2007
0 views

Jesus as Messiah

New Educ Prog Trng Vis
18. 06. 2007
0 views

New Educ Prog Trng Vis

kailas karthikeylan
07. 08. 2007
0 views

kailas karthikeylan

Montes qmapp
18. 06. 2007
0 views

Montes qmapp

mind akad 2004
18. 06. 2007
0 views

mind akad 2004

METRO PARMA
18. 06. 2007
0 views

METRO PARMA

Lezione 10
18. 06. 2007
0 views

Lezione 10

Sprites Presentation
19. 09. 2007
0 views

Sprites Presentation

dy scheler
15. 06. 2007
0 views

dy scheler

DenmarkPresentation
15. 06. 2007
0 views

DenmarkPresentation

DeckertFINALPM
15. 06. 2007
0 views

DeckertFINALPM

Curtiss Murphy
15. 06. 2007
0 views

Curtiss Murphy

moggi telefono
18. 06. 2007
0 views

moggi telefono

emotional branding2007
15. 06. 2007
0 views

emotional branding2007

Ein Gen Enzym
15. 06. 2007
0 views

Ein Gen Enzym

E Economists in the Cartoons
15. 06. 2007
0 views

E Economists in the Cartoons

lorenz
18. 06. 2007
0 views

lorenz

cmodel intro
25. 09. 2007
0 views

cmodel intro

Laboratoriodicittadi nanza
18. 06. 2007
0 views

Laboratoriodicittadi nanza

DibuzSupremeCourt
15. 06. 2007
0 views

DibuzSupremeCourt

LMclerran fest
17. 08. 2007
0 views

LMclerran fest

prm tutorial 2003 02 20
25. 09. 2007
0 views

prm tutorial 2003 02 20

fonasaygestion
18. 06. 2007
0 views

fonasaygestion

ncd survll dr shah
07. 08. 2007
0 views

ncd survll dr shah

Lezione 4
18. 06. 2007
0 views

Lezione 4

polymeric composite
25. 09. 2007
0 views

polymeric composite

CS662b
15. 06. 2007
0 views

CS662b

patterson barcodes zoocodes
19. 09. 2007
0 views

patterson barcodes zoocodes

Presentations sde small islands
07. 08. 2007
0 views

Presentations sde small islands

20070605 Bulte
07. 08. 2007
0 views

20070605 Bulte

Manual TARRAGON
18. 06. 2007
0 views

Manual TARRAGON

Day1TUMGMSeafax
07. 08. 2007
0 views

Day1TUMGMSeafax

kodak memory studio
07. 08. 2007
0 views

kodak memory studio

Jack Carlsen
07. 08. 2007
0 views

Jack Carlsen