Nicosia Raymond Pawson

Information about Nicosia Raymond Pawson

Published on August 8, 2007

Author: Mahugani

Source: authorstream.com

Content

Realist Evaluation &Realist Synthesis:  Realist Evaluation andamp; Realist Synthesis Ray Pawson QMSS Seminar Nicosia Sept 2006 Presentation I:  Presentation I Basic Ideas of Realist Evaluation Key principles of realist evaluation :  Key principles of realist evaluation The nature of programmes: Programmes are ‘embedded’ Programmes are ‘active’. Programmes are ‘theories’ Principal research tasks: Hypothesise the key mechanisms (M) Hypothesise the key contexts (C) Explain the outcome pattern (O) Programmes are ‘embedded’.They are always inserted into pre-existing social situations:  Programmes are ‘embedded’. They are always inserted into pre-existing social situations Educational initiatives operate at different levels: Ideas Individuals Institution Infrastructure Programmes are theories:  Programmes are theories A ‘role model’ programme theory also known as ‘Dishy-David-Beckham-theory’ ‘Interviewer: But do you think the fact that these good-looking blokes are footballers has any effect on girls' attitude to playing football? Girl: No, I think it has more effect on them watching football, well not the football - the guys (general laughter and agreement)’. Programmes are ‘active’They are ‘active’ in the sense that their intended effects work through the reasoning and volition of their subjects.:  Programmes are ‘active’ They are ‘active’ in the sense that their intended effects work through the reasoning and volition of their subjects. Even ‘mechanical’ interventions like the free distribution of smoke alarms depend on the subject’s ideas. Alarms sometimes work but also end up: not installed (can’t be bothered) removed (always going off) battery flat (too fiddly to change) battery ‘walks’ (to Walkman or TV remote) Realist Evaluation: Mechanisms, Contexts and Outcomes:  Realist Evaluation: Mechanisms, Contexts and Outcomes The same programme mechanism will have different outcomes in different contexts Don’t ask ‘what works?’ Rather, investigate: ‘what works for whom in what circumstances?’ Example: Prisoner Education:  Example: Prisoner Education A Practitioner Theory ' The men who are more likely to be changed are best described as ‘mediocre’. You shouldn’t look for high-flyers. They’re likely to come from a deprived background with a poor and maybe non-existent school record. They will be mediocre criminals too. They’ll have gone on from petty crime, street crime to drugs or armed robbery or something. Then when they come onto the program, they’re mediocre or worse. They just survive the first semester but gradually they build up getting C’s and B’s. So by the end, they’ve actually come a long, long way. And that’s what changes ‘em. It’s not so much a case of ‘rehabilitation’ as ‘habilitation’.' Hypothesise key generative mechanismsThe process of how subjects interpret and act upon the intervention stratagem is known as the programme ‘mechanism’ :  Hypothesise key generative mechanisms The process of how subjects interpret and act upon the intervention stratagem is known as the programme ‘mechanism’ Programme - prisoner education (PE) (M1) PE might provide qualifications to allow ex-inmates to compete for jobs (M2) PE might boost confidence and provide social skills to reduce aggressive outbursts in ex-cons (M3) PE might increase cognitive skills and allow ex-prisoners to reason through their difficulties (M4) PE might increase presentational and reasoning skills enabling them to become clever criminals (M5) PE might provide shelter from violent prison culture for more vulnerable prisoners M6, M7, M8, etc. etc. Hypothesise the key contexts‘Contexts’ are the set of surrounding conditions that favour or hinder the programme mechanisms :  Hypothesise the key contexts ‘Contexts’ are the set of surrounding conditions that favour or hinder the programme mechanisms Prisoner Education - for ‘whom’ and in ‘what circumstances’ (C1) Prior experience - poverty, drugs, violence etc. (C2) Prior education (C3) Prior criminal activities (C4) Prison culture (C5) Neighbourhood and locality culture (C6) Economic structure C7, C8, C9 etc. etc. Explain the outcome pattern Programme outcomes are always complex. M & C theories are tested by examining outcomes for different sub-groups of subjects:  Explain the outcome pattern Programme outcomes are always complex. M andamp; C theories are tested by examining outcomes for different sub-groups of subjects Who benefited most? Improved rehabilitation by age 17-21 22-25 26-30 31-35 36over 1st 4th 5th 2nd 3rd Improved rehabilitation by prior education Grade 10 Grade11 Grade 12 Post-Secondary 2nd 1st 3rd 4th Presentation 2 Basic Ideas of Realist Synthesis :  Presentation 2 Basic Ideas of Realist Synthesis Contrasting views of ‘systematic reviews’ :  Contrasting views of ‘systematic reviews’ Meta-analysis perspective Programmes have effects Evaluation measures effect sizes Systematic review seeks mean effect The realist understanding Programmes are theories Evaluation is theory-testing Systematic review is theory-synthesis Slide14:  Example I: Naming andamp; Shaming Examples of Public Disclosure Initiatives Megan’s Law andamp; sex offender registration Outing prostitute’s johns School league tables Inspection and special measures for ‘failing schools’ Hospital and surgeon report cards Pub-watch bans and exclusions Local press adverts for poll tax non-payment and council rent arrears Beach cleanliness standards and kite marking Slide15:  Realist Synthesis: Naming andamp; Shaming Examples of Public Disclosure Initiatives Megan’s Law andamp; sex offender registration Outing prostitute’s johns School league tables Inspection and special measures for ‘failing schools’ Hospital and surgeon report cards Pub-watch bans and exclusions Local press adverts for poll tax non-payment and council rent arrears Beach cleanliness standards and kite marking Public notification – basic theory:  Public notification – basic theory i) Identification: in which the performance or behaviour in question is observed and then classified, measured, rated, ranked, verified, etc. ii) Naming: in which information on, and the identity of, the failing or deviant party is disclosed, publicized, disseminated, notified, published, broadcast, registered etc. iii) Public sanction: in which the broader community acts on the disclosure in order to shame, reprimand, reproach, censure, control, influence, supervise the named party. iv) Recipient response: in which behavioural change follows the sanction, with the subjects being shamed, regretful, penitent, contrite, restrained, re-integrated etc. Slide17:  NAMED BUT WHO IS SHAMED? Poll-tax protesters named in the local newspapers Sex offenders under community notification Under-performing schools identified in league tables Motor manufacturers named in the Car Theft Index Poll-tax protesters named in the local newspapers:  Poll-tax protesters named in the local newspapers Poll tax non-payment – there were a great many sanctions imposed: fines, wage arrest, court appearances etc. Protesters thus ignored or even celebrated disclosure of their names in the local press. Policy abandoned. Sex offenders under community notification:  Sex offenders under community notification Notified Sex Offenders are resentful or scared by public attention. One key result is non-compliance with registration and displacement to other localities. Re-offence rates remain static. Under-performing schools identified in league tables:  Under-performing schools identified in league tables Schools respond to league table positions tactically - increasing resources to marginal candidates (middle grades) and excluding/ not entering hopeless ones (lowest grades). Grades improve. Motor manufacturers named in the Car Theft Index:  Motor manufacturers named in the Car Theft Index Car manufacturers – are embarrassed by adverse publicity and loss of reputation (and downturn in sales) - respond with genuine improvements in vehicle security. Car crime goes down. Is there a theory to accommodate these differences in outcome?:  Is there a theory to accommodate these differences in outcome? Merton’s Typology of aspirations to group membership of eligibles and non-eligibles The theory under further refinement:  The theory under further refinement For Nandamp;S to ‘work’ the following configuration should be in place: the named party should be an ‘aspirational insider’ the shaming mechanism should be dovetailed with other mechanism (market sanctions) the disclosure should carry intense (but controllable) media interest the disclosed data should unambiguous both in allocating blame and in suggested remedial action the disclosing authority should have had exemplary watchdog credentials, which are operated benignly Example II. Megan’s Law - Programme Theory:  Example II. Megan’s Law - Programme Theory STEP ONE Problem Identification Identify high-risk released sex offenders and create valid and reliable registers STEP TWO Public disclosure Issue bulletins, press releases, call meeting to identify released offenders to their community STEP THREE Sanction Instigation Community joins with police and probation to increase surveillance of suspicious behaviour STEP FOUR Offender response Community actions shame offenders and decrease opportunity of further offence Evidence fragment one: could the law have made a difference? - a ‘retrospective simulation’:  Evidence fragment one: could the law have made a difference? - a ‘retrospective simulation’ Petrosino andamp; Petrosino 136 serious sex offences 36 previous offence 12 stranger predatory offences 6 could potentially respond to community notification 100 no previous offence 24 known to victim 6 offender from out of state Evidence fragment two: did the law effect recidivism? A matched trial:  Evidence fragment two: did the law effect recidivism? A matched trial Pre-intervention sample sex recidivism 22% Post-intervention sample sex recidivism 19% Pre-intervention sample arrest slow Post- intervention sample arrest significantly quicker Schram andamp; Milloy Evidence fragment three: how did practitioners respond? Office talk:  Evidence fragment three: how did practitioners respond? Office talk 'The Law is an unfunded mandate' 'Special Bulletin Notification added more work to already over-worked agents' 'There is more pressure to baby sit with SBN cases simply because they are SBN cases' Zevitz and Farkas Key findings synthesised:  Key findings synthesised Study 1: Following The introduction of the law, detection increase more sharply than deterrence. Study 2: The chances of community surveillance of stranger predatory offences remain low and offender may lie low Study 3: practitioner attention becomes increasingly focused on SBN cases because of community harassment And Finally:  And Finally What it feels like to do realist synthesis … THANK YOU FOR YOUR ATTENTION

Related presentations


Other presentations created by Mahugani

Exploring the Deep Web
12. 03. 2008
0 views

Exploring the Deep Web

Moving Mountains
02. 10. 2007
0 views

Moving Mountains

dustbowl
10. 10. 2007
0 views

dustbowl

The Internet China
12. 10. 2007
0 views

The Internet China

shen 1
12. 10. 2007
0 views

shen 1

Triumph of Bolshevism
12. 10. 2007
0 views

Triumph of Bolshevism

Kukovecz
15. 10. 2007
0 views

Kukovecz

09 Panama s ppt
22. 10. 2007
0 views

09 Panama s ppt

Common By Product Feeds
04. 10. 2007
0 views

Common By Product Feeds

Dissertation Writing comms ug
27. 11. 2007
0 views

Dissertation Writing comms ug

TT
27. 11. 2007
0 views

TT

black holes v2
28. 11. 2007
0 views

black holes v2

Production of Calla Lily
07. 12. 2007
0 views

Production of Calla Lily

Water Track 8 7 15 051
07. 11. 2007
0 views

Water Track 8 7 15 051

PVC Toronto talk
16. 11. 2007
0 views

PVC Toronto talk

2022lecture2
19. 11. 2007
0 views

2022lecture2

Robertson
03. 10. 2007
0 views

Robertson

20050922 Crafoord Symposium
29. 08. 2007
0 views

20050922 Crafoord Symposium

field mmr naga
31. 12. 2007
0 views

field mmr naga

Anthony Kelly International
02. 01. 2008
0 views

Anthony Kelly International

fy2004 mfc construction
04. 01. 2008
0 views

fy2004 mfc construction

NASC PresentHanson
08. 08. 2007
0 views

NASC PresentHanson

Methamphetamine final10 05
08. 08. 2007
0 views

Methamphetamine final10 05

ppt43
16. 10. 2007
0 views

ppt43

McCarthy Mitchell
29. 08. 2007
0 views

McCarthy Mitchell

Update FutureDirection LRago
22. 10. 2007
0 views

Update FutureDirection LRago

gef 160306
23. 10. 2007
0 views

gef 160306

IT Trends 2005 2010
14. 11. 2007
0 views

IT Trends 2005 2010

rec pond mgnt compressed
07. 01. 2008
0 views

rec pond mgnt compressed

Sci Case II
29. 08. 2007
0 views

Sci Case II

markenklima index q1 2005
05. 01. 2008
0 views

markenklima index q1 2005

yalenov2006
29. 08. 2007
0 views

yalenov2006

media 4917
08. 08. 2007
0 views

media 4917

gatorsncrocs
12. 10. 2007
0 views

gatorsncrocs

Eradicating Systemic Poverty
29. 11. 2007
0 views

Eradicating Systemic Poverty

Kennedy obesity 0904
08. 08. 2007
0 views

Kennedy obesity 0904

jsimon santacruz
29. 08. 2007
0 views

jsimon santacruz

9 0568 rusack r
20. 11. 2007
0 views

9 0568 rusack r

soc100ch10Corepwrpt
19. 02. 2008
0 views

soc100ch10Corepwrpt

Edward Albee
24. 02. 2008
0 views

Edward Albee

AFCEA NOVA Breakfast7Sept07v1
06. 03. 2008
0 views

AFCEA NOVA Breakfast7Sept07v1

Lakeside2
26. 03. 2008
0 views

Lakeside2

sHansen
29. 08. 2007
0 views

sHansen

Tectonics Terrestrial Planets2
07. 04. 2008
0 views

Tectonics Terrestrial Planets2

Sept SECC
02. 11. 2007
0 views

Sept SECC

Hercules
28. 03. 2008
0 views

Hercules

deprez presentation 12 1 05
30. 03. 2008
0 views

deprez presentation 12 1 05

HARIPARSAD Ishwarie 2
09. 04. 2008
0 views

HARIPARSAD Ishwarie 2

Beaulieu
10. 04. 2008
0 views

Beaulieu

sings2mw
29. 08. 2007
0 views

sings2mw

molgas twong
29. 08. 2007
0 views

molgas twong

newman1
14. 04. 2008
0 views

newman1

session 25 V2
17. 04. 2008
0 views

session 25 V2

Citel
22. 04. 2008
0 views

Citel

icra02
19. 06. 2007
0 views

icra02

ICHEP 04 Barr Higgs
19. 06. 2007
0 views

ICHEP 04 Barr Higgs

IBERs and e Theses
19. 06. 2007
0 views

IBERs and e Theses

HS P2P Liao
19. 06. 2007
0 views

HS P2P Liao

he b
19. 06. 2007
0 views

he b

HB2004
19. 06. 2007
0 views

HB2004

Hartenstein Oerebro03 pt1
19. 06. 2007
0 views

Hartenstein Oerebro03 pt1

Grid InteropSupport
19. 06. 2007
0 views

Grid InteropSupport

Grid Interop
19. 06. 2007
0 views

Grid Interop

grid 06talk
19. 06. 2007
0 views

grid 06talk

wednesday
29. 08. 2007
0 views

wednesday

comer5e ch08 HO
15. 11. 2007
0 views

comer5e ch08 HO

SAG YinG 9 Jan New
03. 01. 2008
0 views

SAG YinG 9 Jan New

02 Cattle2
26. 11. 2007
0 views

02 Cattle2

Grid Shib uk april05
19. 06. 2007
0 views

Grid Shib uk april05

J Acar
14. 03. 2008
0 views

J Acar

20061130 woodling
30. 12. 2007
0 views

20061130 woodling

ch02exoh
07. 01. 2008
0 views

ch02exoh

Choose your way carefully
03. 10. 2007
0 views

Choose your way carefully

4 vista
16. 06. 2007
0 views

4 vista

33233 11162218 S
16. 06. 2007
0 views

33233 11162218 S

23
16. 06. 2007
0 views

23

2007 tips tricks
16. 06. 2007
0 views

2007 tips tricks

19b
16. 06. 2007
0 views

19b

EPL Membership
16. 06. 2007
0 views

EPL Membership

Entire Gra duation Slideshow
16. 06. 2007
0 views

Entire Gra duation Slideshow

elley web graphics
16. 06. 2007
0 views

elley web graphics

A Loose Confederation
14. 12. 2007
0 views

A Loose Confederation

employee 2004
16. 06. 2007
0 views

employee 2004

Obesity 1
08. 08. 2007
0 views

Obesity 1

Active Kill Disk
19. 06. 2007
0 views

Active Kill Disk

teall cost 3 ch16
24. 02. 2008
0 views

teall cost 3 ch16

CFA05
29. 08. 2007
0 views

CFA05

gemini sab
29. 08. 2007
0 views

gemini sab

NINDS Audience Report
08. 08. 2007
0 views

NINDS Audience Report

mm1
29. 08. 2007
0 views

mm1

ENGD POWERPOINT
16. 06. 2007
0 views

ENGD POWERPOINT

I3C BSML July2002
19. 06. 2007
0 views

I3C BSML July2002

igt 3
04. 03. 2008
0 views

igt 3

MassesofGalaxies
29. 08. 2007
0 views

MassesofGalaxies