Internet Equivalence

Information about Internet Equivalence

Published on August 6, 2007

Author: Pravez

Source: authorstream.com

Content

The Equivalence of Internet and Paper-and-pencil Personality Assessments:  The Equivalence of Internet and Paper-and-pencil Personality Assessments Chuah Siang Chee Fritz Drasgow Brent Roberts Society for Industrial and Organizational Psychology, Toronto, April 12-April 14, 2002 Internet Assessment:  Internet Assessment Access from more locations and to more people Convenience for the user and test administrator User access from Internet enabled computers Electronic data entry Relative speed and low cost for large test administrations Database Driven Website:  Database Driven Website Are Internet Assessments Equivalent to Other Approaches? :  Are Internet Assessments Equivalent to Other Approaches? Measurement Equivalence Mean-Level Differential Item Functioning (DIF) Examinees of equal ability but from separate populations differ in their probability of giving a particular answer. Previous research on mean-level differences across modality:  Previous research on mean-level differences across modality Mean-level Social Desirability Distortions Meta-analysis of non-cognitive tests across mediums Richman, Kiesler, Weisband and Drasgow (1999) Anonymity Lower Social Anxiety and Social Desirability with Internet Johnson (1999) Pasveer andamp; Ellard (1998) Self-Trust – No differences Davis (1999) Ruminative Responses – No differences Problems with previous research on mean levels:  Problems with previous research on mean levels Comparison groups were not equivalent. Different recruiting techniques for groups Different samples sizes Unknown internet structure to assessment Previous research on DIF:  Previous research on DIF No published research with DIF analysis The Present Study:  The Present Study Examined mean-level differences on the Big Five across testing medium Equivalent groups across modalities Paper-and-Pencil Traditional administration under experimenter supervision. Computer Laboratory Group administration of WWW questionnaires in laboratory under experimenter supervision. Internet E-mail notification of WWW questionnaire. Administered over WWW for 1 week. The Present Study …:  The Present Study … Random Assignment to Conditions No Self-selection effects Identification of Subjects Unique Password – security/integrity data Academic – course credit Industry – aberrant responses, linking information Multiple-access for Internet Questionnaire No Duplicate Responses DIF Analyses:  DIF Analyses SIBTEST (Stout andamp; Roussos, 1995) SIB Statistic β andamp; Mantel-Haenszel Iterlink DIF (Steve Stark) Lord’s Chi-Square Big 5 Personality Scale:  Big 5 Personality Scale Trait Descriptive Adjective (Goldberg) Neuroticism, Extroversion, Openness, Agreeableness, Conscientiousness 5 point Likert Scale (Strongly Disagree – Strongly Agree) 'How well do the adjectives describe you?' Big 5 Personality Items:  Big 5 Personality Items * Reverse Scored Items * Reverse Scored Items Sample:  Sample Condition N Paper-and-pencil 266 Computer Lab 222 Internet 240 Total 728 Undergraduates Psychology Students participating in the study for course credit SIB Statistic p<.05:  SIB Statistic pandlt;.05 Mantel-Haenszel p<.05:  Mantel-Haenszel pandlt;.05 Lord’s Chi-Square p<.05:  Lord’s Chi-Square pandlt;.05 Expected # of “False Alarms”:  Expected # of 'False Alarms' 95% Confidence Interval 5% Comparisons ± (α X SD) α X SD = 1.96 X (30 X .05 X .95)½ = 2. 34 α X SD = 1.96 X (123 X .05 X .95)½ = 4.74 Per Dimension 2.05 ± 2.735 = (0, 4.39) All 4 Dimensions 6.15 ± 4.74 = (1.41, 10.89) Summary Analysis p<.05:  Summary Analysis pandlt;.05 SIB Statistic Bonferroni Corr.:  SIB Statistic Bonferroni Corr. Mantel-Haenszel Bonferroni :  Mantel-Haenszel Bonferroni Lord’s Chi-Square Bonferroni :  Lord’s Chi-Square Bonferroni Mean-Level Comparisons:  Mean-Level Comparisons DIF analyses established that Personality Items are functioning equivalently across media Is there a shift in Trait Levels as a consequence of medium? mean-levels comparisons using ability/theta estimated by Bilog Mean Trait Levels Effect Size:  Mean Trait Levels Effect Size Paper-and-Pencil Vs Both Computer Administrations Emotional Stability d’ = .19 Emotional Stability Extroversion Agreeableness Conscientiousness pandlt;.033 Conclusion:  Conclusion Personality Tests are Equivalent Features of Internet Questionnaire Important Slide25: 

Related presentations


Other presentations created by Pravez

BlueGene
19. 09. 2007
0 views

BlueGene

krul presentation1
22. 04. 2008
0 views

krul presentation1

GRP
17. 04. 2008
0 views

GRP

Howe1 25
14. 04. 2008
0 views

Howe1 25

Panview 3en
10. 04. 2008
0 views

Panview 3en

Global Trends and Prospects
09. 04. 2008
0 views

Global Trends and Prospects

2002 12 22 Christingle
07. 04. 2008
0 views

2002 12 22 Christingle

303 151renewableenergy
30. 03. 2008
0 views

303 151renewableenergy

mechanics of materials
05. 01. 2008
0 views

mechanics of materials

genetic recombination
06. 08. 2007
0 views

genetic recombination

DRAMA
19. 10. 2007
0 views

DRAMA

jong
19. 09. 2007
0 views

jong

C102 Bergallo
03. 10. 2007
0 views

C102 Bergallo

text cat tutorial
04. 10. 2007
0 views

text cat tutorial

Tornado Safety
07. 10. 2007
0 views

Tornado Safety

newborn screening
12. 10. 2007
0 views

newborn screening

Switzerland Presentation
17. 10. 2007
0 views

Switzerland Presentation

CP15633
22. 10. 2007
0 views

CP15633

Hack lu cisco ddos
07. 10. 2007
0 views

Hack lu cisco ddos

DNA PowerPoint
15. 10. 2007
0 views

DNA PowerPoint

Membres du Bureau
23. 10. 2007
0 views

Membres du Bureau

23981
12. 10. 2007
0 views

23981

Joao LOBO ANTUNES
16. 10. 2007
0 views

Joao LOBO ANTUNES

Tomatoes
11. 12. 2007
0 views

Tomatoes

C avance
20. 11. 2007
0 views

C avance

Familias Unidas
22. 10. 2007
0 views

Familias Unidas

Module 20
23. 11. 2007
0 views

Module 20

media interview
08. 10. 2007
0 views

media interview

EO1 SysEngrColloq 03 02 04 Stu
05. 10. 2007
0 views

EO1 SysEngrColloq 03 02 04 Stu

hoffman arizona
30. 12. 2007
0 views

hoffman arizona

IA Emergency Preparedness
01. 01. 2008
0 views

IA Emergency Preparedness

Cohen NDIA
03. 01. 2008
0 views

Cohen NDIA

mathematicians
05. 01. 2008
0 views

mathematicians

hamm
23. 10. 2007
0 views

hamm

Prologue
15. 11. 2007
0 views

Prologue

geo inversion
19. 09. 2007
0 views

geo inversion

HIV AIDS Pandemic
06. 08. 2007
0 views

HIV AIDS Pandemic

Jeannie Armour Bearer
06. 08. 2007
0 views

Jeannie Armour Bearer

Hawaiian Cultural History
06. 08. 2007
0 views

Hawaiian Cultural History

jiscdigicon 07par1 1notay
06. 08. 2007
0 views

jiscdigicon 07par1 1notay

ESCpresentation
03. 01. 2008
0 views

ESCpresentation

Unit2 Lecture1
04. 01. 2008
0 views

Unit2 Lecture1

graficos ddet265
24. 10. 2007
0 views

graficos ddet265

Robin Room
07. 01. 2008
0 views

Robin Room

jageps
06. 08. 2007
0 views

jageps

Jewish Initiation
06. 08. 2007
0 views

Jewish Initiation

HIUG
06. 08. 2007
0 views

HIUG

singers
20. 02. 2008
0 views

singers

HGM2006 S7 01 Pedersen
06. 08. 2007
0 views

HGM2006 S7 01 Pedersen

ModuleA5Session3
04. 03. 2008
0 views

ModuleA5Session3

hlt 2004
06. 08. 2007
0 views

hlt 2004

Brussel Health Kuopio KPoutanen
20. 03. 2008
0 views

Brussel Health Kuopio KPoutanen

CIO Main Screens Sydney Final
26. 03. 2008
0 views

CIO Main Screens Sydney Final

Movimento Pentecostal 2 ok
01. 10. 2007
0 views

Movimento Pentecostal 2 ok

guyana csw 2000
06. 08. 2007
0 views

guyana csw 2000

05f 1800 lys a3
19. 02. 2008
0 views

05f 1800 lys a3

Guze 07 Sarah Pedersen
06. 08. 2007
0 views

Guze 07 Sarah Pedersen

Normativa Vittoria marzo06
18. 06. 2007
0 views

Normativa Vittoria marzo06

new Media Activism
18. 06. 2007
0 views

new Media Activism

LKD ACPC2005autoshow
18. 06. 2007
0 views

LKD ACPC2005autoshow

LAS VEGAS PRESENTATION
18. 06. 2007
0 views

LAS VEGAS PRESENTATION

lab storia marcia mille
18. 06. 2007
0 views

lab storia marcia mille

Kreutz
18. 06. 2007
0 views

Kreutz

kinder verzamelingen 05
18. 06. 2007
0 views

kinder verzamelingen 05

kereso halo
18. 06. 2007
0 views

kereso halo

japan overview
18. 06. 2007
0 views

japan overview

jaden
18. 06. 2007
0 views

jaden

2007 dossier pere
18. 06. 2007
0 views

2007 dossier pere

2005 NAIDC Promo
18. 06. 2007
0 views

2005 NAIDC Promo

1212 SLIDES CSR Briefing final1
18. 06. 2007
0 views

1212 SLIDES CSR Briefing final1

07PSPTribute
18. 06. 2007
0 views

07PSPTribute

bioprez1
17. 11. 2007
0 views

bioprez1

Chapter18
19. 09. 2007
0 views

Chapter18

LUXva
18. 06. 2007
0 views

LUXva

f38 math meets maps
15. 06. 2007
0 views

f38 math meets maps

Extraction of Beam into TT40
15. 06. 2007
0 views

Extraction of Beam into TT40

Experiencing HaShem
15. 06. 2007
0 views

Experiencing HaShem

Euthyphro
15. 06. 2007
0 views

Euthyphro

ethnic humor
15. 06. 2007
0 views

ethnic humor

Essentials of UP 1
15. 06. 2007
0 views

Essentials of UP 1

Catv2
15. 06. 2007
0 views

Catv2

Cartoons pig
15. 06. 2007
0 views

Cartoons pig

cartoons stick men 1
15. 06. 2007
0 views

cartoons stick men 1

attr 159897 115
12. 10. 2007
0 views

attr 159897 115

kskee
19. 09. 2007
0 views

kskee

akrishna
28. 11. 2007
0 views

akrishna

18cm
18. 06. 2007
0 views

18cm

BrazilSeminar
22. 10. 2007
0 views

BrazilSeminar

PRSarahL
13. 03. 2008
0 views

PRSarahL

prezent1
15. 11. 2007
0 views

prezent1

power law tut
19. 09. 2007
0 views

power law tut

EthicalEgoism
15. 06. 2007
0 views

EthicalEgoism

petersuter ppt
17. 10. 2007
0 views

petersuter ppt

slogany
21. 11. 2007
0 views

slogany

Blue Chalkboard
19. 09. 2007
0 views

Blue Chalkboard

Gogol at the Edge of Being
27. 09. 2007
0 views

Gogol at the Edge of Being

ScottKsander10 10
02. 11. 2007
0 views

ScottKsander10 10

labrolazegbe
18. 06. 2007
0 views

labrolazegbe

chap12sp06 groups day 3
14. 12. 2007
0 views

chap12sp06 groups day 3

Resources Potpourri Final2006
26. 10. 2007
0 views

Resources Potpourri Final2006

powers tami portia topics
19. 09. 2007
0 views

powers tami portia topics

APGridPMA EU 200605
10. 10. 2007
0 views

APGridPMA EU 200605

Higgins Webinar Slides 070425
19. 09. 2007
0 views

Higgins Webinar Slides 070425