Top

Journal of Psychopathology and Behavioral Assessment

Gepubliceerd in:

01-12-2011

Psychometric Properties and Administration Measurement Invariance of Social Phobia Symptom Measures: Paper-Pencil vs. Internet Administrations

Auteurs: Michiyo Hirai, Laura L. Vernon, George A. Clum, Susan T. Skidmore

Gepubliceerd in: Journal of Psychopathology and Behavioral Assessment | Uitgave 4/2011

Abstract

The psychometric properties of the online versions of assessment instruments for phobias and related symptoms were compared to those of paper-pencil versions. The examined measures were the Social Interaction Anxiety Scale (SIAS) and Social Phobia Scale (SPS). Students (n = 514) completed the instruments either in a paper-pencil in lab condition or an online at home condition. Means of the measures were largely equivalent between the two groups. Factor structures of the measures support construct validity of the two versions of the questionnaires. The coefficient alphas for the measures were reasonably high, ranging between .91 and .93 for both groups. Correlations between the measures were similar across groups. Overall, adequate psychometric properties of the online versions of the instruments were demonstrated, however, neither of the social phobia measures demonstrated measurement invariance between the two assessment modalities.

vorige artikel The Structure and Nature of the Broader Autism Phenotype in a Non-clinical Sample

volgende artikel Psychometric Properties of the Wisconsin Schizotypy Scales in an Undergraduate Sample: Classical Test Theory, Item Response Theory, and Differential Item Functioning

Fit indices showed adequate to good fit across gender for the SIAS and SPS for both paper-pencil and online administrations. RMSEA ranged from .07 to .08 for males and from .07 to .09 for females; CFI ranged from .88 to .91 for males and from .86 to .93 for females; SRMR ranged from .06 to .08 for males and from .05 to .08 for females; and χ ²/df was consistently less than 2.50. Although the CFI values are not as good as we would like, we acknowledge that because the CFI penalizes for less parsimonius models (Kenny and McCoach 2003) and the phobia measures in the present study have a relatively large number of parameters to be estimated a lower than ideal value for CFI is not unexpected. In addition, we recognize that multiple fit indices provide a more comprehensive view of model fit (Hu and Bentler 1999). Thus the RMSEA, SRMR, and χ ²/df demonstrate good to acceptable fit of the models.

Andersson, E., Ljótsson, B., Smit, F., Paxling, B., Hedman, E., Lindefors, N., et al. (2011). Cost-effectiveness of internet-based cognitive behavior therapy for irritable bowel syndrome: results from a randomized controlled trial. BioMed Central Public Health, 11, 1–7.

Austin, D. W., Carlbring, P., Richards, J. C., & Andersson, G. (2006). Internet administration of three commonly used questionnaires in panic research: equivalence to paper administration in Australian and Swedish samples of people with panic disorder. International Journal of Testing, 6, 25–39.CrossRef

Baker, S. L., Heinrichs, N., Kim, H. J., & Hofmann, S. G. (2002). The Liebowitz social anxiety scale as a self-report instrument: a preliminary psychometric analysis. Behaviour Research and Therapy, 40, 701–715.PubMedCrossRef

Buchanan, T. (2003). Internet-based questionnaire assessment: appropriate use in clinical contexts. Cognitive Behaviour Therapy, 32, 100–109.PubMedCrossRef

Carlbring, P., Brunt, S., Bohman, S., Austin, D., Richards, J., Öst, L., et al. (2007). Internet vs. paper and pencil administration of questionnaires commonly used in panic/agoraphobia research. Computers in Human Behavior, 23, 1421–1434.CrossRef

Cohen, J. (1990). Things I have learned (so far). American Psychologist, 45, 1304–1312.CrossRef

Cole, M. S., Bedeian, A. G., & Feild, H. S. (2006). The measurement equivalence of web-based and paper-and-pencil measures of transformational leadership: a multinational test. Organizational Research Methods, 9, 339–368.CrossRef

Coles, M. E., Cook, L. M., & Blake, T. R. (2007). Assessing obsessive compulsive symptoms and cognitions on the internet: evidence for the comparability of paper and internet administration. Behaviour Research and Therapy, 45, 2232–2240.PubMedCrossRef

Curran, P. J., West, S. G., & Finch, J. F. (1996). The robustness of test statistics to nonnormality and specification error in confirmatory factor analysis. Psychological Methods, 1, 16–29.CrossRef

Emmelkamp, P. M. G. (2005). Technological innovations in clinical assessment and psychotherapy. Psychotherapy and Psychosomatics, 74, 336–343.PubMedCrossRef

Feldt, L. S. (1969). A test of the hypothesis that Cronbach’s alpha or Kuder-Richardson coefficient twenty is the same for two tests. Psychometrika, 34, 363–373.CrossRef

Fortson, B. L., Scotti, J. R., Del Ben, K. S., & Chen, Y. (2006). Reliability and validity of an internet traumatic stress survey with a college student sample. Journal of Traumatic Stress. Special Issue: Dissemination: Transforming Lives through Transforming Care, 19, 709–720.

Habke, A. M., Hewitt, P. L., Norton, G. R., & Asmundson, G. (1997). The social phobia and social interaction anxiety scales: an exploration of the dimensions of social anxiety and sex differences in structure and relations with pathology. Journal of Psychopathology and Behavioral Assessment, 19, 21–39.CrossRef

Hedman, E., Ljótsson, B., Rück, C., Furmark, T., Carlbring, P., Lindefors, N., et al. (2010). Internet administration of self-report measures commonly used in research on social anxiety disorder: a psychometric evaluation. Computers in Human Behavior, 26, 736–740.CrossRef

Heimberg, R. G., Mueller, G. P., Holt, C. S., Hope, D. A., & Liebowitz, M. R. (1992). Assessment of anxiety in social interaction and being observed by others: the social interaction anxiety scale and the social phobia scale. Behavior Therapy, 23, 53–73.CrossRef

Henson, R. K. (2001). Understanding internal consistency reliability estimates: a conceptual primer on coefficient alpha. Measurement and Evaluation in Counseling and Development, 34, 177–189.

Hirai, M., & Clum, G. A. (2008). Self-help therapies for anxiety disorders. In P. L. Watkins & G. A. Clum (Eds.), Handbook of self-help therapies (pp. 77–107). New York: Routledge/Taylor & Francis Group; Mahwah, NJ, US: Lawrence Erlbaum Associates Publishers.

Horn, J. L., & McArdle, J. J. (1992). A practical and theoretical guide to measurement invariance in aging research. Experimental Aging Research. Special Issue: Quantitative Topics in Research on Aging, 18, 117–144.

Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: coventional criteria versus new alternatives. Structural Equation Modeling, 6, 1–55.CrossRef

Kenny, D. A., & McCoach, D. (2003). Effect of the number of variables on measures of fit in structural equation modeling. Structural Equation Modeling, 10, 333–351.CrossRef

Liebowitz, M. R. (1987). Social phobia. Modern Problems of Pharmacopsychiatry, 22, 141–173.PubMed

Marks, I. M., & Mathews, A. M. (1979). Brief standard self-rating for phobic patients. Behavior Research and Therapy, 17, 263–267.CrossRef

Mattick, R. P., & Clarke, J. C. (1998). Development and validation of measures of social phobia scrutiny fear and social interaction anxiety. Behaviour Research and Therapy, 36, 455–470.PubMedCrossRef

McCabe, R. E., & Antony, M. M. (2002). Specific and social phobia. In M. Antony & D. Barlow (Eds.), Handbook of assessment and treatment planning for psychological disorders. New York: The Guilford Press.

McCrae, R. R., Zonderman, A. B., Costa, P. T., Jr., Bond, M. H., & Paunonen, S. V. (1996). Evaluating replicability of factors in the revised NEO personality inventory: confirmatory factor analysis versus procrustes rotation. Journal of Personality and Social Psychology, 70, 552–566.CrossRef

Meade, A. W., Michels, L. C., & Lautenschlager, G. J. (2007). Are internet and paper-and-pencil personality tests truly comparable?: An experimental design measurement invariance study. Organizational Research Methods, 10, 322–345.CrossRef

Meredith, W. (1993). Measurement invariance, factor analysis and factorial invariance. Psychometrika, 58, 525–543.CrossRef

Meredith, W., & Teresi, J. A. (2006). An essay on measurement and factorial invariance. Medical Care, 44, S69–S77.PubMedCrossRef

Naglieri, J. A., Drasgow, F., Schmit, M., Handler, L., Prifitera, A., Margolis, A., et al. (2004). Psychological testing on the internet: new problems, old issues. American Psychologist, 59, 150–162.PubMedCrossRef

Nickerson, R. S. (2000). Null hypothesis significance testing: a review of an old and continuing controversy. Psychological Methods, 5, 241–301.PubMedCrossRef

Nunnally, J. C., & Bernstein, I. (1994). Psychometric theory. New York: McGraw-Hill.

Osman, A., Gutierrez, P. M., Barrios, F. X., Kopper, B. A., & Chiros, C. E. (1998). The social phobia and social interaction anxiety scales: evaluation of psychometric properties. Journal of Psychopathology and Behavioral Assessment, 20, 249–264.CrossRef

Raykov, T. (2004). Behavioral scale reliability and measurement invariance evaluation using latent variable modeling. Behavior Therapy, 35, 299–331.CrossRef

Read, J. P., Farrow, S. M., Jaanimägi, U., & Ouimette, P. (2009). Assessing trauma and traumatic stress via the internet: measurement equivalence and participant reactions. Traumatology. Special Issue: Culture and International Contributions, 15, 94–102.

Tate, D. F., & Zabinski, M. F. (2004). Computer and internet applications for psychological treatment: update for clinicians. Journal of Clinical Psychology, 60, 209–220.PubMedCrossRef

Thompson, B. (2006). Foundations of behavioral statistics: An insight-based approach. New York: Guilford.

Turner, S. M., Beidel, D. C., Dancu, C. V., & Stanley, M. A. (1989). An empirically derived inventory to measure social fears and anxiety: the social phobia and anxiety inventory. Psychological Assessment: A Journal of Consulting and Clinical Psychology, 1, 35–40.CrossRef

Watson, D., & Friend, R. (1969). Measurement of social-evaluative anxiety. Journal of Consulting and Clinical Psychology, 33, 448–457.PubMedCrossRef

Zlomke, K. R. (2009). Psychometric properties of internet administered versions of Penn State Worry Questionnaire (PSWQ) and Depression, Anxiety, and Stress Scale (DASS). Computers in Human Behavior, 25, 841–843.CrossRef

Titel: Psychometric Properties and Administration Measurement Invariance of Social Phobia Symptom Measures: Paper-Pencil vs. Internet Administrations
Auteurs: Michiyo Hirai
Laura L. Vernon
George A. Clum
Susan T. Skidmore
Publicatiedatum: 01-12-2011
Uitgeverij: Springer US
Gepubliceerd in: Journal of Psychopathology and Behavioral Assessment / Uitgave 4/2011
Print ISSN: 0882-2689
Elektronisch ISSN: 1573-3505
DOI: https://doi.org/10.1007/s10862-011-9257-2

Open Access

Bohn Stafleu van Loghum

Welkom bij THIM Hogeschool voor Fysiotherapie & Bohn Stafleu van Loghum

Registreer

Login

Psychometric Properties and Administration Measurement Invariance of Social Phobia Symptom Measures: Paper-Pencil vs. Internet Administrations

Abstract

Andere artikelen Uitgave 4/2011

Women with Childhood ADHD: Comparisons by Diagnostic Group and Gender

Individuals with Fear of Blushing Explicitly and Automatically Associate Blushing with Social Costs

The Structure and Nature of the Broader Autism Phenotype in a Non-clinical Sample

Psychometric Analyses of the Test Anxiety Scale for Elementary Students (TAS-E) Scores among Singapore Primary School Students

An Evaluation of Behavioral Approach in Adults with ADHD

Factor Structure of the PTSD Checklist in a Sample of OEF/OIF Veterans Presenting to Primary Care: Specific and Nonspecific Aspects of Dysphoria

Bohn Stafleu van Loghum

Welkom bij THIM Hogeschool voor Fysiotherapie & Bohn Stafleu van Loghum

Registreer

Login

Deel dit onderdeel of sectie (kopieer de link)

Abstract

Log in om toegang te krijgen

Women with Childhood ADHD: Comparisons by Diagnostic Group and Gender

Individuals with Fear of Blushing Explicitly and Automatically Associate Blushing with Social Costs

The Structure and Nature of the Broader Autism Phenotype in a Non-clinical Sample

Psychometric Analyses of the Test Anxiety Scale for Elementary Students (TAS-E) Scores among Singapore Primary School Students

An Evaluation of Behavioral Approach in Adults with ADHD

Factor Structure of the PTSD Checklist in a Sample of OEF/OIF Veterans Presenting to Primary Care: Specific and Nonspecific Aspects of Dysphoria