Skip to main content

Invariance Testing

 


Invariance Testing in Psychology

Invariance testing is a statistical technique to assist researchers in determining the degree of comparability of a measure, which has been used with different groups.

When a measure has been modified, translated, or used with people in various cultures, invariance testing can help determine if the same construct is being measured by the changes to the original measure and how people in different groups may understand the items.

Invariance testing is important to ensure a measure functions in the same way (measures the same concept) in different groups.

Hypothetical Example: A 16-item measure of forgiveness may have been originally written in American English and tested with college samples. The items are translated into four different languages and administered in ten different locations. One thing a researcher can do is examine the psychometric properties in the different samples. They may also consider correlations with other measures.  Another strategy is to conduct factor analyses to see if the scale has the same number of factors as did the original and if the same items load on the factors as they did in the original version.

Research Example: Davis et al. (2016) 

  [Notice the phrase "understood in the same way" as a key feature of the concept, invariance testing.

Although previous studies have suggested that the MFQ subscales are associated with religiosity, basic research has not yet established whether the measure is understood in the same way by believing and nonbelieving individuals. The purpose of this study, therefore, was to examine whether the MFQ (and specifically the purity/sanctity subscale) is understood in the same way by these 2 groups. We predicted that the purity/sanctity subscale would not demonstrate strong (i.e., scalar) invariance. Across 2 samples, we found support for configural and metric invariance and problems with scalar invariance. These results suggest that between-groups differences observed in previous studies may be due to measurement artifacts. (Davis et al., 2016, Abstract).


Read more in Lugtig & Hox (2012).

References

Davis, D. E., Dooley, M. T., Hook, J. N., Choe, E., & McElroy, S. E. (2017). The purity/sanctity subscale of the Moral Foundations Questionnaire does not work similarly for religious versus non-religious individuals. Psychology of Religion and Spirituality, 9(1), 124–130. https://doi.org/10.1037/rel0000057


Lugtig, P. & Hox, J. (2012) A checklist for testing measurement invariance, European Journal of Developmental Psychology, 9:4, 486-492, DOI: 10.1080/17405629.2012.686740


Labels:

Comments

Post a Comment

Popular posts from this blog

Academic Self-Efficacy Scale ASE

  Overview The  Academic Self-Efficacy Scale is an application of Self-Efficacy Theory   to examine the relationship between self-efficacy and academic performance using 8-items rated on a 7-point scale. The work of Chemers et al. (2001) has been widely cited. Format The 8-items are rated on a 7-point Likert-type scale ranging from 1 = Very Untrue to 7 = Very True. Sample Items 2. I know how to take notes. 6. I usually do very well in school and at academic tasks.   Reliability, Validity, and Other Research notes In the article describing the development and use of the ASE, the authors observed: “As predicted, academic self-efficacy was significantly and directly related to academic expectations and academic performance.” (Chemers et al., 2001, p. 61)   Sutton et al. (2011) reported Cronbach's alpha of .83 in their study of academic self-esteem and personal strengths. ASE was highly positively correlated with ACT scores (.24) and GPA (.39)....
Post a Comment
Read more

Rotterdam Emotional Intelligence Scale (REIS)

  Scale name: Rotterdam Emotional Intelligence Scale (REIS) Scales overview : The Rotterdam Emotional Intelligence Scale (REIS) is a 28-item measure of emotional intelligence having four subscales. Authors: Pekaar, Keri A., Bakker, Arnold B., van der Linden, Dimitri, & Born, Marise Ph. Response Type: All items are rated on a 5-point Likert type scale ranging from 1 (totally disagree to 5 (totally agree). Subscales = 4   Following are the four subscales with a sample item. Self-focused emotion appraisal( 1. I always know how I feel.) Other-focused emotion appraisal ( 8. I am aware of the emotions of the people around me.) Self-focused emotion regulation ( 15. I am in control of my own emotions.) Other-focused emotion regulation ( 22. I can make someone else feel differently.)   Reliability and Validity “The results indicate that the REIS follows a four-factorial structure and can be reliably measured with 28 items. The REIS was strongly correl...
Post a Comment
Read more

Spiritual Bypass Scale (SBS-13)

  Assessment name:   Spiritual Bypass Scale-13 (SBS-13) Scale overview: To assess the observed spiritual bypassing phenomenon, Fox et al. (2017) developed the 13 item Spiritual Bypass Scale . Authors: Fox, Cashwell, and Picciotto    [ Read more about Spiritual Bypassing in Psychotherapy] Response Type: The 13 items are rated on a four-point scale of agreement. Scale items Data analyses from two ethnically diverse US adult samples supported two factors (Psychological Avoidance, PA; Spiritualizing, SP). PA example: When I am in pain, I believe God will deliver me from it SP example: When someone I know is in trouble, I believe it is because they have done something wrong spiritually.   Psychometric properties Cronbach’salphas: Total scale = .85, PA = .82; Sp = .75. The total SBS score was associated with the ASPIRES subscales except for connectedness. PA was associated with depression and SP with stress and anxiety (DASS-21). The over...
Post a Comment
Read more