Skip to main content

Post Hoc Tests and Data Analyses

 A post hoc test is a statistical test used to determine if a pair of values are significantly different from each other after the primary analysis has been completed.

The term post hoc is a Latin phrase meaning after the event.

A common use of post hoc tests is the comparison of group means after an F-test in an ANOVA has revealed significant differences among the groups. The reason to test for differences after an overall test like ANOVA is to reduce the risk of finding a significant difference by chance. That is, if researchers perform a large number of tests on a sample, they may find one or more tests significant by chance.

There are many post hoc tests. Following are some examples of tests that compare the means of two groups.

Bonferroni Test

This is a popular test. By dividing the significance level by the number of comparisons, the risk of finding a significant difference by chance is reduced. This procedure is called the Bonferroni Correction.

Tukey's Honest Significant Difference Test (HSD)

The Tukey HSD is a commonly used test, which adjusts for the number of comparisons.

Scheffés Test

Scheffés Test is similar to the Tukey HSD but it is slightly more conservative.

More post hoc tests

Additional post hoc tests are available. I will list them so you can recognize the test as one that evaluates a pair of means for significant differences after an overall test (such as an ANOVA).

Duncan's New Multiple Range Test (MRT)

Dunn's Multiple Comparison Test

Fisher's Least Significant Difference (LSD)

Holm-Bonferroni Procedure

Newman-Keuls

Rodger's Method

Dunnett's correction

Benjamin-Hochberg (BH) procedure

Cite this post

Sutton, G. (2022, July 24). Post hoc tests and data analyses. Assessment, Statistics, and Research. Retrieved from https://statistics.suttong.com/2022/07/post-hoc-tests-and-data-analyses.html 


Reference for using scales in research:

Creating Surveys 

on AMAZON 

or GOOGLE








Reference for clinicians on understanding assessment

Applied Statistics Concepts for Counselors on

  AMAZON 

or GOOGLE









Resource Link:  A – Z Test Index



Please check out my website   www.suttong.com

   and see my books on   AMAZON       or  GOOGLE STORE

Also, consider connecting with me on    FACEBOOK   Geoff W. Sutton    

   TWITTER  @Geoff.W.Sutton    

You can read many published articles at no charge:

  Academia   Geoff W Sutton     ResearchGate   Geoffrey W Sutton 

 




Comments

Popular posts from this blog

Personal Self-Concept Questionnaire (PSQ)

  The Personal Self-Concept Questionnaire  ( PSQ )   Overview The Personal Self-Concept Questionnaire (PSQ) measures self-concept based on ratings of 18 items, which are grouped into four categories: Self-fulfilment, autonomy, honesty, and emotional self-concept. It is a likert-type rating scale with high internal consistency values and has been used with youth and adults. Subscales : The PSQ has four subscales 1. Self-fulfilment (6 items) 2. Autonomy (4 items) 3. Honesty (3 items) 4. Emotional self-concept (5 items)  ðŸ‘‰ [ Read more about Self-Concept and Self-Identity] The PSQ is a Likert-type scale with five response options ranging from totally disagree to totally agree. Reliability and Validity In the first study, coefficient alpha = .85 and in study two, alpha = .83. Data analysis supported a four-dimensional model (see the four categories above). Positive correlations with other self-concept measures were statistically significant. Other notes The authors e...

Mathematics Self-Efficacy and Anxiety Questionnaire (MSEAQ)

  Scale name: Mathematics Self-Efficacy and Anxiety Questionnaire (MSEAQ) Scale overview: The Mathematics Self-Efficacy and Anxiety Questionnaire (MSEAQ) is a 29-item self-report measure of both mathematics self-efficacy and mathematics anxiety. Author: Diana Kathleen May Response Type: Items are rated on a 5-point Likert-type scale following a “no response” option: 1 = Never 2 = Seldom 3 = Sometimes 4 = Often 5 = usually Sample items 1. I feel confident enough to ask questions  in my mathematics class. 6. I worry that I will not be able to get a  good grade in my mathematics course.   Subscales and basic statistics for the MSEAQ       Self-Efficacy M = 44.11, SD = 10.78, alpha = .93       Anxiety M = 46.47, SD = 12.61, alpha = .93       Total Scale M = 90.58, SD = 22.78, alpha = .96 Reliability: See the Cronbach’s alpha levels reported above. Validity: There were significant ...

Spiritual Bypass Scale (SBS-13)

  Assessment name:   Spiritual Bypass Scale-13 (SBS-13) Scale overview: To assess the observed spiritual bypassing phenomenon, Fox et al. (2017) developed the 13 item Spiritual Bypass Scale . Authors: Fox, Cashwell, and Picciotto    [ Read more about Spiritual Bypassing in Psychotherapy] Response Type: The 13 items are rated on a four-point scale of agreement. Scale items Data analyses from two ethnically diverse US adult samples supported two factors (Psychological Avoidance, PA; Spiritualizing, SP). PA example: When I am in pain, I believe God will deliver me from it SP example: When someone I know is in trouble, I believe it is because they have done something wrong spiritually.   Psychometric properties Cronbach’salphas: Total scale = .85, PA = .82; Sp = .75. The total SBS score was associated with the ASPIRES subscales except for connectedness. PA was associated with depression and SP with stress and anxiety (DASS-21). The over...