Skip to main content

Post Hoc Tests and Data Analyses

 A post hoc test is a statistical test used to determine if a pair of values are significantly different from each other after the primary analysis has been completed.

The term post hoc is a Latin phrase meaning after the event.

A common use of post hoc tests is the comparison of group means after an F-test in an ANOVA has revealed significant differences among the groups. The reason to test for differences after an overall test like ANOVA is to reduce the risk of finding a significant difference by chance. That is, if researchers perform a large number of tests on a sample, they may find one or more tests significant by chance.

There are many post hoc tests. Following are some examples of tests that compare the means of two groups.

Bonferroni Test

This is a popular test. By dividing the significance level by the number of comparisons, the risk of finding a significant difference by chance is reduced. This procedure is called the Bonferroni Correction.

Tukey's Honest Significant Difference Test (HSD)

The Tukey HSD is a commonly used test, which adjusts for the number of comparisons.

Scheffés Test

Scheffés Test is similar to the Tukey HSD but it is slightly more conservative.

More post hoc tests

Additional post hoc tests are available. I will list them so you can recognize the test as one that evaluates a pair of means for significant differences after an overall test (such as an ANOVA).

Duncan's New Multiple Range Test (MRT)

Dunn's Multiple Comparison Test

Fisher's Least Significant Difference (LSD)

Holm-Bonferroni Procedure

Newman-Keuls

Rodger's Method

Dunnett's correction

Benjamin-Hochberg (BH) procedure

Cite this post

Sutton, G. (2022, July 24). Post hoc tests and data analyses. Assessment, Statistics, and Research. Retrieved from https://statistics.suttong.com/2022/07/post-hoc-tests-and-data-analyses.html 


Reference for using scales in research:

Creating Surveys 

on AMAZON 

or GOOGLE








Reference for clinicians on understanding assessment

Applied Statistics Concepts for Counselors on

  AMAZON 

or GOOGLE









Resource Link:  A – Z Test Index



Please check out my website   www.suttong.com

   and see my books on   AMAZON       or  GOOGLE STORE

Also, consider connecting with me on    FACEBOOK   Geoff W. Sutton    

   TWITTER  @Geoff.W.Sutton    

You can read many published articles at no charge:

  Academia   Geoff W Sutton     ResearchGate   Geoffrey W Sutton 

 




Labels:

Comments

Post a Comment

Popular posts from this blog

Academic Self-Efficacy Scale ASE

  Overview The  Academic Self-Efficacy Scale is an application of Self-Efficacy Theory   to examine the relationship between self-efficacy and academic performance using 8-items rated on a 7-point scale. The work of Chemers et al. (2001) has been widely cited. Format The 8-items are rated on a 7-point Likert-type scale ranging from 1 = Very Untrue to 7 = Very True. Sample Items 2. I know how to take notes. 6. I usually do very well in school and at academic tasks.   Reliability, Validity, and Other Research notes In the article describing the development and use of the ASE, the authors observed: “As predicted, academic self-efficacy was significantly and directly related to academic expectations and academic performance.” (Chemers et al., 2001, p. 61)   Sutton et al. (2011) reported Cronbach's alpha of .83 in their study of academic self-esteem and personal strengths. ASE was highly positively correlated with ACT scores (.24) and GPA (.39)....
Post a Comment
Read more

Brief Self-Control Scale (BSCS)

  Assessment name:   Brief Self-Control Scale Scale overview: The Brief Self-Control Scale (BSCS) is a 13-item self-report measure of self-control, which is also called self-discipline and willpower.   Authors: June P. Tangney, Roy F. Baumeister, Angie L. Boone   Response Type: Items are rated on a five-point scale of self-evaluation from 1 = not at all like me to 5 = very much like me. Scale items Example items include “I am good at resisting temptation” and “I have a hard time breaking bad habits” (reverse coded). Psychometric properties In their original publication, Tangney and others (2004) documented high internal consistency and retest values. High scores representing self-control were associated with academic success and better relationships whereas low scores were correlated with personal problems and problem relationships. Availability: The BSCS is widely used and available in many languages. The original 36-item scale and the Brief...
Post a Comment
Read more

Mathematics Self-Efficacy and Anxiety Questionnaire (MSEAQ)

  Scale name: Mathematics Self-Efficacy and Anxiety Questionnaire (MSEAQ) Scale overview: The Mathematics Self-Efficacy and Anxiety Questionnaire (MSEAQ) is a 29-item self-report measure of both mathematics self-efficacy and mathematics anxiety. Author: Diana Kathleen May Response Type: Items are rated on a 5-point Likert-type scale following a “no response” option: 1 = Never 2 = Seldom 3 = Sometimes 4 = Often 5 = usually Sample items 1. I feel confident enough to ask questions  in my mathematics class. 6. I worry that I will not be able to get a  good grade in my mathematics course.   Subscales and basic statistics for the MSEAQ       Self-Efficacy M = 44.11, SD = 10.78, alpha = .93       Anxiety M = 46.47, SD = 12.61, alpha = .93       Total Scale M = 90.58, SD = 22.78, alpha = .96 Reliability: See the Cronbach’s alpha levels reported above. Validity: There were significant ...
Post a Comment
Read more