Skip to main content

Post Hoc Tests and Data Analyses

 A post hoc test is a statistical test used to determine if a pair of values are significantly different from each other after the primary analysis has been completed.

The term post hoc is a Latin phrase meaning after the event.

A common use of post hoc tests is the comparison of group means after an F-test in an ANOVA has revealed significant differences among the groups. The reason to test for differences after an overall test like ANOVA is to reduce the risk of finding a significant difference by chance. That is, if researchers perform a large number of tests on a sample, they may find one or more tests significant by chance.

There are many post hoc tests. Following are some examples of tests that compare the means of two groups.

Bonferroni Test

This is a popular test. By dividing the significance level by the number of comparisons, the risk of finding a significant difference by chance is reduced. This procedure is called the Bonferroni Correction.

Tukey's Honest Significant Difference Test (HSD)

The Tukey HSD is a commonly used test, which adjusts for the number of comparisons.

Scheffés Test

Scheffés Test is similar to the Tukey HSD but it is slightly more conservative.

More post hoc tests

Additional post hoc tests are available. I will list them so you can recognize the test as one that evaluates a pair of means for significant differences after an overall test (such as an ANOVA).

Duncan's New Multiple Range Test (MRT)

Dunn's Multiple Comparison Test

Fisher's Least Significant Difference (LSD)

Holm-Bonferroni Procedure

Newman-Keuls

Rodger's Method

Dunnett's correction

Benjamin-Hochberg (BH) procedure

Cite this post

Sutton, G. (2022, July 24). Post hoc tests and data analyses. Assessment, Statistics, and Research. Retrieved from https://statistics.suttong.com/2022/07/post-hoc-tests-and-data-analyses.html 


Reference for using scales in research:

Creating Surveys 

on AMAZON 

or GOOGLE








Reference for clinicians on understanding assessment

Applied Statistics Concepts for Counselors on

  AMAZON 

or GOOGLE









Resource Link:  A – Z Test Index



Please check out my website   www.suttong.com

   and see my books on   AMAZON       or  GOOGLE STORE

Also, consider connecting with me on    FACEBOOK   Geoff W. Sutton    

   TWITTER  @Geoff.W.Sutton    

You can read many published articles at no charge:

  Academia   Geoff W Sutton     ResearchGate   Geoffrey W Sutton 

 




Comments

Popular posts from this blog

Personal Self-Concept Questionnaire (PSQ)

  The Personal Self-Concept Questionnaire  ( PSQ )   Overview The Personal Self-Concept Questionnaire (PSQ) measures self-concept based on ratings of 18 items, which are grouped into four categories: Self-fulfilment, autonomy, honesty, and emotional self-concept. Subscales : The PSQ has four subscales 1. Self-fulfilment (6 items) 2. Autonomy (4 items) 3. Honesty (3 items) 4. Emotional self-concept (5 items)  ðŸ‘‰ [ Read more about Self-Concept and Self-Identity] The PSQ is a Likert-type scale with five response options ranging from totally disagree to totally agree. Reliability and Validity In the first study, coefficient alpha = .85 and in study two, alpha = .83. Data analysis supported a four-dimensional model (see the four categories above). Positive correlations with other self-concept measures were statistically significant. Other notes The authors estimated it took about 10 minutes to complete the PSQ. Their first study included people ages 12 to 36 ( n = 50...

Student Self-Efficacy

  Assessment name:  STUDENT SELF-EFFICACY SCALE * Note. This post has been updated to provide an available measure of student self-efficacy. ———- Scale overview:  The  student self-efficacy scale i s a 10-item measure of self-efficacy. It was developed using data from university nursing students in the United States. Authors: Melodie Rowbotham and Gerdamarie Schmitz Response Type:  A four-choice rating scale as follows: 1 = not at all true 2 = hardly true 3 = moderately true 4 = exactly true   Self-efficacy is the perception that a person can act in a way to achieve a desired goal.  Scale items There are 10 items. Examples: I am confident in my ability to learn, even if I am having a bad day. If I try hard enough, I can obtain the academic goals I desire.   Psychometric properties The authors reported that their sample scores ranged from 25 to 40 with a scale mean of 34.23 ( SD  = 3.80. Internal consistency was high at alpha = .84. The a...

Mathematics Self-Efficacy and Anxiety Questionnaire (MSEAQ)

  Scale name: Mathematics Self-Efficacy and Anxiety Questionnaire (MSEAQ) Scale overview: The Mathematics Self-Efficacy and Anxiety Questionnaire (MSEAQ) is a 29-item self-report measure of both mathematics self-efficacy and mathematics anxiety. Author: Diana Kathleen May Response Type: Items are rated on a 5-point Likert-type scale following a “no response” option: 1 = Never 2 = Seldom 3 = Sometimes 4 = Often 5 = usually Sample items 1. I feel confident enough to ask questions  in my mathematics class. 6. I worry that I will not be able to get a  good grade in my mathematics course.   Subscales and basic statistics for the MSEAQ       Self-Efficacy M = 44.11, SD = 10.78, alpha = .93       Anxiety M = 46.47, SD = 12.61, alpha = .93       Total Scale M = 90.58, SD = 22.78, alpha = .96 Reliability: See the Cronbach’s alpha levels reported above. Validity: There were significant ...