Skip to main content

How to Evaluate a Workshop or Seminar


 Introduction to a Basic Study

This post provides information about one way to evaluate a workshop or seminar.

I will illustrate the process using a hypothetical example of forgiveness.


Suppose you wanted to evaluate the effectiveness of a workshop on forgiveness. 

You hypothesize that the group participating in the workshop would be more forgiving toward an offender than the group not receiving the forgiveness workshop.

Get approval from your company, university, or other research review board. They usually have forms listing the information you need to provide.

Recruit participants for your workshop.

Obtain consent for the study.

Select a forgiveness program

Select a survey to measure progress in forgiveness.

Create two groups of people.

    Group 1 gets the workshop now.

    Group 2 gets the workshop later and will serve as a control group.

Randomly assign volunteers to one of the two groups.

Deliver the workshop.

Assess the participants' progress by having people in both groups complete the forgiveness survey along with basic information such as age and other relevant characteristics.

Score the survey.

Calculate statistics such as the mean and standard deviation of the forgiveness measure for both groups.

Analyze the data to see if one group obtained a better score than the other group. t test  can help you decide if the differences are statistically different. A measure of  effect size  provides information on the effectiveness of the workshop. You can hire a consultant to perform the statistics.

******

Notes: Some researchers like to provide a survey before and after a workshop (this is a pretest-posttest design). The advantage is offering a basis for comparison for any changes between before and after but the disadvantage is that the participants may be influenced by reading the set of questions they will complete a second time.

Other researchers avoid the pretest problem by relying on random assignment to control for differences.

Another alternative, is to use a different forgiveness measure as a pretest to see if the groups are different on a relevant dimension of forgiveness before the workshop began. A statistician can use that pretest data as a  covariate  in the analysis

You can read more about evaluating workshops and seminars in Chapter 15 of Creating Surveys.

The text below is from Chapter 15.

**********

After reading about the REACH model developed by Everett L. Worthington Jr. at Virginia Commonwealth University, they decide to implement the program in a weekend format. The research team formulates a simple hypothesis: the REACH forgiveness program will help people forgive someone who deeply offended them.



            In this example, forgiveness is the independent variable having two levels or groups formed by randomly assigning participants to the REACH workshop or the control group. The control group does not attend the REACH workshop. At the conclusion of the workshop, all the people in the study complete a forgiveness survey, which asks questions to determine how forgiving they are toward a person who offended them. The forgiveness survey measures the dependent variable, which is forgiveness. Notice that forgiveness is used in two ways. Forgiveness is both the independent and dependent variable. As an independent variable, forgiveness is defined as participation or nonparticipation in the REACH forgiveness workshop. As a dependent variable, forgiveness is a state of forgiveness measured by a score on a forgiveness survey.


IV Forgiveness

DV Forgiveness

Forgiveness Workshop

Forgiveness Survey

No Workshop Control

Forgiveness Survey


After the surveys have been completed, the data are analyzed. A common statistical analysis to analyze data from a two-group study is the t test. The test results will indicate the REACH workshop was effective if people who took the workshop produced much higher scores than did people in the no-workshop control group.


Link to measures of forgiveness and other psychological variables.


**********


Learn more about using surveys to explore ideas and evaluate programs in the highly recommended book, Creating Surveys available on


AMAZON


GOOGLE







Resource Link:  A – Z Test Index

 

NOTICE:

The information about scales and measures is provided for clinicians and researchers based on professional publications. The links to authors, materials, and references can change. You may be able to locate details by contacting the main author of the original article or another author on the article list.

 

Post Author

 

Geoffrey W. Sutton PhD is Emeritus Professor of Psychology who publishes book and articles about clinical and social psychology including the psychology of religion. Website:     www.suttong.com





Books available on
 AMAZON   and the GOOGLE STORE

 

Connections

   FACEBOOK   Geoff W. Sutton  

  

   TWITTER  @Geoff.W.Sutton

 

   PINTEREST  www.pinterest.com/GeoffWSutton

 

Read many published articles and book samples on:

 

  Academia Geoff W Sutton   

 

  ResearchGate   Geoffrey W Sutton 

 




Comments

Popular posts from this blog

Personal Self-Concept Questionnaire (PSQ)

  The Personal Self-Concept Questionnaire  ( PSQ )   Overview The Personal Self-Concept Questionnaire (PSQ) measures self-concept based on ratings of 18 items, which are grouped into four categories: Self-fulfilment, autonomy, honesty, and emotional self-concept. Subscales : The PSQ has four subscales 1. Self-fulfilment (6 items) 2. Autonomy (4 items) 3. Honesty (3 items) 4. Emotional self-concept (5 items)  👉 [ Read more about Self-Concept and Self-Identity] The PSQ is a Likert-type scale with five response options ranging from totally disagree to totally agree. Reliability and Validity In the first study, coefficient alpha = .85 and in study two, alpha = .83. Data analysis supported a four-dimensional model (see the four categories above). Positive correlations with other self-concept measures were statistically significant. Other notes The authors estimated it took about 10 minutes to complete the PSQ. Their first study included people ages 12 to 36 ( n = 506). In the second s

Student Self-Efficacy

  Assessment name:  STUDENT SELF-EFFICACY SCALE * Note. This post has been updated to provide an available measure of student self-efficacy. ———- Scale overview:  The  student self-efficacy scale i s a 10-item measure of self-efficacy. It was developed using data from university nursing students in the United States. Authors: Melodie Rowbotham and Gerdamarie Schmitz Response Type:  A four-choice rating scale as follows: 1 = not at all true 2 = hardly true 3 = moderately true 4 = exactly true   Self-efficacy is the perception that a person can act in a way to achieve a desired goal.  Scale items There are 10 items. Examples: I am confident in my ability to learn, even if I am having a bad day. If I try hard enough, I can obtain the academic goals I desire.   Psychometric properties The authors reported that their sample scores ranged from 25 to 40 with a scale mean of 34.23 ( SD  = 3.80. Internal consistency was high at alpha = .84. The authors reported the results of a principal compon

Mathematics Self-Efficacy and Anxiety Questionnaire (MSEAQ)

  Scale name: Mathematics Self-Efficacy and Anxiety Questionnaire (MSEAQ) Scale overview: The Mathematics Self-Efficacy and Anxiety Questionnaire (MSEAQ) is a 29-item self-report measure of both mathematics self-efficacy and mathematics anxiety. Author: Diana Kathleen May Response Type: Items are rated on a 5-point Likert-type scale following a “no response” option: 1 = Never 2 = Seldom 3 = Sometimes 4 = Often 5 = usually Sample items 1. I feel confident enough to ask questions  in my mathematics class. 6. I worry that I will not be able to get a  good grade in my mathematics course.   Subscales and basic statistics for the MSEAQ       Self-Efficacy M = 44.11, SD = 10.78, alpha = .93       Anxiety M = 46.47, SD = 12.61, alpha = .93       Total Scale M = 90.58, SD = 22.78, alpha = .96 Reliability: See the Cronbach’s alpha levels reported above. Validity: There were significant positive correlations with similar measures. The results of a Fa