Assessment, Statistics, and Research

The Theistic Spirituality Outcome Scale (TSOS) has potential as a useful outcome measure. Recently, a group of us completed a study of clients who saw Christian counselors. We assessed their current well-being using two measures: The Schwartz Outcome Scale (SOS) and the Theistic Outcome Scale (TSOS). (See references below.) The TSOS was designed by Richards (2005) as a measure of well-being for people associated with a theistic religion like Christianity, Judaism or Islam. We used the 17-item version, which uses a 5-point response format from  1 = never to 5 = almost always to rate each item (e.g., “I felt spiritually alive.”). Reliability We only calculated coefficient alpha, which was strong at .95. Validity The TSOS was significantly correlated with ratings of satisfaction with Christian counseling (.65) and likelihood of returning to Christian counseling (.62). It was significantly correlated with the SOS measure of general well-being (.84). Other signi...

  What makes a test valid? is a tricky question.  The short, and rather obnoxious response is, “nothing.”  Like reliability , validity is a property of test scores  rather than tests but more accurately, an interpretation of the scores. But it is important to take the question seriously when test-takers and users are wondering how much confidence to place in a test score. As with many aspects of science, the answers can be simply stated but there is a complicated backstory. Validity Traditions For many, the traditional views of test score validity will be sufficient. Tests measure constructs. Scientific constructs are ideas that have features that can be measured like reading comprehension, dominance, short-term memory, and verbal intelligence. Construct validity is not a single entity but rather the current state of knowledge about how a test instrument’s scores have functioned in many settings and in relation to crite...