Judgment and Decision Making · 2009 · 18 citations · 25 references
EducationEducational AssessmentPsychologyCognitive PsychologyPerformance AssessmentPerformance MeasurementCognitive Task AnalysisPerformance ScorePerformance TasksPerformance TestingPerformance Under PressurePerformance-based AssessmentCognitive PerformanceCognitive Performance TestingMulti-digit AdditionPerceptual-motor CouplingPerformance-based Cognitive AssessmentProficiency RankingThree-digit AdditionTwo-digit Addition
Abstract Using a cognitive task (mental calculation) and a perceptual-motor task (stylized golf putting), we examined differential proficiency using the CWS index and several other quantitative measures of performance. The CWS index (Weiss & Shanteau, 2003) is a coherence criterion that looks only at internal properties of the data without incorporating an external standard. In Experiment 1, college students (n = 20) carried out 2- and 3-digit addition and multiplication problems under time pressure. In Experiment 2, experienced golfers (n = 12), also college students, putted toward a target from nine different locations. Within each experiment, we analyzed the same responses using different methods. For the arithmetic tasks, accuracy information (mean absolute deviation from the correct answer, MAD) using a coherence criterion was available; for golf, accuracy information using a correspondence criterion (mean deviation from the target, also MAD) was available. We ranked the performances of the participants according to each measure, then compared the orders using Spearman’s r s . For mental calculation, the CWS order correlated moderately (r s =.46) with that of MAD. However, a different coherence criterion, degree of model fit, did not correlate with either CWS or accuracy. For putting, the ranking generated by CWS correlated .68 with that generated by MAD. Consensual answers were also available for both experiments, and the rankings they generated correlated highly with those of MAD. The coherence vs. correspondence distinction did not map well onto criteria for performance evaluation.
25
Man as an intuitive statistician.
Cameron R. Peterson, Lee Roy Beach · Psychological Bulletin · 1967 · 981 citations
Sian L. Beilock, Thomas H. Carr, Clare MacMahon et al. · Journal of Experimental Psychology Applied · 2002 · 799 citations
Education, Kinesiology, Psychology +15
Moneyball: the art of winning an unfair game
Choice Reviews Online · 2004 · 797 citations