Language Learning · 1991 · 86 citations · 15 references
EducationEducational AssessmentEducational MeasurementEnglish WritingForeign Language WritingPsychometricsAcademic WritingEssay WritingLanguage AssessmentWriting AssessmentWriting ProficiencyWriting SkillsAcademic Language Assessment ScoringAcademic Writing AssessmentEnglish As A Second Language WritingLearner Writing AnalysisLinguistic AccuracyPsychometric Properties
This study investigated the validity of using a multipletrait scoring procedure to obtain communicative writing profiles of the writing performance of adult nonnative English speakers in assessment contexts different from that for which the instrument was designed. Tran sferability could be of great benefit to those without the resources to design and pilot a multiple‐trait scoring instrument of their own. A modification of the New Profile Scale (NPS)was applied in the rating of 170 essays taken from two non‐NPS contexts, including 91 randomly selected essays of the Test of Written English and 79 essays written by a cohort of University of Michigan entering undergraduate nonnative English speaking students responding to the Michigan Writing Assessment. The scoring method taken as a who leappeared to be highly reliable in composite assessment, appropriate for application to essays of different timed lengths and rhetorical modes, and appropriateto writers of different levels of educational preparation. However, whereas the subscales of Communicative Quality and Linguistic Accuracy tended to show individual discriminant validity, little psychometric support for reporting scores on seven or five components of writing was found. Arguments for transferring the NPS for use in new writing assessment contexts would thus be educational rather than statistical.
15
A Rating Formulation for Ordered Response Categories
David Andrich · Psychometrika · 1978 · 3K citations