Procedia - Social and Behavioral Sciences · 2012 · 142 citations · 11 references
ComputingComputer ScienceEducational AssessmentComputational LinguisticsFormative AssessmentNatural Language ProcessingKeyword ExtractionNatural Language Processing In EducationNatural Language UnderstandingQuestion AnsweringTaxonomyAutomated Data AnalysisCategory Taxonomy DevelopmentCognitive Level ClassificationQuestion TaxonomySubject TaxonomiesTaxonomy Induction
Bloom's Taxonomy classifies learning objectives and the cognitive domain verifies student levels, but educators struggle to assess whether exam questions align with its cognitive levels. The study proposes automating exam question analysis to assign Bloom's taxonomy categories. A rule‑based NLP system identifies keywords and verbs in programming exam questions, trained on 70 examples and tested on 30. Initial tests show the rule‑based system correctly classifies Bloom's taxonomy categories for exam questions.
Bloom's Taxonomy is a classification of learning objectives within education that educators set for students. The cognitive domain within this taxonomy is designed to verify a student's cognitive level during a written examination. Educators may sometimes face the challenge in analysing whether their examination questions comply within the requirements of the Bloom's taxonomy at different cognitive levels. This paper proposes an automated analysis of the exam questions to determine the appropriate category based on this taxonomy. This rule-based approach applies Natural Language Processing (NLP) techniques to identify important keywords and verbs, which may assist in the identification of the category of a question. This work focuses on the computer programming subject domain. At present, a set of 100 questions (70 training set and 30 test set) is used in the research. Preliminary results indicate that the rules may successfully assist in the identification of the Bloom's taxonomy category correctly in the exam questions.
11
Introductory programming, criterion-referencing, and bloom
Raymond Lister, John Leaney · 2003 · 117 citations · Full text