Automated Analysis of Exam Questions According to Bloom's Taxonomy

Nazlia Omar, S Haris, Rosilah Hassan, Haslina Arshad, Masura Rahmat, Noor Faridatul Ainun Zainal, Rozli Zulkifli

Procedia - Social and Behavioral Sciences · 2012 · 142 citations · 11 references

DOIFull text

Open access

Concepts

TL;DR

Bloom's Taxonomy classifies learning objectives and the cognitive domain verifies student levels, but educators struggle to assess whether exam questions align with its cognitive levels. The study proposes automating exam question analysis to assign Bloom's taxonomy categories. A rule‑based NLP system identifies keywords and verbs in programming exam questions, trained on 70 examples and tested on 30. Initial tests show the rule‑based system correctly classifies Bloom's taxonomy categories for exam questions.

Abstract

Bloom's Taxonomy is a classification of learning objectives within education that educators set for students. The cognitive domain within this taxonomy is designed to verify a student's cognitive level during a written examination. Educators may sometimes face the challenge in analysing whether their examination questions comply within the requirements of the Bloom's taxonomy at different cognitive levels. This paper proposes an automated analysis of the exam questions to determine the appropriate category based on this taxonomy. This rule-based approach applies Natural Language Processing (NLP) techniques to identify important keywords and verbs, which may assist in the identification of the category of a question. This work focuses on the computer programming subject domain. At present, a set of 100 questions (70 training set and 30 test set) is used in the research. Preliminary results indicate that the rules may successfully assist in the identification of the Bloom's taxonomy category correctly in the exam questions.

References

11