Relationship of text length of multiple-choice questions on item psychometric properties – A retrospective study

Fawaz Pullishery, DareenKhalid Aljehani, OmerAbdelgadir Elfaki Osman, BasemMohamed Abuzenada

Saudi Journal for Health Sciences · 2020 · 12 citations · 10 references

DOIFull text

Open access

Concepts

Abstract

Background: Item writing flaws while constructing multiple-choice questions (MCQs) have serious impact on different psychometric properties of questionnaire. The study aimed to evaluate the relationship of length of questions of (MCQs) items on difficulty factor (DF), discrimination index (DI), and Point Bi-serial (rBP) of a dental program assessment. Materials and Methods: The cross-sectional study included 627 MCQs. The data were analyzed from the report achieved through ExamSoft software. The questions were divided into long (words >100); medium (words of 70–100); and short (words <70). We divided the DF into hard (DF <0.3), average (DF = 0.3–0.8) easy (DF >0.8); DI into negative (DI <0), DI = 0–0.2 and DI >0.2; Point Bi-serial into “Negative” (rBP <0), rBP = 0–0.2 and rBP >0.2; Pearson's Chi-square test was used to find a relationship between length of question with other variables. Results: Thirty-one long MCQs, 56 medium, and 540 short MCQs were achieved based on the analysis. There was a statistically significant association found between DF and length of the questions (P < 0.05). No significant relationship between the length of the questions with DI and Point Bi-Serial factors. The median of DF was 0.6300 (interquartile range [IQR] 0.41). The median length of the MCQs was found to be 35.0 (IQR 25.0). Conclusion: The study proved that the length of the question has an impact on the DF but not always with the DI or Point Bi-serial.

References

10