Fair Procedures when Constructing Multiple-choice Test-Keys
Keywords:multiple-choice, guessing, procedural fairness, testing, factorial ANOVA
Multiple-choice testing is a staple within the U.S. higher education system. From classroom assessments to standardized entrance exams such as the GRE, GMAT, or LSAT, test developers utilize a variety of validated and heuristic-driven item-writing guidelines. One such guideline that has been given recent attention is to randomize the position of the correct answer throughout the entire answer key. Doing this theoretically limits the number of correct guesses that test-takers can make and thus reduces the amount of construct-irrelevant variance in test score interpretations. This study empirically tested the strategy to randomize the answer-key. Specifically, a factorial ANOVA was conducted to examine differences in General Biology classroom multiple-choice test scores by the interaction of method for varying the correct answer’s position and student-ability. Although no statistically significant differences were found, the paper argues that the guideline is nevertheless ethically substantiated.
The Author (or Authors, collectively referred to herein as Author) retains the copyright for the Article/Review to be published in the Journal of Effective Teaching in Higher Education and is acknowledged in the copyright line on the Article/Review. The Author asserts the moral right to be identified as the Authors of the Article/Review.
- The Author and the Publisher (Journal of Effective Teaching in Higher Education) agree that the Author grants a Creative Commons Copyright License in the Article/Review to the general public (see Attribution-NonCommercial-NoDerivatives 4.0 International (CC BY-NC-ND 4.0))
- The Author grants to the Publisher a royalty-free, worldwide, non-exclusive license to publish, reproduce, display, distribute and use the Article/Review in any form, either separately or as part of a collective work, including (but not limited to) a non-exclusive license to publish the article in an issue of the Journal, authorize reproduction of the entire Article/Review in another publication, and authorize reproduction and distribution of the Article/Review by means of computerized retrieval systems. The Author retains the ownership of all rights under copyright in the Article, and all rights not expressly granted in this Agreement.
- The Author agrees that the Journal of Effective Teaching in Higher Education be given credit as the original publisher in any republication of the Article/Review authorized by the Author. If the Publisher authorizes any other party to republish the article under the terms above, the Publisher shall require such party to ensure that the Author is properly credited.