Using Text Mining and Data Mining Techniques for Applied Learning Assessment
Keywords:Text mining, data mining, applied learning assessment, short answer questions, student evaluation
In a society where first hand work experience is greatly valued many universities or institutions of higher education have designed their Quality enhancement plan (QEP) to address student applied learning. This paper is the results of a university’s QEP plan, called Experiencing Transformative Education Through Applied Learning or ETEAL. This paper will highlight the research that was conducted using text mining and data mining techniques to analyze a dataset of 672 student evaluations collected from 40 different applied learning courses from fall 2013 to spring 2015, in order to evaluate the impact on instructional practice and student learning. Text mining techniques are applied through the NVivo text mining software to find the 100 most frequent terms to create a document-term matrix in Excel. Then, the document-term matrix is merged with the manual interpretation scores received to create the applied learning assessment data. Lastly, data mining techniques are applied to evaluate the performance, including Random Forest, K-nearest neighbors, Support Vector Machines (with linear and radial kernel), and 5-fold cross-validation. Our results show that the proposed text mining and data mining approach can provide prediction rates of around 67% to 85%, while the decision fusion approach can provide an improvement of 69% to 86%. Our study demonstrates that automatic quantitative analysis of student evaluations can be an effective approach to applied learning assessment.
The Author (or Authors, collectively referred to herein as Author) retains the copyright for the Article/Review to be published in the Journal of Effective Teaching in Higher Education and is acknowledged in the copyright line on the Article/Review. The Author asserts the moral right to be identified as the Authors of the Article/Review.
- The Author and the Publisher (Journal of Effective Teaching in Higher Education) agree that the Author grants a Creative Commons Copyright License in the Article/Review to the general public (see Attribution-NonCommercial-NoDerivatives 4.0 International (CC BY-NC-ND 4.0))
- The Author grants to the Publisher a royalty-free, worldwide, non-exclusive license to publish, reproduce, display, distribute and use the Article/Review in any form, either separately or as part of a collective work, including (but not limited to) a non-exclusive license to publish the article in an issue of the Journal, authorize reproduction of the entire Article/Review in another publication, and authorize reproduction and distribution of the Article/Review by means of computerized retrieval systems. The Author retains the ownership of all rights under copyright in the Article, and all rights not expressly granted in this Agreement.
- The Author agrees that the Journal of Effective Teaching in Higher Education be given credit as the original publisher in any republication of the Article/Review authorized by the Author. If the Publisher authorizes any other party to republish the article under the terms above, the Publisher shall require such party to ensure that the Author is properly credited.