A Systematic Review on the Use of Artificial Intelligence in Providing Feedback in Teaching Writing
DOI:
https://doi.org/10.11113/lspi.v12.26003Keywords:
Artificial Intelligence, Automated Feedback, Writing, Systematic Literature ReviewAbstract
Artificial Intelligence (AI) has rapidly evolved in recent years, permeating many facets of human life. One of the noteworthy uses of AI in education is the provision of feedback, which plays a crucial role in enhancing students’ learning outcomes, particularly in writing skills. Providing feedback on students’ writings is important for both teachers and students. Feedback in writing is a fundamental aspect of teaching practice, and AI offers innovative solutions to enhance its effectiveness. This review performs a rigorous systematic review of the existing literature on the utilization of AI in educational feedback mechanisms. Through a meticulous examination of scholarly literature, this review synthesizes findings regarding the effectiveness, challenges, and future directions of AI-driven feedback mechanisms. The findings reveal the potential of AI in providing personalized and timely constructive feedback. However, it also addresses challenges like the integration of AI tools into pedagogical practices to cater students from different educational levels. Additionally, it identifies the gaps in the existing literature and offers insights into potential areas for further exploration and development to optimize AI-driven feedback in improving pupils’ writing skills. To improve writing instruction, this review hopes to serve as a valuable resource for educators, researchers and policymakers seeking to leverage AI for feedback provision.
References
Almusharraf, N. M., & Alotaibi, Hind. (2022). An error-analysis study from an EFL writing context: human and automated essay scoring approaches. Technology, Knowledge and Learning. 28. 10.1007/s10758-022-09592-z.
Chen, X., & Pan, Q. (2022). Computer or human: A comparative study of automated evaluation scoring and instructors' feedback on Chinese college students' English writing. Journal of Educational Technology, 35(2), 123134.
Ghafouri, M. (2024). ChatGPT: The catalyst for teacher-student rapport and grit development in L2 class. System 120, Article 103209. https://doi.org/10.1016/j.system.2023.103209.
Latif, E., & Zhai, X. (2024). Fine-tuning ChatGPT for automatic scoring: Experimental comparison of GPT-3.5-turbo and BERT in educational assessments. Computers and Education: Artificial Intelligence, 6, Article 100210. https://doi.org/10.1016/j.caeai.2024.100210.
Meyer, J., Jansen, T., Schiller, R., Liebenow, L. W., Steinbach, M., Horbach, A., & Fleckenstein, J. (2024). “Your argumentation is good” says the AI vs humans: The role of feedback. Journal of Educational Psychology, 116(3), 456470.
Mizumoto, A., & Eguchi, M. (2023). Exploring the potential of using an AI language model for automated essay scoring. Language Assessment Quarterly, 20(2), 140161.
Pang, T. Y., Kootsookos, A., & Cheng, C. T. (2024). Artificial intelligence use in feedback: A qualitative analysis. Educational Research and Development, 56(2), 211225.
Sadler, D. R. (1989). Formative assessment and the design of instructional systems. Instructional Science, 18(2), 119–144. https://doi.org/10.1007/BF00117714.
Steiss, J., Tate, T., Graham, S., Cruz, J., Hebert, M., Wang, J., Moon, Y., Tseng, W., Warschauer, M., & Olson, C. B. (2024). Comparing the quality of human and ChatGPT responses. Computers in Human Behavior, 146, 107620.
Visser, M., van Eck, N. J., & Waltman, L. (2021). Large-scale comparison of bibliographic data sources: Scopus, Web of Science, Dimensions, Crossref, and Microsoft Academic. Quantitative Science Studies, 2(1), 2041.
Wang, Z., & Han, F. (2022). The effects of teacher feedback and automated feedback on cognitive and psychological aspects of foreign language writing: A mixed-methods research. Applied Linguistics Review, 13(1), 95122.
Wilson, J., Huang, Y., Palermo, C., Beard, G., & May, H. (2021). Automated feedback and automated scoring in the elementary grades: Usage, attitudes, and associations with writing outcomes in a districtwide implementation of MI Write. International Journal of Artificial Intelligence in Education, 31(1), 4–32.
Wilson, J., Palermo, C., & Wibowo, A. (2024). Elementary English learners’ engagement with automated feedback. Quantitative analysis using XGBoost and SHAP methods. Learning and Instruction, 91, 101890. https://doi.org/10.1016/j.learninstruc.2024.101890.
Zhang, Z. (V.), & Hyland, K. (2018). Student engagement with teacher and automated feedback on L2 writing. Assessing Writing, 36, 90102.
