The Impact of AI Tools (Like ChatGPT) on Student Learning Outcomes and Academic Integrity: A Mixed-Methods Study

Authors

  • Kashif Ali M. Phil English Linguistics Scholar, National University of Modern Languages, Islamabad, Pakistan
  • Sawera Qureshi Department of Computer Sciences, Abdul Wali Khan University Mardan

DOI:

https://doi.org/10.21015/vtess.v13i1.2180

Abstract

The fast pace of the introduction of artificial intelligence (AI) tools (including ChatGPT) into the educational process has already raised a storm of controversy about the impact they have on student achievement and academic integrity. This combined research evaluates the impact of writing assistants powered by AI on academic achievements and critical thinking abilities and moral reflections of students as well as within the educational landscape. Surveys of 300 university students were used to collect quantitative data on their habits regarding the use of AI tools, perceived benefits and challenges of using them. It yielded qualitative data through a qualitative survey concerning 15 educators through in-depth interviews to discuss the responses of institutions, policy gaps and pedagogical issues. The preliminary findings suggest that although the AI instruments can increase the efficiency of research and the drafting process, they are also associated with the issue of excessive dependence, lack of original thinking, and the risk of plagiarism. There was a notable correlation between a high frequency of AI use and positive short-term educational achievements, yet long-lasting components of the cognitive effects are not certain in any way. Teachers had rather ambivalent opinions, with some supporting the introduction of AI literacy at education institutions, and others demanding enforcement and regulation. The paper underlines the importance of a balanced AI implementation- stimulating progress and protecting the campus integrity. Suggestions such as the creation of institutional rules, AI-detective devices, and critical thinking modules should be created in order to reduce the misuse. In terms of the continued debate about AI in education, this study adds to the empirical literature to be used by policy and practices in the age of digital learning.

References

Braun, V., & Clarke, V. (2022). Thematic analysis: A practical guide. Sage.

Cotton, D. R. E., Cotton, P. A., & Shipway, J. R. (2023). Chatting and cheating: Ensuring academic integrity in the era of ChatGPT. Innovations in Education and Teaching International, 60(1), 1–12. https://doi.org/10.1080/14703297.2023.2190148

Creswell, J. W., & Creswell, J. D. (2023). Research design: Qualitative, quantitative, and mixed methods approaches (6th ed.). Sage.

Dai, W., Lin, Y., Li, S., & Zhang, L. (2023). Can ChatGPT improve student learning? Experimental evidence from a writing course. Computers & Education, 104, 103869. https://doi.org/10.1016/j.compedu.2023.103869

Hwang, G. J., Chang, Y. S., & Chen, C. Y. (2023). Measuring AI adoption in education: Scale development and validation. Computers & Education, 105, 104301. https://doi.org/10.1016/j.compedu.2023.104301

Johnson, R. B., Onwuegbuzie, A. J., & Turner, L. A. (2024). Mixed methods in educational research: A systematic review. Journal of Mixed Methods Research, 18(1), 45–67. https://doi.org/10.1177/15586898231195684

Kasneci, E., Sessler, K., Kübler, S., Bannert, M., Dementieva, D., Fischer, F., & Kasneci, G. (2023). ChatGPT for good? On opportunities and challenges of large language models for education. Learning and Individual Differences, 103, 102274. https://doi.org/10.1016/j.lindif.2023.102274

Kline, R. B. (2023). Principles and practice of structural equation modeling (5th ed.). Guilford Press.

Lo, C. K. (2023). What is the impact of ChatGPT on education? A rapid review of the literature. Education Sciences, 13(4), 410. https://doi.org/10.3390/educsci13040410

Newton, P. (2024). How common is ChatGPT use in universities? A global survey. Higher Education Policy, 37(1), 89–105. https://doi.org/10.1057/s41307-024-00319-6

Perkins, M., Brown, D., & Taylor, L. (2023). Academic integrity in the age of AI: Is ChatGPT a threat to learning? Journal of Academic Ethics, 21(3), 321–340. https://doi.org/10.1007/s10805-023-09467-1

Selwyn, N. (2023). Education and technology: Key issues and debates (4th ed.). Bloomsbury Academic.

UNESCO. (2023). AI in education: Challenges and opportunities for sustainable development (Tech. Rep.). UNESCO Digital Education Report. https://unesdoc.unesco.org/

Warschauer, M. (2022a). Will AI make us stupid? The cognitive consequences of automated writing. Educational Psychologist, 57(3), 201–215. https://doi.org/10.1080/00461520.2022.2098538

Warschauer, M. (2022b). Will AI make us stupid? The cognitive consequences of automated writing (Vol. 57, No. 3). Educational Psychologist.

Watson, L. (2024). Advanced statistical techniques for AI impact studies. Educational Technology & Society, 27(2), 112–130. https://www.j-ets.net/

Weber-Wulff, D., Köhler, M., & Möller, N. (2023). Can AI-generated text be detected? A comparative analysis of plagiarism tools. International Journal for Educational Integrity, 19(1), 1–18. https://doi.org/10.1007/s40979-023-00121-2

Zawacki-Richter, O., Marín, V. I., Bond, M., & Gouverneur, F. (2023). Generative AI and the future of higher education: A threat or opportunity? EdTech Review, 12(2), 45–60.

Downloads

Published

2025-03-31

How to Cite

Ali, K., & Qureshi, S. (2025). The Impact of AI Tools (Like ChatGPT) on Student Learning Outcomes and Academic Integrity: A Mixed-Methods Study. VFAST Transactions on Education and Social Sciences, 31(1), 36–46. https://doi.org/10.21015/vtess.v13i1.2180

Issue

Vol. 31 No. 1 (2025): January-March

Section

Articles

License

Authors who publish with this journal agree to the following terms:

  1. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License (CC-By) that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
  2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
  3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).

                                      

This work is licensed under a Creative Commons Attribution  License CC BY