Keywords
English as a Medium of Instruction
Higher Education
systematic review
qualitative research synthesis inteligencia artificial generativa
inglés como medio de instrucción
educación universitaria
revisión sistemática
síntesis de investigación cualitativa
How to Cite
Abstract
This systematic review investigates the current state of research on Generative Artificial Intelligence (GenAI) and its implications for (EMI) Higher Education. The study employs a methodology based on an evidence-informed and theoretically credible framework to answer two research questions: (1) What studies of relevance to (EMI) Higher Education have been published thus far, considering the most recent developments of GenAI? and (2) Which key areas are currently lacking in extant literature and in need of further scholarly exploration in this regard in (EMI) Higher Education research? The results of the study reveal a limited number of pertinent publications, indicating a sparse scholarly landscape with a dearth of work on the implications of Generative AI in EMI Higher Education. Based on these findings, preliminary recommendations have been made to guide future research in this area. This study contributes to the literature by highlighting the need for further research on the potential of GenAI to enhance the teaching and learning experience in (EMI) Higher Education and provides a theoretical framework to guide future research. These findings may inform researchers and educators interested in exploring how GenAI may be leveraged from different educational perspectives.
References
Abdelwahab, H. R., Rauf, A., & Chen, D. (2023). Business students’ perceptions of Dutch higher educational institutions in preparing them for artificial intelligence work environments. Industry and Higher Education, 37(1), 22–34. https://doi.org/10.1177/09504222221087614
Abunasser, B. S., Al-Hiealy, M. R. J., Barhoom, A. M., Almasri, A. R., & Abu-Naser, S. S. (2022). Prediction of Instructor Performance using Machine and Deep Learning Techniques. International Journal of Advanced Computer Science and Applications, 13(7), 78–83. https://doi.org/10.14569/IJACSA.2022.0130711
Archibald, A., Hudson, C., Heap, T., Thompson, R., Lin, L., DeMerrit, J. & Lucke, H. (2023). A validation of AI-enabled discussion platform metrics and relationships to student efforts. TechTrends, 67(2), 285-293. https://doi.org/10.1007/s11528-022-00825-7
Archibald, M. M., & Clark, A. M. (2023). ChatGTP: What is it and how can nursing and health science education use it? Journal of Advanced Nursing. https://doi.org/10.1111/jan.15643
Bañeres, D., Rodríguez-González, M. E., Guerrero-Roldán, A.-E., & Cortadas, P. (2023). An early warning system to identify and intervene online dropout learners. International Journal of Educational Technology in Higher Education, 20(1). https://doi.org/10.1186/s41239-022-00371-5
Banihashem, S. K., Noroozi, O., den Brok, P., Biemans, H. J. A., & Kerman, N. T. (2023). Modeling teachers’ and students’ attitudes, emotions, and perceptions in blended education: Towards post-pandemic education. International Journal of Management Education, 21(2). https://doi.org/10.1016/j.ijme.2023.100803
Basilotta-Gómez-Pablos, V., Matarranz, M., Casado-Arranda, L.-A. & Otto, A. (2022). Teachers’ digital competencies in higher education: a systematic literature review. International Journal of Educational Technology in Higher Education, 19(8). https://doi.org/10.1186/s41239-021-00312-8
Bornmann, L. (2013). What is societal impact of research and how can it be assessed? A literature survey. Journal of the American Society for Information Science and Technology, 64(2), 217-233. https://doi.org/10.1002/asi.22803
Chang, Q., Pan, X., Manikandan, N., & Ramesh, S. (2022). Artificial Intelligence Technologies for Teaching and Learning in Higher Education. International Journal of Reliability, Quality and Safety Engineering, 29(5). https://doi.org/10.1142/S021853932240006X
Charmaz, K. (1996). The search for meanings- grounded theory. In J.A. Smith, R Harré & L. Van Langenhove (Eds.), Rethinking methods in psychology (pp. 27-49). Sage Publications.
Chen, X., Xie, H., Zou, D., Hwang, G.-J. (2020). Application and theory gaps during the rise of Artificial Intelligence in Education. Computers and Education: Artificial Intelligence, 1, 100002. https://doi.org/10.1016/j.caeai.2020.100002
Chen, Y., Jensen, S., Albert, L. J., Gupta, S. & Lee, T. (2023). Artificial Intelligence (AI) Student Assistants in the Classroom: Designing Chatbots to Support Student Success. Information Systems Frontiers, 25(1), 161-182. https://doi.org/10.1007/s10796-022-10291-4
Chen, Z. (2022). Artificial Intelligence Evaluation for Mathematics Teaching in Colleges under the Guidance of Wireless Network. Mobile Information Systems, 2022. https://doi.org/10.1155/2022/3201004
Choi, E. P. H., Lee, J. J., Ho, M.-H., Kwok, J. Y. Y., & Lok, K. Y. W. (2023). Chatting or cheating? The impacts of ChatGPT and other artificial intelligence language models on nurse education. Nurse Education Today, 125. https://doi.org/10.1016/j.nedt.2023.105796
Chong, S.W., Lin, T.J. & Chen, Y. (2022). A methodological review of systematic literature reviews in higher education: Heterogeneity and homogeneity. Educational Research Review, 35, 100426. https://doi.org/10.1016/j.edurev.2021.100426
Chu, H.-C., Hwang, G.-H., Tu, Y.-F., & Yang, K.-H. (2022). Roles and research trends of artificial intelligence in higher education: A systematic review of the top 50 most-cited articles. Australasian Journal of Educational Technology, 38(3), 22–42. https://doi.org/10.14742/ajet.7526
Cooper, G. (2023). Examining Science Education in ChatGPT: An Exploratory Study of Generative Artificial Intelligence. Journal of Science Education and Technology. https://doi.org/10.1007/s10956-023-10039-y
Costello, E. (2023). ChatGPT and the Educational AI Chatter: Full of Bullshit or Trying to Tell Us Something? Postdigital Science and Education. https://doi.org/10.1007/s42438-023-00398-5
Cotton, D. R. E., Cotton, P. A., & Shipway, J. R. (2023). Chatting and cheating: Ensuring academic integrity in the era of ChatGPT. Innovations in Education and Teaching International. https://doi.org/10.1080/14703297.2023.2190148
Cox, A., Cameron, D., Checco, A., Herrick, T., Mawson, M., & Steadman-Jones, R. (2022). Criteria of quality in fiction-based research to promote debate about the use of AI and robots in Higher Education. Higher Education Research and Development. https://doi.org/10.1080/07294360.2022.2087603
Crawford, J., Cowling, M., & Allen, K.-A. (2023). Leadership is needed for ethical ChatGPT: Character, assessment, and learning using artificial intelligence (AI). Journal of University Teaching and Learning Practice, 20(3). https://doi.org/10.53761/1.20.3.02
Dahmen, J., Kayaalp, M. E., Ollivier, M., Pareek, A., Hirschmann, M. T., Karlsson, J., & Winkler, P. W. (2023). Artificial intelligence bot ChatGPT in medical research: the potential game changer as a double-edged sword. Knee Surgery, Sports Traumatology, Arthroscopy. https://doi.org/10.1007/s00167-023-07355-6
Dameri, R.P. & Demartini, P. (2020). Knowledge transfer and translation in cultural ecosystems. Management Decision, 58(9), 1885-1907. https://doi.org/10.1108/MD-10-2019-1505
Dwivedi, Y. K., Kshetri, N., Hughes, L., Slade, E. L., Jeyaraj, A., Kar, A. K., Baabdullah, A. M., Koohang, A., Raghavan, V., Ahuja, M., Albanna, H., Albashrawi, M. A., Al-Busaidi, A. S., Balakrishnan, J., Barlette, Y., Basu, S., Bose, I., Brooks, L., Buhalis, D., … Wright, R. (2023). “So what if ChatGPT wrote it?” Multidisciplinary perspectives on opportunities, challenges and implications of generative conversational AI for research, practice and policy. International Journal of Information Management, 71. https://doi.org/10.1016/j.ijinfomgt.2023.102642
Egger, M., Dickersin, K. & Smith, G. D. (2008). Problems and limitations in conducting systematic reviews. In M. Egger, G. D. Smith & D. Altman (Eds.), Systematic Reviews in Health Care: Meta-Analysis in Context (pp. 43-68). Wiley. https://doi.org/10.1002/9780470693926.ch3
Elliot, V. (2022). Foundations of Educational Research. Bloomsbury Publishing.
Emenike, M. E., & Emenike, B. U. (2023). Was This Title Generated by ChatGPT? Considerations for Artificial Intelligence Text-Generation Software Programs for Chemists and Chemistry Educators. Journal of Chemical Education. https://doi.org/10.1021/acs.jchemed.3c00063
Farrokhnia, M., Banihashem, S. K., Noroozi, O. & Wals, A. (2023). A SWOT Analysis of ChatGPT: Implications for educational practice and research. Innovations in Education and Teaching International. https://doi.org/10.1080/14703297.2023.2195846
Fergus, S., Botha, M., & Ostovar, M. (2023). Evaluating Academic Answers Generated Using ChatGPT. Journal of Chemical Education. https://doi.org/10.1021/acs.jchemed.3c00087
Fernández, A., Gómez, B., Binjaku, K., & Meçe, E. K. (2023). Digital transformation initiatives in higher education institutions: A multivocal literature review. Education and Information Technologies. https://doi.org/10.1007/s10639-022-11544-0
Galvez, C. (2018). Co-word analysis applied to highly cited papers in Library and Information Science (2017-2017). Transinformacao, 30(3), 277-286. https://doi.org/10.1590/2318-08892018000300001
Gellai, D. B. (2022). Enterprising Academics: Heterarchical Policy Networks for Artificial Intelligence in British Higher Education. ECNU Review of Education. https://doi.org/10.1177/20965311221143798
Ghnemat, R., Shaout, A., & Al-Sowi, A. M. (2022). Higher Education Transformation for Artificial Intelligence Revolution: Transformation Framework. International Journal of Emerging Technologies in Learning, 17(19), 224–241. https://doi.org/10.3991/ijet.v17i19.33309
González-Calatayud, V., Prendes-Espinosa, P. & Riog-Vila, R. (2021). Artificial intelligence for student assessment: A systematic review. Applied Sciences, 11(12), 5467. https://doi.org/10.3390/app11125467
Graf, A., & Bernardi, R. E. (2023). ChatGPT in Research: Balancing Ethics, Transparency and Advancement. Neuroscience, 515, 71–73. https://doi.org/10.1016/j.neuroscience.2023.02.008
Gupta, P., & Yadav, S. (2022). A TAM-based Study on the ICT Usage by the Academicians in Higher Educational Institutions of Delhi NCR. Lecture Notes on Data Engineering and Communications Technologies, 111, 329–353. https://doi.org/10.1007/978-981-16-9113-3_25
Gupta, S. & Chen, Y. (2022). Supporting inclusive learning using chatbots? A chatbot-led interview study. Journal of Information Systems Education, 33(1), 98-108. https://aisel.aisnet.org/jise/vol33/iss1/11
Henry, J. V, & Oliver, M. (2022). Who Will Watch the Watchmen? The Ethico-political Arrangements of Algorithmic Proctoring for Academic Integrity. Postdigital Science and Education, 4(2), 330–353. https://doi.org/10.1007/s42438-021-00273-1
Heugh, K., French, M., Arya, V., Pham, M., Tudini, V., Billinghurst, N., Tippett, N., Chang, L.-C., Nichols, J., & Viljoen, J.-M. (2022). Multilingualism, translanguaging and transknowledging: Translation technology in EMI higher education. AILA Review, 35(1), 89–127. https://doi.org/10.1075/aila.22011.heu
Hodgson, D., Goldingay, S., Boddy, J., Nipperess, S., & Watts, L. (2022). Problematising Artificial Intelligence in Social Work Education: Challenges, Issues and Possibilities. British Journal of Social Work, 52(4), 1878–1895. https://doi.org/10.1093/bjsw/bcab168
Hooda, M., Rana, C., Dahiya, O., Rizwan, A., & Hossain, M. S. (2022). Artificial Intelligence for Assessment and Feedback to Enhance Student Success in Higher Education. Mathematical Problems in Engineering, 2022. https://doi.org/10.1155/2022/5215722
Hurlburt, G., & Reisman, S. (2023). The Importance of Educating Computational Educators. Computer, 56(3), 131–134. https://doi.org/10.1109/MC.2023.3235097
Iskender, A. (2023). Holy or Unholy? Interview with Open AI’s ChatGPT. European Journal of Tourism Research, 34. https://doi.org/10.54055/ejtr.v34i.3169
Jiao, P., Ouyang, F., Zhang, Q., & Alavi, A. H. (2022). Artificial intelligence-enabled prediction model of student academic performance in online engineering education. Artificial Intelligence Review, 55(8), 6321–6344. https://doi.org/10.1007/s10462-022-10155-y
Johinke, R., Cummings, R., & Di Lauro, F. (2023). Reclaiming the technology of higher education for teaching digital writing in a post—pandemic world. Journal of University Teaching and Learning Practice, 20(2). https://doi.org/10.53761/1.20.02.01
Khan, R. A., Jawaid, M., Khan, A. R., & Sajjad, M. (2023). ChatGPT-Reshaping medical education and clinical management. Pakistan Journal of Medical Sciences, 39(2), 605–607. https://doi.org/10.12669/pjms.39.2.7653
King, M. R. (2023). A Conversation on Artificial Intelligence, Chatbots, and Plagiarism in Higher Education. Cellular and Molecular Bioengineering, 16(1), 1–2. https://doi.org/10.1007/s12195-022-00754-8
Koo, M. (2023). Harnessing the potential of chatbots in education: The need for guidelines to their ethical use. Nurse Education in Practice, 68. https://doi.org/10.1016/j.nepr.2023.103590
Kris, A., Nailer, C., Jansen, K. & Potocnjak-Oxman, C. (2021). Teaching-practice as a critical bridge for narrowing the research-practice gap. Industrial Marketing Management, 92, 254-266. https://doi.org/10.1016/j.indmarman.2020.02.017
Latif, G., Alghazo, R., Pilotti, M. A. E., & Ben Brahim, G. (2022). Identifying ‘At-Risk’ Students: An AI-based Prediction Approach. International Journal of Computing and Digital Systems, 11(1), 1051–1059. https://doi.org/10.12785/ijcds/110184
Lim, W. M., Gunasekara, A., Pallant, J. L., Pallant, J. I., & Pechenkina, E. (2023). Generative AI and the future of education: Ragnarök or reformation? A paradoxical perspective from management educators. International Journal of Management Education, 21(2). https://doi.org/10.1016/j.ijme.2023.100790
Liu, L., Subbareddy, R., & Raghavendra, C. G. (2022). AI Intelligence Chatbot to Improve Students Learning in the Higher Education Platform. Journal of Interconnection Networks, 22. https://doi.org/10.1142/S0219265921430325
Lubienski, C. Conclusion: The future of research use? In J. Malin & C. Brown (Eds.), The Role of Knowledge Brokers in Education (pp. 201-212). Routledge.
Lund, B. D., Wang, T., Mannuru, N. R., Nie, B., Shimray, S., & Wang, Z. (2023). ChatGPT and a new academic reality: Artificial Intelligence-written research papers and the ethics of the large language models in scholarly publishing. Journal of the Association for Information Science and Technology. https://doi.org/10.1002/asi.24750
Ma, X. (2022). English Teaching in Artificial Intelligence-based Higher Vocational Education Using Machine Learning Techniques for Students’ Feedback Analysis and Course Selection Recommendation. Journal of Universal Computer Science, 28(9), 898–915. https://doi.org/10.3897/jucs.94160
Macaro, E. (2019). Systematic reviews in applied linguistics. In J. McKinley & H. Rose (Eds.), The Routledge Handbook of Research Methods in Applied Linguistics (pp. 228-237). http://dx.doi.org/10.4324/9780367824471-20
Macaro, E. (2022). English medium instruction: What do we know so far and what do we still need to find out? Language Teaching, 55, 533-546. https://doi.org/10.1017/S0261444822000052
Macaro, E., Curle, S., Pun, J., An, J. & Dearden, J. (2018). A systematic review of English medium instruction in higher education. Language Teaching, 51, 36-76. https://doi.org/10.1017/S0261444817000350
Martín-Núñez, J. L., Ar, A. Y., Fernández, R. P., Abbas, A., & Radovanović, D. (2023). Does intrinsic motivation mediate perceived artificial intelligence (AI) learning and computational thinking of students during the COVID-19 pandemic? Computers and Education: Artificial Intelligence, 4. https://doi.org/10.1016/j.caeai.2023.100128
Martín-Ramallal, P., Merchán-Murillo, A., & Ruiz-Mondaza, M. (2022). Virtual trainers with artificial intelligence: levels of acceptance among university students. Educar, 58(2), 427–442. https://doi.org/10.5565/rev/educar.1482
Masters, K. (2023). Ethical use of artificial intelligence in health professions education: AMEE Guide No.158. Medical Teacher. https://doi.org/10.1080/0142159X.2023.2186203
Miltra, S. (2023). Performing a literature review: An overview. Galaxy International Interdisciplinary Research Journal, 11(3), 184-190. Retrieved from https://giirj.com/index.php/giirj/article/view/4810
Morreel, S., Mathysen, D., & Verhoeven, V. (2023). Aye, AI! ChatGPT passes multiple-choice family medicine exam. Medical Teacher. https://doi.org/10.1080/0142159X.2023.2187684
Nagy, M., & Molontay, R. (2023). Interpretable Dropout Prediction: Towards XAI-Based Personalized Intervention. International Journal of Artificial Intelligence in Education. https://doi.org/10.1007/s40593-023-00331-8
Odden, T. O. B., Lauvland, A., Bøe, M. V, & Henriksen, E. K. (2023). Implementing the learning assistant model in European higher education. European Journal of Physics, 44(3). https://doi.org/10.1088/1361-6404/acb39e
Ouyang, F., Zheng, L. & Jiao, P. (2022). Artificial intelligence in online higher education: A systematic review of empirical research from 2011 to 2020. Education and Information Technologies, 27, 7893-7925. https://doi.org/10.1007/s10639-022-10925-9
Palatinus, D. L. (2017). Humans, machines and the screen of the Anthropocene. Americana E-Journal of American Studies in Hungary, XIII(2). Retrieved from: http://americanaejournal.hu/vol13no2/palatinus
Perkins, M. (2023). Academic Integrity considerations of AI Large Language Models in the post-pandemic era: ChatGPT and beyond. Journal of University Teaching and Learning Practice, 20(2). https://doi.org/10.53761/1.20.02.07
Quezada Castro, G. A., Castro Arellano, M. P., & Quezada Castro, M. P. (2022). Artificial intelligence and legal education: Its incorporation during the Covid-19 pandemic. Revista Venezolana de Gerencia, 27(8), 750–764. https://doi.org/10.52080/rvgluz.27.8.2
Rahman, A. (2022). Mapping the Efficacy of Artificial Intelligence-based Online Proctored Examination (OPE) in Higher Education during COVID-19: Evidence from Assam, India. International Journal of Learning, Teaching and Educational Research, 21(9), 76–94. https://doi.org/10.26803/ijlter.21.9.5
Ramo, R. M., Alshaher, A. A., & Al-Fakhry, N. A. (2022). The Effect of Using Artificial Intelligence on Learning Performance in Iraq: The Dual Factor Theory Perspective. Ingenierie Des Systemes d’Information, 27(2), 255–265. https://doi.org/10.18280/isi.270209
Razia, B., Awwad, B., & Taqi, N. (2022). The relationship between artificial intelligence (AI) and its aspects in higher education. Development and Learning in Organizations. https://doi.org/10.1108/DLO-04-2022-0074
Rycroft-Smith, L. (2022). Knowledge brokering to bridge the research-practice gap in education: Where are we now? Review of Education, 10(1), e3341. https://doi.org/10.1002/rev3.3341
Saad, I., & Tounkara, T. (2023). Artificial intelligence-based group decision making to improve knowledge transfer: the case of distance learning in higher education. Journal of Decision Systems. https://doi.org/10.1080/12460125.2022.2161734
Sadasivan, V. S., Kumar, A., Balasubramanian, S., Wang, W., & Feizi, S. (2023). Can AI-Generated Text be Reliably Detected?. arXiv preprint arXiv:2303.11156. https://doi.org/10.48550/arXiv.2303.11156
Sailer, M., Bauer, E., Hofmann, R., Kiesewetter, J., Glas, J., Gurevych, I., & Fischer, F. (2023). Adaptive feedback from artificial neural networks facilitates pre-service teachers’ diagnostic reasoning in simulation-based learning. Learning and Instruction, 83. https://doi.org/10.1016/j.learninstruc.2022.101620
Sharadgah, T. A., & Sa’di, R. A. (2022). A systematic review of research on the use of artificial intelligence in english language teaching and learning (2015-2021): What are the current effects? Journal of Information Technology Education: Research, 21, 337–377. https://doi.org/10.28945/4999
Singh, S. V, & Hiran, K. K. (2022). The Impact of AI on Teaching and Learning in Higher Education Technology. Journal of Higher Education Theory and Practice, 22(13), 135–148. https://doi.org/10.33423/jhetp.v22i13.5514
Subirats, L., Corral, A. P., Pérez-Ruiz, S., Fort, S., & Sacha, G.-M. (2023). Temporal analysis of academic performance in higher education before, during and after COVID-19 confinement using artificial intelligence. PLoS ONE, 18(2 February). https://doi.org/10.1371/journal.pone.0282306
Tian, X. (2022). Exploring Intelligent Teaching for Teachers of Ideology and Politics in the Context of Artificial Intelligence. Wireless Communications and Mobile Computing, 2022. https://doi.org/10.1155/2022/7423038
Tlili, A., Shehata, B., Adarkwah, M. A., Bozkurt, A., Hickey, D. T., Huang, R., & Agyemang, B. (2023). What if the devil is my guardian angel: ChatGPT as a case study of using chatbots in education. Smart Learning Environments, 10(1). https://doi.org/10.1186/s40561-023-00237-x
Urtasun, A. (2022). Empowering undergraduates through machine learning. Industry and Higher Education. https://doi.org/10.1177/09504222221124498
Wang, Y. (2022). Analysis on the Particularity of Higher Education Subject Development under the Background of Artificial Intelligence. International Transactions on Electrical Energy Systems, 2022. https://doi.org/10.1155/2022/8109117
Xia, X., & Li, X. (2022). Artificial Intelligence for Higher Education Development and Teaching Skills. Wireless Communications and Mobile Computing, 2022. https://doi.org/10.1155/2022/7614337
Yang, T.-C. (2023). Application of Artificial Intelligence Techniques in Analysis and Assessment of Digital Competence in University Courses. Educational Technology and Society, 26(1), 232–243. https://doi.org/10.30191/ETS.202301_26(1).0017
Yao, X. (2022). Design and Research of Artificial Intelligence in Multimedia Intelligent Question-Answering System and Self-Test System. Advances in Multimedia, 2022. https://doi.org/10.1155/2022/2156111
Yeo, M. A. (2023). Academic integrity in the age of Artificial Intelligence (AI) authoring apps. TESOL Journal. https://doi.org/10.1002/tesj.716
Yildirim-Erbasli, S. N., & Bulut, O. (2023). Conversation-based assessment: A novel approach to boosting test-taking effort in digital formative assessment. Computers and Education: Artificial Intelligence, 4. https://doi.org/10.1016/j.caeai.2023.100135
Zawacki- Richter, O., Marín, V.-I.; Bond, M. & Gouverneur, F. (2019). Systematic review of research on artificial intelligence applications in higher education – where are the educators? International Journal in Educational Technology in Higher Education, 16, 39. https://doi.org/10.1186/s41239-019-0171-0
Zembylas, M. (2023). A decolonial approach to AI in higher education teaching and learning: strategies for undoing the ethics of digital neocolonialism. Learning, Media and Technology, 48(1), 25–37. https://doi.org/10.1080/17439884.2021.2010094
Zhang, F. (2022). Design and Application of Artificial Intelligence Technology-Driven Education and Teaching System in Universities. Computational and Mathematical Methods in Medicine, 2022. https://doi.org/10.1155/2022/8503239
Zhou, C. (2022). Integration of modern technologies in higher education on the example of artificial intelligence use. Education and Information Technologies. https://doi.org/10.1007/s10639-022-11309-9
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
Copyright (c) 2023 Aula Abierta