Main Article Content

Abstract

Generative AI introduces complexity by offering potential support for human skills development, while also generating noise and false information in a postdigital context. Grounded in a Vygotskian perspective, this study explores the combined use of argument mapping (AM) and ChatGPT as mediational tools for developing argumentative skills as a proxy for critical thinking in higher education. These tools are conceptualized as socio-technical assemblages providing double stimulation within students’ Zone of Proximal Development (ZPD), addressing how multimodal texts and AI mediate comprehension of information (CoI) and critical thinking (CT). Adopting a case study approach with a quasi-experimental design, the research involved 17 female undergraduate students from the University of Padua, divided into three groups: G1 working with analog texts, G2 with multimodal texts, and a control group interacting only with ChatGPT (G3). Chatbot interactions were analyzed to explore its potential to support reflection and personal information re-elaboration. Results indicate improvements in comprehension and critical thinking, especially in the multimodal group (G2). G1 achieved weaker outcomes, possibly due to limited external stimulation. G3 outperformed G1 but showed stable yet comparatively lower results in advanced argumentative reworking despite a positive median. Overall, AM seems to support text comprehension and meaning reconstruction, while multimodality fosters the integration of multiple perspectives. Generative AI can further support critical engagement and understanding of AI systems when embedded in a structured pedagogical design rather than used “in the wild”.

Keywords

Generative AI Argumentative Skills Argument Maps Critical Thinking

Article Details

How to Cite
Crudele, F., & Raffaghelli, J. E. (2026). Gotcha! Enhancing Argumentation as a Basis for Critical Thinking via Generative AI-Supported Learning in Higher Education. Journal of E-Learning and Knowledge Society, 21(3), 20-35. https://doi.org/10.20368/1971-8829/1136130

References

  1. Al-Abdullatif, A. M. (2023). Modeling Students’ Perceptions of Chatbots in Learning: Integrating Technology Acceptance with the Value-Based Adoption Model. Education Sciences, 13(11). https://doi.org/10.3390/educsci13111151
  2. Alotto, P. (2021). Laboratorio di argomentazione: Guida al critical thinking e all’argument thinking [Argumentation workshop: A guide to critical thinking and argument thinking]. In A. Sani & A. Linguiti (Eds.), Sinapsi. Storia della filosofia. Protagonisti, percorsi, connessioni [Synapses. History of philosophy. Protagonists, paths, connections]. La Scuola editrice.
  3. Avenia, M. (2021). Ti spiego il mio problema: Un’indagine sulle competenze argomentative nella risoluzione di problemi matematici [I'll explain my problem: An investigation of argumentative skills in mathematical problem solving]. Didattica della matematica. Dalla ricerca alle pratiche d’aula [Teaching mathematics. From research to classroom practices], 10, 71-99. https://doi.org/10.33683/ddm.21.10.4
  4. Ayman, S. E., El-Seoud, S. A., Nagaty, K., & Karam, O. H. (2023). The Influence of ChatGPT on Student Learning and Academic Performance. ICCA 2023 - 2023 5th International Conference on Computer and Applications, Proceedings. https://doi.org/10.1109/ICCA59364.2023.10401713
  5. Bozkurt, A., Xiao, F., Lambert, S., Pazurek, A., Crompton, H., Koseoglu, S., Farrow, R., Bond, M., Nerantzi, C., Honeychurch, S., Bali, M., Dron, J., Mir, K., Stewart, B., Stewart, B., Costello, E., Mason, J., Stracke, C., Romero-Hall, E., & Jandric, P. (2023). Speculative Futures on ChatGPT and Generative Artificial Intelligence (AI): A Collective Reflection from the Educational Landscape. Asian Journal of Distance Education, 18(1), 53–130. https://doi.org/10.5281/zenodo.7636568
  6. Canale, D., Frigerio, A., Giovanni, T., & Roberto, C. (2021). Critical thinking. Un’introduzione [Critical Thinking. An introduction]. Egea.
  7. Carrington, M., Chen, R., Davies, M., Kaur, J., & Neville, B. (2011). The effectiveness of a single intervention of computer‐aided argument mapping in a marketing and a financial accounting subject. Higher Education Research & Development, 30, 387–403. https://doi.org/10.1080/07294360.2011.559197
  8. Colombo, A. (2018). Il testo argomentativo: Presupposti pedagogici e modelli di analisi [The argumentative text: Pedagogical assumptions and models of analysis]. In A. Colombo (Eds.), I pro e i contro [The pros and cons] (pp. 59–84). La Nuova Italia.
  9. Cortiana, P. (2017). Multimodalità e scrittura tradizionale a confronto: Un intervento nella scuola secondaria [Multimodality and traditional writing compared: An intervention in the secondary school]. Italian Journal of Educational Technology, 25(3). https://doi.org/10.17471/2499-4324/915
  10. Crudele, F., & Raffaghelli, J. E. (2023a). Ripensare le mappe argomentative nei nuovi contesti multimodali: Una revisione narrativa della letteratura [Rethinking argumentative maps in new multimodal contexts: A narrative review of the literature]. Media Education, 14(2). https://doi.org/10.36253/me-13801
  11. Crudele, F., & Raffaghelli, J. E. (2023b). Argument maps as tools to support the development of new media literacies: A systematic review. (Versione Version 1) [Dataset]. Zenodo. https://doi.org/10.5281/zenodo.7729327
  12. Crudele, F., & Raffaghelli, J. E. (2023c). Promoting Critical Thinking Through Argument Mapping: A Lab for Undergraduate Students. Journal of Information Technology Education: Research, 22, 497–525. https://doi.org/10.28945/5220
  13. Crudele, F., & Raffaghelli, J. E. (2024a). Human-driven and AI-driven mediational tool for argumentative reworking skills: An undergraduate students lab. In J. M. Duart & E. Trepulè (Eds.), Learning in the Age of AI: Towards Imaginative Futures (pp. 115–116). EDEN. https://drive.google.com/file/d/1CKuGXZPU-ZnQgnzFGP-6o_5K22u5gaNI/view?usp=sharing
  14. Crudele, F. & Raffaghelli, J.E. (2024b). Toward multimodal information and AI interaction: a quasi-experiment with ChatGPT. [Data set]. Zenodo. https://zenodo.org/doi/10.5281/zenodo.13220545
  15. Cuomo, S., Biagini, G., & Ranieri, M. (2022). Artificial Intelligence Literacy, che cos’è e come promuoverla. Dall’analisi della letteratura ad una proposta di Framework. Media Education, 13(2). https://doi.org/10.36253/me-13374
  16. Danielsson, K., & Selander, S. (2021). Working with Multimodal Texts in Education. In K. Danielsson & S. Selander (Eds.), Multimodal Texts in Disciplinary Education. A Comprehensive Framework (pp. 25–43). Springer. https://doi.org/10.1007/978-3-030-63960-0_4
  17. García-Peñalvo, F. (2023). The perception of Artificial Intelligence in educational contexts after the launch of ChatGPT: Disruption or Panic? [La percepción de la Inteligencia Artificial en contextos educativos tras el lanzamiento de ChatGPT: disrupción o pánico]. Education in the Knowledge Society (EKS), 24, e31279. https://doi.org/10.14201/eks.31279
  18. Engeström, Y. (1987). Learning by Expanding. Cambridge University Press.
  19. Facione, P. A., Facione, N. C. (2014). The Holistic Critical Thinking Scoring Rubric – HCTSR. Insight Assessment/The California Academic Press.
  20. Fadeev, A. (2019). Vygotsky’s theory of mediation in digital learning environment: Actuality and practice. Punctum., 5(1), 24–44. https://doi.org/10.18680/hss.2019.0004
  21. Ferrarelli, M. (2024, 29 giugno). Generative twins. Revista - El Arcón de Clío. https://revista.elarcondeclio.com.ar/gemelos-generativos-en-la-formacion-docente-los-sentidos-pedagogicos-de-la-ia-en-la-universidad/
  22. Floridi, L. (2023). AI as Agency Without Intelligence: On ChatGPT, Large Language Models, and Other Generative Models. SSRN Scholarly Paper. https://doi.org/10.2139/ssrn.4358789
  23. Iordanou, K., & Rapanta, C. (2021). “Argue With Me”: A Method for Developing Argument Skills. Frontiers in Psychology, 12. https://doi.org/10.3389/fpsyg.2021.631203
  24. Haque, M. A., & Li, S. (2024). Exploring ChatGPT and its Impact on Society. AI and Ethics. https://doi.org/10.1007/s43681-024-00435-4
  25. Hollweck, T. (2016). Robert K. Yin. (2014). Case Study Research Design and Methods (5th ed.). [Review] Canadian Journal of Program Evaluation, 30(1). https://doi.org/10.3138/cjpe.30.1.10
  26. Howell, E. (2017). Expanding Argument Instruction: Incorporating Multimodality and Digital Tools. Journal of Adolescent & Adult Literacy, 61(5), 533–542. https://doi.org/10.1002/jaal.716
  27. Jahani, M., Baruah, B., & Ward, A. (2024). Exploring ChatGPT Utilization Among Master’s Students in Higher Education. 2024 21st International Conference on Information Technology Based Higher Education and Training, ITHET 2024. https://doi.org/10.1109/ITHET61869.2024.10837601
  28. Jandrić, P., MacKenzie, A., & Knox, J. (2024). Postdigital Research: Genealogies, Challenges, and Future Perspectives. Postdigital Science and Education, 6(2), 409–415. https://doi.org/10.1007/s42438-022-00306-3
  29. Kim, M. K., Kim, N. J., & Heidari, A. (2022). Learner experience in artificial intelligence-scaffolded argumentation. Assessment & Evaluation in Higher Education, 47(8), 1–16. https://doi.org/10.1080/02602938.2022.2042792
  30. Knox, J. (2019). What Does the ‘Postdigital’ Mean for Education? Three Critical Perspectives on the Digital, with Implications for Educational Research and Practice. Postdigital Science and Education, 1(2), 357–370. https://doi.org/10.1007/s42438-019-00045-y
  31. Kress, G. (2013). Recognizing Learning. A Perspective from a Social Semiotic Theory of Multimodality. In I. de Saint-Georges & J.J. Weber (Eds.), Multilingualism and Multimodality (pp. 117–140). Brill. https://brill.com/display/book/9789462092662/BP000008.xml
  32. Kress, G. (2015). Multimodalità. Un approccio socio-semiotico alla comunicazione contemporanea [Multimodality. A socio-semiotic approach to contemporary communication]. Progedit.
  33. Lidåker, T. (2018). The potential of argument mapping as a tool for teaching critical thinking in secondary school [PhD Thesis]. Linköping University. http://urn.kb.se/resolve?urn=urn:nbn:se:liu:diva-149438
  34. Lund, B., & Wang, T. (2023). Chatting about ChatGPT: How may AI and GPT impact academia and libraries? Library Hi Tech News, 40. https://doi.org/10.1108/LHTN-01-2023-0009
  35. Macgilchrist, F. (2021). Theories of Postdigital Heterogeneity: Implications for Research on Education and Datafication. Postdigital Science and Education, 3(3), 660–667. https://doi.org/10.1007/s42438-021-00232-w
  36. Martha, A. S. D., Widowati, S., & Rahayu, D. P. (2025). Assessing Student Readiness And Perceptions Of Chatgpt In Learning: A Case Study In Indonesian Higher Education. Journal of Information Technology Education: Research, 24. https://doi.org/10.28945/5599
  37. McLeod, S. (2024). Mixed Methods Research. SimplyPsychology. https://doi.org/10.13140/RG.2.2.31329.93286
  38. Means, A., Jandrić, P., Sojot, A. N., Ford, D. R., Peters, M. A., & Hayes, S. (2022). The Postdigital-Biodigital Revolution. Postdigital Science and Education, 4(3), 1032–1051. https://doi.org/10.1007/s42438-022-00338-9
  39. Mollick, E. R., & Mollick, L. (2023). Assigning AI: Seven Approaches for Students, with Prompts. SSRN. https://doi.org/10.2139/ssrn.4475995
  40. OpenAI. (2022, November 30). Introducing ChatGPT [Blog]. Openai.Com. https://openai.com/blog/chatgpt
  41. Panciroli, C., & Rivoltella, P. C. (2024). Collaborating with Machines. AI, Literacies, School. In P. C. Rivoltella & C. Panciroli (Eds.), Sezione monografica—Artificial Intelligence in Education (Intelligenza Artificiale ed educazione) (pp. 17–48). Schole’.
  42. Pangrazio, L., & Selwyn, N. (2019). ‘Personal data literacies’: A critical literacies approach to enhancing understandings of personal digital data. New Media & Society, 21(2), 419–437. https://doi.org/10.1177/1461444818799523
  43. Petkauskas, V. (2023, March 6). ChatGPT’s answers could be nothing but a hallucination. Cybernews. https://cybernews.com/tech/chatgpts-bard-ai-answers-hallucination/
  44. Raffaghelli, J. E. (2024). (Post)Digital Scholarship. Professionalità accademica e trasformazione tecnologica in università Manoscritto 2.0 [(Post)Digital Scholarship. Academic professionalism and technological transformation in universities Manuscript 2.0]. Pensa Multimedia. https://www.pensamultimedia.it/libro/9791255681205
  45. Ranieri, M. (2019). Professional development in the digital age. Benefits and constraints of social media for lifelong learning. Form@re - Open Journal per La Formazione in Rete, 19(2), 178-192. https://doi.org/10.13128/formare-25353
  46. Ranieri, M., Cuomo, S., & Biagini, G. (2024). Scuola e intelligenza artificiale [School and artificial intelligence]. Tascabili Faber.
  47. Rivoltella, P. C. (2020). Nuovi alfabeti. Educazione e culture nella società post-mediale [New Alphabets. Education and cultures in the post-media society]. Scholè.
  48. Roose, K. (2022, December 5). The Brilliance and Weirdness of ChatGPT. The New York Times. https://www.nytimes.com/2022/12/05/technology/chatgpt-ai-twitter.html
  49. Sannino, A. (2015). The principle of double stimulation: A path to volitional action. Learning, Culture and Social Interaction, 6, 1–15. https://doi.org/10.1016/j.lcsi.2015.01.001
  50. Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Wadsworth Pub Co.
  51. Song, C., & Song, Y. (2023). Enhancing academic writing skills and motivation: Assessing the efficacy of ChatGPT in AI-assisted language learning for EFL students. Frontiers in Psychology, 14. https://doi.org/10.3389/fpsyg.2023.1260843
  52. Vygotsky, L. S. (1978). Mind in Society. The development of Higher Psychological Processes. Harvard University Press.
  53. Vygotskij, L. S. (2023). Pensiero e Linguaggio. Ricerche Psicologiche [Thought and Language. Psychological Research.]. Laterza. (Original work published 1934)
  54. Wang, T., Lund, B., Marengo, A., Pagano, A., Mannuru, N. R., Teel, Z. A., & Pange, J. (2023). Exploring the Potential Impact of Artificial Intelligence (AI) on International Students in Higher Education: Generative AI, Chatbots, Analytics, and International Student Success. Applied Sciences, 13, 6716. https://doi.org/10.3390/app13116716
  55. Wertsch, J. V. (2007). Mediation. In H. Daniels, J. V. Wertsch, & M. Cole (Eds.), The Cambridge Companion to Vygotsky (pp. 178–192). Cambridge University Press. https://doi.org/10.1017/CCOL0521831040.008
  56. Yin, K. R. (2014). Case Study Research Design and Methods (5th ed.). Sage Publications. (Original work published 1984)