Main Article Content
Abstract
The pandemic emergency has almost forced the transition from face-to-face to remote evaluation. Starting from the results of the research in Mathematics Education, this exploratory work focuses on how to design effective closed-ended questions of different types, capable of reliably assessing mathematical learning outcomes, especially in terms of the involved competencies. We also investigate how to aggregate the questions into Moodle quizzes able to effectively replace the traditional open written exam. We propose a three-dimensional theoretical model, which takes into account the various types of questions, expected learning outcomes, and mathematical arguments, to shed light on the problems of validity, reliability, balance, and correctness of closed-ended quizzes. We discuss the results of the first implementation of the model within a Linear Algebra course for engineering freshmen.
Keywords
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
The author declares that the submitted to Journal of e-Learning and Knowledge Society (Je-LKS) is original and that is has neither been published previously nor is currently being considered for publication elsewhere.
The author agrees that SIe-L (Italian Society of e-Learning) has the right to publish the material sent for inclusion in the journal Je-LKS.
The author agree that articles may be published in digital format (on the Internet or on any digital support and media) and in printed format, including future re-editions, in any language and in any license including proprietary licenses, creative commons license or open access license. SIe-L may also use parts of the work to advertise and promote the publication.
The author declares s/he has all the necessary rights to authorize the editor and SIe-L to publish the work.
The author assures that the publication of the work in no way infringes the rights of third parties, nor violates any penal norms and absolves SIe-L from all damages and costs which may result from publication.
The author declares further s/he has received written permission without limits of time, territory, or language from the rights holders for the free use of all images and parts of works still covered by copyright, without any cost or expenses to SIe-L.
For all the information please check the Ethical Code of Je-LKS, available at http://www.je-lks.org/index.php/ethical-code
References
- Albano, G., and Ferrari, P.L. (2008), Integrating Technology and Research in Mathematics Education: The Case of E-Learning, In F.J. García-Peñalvo (Ed.), Advances in E-Learning: Experiences and Methodologies (pp.132-148). Hershey, NY: InformationScienceReference.
- Albano, G. and Ferrari, P.L. (2013), Mathematics education and e-learning: meaningful use of the quiz-modules, In E. Faggiano & A. Montone (Eds.). ICTMT 11 Conference Proceedings (pp.53-58).
- Albano G., Pi,erri, A. & Sabena, C. (2020), Enhancing formative assessment practices in undergraduate courses by means of online workshops, In: Proceedings of the 14th International Conference on Technology in Mathematics Teaching – ICTMT 14 DuEPublico, Duisburg-Essen Publications Online (pp. 155-162).
- Chakrabarrty, S.N. (2013) Best Split – half and Maximum Reliability, Journal of Research & Method in Education 3 (1), 1-8.
- Darlington, E. (2014), Contrasts in mathematical challenges in A-level Mathematics and Further Mathematics, and undergraduate mathematics examinations. Teaching Mathematics and its Applications, 3, 213–229.
- Dubinsky, E. (1997), On Learning Quantification, Journal of Computers in Mathematics and Science Teaching. 16 (213), 335-362.
- Duval, R. (2006), A cognitive analysis of problems of comprehension in a learning of mathematics, Educational Studies in Mathematics, 61, 103-131.
- Ferrari, P.L. (2019), Argomentare a scuola: intrecci fra matematica e lingua, L'insegnamento della matematica e delle scienze integrate, vol.42 A-B, n.5, 611-625.
- Ferrari, P.L. (2020). Educazione matematica, lingua, linguaggi. Costruire, condividere e comunicare matematica in classe. UTET Università.
- Garuti, R. & Martignone, F. (2019), Assessment and argumentation: an analysis of mathematics standardized items, In: U.T. Jankvist, M. Van den Heuvel-Panhuizen & M. Veldhuis (Eds.). Proceedings of CERME 11 (pp. 4075-4082) Utrecht: Freudenthal Group & Institute, Utrecht University and ERME.
- Iannone, P. (2020a), Assessing Mathematics at University: Covid-19 and beyond. London Mathematical Society, Newsletter, Issue 490, september 2020, 34-40.
- Iannone, P. (2020b), Assessment of mathematics in the digital age: the case of university mathematics. In: A. Donevska-Todorova, E. Faggiano, J. Trgalova, Z. Lavicza, R. Weinhandl, et al. (Eds.), Proceedings of the Tenth ERME Topic Conference (ETC 10) on Mathematics Education in the Digital Age (MEDA).
- Livingston, S. A. (2018). Test reliability—Basic concepts (Research Memorandum No. RM-18-01). Princeton, NJ: Educational Testing Service.
- Niss, M., and Højgaard, T. (2019), Mathematical competencies revisited, Educational Studies in Mathematics, 102, 9–28.
- Sangwing, C. (2013), Computer Aided Assessment of Mathematics, Oxford University Press.
- Scalise, K. and Gifford, B. (2006), Computer-Based Assessment in E-Learning: A Framework for Constructing “Intermediate Constraint” Questions and Tasks for Technology Platforms, Journal of Technology, Learning, and Assessment, 4.
- Skemp, R. (1976), Relational understanding and instrumental understanding. Mathematics Teaching, 77, 20–26.
- Telloni, A.I. (2021), Design of individualized digital activities fostering strategic planning in linear algebra, In: G. Mele, P. Magnaghi-Delfino & T. Norando (Eds.) Faces of geometry II. Lectures Notes in Networks and Systems, 172, pp. 287-298. Springer International Publishing.
- Trinchero, R. (2006), Valutare l’apprendimento nell’e-learning, Erickson.
- Watson, K., Wawro, M., Zandieh, M & Kerrigan, S. (2017), Knowledge about student understanding of eigentheory: Information gained from multiple choice extended assessment, Proceedings of the 20th Annual Conference on Research in Undergraduate Mathematics Education, pp. 311-325.