Article Sidebar

Submitted
Nov 29, 2019
Accepted
Feb 13, 2020
Published
May 7, 2020
Download
PDF
Statistic
Read Counter : 2370 Download : 1329

Main Article Content

Abstract

Based on current trends in graduation rates, 39% of todays young adults on average across OECD countries are expected to complete tertiary-type A (university level) education during their lifetime. In 2017, an average of 10.6% of young people in the EU-28 were early leavers from education and training. Therefore the level of dropout in the scenery of European education is one of the major issue to be faced in a near future. The main aim of the research is to predict, as early as possible, which student will dropout in the Higher Education context. The accurate knowledge of this information would allow one to effectively carry out targeted actions in order to limit the incidence of the phenomenon. The recent breakthrough on Neural Networks with the use of Convolutional Neural Networks architectures has become disruptive in AI. By stacking together tens or hundreds of convolutional neural layers, a “deep” network structure is obtained, which has been proved very effective in producing high accuracy models. In this research the administrative data of about 6000 students enrolled from 2009 in the Department of Education at Roma Tre University had been used to train a Convolutional Neural Network based. Then, the trained network provides a predictive model that predicts whether the student will dropout. Furthermore, we compared the results obtained using deep learning models to the ones using Bayesian networks. The accuracy of the obtained deep learning models ranged from 67.1% for the first-year students up to 94.3% for the third-year students.

Keywords

University Dropout Deep Learning Convolutional Neural Network Educational Data Mining Bayesian Network

Article Details

Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.

The author declares that the submitted to Journal of e-Learning and Knowledge Society (Je-LKS) is original and that is has neither been published previously nor is currently being considered for publication elsewhere.
The author agrees that SIe-L (Italian Society of e-Learning) has the right to publish the material sent for inclusion in the journal Je-LKS.
The author agree that articles may be published in digital format (on the Internet or on any digital support and media) and in printed format, including future re-editions, in any language and in any license including proprietary licenses, creative commons license or open access license. SIe-L may also use parts of the work to advertise and promote the publication.
The author declares s/he has all the necessary rights to authorize the editor and SIe-L to publish the work.
The author assures that the publication of the work in no way infringes the rights of third parties, nor violates any penal norms and absolves SIe-L from all damages and costs which may result from publication.

The author declares further s/he has received written permission without limits of time, territory, or language from the rights holders for the free use of all images and parts of works still covered by copyright, without any cost or expenses to SIe-L.

For all the information please check the Ethical Code of Je-LKS, available at http://www.je-lks.org/index.php/ethical-code

How to Cite
Agrusti, F., Mezzini, M., & Bonavolontà, G. (2020). Deep learning approach for predicting university dropout: a case study at Roma Tre University . Journal of E-Learning and Knowledge Society, 16(1), 44-54. https://doi.org/10.20368/1971-8829/1135192

References

  1. Agrusti, F., Bonavolontà, G., & Mezzini, M. (2019). University Dropout Prediction through Educational Data Mining Techniques: A Systematic Review. Journal of E-Learning and Knowledge Society, 15(3), 161-182. https://doi.org/10.20368/1971-8829/1135017
  2. Alban, M., Mauricio, D., Mauricio, D., and National University of San Marcos, Artificial Intelligence Group, Per; (2019). Predicting University Dropout trough Data Mining: A systematic Literature. Indian Journal of Science and Technology, 12(4):1–12.
  3. Altman, N. S. (1992). An introduction to kernel and nearest-neighbor nonparametric regression. The American Statistician, 46(3):175–185.
  4. ANVUR (2018). Rapporto Biennale 2018 ANVUR Agenzia Nazionale di Valutazione del Sistema Universitario e della Ricerca.
  5. Araque, F., Roldan, C., and Salguero, A. (2009). Factors influencing university drop out rates. Computers & Education, 53(3):563–574.
  6. Bala, M. and Ojha, D. (2012). Study of applications of data mining techniques in education. International Journal of Research in Science and Technology, 1(4):1– 10.
  7. Bandura, A. (1997). Self-efficacy: The exercise of control. Macmillan.
  8. Bandura, A., Barbaranelli, C., Caprara, G. V., and Pastorelli, C. (2001). Self-efficacy beliefs as shapers of children’s aspirations and career trajectories. Child development, 72(1):187–206.
  9. Bean, J. P. (1988). Leaving college: Rethinking the causes and cures of student attrition. Taylor & Francis.
  10. Bengio, Y. and LeCun, Y., editors (2015). 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7-9, 2015, Conference Track Proceedings.
  11. Bentler, P. M. and Speckart, G. (1979). Models of attitudebehavior relations. Psychological review, 86(5):452.
  12. Bernardo Gutirrez, A. B., Esteban Garca, M., Gonzlez Garca, J. A., Nez Prez, J. C., and Dobarro Gonzlez, A. (2017). University dropout: Definition, features and prevention measures. Factors affecting academic performance.
  13. Braxton, J. M., Shaw Sullivan, A. V., and Johnson, R. M. (1997). Appraising tinto’s theory of college student departure. Higher Education - New York-Agathon Press Incorporated, 12:107–164.
  14. Breiman, L. (2001). Statistical modeling: The two cultures (with comments and a rejoinder by the author). Statistical science, 16(3):199–231.
  15. Bridgeman, B., McCamley-Jenkins, L., and Ervin, N. (2000). Predictions of freshman grade-point average from the revised and recentered sat R i: Reasoning test. ETS Research Report Series, 2000(1):i–16.
  16. Burgalassi, M., Biasi, V., Capobianco, R., and Moretti, G. (2016). Il fenomeno dell’abbandono universitario precoce. Uno studio di caso sui corsi di laurea del Dipartimento di Scienze della Formazione dell’Università Roma Tre. Giornale Italiano di Ricerca Didattica/Italian Journal of Educational Research, 17:131–152.
  17. Cabrera, A. F., Castaneda, M. B., Nora, A., and Hengstler, D. (1992). The convergence between two theories of college persistence. The journal of higher education, 63(2):143–164.
  18. Camara, W. J. and Echternacht, G. (2000). The sat [r] i and high school grades: Utility in predicting success in college. research notes.
  19. Carbone, V. and Piras, G. (1998). Palomar project: predicting school renouncing dropouts, using the artificial neural networks as a support for educational policy decisions. Substance use & misuse, 33(3):717–750.
  20. Chow, C. K. and Liu, C. N. (1968). Approximating Discrete Probability Distributions With Dependence Trees. IEEE Transactions on Information Theory, IT-14:462–467.
  21. Covington, M. V. (2000). Goal theory, motivation, and school achievement: An integrative review. Annual review of psychology, 51(1):171–200.
  22. Cox, B. E. and Orehovec, E. (2007). Faculty-student interaction outside the classroom: A typology from a residential college. The review of higher education, 30(4):343–362.
  23. Cukusic, M., Garaca, Z., and Jadric, M. (2014). Online self-assessment and students’ success in higher education institutions. Computers & Education, 72:100–109.
  24. DesJardins, S. L., Ahlburg, D. A., and McCall, B. P. (1999). An event history model of student departure. Economics of education review, 18(3):375–390.
  25. Duque, L. C., Duque, J. C., and Suriach, J. (2013). Learning outcomes and dropout intentions: an analytical model for Spanish universities. Educational studies, 39(3):261–284.
  26. Friedman, N., Geiger, D., and Goldszmidt, M. (1997). Bayesian network classifiers. Machine Learning, 29(2):131–163.
  27. Georg, W. (2009). Individual and institutional factors in the tendency to drop out of higher education: a multilevel analysis using data from the Konstanz Student Survey. Studies in Higher Education, 34(6):647–661.
  28. Ghignoni, E. (2017). Family background and university dropouts during the crisis: the case of italy. Higher Education, 73(1):127–151.
  29. Gifford, D. D., BricenoPerriott, J., and Mianzo, F. (2006). Locus of control: Academic achievement and retention in a sample of university first-year students. Journal of College Admission, 191:18–25.
  30. Gutierrez, A. B. B., Menendez, R. C., Rodrıguez-Muniz, L. J., Perez, J. C. N., Herrero, E. T., and Garcıa, M. E. (2015). Prediccion del abandono universitario: variables explicativas y medidas de prevencion. Revista Fuentes, (16):63–84.
  31. He, K., Zhang, X., Ren, S., and Sun, J. (2016). Deep residual learning for image recognition. In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 770–778.
  32. Hu, J., Shen, L., and Sun, G. (2018). Squeeze-and-excitation networks. 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 7132–7141.
  33. Hu, S. and Kuh, G. D. (2002). Being (dis) engaged in educationally purposeful activities: The influences of student and institutional characteristics. Research in Higher Education, 43(5):555–575.
  34. Ishitani, T. T. (2006). Studying attrition and degree completion behavior among first-generation college students in the united states. The Journal of Higher Education, 77(5):861–885.
  35. Koedinger, K. R., D’Mello, S., McLaughlin, E. A., Pardos, Z. A., and Rose, C. P. (2015). Data mining and education. Wiley Interdisciplinary Reviews: Cognitive Science, 6(4):333–353.
  36. Krause, K. L. (2005). Serious thoughts about dropping out in first year : trends, patterns and implications for higher education. Studies in Learning, Evaluation, Innovation and Development, 2(3):55–68.
  37. Krizhevsky, A., Sutskever, I., and Hinton, G. E. (2012). Imagenet classification with deep convolutional neural networks. In Pereira, F., Burges, C. J. C., Bottou, L., and Weinberger, K. Q., editors, Advances in Neural Information Processing Systems 25, pages 1097–1105. Curran Associates, Inc.
  38. Kuncel, N. R. and Hezlett, S. A. (2007). Standardized tests predict graduate students’ success. Science, 315(5815):1080–1081.
  39. Kuncel, N. R., Crede, M., and Thomas, L. L. (2007). A meta-analysis of the predictive validity of the graduate management admission test (gmat) and undergraduate grade point average (ugpa) for graduate student academic performance. Academy of Management Learning & Education, 6(1):51–68.
  40. Kuncel, N. R., Hezlett, S. A., and Ones, D. S. (2004). Academic performance, career potential, creativity, and job performance: Can one construct predict them all? Journal of personality and social psychology, 86(1):148.
  41. Larsen, M. R., Sommersel, H. B., and Larsen, M. S. (2013). Evidence on dropout phenomena at universities. Danish Clearinghouse for educational research Copenhagen.
  42. LeCun, Y., Bengio, Y., and Hinton, G. E. (2015). Deep learning. Nature, 521(7553):436–444.
  43. Lohfink, M. M. and Paulsen, M. B. (2005). Comparing the determinants of persistence for first-generation and continuing-generation students. Journal of College Student Development, 46(4):409–428.
  44. Maas, A. L., Hannun, A. Y., and Ng, A. Y. (2013). Rectifier nonlinearities improve neural network acoustic models. In in ICML Workshop on Deep Learning for Audio, Speech and Language Processing.
  45. Malvestuto, F. M., Mezzini, M., and Moscarini, M. (2011). Computing simple-path convex hulls in hypergraphs. Inf. Process. Lett., 111(5):231–234.
  46. Marshall, M. A. and Brown, J. D. (2004). Expectations and realizations: The role of expectancies in achievement settings. Motivation and Emotion, 28(4):347– 361.
  47. Martinho, V. R. D. C., Nunes, C., and Minussi, C. R. (2013). An intelligent system for prediction of school dropout risk group in higher education classroom based on artificial neural networks. In 2013 IEEE 25th International Conference on Tools with Artificial Intelligence, pages 159–166. IEEE.
  48. Mezzini, M. (2007). Finding a nonempty algebraic subset of an edge set in linear time. J. Graph Algorithms Appl., 11(1):239– 257.
  49. Mezzini, M. (2010). On the complexity of finding chordless paths in bipartite graphs and some interval operators in graphs and hypergraphs. Theor. Comput. Sci., 411(79):1212–1220.
  50. Mezzini, M. (2011). Fast minimal triangulation algorithm using minimum degree criterion. Theor. Comput. Sci., 412(29):3775– 3787.
  51. Mezzini, M. (2012). Fully dynamic algorithm for chordal graphs with O(1) querytime and o(n2) update-time. Theor. Comput. Sci., 445:82–92.
  52. Mezzini, M. (2016). On the geodetic iteration number of the contour of a graph. Discrete Applied Mathematics, 206:211–214.
  53. Mezzini, M. (2018). Polynomial time algorithm for computing a minimum geodetic set in outerplanar graphs. Theor. Comput. Sci., 745:63–74.
  54. Mezzini, M. and Moscarini, M. (2010). Simple algorithms for minimal triangulation of a graph and backward selection of a decomposable markov network. Theor. Comput. Sci., 411(7-9):958–966.
  55. Mezzini, M. and Moscarini, M. (2015). On the geodeticity of the contour of a graph. Discrete Applied Mathematics, 181:209–220.
  56. Mezzini, M. and Moscarini, M. (2016). The contour of a bridged graph is geodetic. Discrete Applied Mathematics, 204:213–215.
  57. Mezzini, M., Bonavolontà, G., Agrusti F. (2019) Predicting University Dropout by using Convolutional Neural Networks, INTED2019 Proceedings, pp. 9155-9163.
  58. Mitchell, T. M. (1997). Machine learning. McGraw hill.
  59. Moretti, G., Burgalassi, M., and Giuliani, A. (2017). Enhance Students’ Engagement To Counter Dropping-Out: A Research At Roma Tre University. pages 305–313, Valencia, Spain.
  60. Mustafa, M. N., Chowdhury, L., and Kamal, M. S. (2012). Students dropout prediction for intelligent system from tertiary level in developing country. In 2012 International Conference on Informatics, Electronics & Vision (ICIEV), pages 113–118. IEEE.
  61. Nagy, M. and Molontay, R. (2018). Predicting dropout in higher education based on secondary school performance. In 2018 IEEE 22nd International Conference on Intelligent Engineering Systems (INES), pages 000389–000394. IEEE.
  62. Pascarella, E. T. and Terenzini, P. T. (1980). Predicting freshman persistence and voluntary dropout decisions from a theoretical model. The journal of higher education, 51(1):60–75.
  63. Pascarella, E. T. and Terenzini, P. T. (2005). How College Affects Students: A Third Decade of Research. Volume 2. ERIC.
  64. Pearl, J. (1988). Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA.
  65. Pereira, R. T., Romero, A. C., and Toledo, J. J. (2013). Extraction student dropout patterns with data mining techniques in undergraduate programs. In KDIR/KMIS, pages 136–142.
  66. Perfetto, G. (2002). Predicting academic success in the admissions process: Placing an empirical approach in a larger process. College Board Review, 196:30–35.
  67. Pintrich, P. R. (2000). The role of goal orientation in self-regulated learning. In Handbook of self-regulation, pages 451–502. Elsevier.
  68. Qian, N. (1999). On the momentum term in gradient descent learning algorithms. Neural Networks, 12(1):145 – 151.
  69. Quinlan, J. R. (2014). C4. 5: programs for machine learning. Elsevier.
  70. Rosenbaum, J. (2004). Its time to tell the kids: If you dont do well in high school, you wont do well in college (or on the job). American Educator, 28:8–42.
  71. Rovira, S., Puertas, E., and Igual, L. (2017). Data-driven system to predict academic grades and dropout. PLoS one, 12(2):e0171207.
  72. Santelices, M. V., Cataln, X., Kruger, D., and Horn, C. (2016). Determinants of persistence and the role of financial aid: lessons from Chile. Higher Education, 71(3):323– 342.
  73. Scutari, M. (2010). Learning Bayesian Networks with the bnlearn R Package. Journal of Statistical Software, 35(3):1–22.
  74. Siri, A. (2015). Predicting students’ dropout at university using artificial neural networks. Italian Journal of Sociology of Education, 7(2).
  75. Sivakumar, S., Venkataraman, S., and Selvaraj, R. (2016). Predictive modeling of student dropout indicators in educational data mining using improved decision tree. Indian Journal of Science and Technology, 9(4):1–5.
  76. Spirtes, P., Glymour, C., and Scheines, R. (2000). Causation, Prediction, and Search. MIT press, 2nd edition.
  77. Szegedy, C., Ioffe, S., Vanhoucke, V., and Alemi, A. A. (2017). Inceptionv4, inception-resnet and the impact of residual connections on learning. In Singh, S. P. and Markovitch, S., editors, Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence, February 4-9, 2017, San Francisco, California, USA., pages 4278–4284. AAAI Press.
  78. Tan, P.-N., Steinbach, M., Kumar, V. (2005). Introduction to Data Mining. Addison Wesley. ISBN: 0321321367.
  79. Tanucci, G. (2006). Orientamento e carriera universitaria. In Fasanella A. e Tanucci G., a cura di, Orientamento e carriera universitaria. Ingressi ed abbandoni in cinque Facoltà dell’Università di Roma La Sapienza nel nuovo assetto didattico. Milano: FrancoAngeli.
  80. Ting, S.-M. R. and Robinson, T. L. (1998). First-year academic success: A prediction combining cognitive and psychosocial variables for caucasian and african american students. Journal of college student development.
  81. Tinto, V. (1975). Dropout from higher education: A theoretical synthesis of recent research. Review of educational research, 45(1):89–125.
  82. Tinto, V. (2010). From theory to action: Exploring the institutional conditions for student retention. In Higher education: Handbook of theory and research, pages 51–89. Springer.
  83. Weiner, B. (1985). An attributional theory of achievement motivation and emotion. Psychological review, 92(4):548.
  84. Willcoxson, L. (2010). Factors affecting intention to leave in the first, second and third year of university studies: A semesterby-semester investigation. Higher Education Research & Development, 29(6):623–639.