Main Article Content
Abstract
This article demonstrates the validity and reliability of an instrument to evaluate the level of digital competence of Higher Education (HE) teachers in the use of digital resources in research work. The initial instrument was made up of a total of 22 items classified into four dimensions: (DIM. 1. Digital skills to search for information, manage it, analyze it and communicate results; DIM. 2. Digital ethics in digital research; DIM. 3. Digital flow in research work; DIM. 4. Anxiety towards the use of ICT resources for research). The instrument was applied to a final sample of 1709 teachers from different higher education institutions in Spain, from an initial sample of 1740. Reliability was measured using Cronbach’s Alpha and composite reliability. To check the validity of the instrument, the validity of understanding and exploration of dimensionality was analyzed using Exploratory Factor Analysis (EFA), and the instrument was adjusted for the different models using Confirmatory Factor Analysis (CFA). IBM SPSS V.24 software was used for the AFE and AMOS V.24 software was used for the AFC. The result of the reliability analyzes were adequate and, in relation to construct validity, the results found a good fit of the model, both in internal validity and factorial invariance. The final version of the instrument consists of 12 items.
Keywords
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
The author declares that the submitted to Journal of e-Learning and Knowledge Society (Je-LKS) is original and that is has neither been published previously nor is currently being considered for publication elsewhere.
The author agrees that SIe-L (Italian Society of e-Learning) has the right to publish the material sent for inclusion in the journal Je-LKS.
The author agree that articles may be published in digital format (on the Internet or on any digital support and media) and in printed format, including future re-editions, in any language and in any license including proprietary licenses, creative commons license or open access license. SIe-L may also use parts of the work to advertise and promote the publication.
The author declares s/he has all the necessary rights to authorize the editor and SIe-L to publish the work.
The author assures that the publication of the work in no way infringes the rights of third parties, nor violates any penal norms and absolves SIe-L from all damages and costs which may result from publication.
The author declares further s/he has received written permission without limits of time, territory, or language from the rights holders for the free use of all images and parts of works still covered by copyright, without any cost or expenses to SIe-L.
For all the information please check the Ethical Code of Je-LKS, available at http://www.je-lks.org/index.php/ethical-code
References
- Adtani, R., Arora, R., Raut, R., & Neelam, N. (2023). ICT in higher education: learning as usual or a “new normal”?. Higher Education, Skills and Work-Based Learning, 13(4), 846-860.
- Agustí López, A. I., Martí Aras, A., Rodríguez Martín, A., & Gabarda Méndez, C. (2023). Personality, Burnout and Digital Competence in university professor, An approach to the current reality. Innoeduca. International Journal of Technology and Educational Innovation, 9(2), 162–176. https://doi.org/10.24310/innoeduca.2023.v9i2.15063
- Asencio, E. N., García, E. J., Redondo, S. R., & Thoilliez, B. (2017). Fundamentos de la investigación y la innovación educativa. Unir Editorial.
- Atiqah, S. N., Hanafiah, M. H., Ismail , H., & Kandappan, B. (2024). Preparing instructors to transition to online distance learning: a pandemic panacea?. Innoeduca. International Journal of Technology and Educational Innovation, 10(1), 5–28. https://doi.org/10.24310/ijtei.101.2024.16820
- Bala, J. (2016). Contribution of SPSS in Social Sciences Research. International Journal of Advanced Research in Computer Science, 7(6), 250-254.
- Bandalos, D. L., & Finney, S. J. (2018). Factor analysis: Exploratory and confirmatory. In The reviewer’s guide to quantitative methods in the social sciences (pp. 98-122). Routledge.
- Birdsall, C., & Tkaczyk, V. (2019). Listening to the archive: sound data in the humanities and sciences. Technology and Culture, 60(2), S1-S13.
- Bretag, T., & Mahmud, S. (2009). Self-plagiarism or appropriate textual re-use?. Journal of Academic Ethics, 7, 193-205.
- Butros, A., & Taylor, S. (2010, October). Managing information: evaluating and selecting citation management software, a look at EndNote, RefWorks, Mendeley and Zotero. In Netting knowledge: two hemispheres/one world: proceedings of the 36th IAMSLIC Annual Conference (pp. 17-21). USA: IAMSLIC.
- Byrne, B.M. (2013). Structural equation modeling with AMOS: Basic concepts, 15 applications, and programming. Routledge.
- Chapman, K., & Ellinger, A. E. (2019). An evaluation of Web of Science, Scopus and Google Scholar citations in operations management. The International Journal of Logistics Management, 30(4), 1039-1053.
- Cheung, G. W., & Wang, C. (2017). Current approaches for assessing convergent and discriminant validity with SEM: issues and solutions. Academy of Management Proceedings, 2017(1), 12706. https://doi.org/10.5465/AMBPP.2017.12706abstract
- Clark, T. (2010). On ‘being researched’: Why do people engage with qualitative research?. Qualitative Research, 10(4), 399-419.
- Degn, L. (2023). Digitalization as a Strategic Goal—The Missed Potential of Profiling Danish Universities in the Digitalization Era? Digital Transformations in Nordic Higher Education, 197–215. https://doi.org/10.1007/978-3-031-27758-0_9
- Demeshkant, N., Potyrala, K., & Tomczyk, L. (2020). Levels of academic teachers digital competence: Polish case-study. In 2020). Proceedings of the 28th International Conference on Computers in Education (pp. 591-601).
- Dzib Goodin, A., Castevich, J., Hogan, D. L., Sanders, L., Slovec, K., & Yelizarov, D. (2015). Staff Development learning environment for tutoring and research in higher education levels. Innoeduca. International Journal of Technology and Educational Innovation, 1(1), 10–16. https://doi.org/10.20548/innoeduca.2015.v1i1.27
- Cataudella, S., Carta, S. M., Mascia, M. L., Masala, C., Petretto, D. R., Agus, M., & Penna, M. P. (2021). Teaching in times of the COVID-19 pandemic: A pilot study on teachers’ self-esteem and self-efficacy in an italian sample. International Journal of Environmental Research and Public Health, 18(15), 8211. https://doi.org/10.3390/ijerph18158211
- Egghe, L. (2010). The Hirsch index and related impact measures. Annual review of information science and technology, 44(1), 65-114.
- Fornell, C., & Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of marketing research, 18(1), 39-50. https://doi.org/10.1177/002224378101800104
- Granić, A., & Marangunić, N. (2019). Technology acceptance model in educational context: A systematic literature review. British Journal of Educational Technology, 50(5), 2572-2593. https://doi.org/10.1111/bjet.12864
- Guillén-Gámez, F. D., & Mayorga-Fernández, M. J. (2021). Design and validation of an instrument of self-perception regarding the lecturers’ use of ICT resources: to teach, evaluate and research. Education and Information Technologies, 26(2), 1627-1646. https://doi.org/10.1007/s10639-020-10321-1
- Guillén-Gámez, F. D., Ruiz-Palmero, J., & García, M. G. (2023). Digital competence of teachers in the use of ICT for research work: development of an instrument from a PLS-SEM approach. Education and Information Technologies, 1-21. https://doi.org/10.1007/s10639-023-11895-2
- Guillén-Gámez, F. D., Gómez-García, M., & Ruiz-Palmero, J. (2024). Competencia digital en labores de Investigación: predictores que influyen en función del tipo de universidad y sexo del profesorado. Pixel-Bit, revista de medios y educación, 69, 7-34. https://doi.org/10.12795/pixelbit.99992
- Jiménez Sabino, M. J., & Cabero Almenara, J. (2021). The technological, pedagogical and content knowledge of Andalusian university professors on ICT. Analysis from the TPACK model. Innoeduca. International Journal of Technology and Educational Innovation, 7(1), 4–18. https://doi.org/10.24310/innoeduca.2021.v7i1.11940
- Hair, J., Black, W., Babin, B., & Anderson, R. (2010). Multivariate data analysis. Prentice-Hall: USA.
- Harari, M. B., Parola, H. R., Hartwell, C. J., & Riegelman, A. (2020). Literature searches in systematic reviews and meta-analyses: A review, evaluation, and recommendations. Journal of Vocational Behavior, 118, 103377.
- Henseler, J., Ringle, C. M., & Sarstedt, M. (2015). A new criterion for assessing discriminant validity in variance-based structural equation modeling. Journal of the academy of marketing science, 43(1), 115-135. https://doi.org/10.1007/s11747-014-0403-8
- Hinkin, T. R., Tracey, J. B., & Enz, C. A. (1997). Scale construction: Developing reliable and valid measurement instruments. Journal of Hospitality & Tourism Research, 21(1), 100-120. https://doi.org/10.1177%2F109634809702100108
- Hu, L., & Bentler, P.M. (1999). Cutoff criteria for fit indexes in covariance structure 17 analysis: Conventional criteria versus new alternatives. Structural Equation 18 Modeling: A Multidisciplinary Journal, 6(1), 1-55. https://doi.org/10.1080/10705519909540118
- Imfeld, C. (2003). Playing Fair with Fair Use? The Digital Millennium Copyright Act's Impact on Encryption Researchers and Academicians. Communication law and Policy, 8(1), 111-144.
- Kavoura, A. (2014). Social media, online imagined communities and communication research. Library review, 63(6/7), 490-504.
- Kline, R. B. (2023). Principles and practice of structural equation modeling. Guilford publications.
- Königs, P. (2022). What is techno-optimism?. Philosophy & Technology, 35(3), 62-67.
- Lawrence, S., Pennock, D. M., Flake, G. W., Krovetz, R., Coetzee, F. M., Glover, E., ... & Giles, C. L. (2001). Persistence of web references in scientific research. Computer, 34(2), 26-31.
- Lipson, C. (2011). Cite right: a quick guide to citation styles--MLA, APA, Chicago, the sciences, professions, and more. Chicago: University of Chicago Press.
- Lloret-Segura, S., Ferreres-Traver, A., Hernández-Baeza, A., & Tomás-Marco, I. (2014). El análisis factorial exploratorio de los ítems: una guía práctica, revisada y actualizada. Anales de psicología/annals of psychology, 30(3), 1151-1169. https://doi.org/10.6018/analesps.30.3.199361
- Mabić, M., & Garbin Praničević, D. (2021). Digital Maturity of Higher Education Institutions in Bosnia and Herzegovina: Teachers’ Assessment. ENTRENOVA - ENTerprise REsearch InNOVAtion, 7(1), 160–169. https://doi.org/10.54820/rakw8731
- Maican, C. I., Cazan, A. M., Lixandroiu, R. C., & Dovleac, L. (2019). A study on academic staff personality and technology acceptance: The case of communication and collaboration applications. Computers & Education, 128, 113-131. https://doi.org/10.1016/j.compedu.2018.09.010
- Mallery, P. (1999). SPSS for Windows step by step: A simple guide and reference. Wind. Step by step a simple guid. Ref. Needham Height. MA Allyn Bacon.
- Mason, S., & Singh, L. (2022). When a journal is both at the ‘top’and the ‘bottom’: the illogicality of conflating citation-based metrics with quality. Scientometrics, 127(6), 3683-3694.
- Medeshova, A., Özerbaş, M., Akimova, S., & Kurmasheva, D. (2023). Innovative pedagogical strategies for effective digitalization of education in the universities. Pedagogy and Psychology, 57(4), 25-34. https://doi.org/10.51889/2960-1649.2023.15.4.011
- Meroño, L., Calderón Luquin, A., Arias Estero, J. L., & Méndez Giménez, A. (2018). Diseño y validación del cuestionario de percepción del profesorado de Educación Primaria sobre el aprendizaje del alumnado basado en competencias (# ICOMpri2). Revista Complutense de Educación, 29 (1), 215-235. http://dx.doi.org/10.5209/RCED.52200
- Michel, C., & Pierrot, L. (2023). Modelling Teachers’ Digital Maturity: Literature Review and Proposal for a Unified Model. In 15th International Conference on Computer Supported Education (Vol. 2, pp. 535-542). SCITEPRESS-Science and Technology Publications.
- Moreira-Fontán, E., García-Señorán, M., Conde-Rodríguez, Á., & González, A. (2019). Teachers' ICT-related self-efficacy, job resources, and positive emotions: Their structural relations with autonomous motivation and work engagement. Computers & Education, 134, 63-77. https://doi.org/10.1016/j.compedu.2019.02.007
- Nunally, J. C. (1978). Psychometric Theory (2º ed.). McGraw-Hill.
- Pajić, D. (2015). On the stability of citation-based journal rankings. Journal of Informetrics, 9(4), 990-1006.
- Pérez, E. R., & Medrano, L. A. (2010). Análisis factorial exploratorio: bases conceptuales y metodológicas. Revista Argentina de Ciencias del Comportamiento (RACC), 2(1), 58-66.
- Ping, L., & Cunningham, D. (2013). Application of structural equation modeling in educational research and practice (Vol. 7). M. S. Khine (Ed.). Rotterdam: SensePublishers.
- Popescu, M.-F., Chiripuci, B.-C., Orîndaru, A., Constantin, M., & Scrieciu, A. (2020). Fostering Sustainable Development through Shifting Toward Rural Areas and Digitalization - The Case of Romanian Universities. Sustainability, 12(10), 4020. https://doi.org/10.3390/su12104020
- Raykov, T., & Marcoulides, G. A. (2008). An introduction to applied multivariate analysis. New York: Routledge.
- Ribeiro, B., Meckin, R., Balmer, A., & Shapira, P. (2023). The digitalisation paradox of everyday scientific labour: How mundane knowledge work is amplified and diversified in the biosciences. Research Policy, 52(1), 104607. https://doi.org/10.1016/j.respol.2022.104607
- Rosak-Szyrocka, J. (2024). The Era of Digitalization in Education where do Universities 4.0 Go? Management Systems in Production Engineering, 32(1), 54-66. https://doi.org/10.2478/mspe-2024-0006
- Saidy, C., & Sura, T. (2020). When everything changes over night: what we learned from teaching the writing practicum in the era of Covid-19. Teaching/Writing: The Journal of Writing Teacher Education, 9(1), 21, 1-6.
- Sarfraz, Z., Sarfraz, A., Anwer, A., Nadeem, Z., Bano, S., & Tareen, S. (2020). Predatory journals: A literature review. Pakistan Journal of Surgery and Medicine, 1(1), 42-51.
- Scheerder, A., Van Deursen, A., & Van Dijk, J. (2017). Determinants of Internet skills, uses and outcomes. A systematic review of the second-and third-level digital divide. Telematics and informatics, 34(8), 1607-1624.
- Schröter, T., & Grafe, S. (2020). Digital Literacy and Digital Competency of University Teachers. A Systematic Analysis of Frameworks. In Innovate Learning Summit (pp. 144-157). Association for the Advancement of Computing in Education (AACE).
- Severin, A., & Low, N. (2019). Readers beware! Predatory journals are infiltrating citation databases. International Journal of Public Health, 64, 1123-1124.
- Souza, A. C. D., Alexandre, N. M. C., & Guirardello, E. D. B. (2017). Psychometric properties in instruments evaluation of reliability and validity. Epidemiologia e servicos de saude, 26, 649-659.
- Stosic, L. (2017). Does the use of ICT enable easier, faster and better acquiring of knowledge. International Journal of Innovative Research in Education, 4(4), 179-185.
- Suyo-Vega, J. A., Meneses-La-Riva, M. E., Fernández-Bedoya, V. H., Ocupa-Cabrera, H. G., Alvarado-Suyo, S. A., da Costa Polonia, A., ... & Gago-Chávez, J. D. J. S. (2022). University teachers’ self-perception of digital research competencies. A qualitative study conducted in Peru. Frontiers in Education (Vol. 7, p. 1004967)
- Tomczyk, Ł., & Fedeli, L. (2022). Digital Literacy for Teachers. Lecture Notes in Educational Technology. Springer Nature Singapore. https://doi.org/10.1007/978-981-19-1738-7
- Tomczyk, Ł., Fedeli, L., Włoch, A., Limone, P., Frania, M., Guarini, P., Szyszka, M., Mascia, M. L., & Falkowska, J. (2022). Digital Competences of Pre-service Teachers in Italy and Poland. Technology, Knowledge and Learning, 28(2), 651–681. https://doi.org/10.1007/s10758-022-09626-6
- Tomczyk, Ł., Jáuregui, V. C., de La Higuera Amato, C. A., Muñoz, D., Arteaga, M., Oyelere, S. S., ... & Porta, M. (2021). Are teachers techno-optimists or techno-pessimists? A pilot comparative among teachers in Bolivia, Brazil, the Dominican Republic, Ecuador, Finland, Poland, Turkey, and Uruguay. Education and Information Technologies, 26(3), 2715-2741.
- Tomczyk, L., Potyrala, K., Demeshkant, N., & Czerwiec, K. (2021). University teachers and crisis e-learning : Results of a Polish pilot study on: attitudes towards e-learning, experiences with e-learning and anticipation of using e-learning solutions after the pandemic. 2021 16th Iberian Conference on Information Systems and Technologies (CISTI). https://doi.org/10.23919/cisti52073.2021.9476521
- Van Laar, E., Van Deursen, A. J., Van Dijk, J. A., & De Haan, J. (2017). The relation between 21st-century skills and digital skills: A systematic literature review. Computers in human behavior, 72, 577-588.
- Weninger, C. (2022). Skill versus social practice? Some challenges in teaching digital literacy in the university classroom. Tesol Quarterly, 56(3), 1016-1028.
- Woods, M., Paulus, T., Atkins, D. P., & Macklin, R. (2016). Advancing qualitative research using qualitative data analysis software (QDAS)? Reviewing potential versus practice in published studies using ATLAS. ti and NVivo, 1994-