Article Sidebar

Submitted
Aug 18, 2024
Accepted
Oct 13, 2024
Published
Oct 30, 2024
Download
PDF
Statistic
Read Counter : 57 Download : 42

Main Article Content

Abstract

The fast evolution of technology makes digital competencies mandatories in all professional contexts. The authors conducted a study aiming to systematize the design and validation of an instrument to measure digital skills for research. The methodology included a literature review to identify the theoretical bases and the dimensions or components of digital skills and the design of the questionnaire. Secondly, its validity was tested through the Content Validity Index (CVI) with the judgment of six experts and the Exploratory Factor Analysis (EFA) after a pilot study with a sample of 96 researchers. Finally, Cronbach’s alpha coefficient test was performed to assess reliability. The results yielded the Kaiser-Meyer-Olkin (KMO) determined sampling adequacy (KMO= .830) and a significant Bartlett's sphericity test (p= .000). The anti-image matrix showed high values except for the first item that did not reach the critical threshold in the communality’s values; so, it was removed. The validity test showed a high content validity coefficient (IVC= .98). Regarding the EFA, the six-factor analysis revealed that nine out of the 14 items showed factor loading > 0.7. The reliability test also showed positive results (ɑ=.874). In conclusion, the results obtained in the present study validate the questionnaire as an accurate and reliable tool for assessing the digital competencies of researchers. This may be a useful tool in the initial phases of policy planning for strengthening scientific production and closing digital competencies gaps in universities.

Keywords

Digital Skills Researchers Content Validity Factorial Analysis

Article Details

Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.

The author declares that the submitted to Journal of e-Learning and Knowledge Society (Je-LKS) is original and that is has neither been published previously nor is currently being considered for publication elsewhere.
The author agrees that SIe-L (Italian Society of e-Learning) has the right to publish the material sent for inclusion in the journal Je-LKS.
The author agree that articles may be published in digital format (on the Internet or on any digital support and media) and in printed format, including future re-editions, in any language and in any license including proprietary licenses, creative commons license or open access license. SIe-L may also use parts of the work to advertise and promote the publication.
The author declares s/he has all the necessary rights to authorize the editor and SIe-L to publish the work.
The author assures that the publication of the work in no way infringes the rights of third parties, nor violates any penal norms and absolves SIe-L from all damages and costs which may result from publication.

The author declares further s/he has received written permission without limits of time, territory, or language from the rights holders for the free use of all images and parts of works still covered by copyright, without any cost or expenses to SIe-L.

For all the information please check the Ethical Code of Je-LKS, available at http://www.je-lks.org/index.php/ethical-code

Author Biographies

Bexi Perdomo, University of Sciences and Arts of Latin America (UCAL)

Dr. in Human Sciences, MSc. in Education, Lic in Education, and Lawyer. She is a researcher accredited in Peru and Venezuela. She is currently a research professor at the Universidad de Ciencias y Artes de América Latina (UCAL), Lima-Peru. She is a member of the editorial board and peer reviewer for scientific journals in several countries. She has been a lecturer and workshop facilitator at national and international scientific congresses. She has registered over 80 scientific publications including books, chapters, and articles in indexed journals. She has been lecturer in many international scientific meetings and has participated in inter-institutional scientific exchanges in Latin America, the Caribbean, and Europe. She has also received awards for her achievements as a teacher and researcher.

Oscar Alberto Morales, Universidad de Los Andes (ULA)

Bachelor's Degree in Education, Master's Degree in Education, Universidad de Los Andes; Master's degree in Linguistics and PhD in Multilingual Communication, Pompeu Fabra University. I also did a postdoctoral stay at Pompeu Fabra University, thanks to a grant from the Carolina Foundation, Spain. He has published more than 100 articles on science communication, academic reading and writing, teacher training, evaluation and discourse analysis at different educational levels in the following international journals. In addition, I have presented more than 50 papers and conferences at different national and international events, some of which have been published in the respective proceedings of these events. He has been invited to carry out research stays in the Department of Spanish Philology of the University of Granada, Spain, to give a series of conferences and workshops in some Argentine universities (University of Buenos Aires, University of Luján, University of Tandil, University of the Northeast of Corrientes) and in the Ceferino Namuncurá Foundation, Puerto Madryn, Patagonia Argentina; to do a PhD visiting scholar at the University of Michigan, USA, and a postdoctoral fellow at the Universitat Pompeu Fabra, Spain.

How to Cite
Perdomo, B., & Morales, O. A. (2024). Design and validation of a questionnaire to assess digital skills for research. Journal of E-Learning and Knowledge Society, 20(3), 83-89. https://doi.org/10.20368/1971-8829/1136008

References

  1. Alemán, S. A., Deroncele-Acosta, A., & Robles-Mori, H. (2023). Traducción, adaptación cultural y validación del cuestionario TPACK-21 en docentes en servicio [Translation, adaptation and validity of the TPACK-21 questionnaire in teachers]. Revista de Ciencias Sociales, 29(3), 453-469.
  2. Arroba-Freire, E., Bonilla-Jurado, D., Guevara, C., & Ramírez-Casco, A. (2022). Factor analysis: An application of the digital competencies questionnaire in students of the business administration career of the Instituto Tecnológico Superior España (ISTE). Journal of Higher Education Theory and Practice, 22(18), 201.
  3. Bandura, A. (1997). Self-Efficacy: The Exercise of Control. W. H. Freeman.
  4. Barajas, S., García, R., & Cuevas, O. (2023). Adaptación y validación de un instrumento basado en el modelo TPACK para docentes universitarios [Adaptation and validation of an instrument based on the TPACK model for university teachers]. IE Revista de Investigación Educativa de La REDIECH, 14, e1831. https://doi.org/10.33010/ie_rie_rediech.v14i0.1831
  5. Barbazan, D., Ben, Khaddouja., & Montes, C. (2021). La competencia digital docente en educación superior: estado del arte en España y Latinoamérica [Digital Competence for Teachers in Higher Education: State of the Art in Spain and Latin America]. Etic@net. Revista Científica Electrónica de Educación y Comunicación En La Sociedad Del Conocimiento, 21(2), 267-282. https://doi.org/10.30827/eticanet.v21i2.20837
  6. Centeno-Caamal, R. (2021). Formación tecnológica y competencias digitales docentes [Technological training and digital teaching skills]. Revista Tecnológica-Educativa Docentes 2.0, 11(1), 174-182. https://doi.org/10.37843/rted.v11i1.210
  7. Churampi-Cangalaya, R. L., Inga-Ávila, M. F., Coz, K. R. L., Churampi-Cangalaya, J. J., Huamán-Pérez, F., Caballero, E. M., & Quispe, M. A. (2024). The impact of digital skills on teaching performance in higher education: A meta-analysis. International Journal of Data and Network Science, 8(4), 2185-2192. https://doi.org/10.5267/j.ijdns.2024.6.01
  8. Claro, M., Castro-Grau, C., Ochoa, J., Hinostroza, J., & Cabello, P. (2024). Systematic review of quantitative research on digital competences of in-service school teachers. Computers and Education, 215, 105030. https://doi.org/10.1016/j.compedu.2024.105030
  9. Davis, F. (1989). Perceived usefulness, perceived ease of use, and user acceptance of information technology. Management Information Systems Research Center, University of Minnesota.
  10. Falloon, G. (2020). From digital literacy to digital competence: the teacher digital competency (TDC) framework. Educational Technology Research and Development, 68(5), 2449-2472. https://doi.org/10.1007/s11423-020-09767-4
  11. García-Ruiz, R., Buenestado-Fernández, M., & Ramírez-Montoya, M. S. (2023). Assessment of digital teaching competence: Instruments, results and proposals. Systematic literature review. Educacion XX1, 26(1), 273-301. https://doi.org/10.5944/educxx1.33520
  12. González-Rodríguez, C., & Urbina-Ramírez, S. (2020). Análisis de instrumentos para el diagnóstico de la competencia digital [Analysis of instruments for the diagnosis of digital competence]. Revista Interuniversitaria de Investigación En Tecnología Educativa, 9, 1-12. https://doi.org/10.6018/riite.411101
  13. Kuhlthau, C. (2004). Seeking Meaning. A Process Approach to Library and Information Services (2nd ed.). Bloomsbury Academic.
  14. Kuzminska, O., Mazorchuk, M., Morze, N., Prokopchuk, M., & Danylchuk, H. (2023). Integrating digital competencies of researchers into Ph.D. curricula: a case study on open science education. CEUR Workshop Proceedings, 195-208.
  15. Kuzminska, O., Morze, N., Varchenko-Trotsenko, L., Boiko, M., & Prokopchuk, M. (2021). Digital competence of future researchers: Empirical research of PhD students of ukrainian university. ACM International Conference Proceeding Series, 177-184. https://doi.org/10.1145/3526242.3526258
  16. Le, T., Galperin, H., & Traube, D. (2023). The impact of digital competence on telehealth utilization. Health Policy and Technology, 12(1), 100724. https://doi.org/10.1016/j.hlpt.2023.100724
  17. Martzoukou, K., Fulton, C., Kostagiolas, P., & Lavranos, C. (2020). A study of higher education students’ self-perceived digital competences for learning and everyday life online participation. Journal of Documentation, 76(6), 1413-1458. https://doi.org/10.1108/JD-03-2020-0041
  18. Massieu, A., Díaz, F., Sánchez, M., & Martínez, A. (2024). Evidencias de validez de un instrumento para evaluar la competencia digital docente en educación médica [Evidence of validity of an instrument to assess teaching digital competence in medical education]. Investigacion En Educacion Medica, 13(51), 82-92. https://doi.org/10.22201/fm.20075057e.2024.51.23584
  19. Mattar, J., Piovezan, M., Souza, S., Santos, C., & dos Santos, A. (2020). Apresentação crítica do Quadro Europeu de Competência Digital (DigComp) e modelos relacionados [Critical presentation of the European Digital Competence Framework (DigComp) and related models]. Research, Society and Development, 9(4), e172943062. https://doi.org/10.33448/rsd-v9i4.3062
  20. Ning, Y., Zhang, C., Xu, B., Zhou, Y., & Wijaya, T. (2024). Teachers’ AI-TPACK: Exploring the relationship between knowledge elements. Sustainability (Switzerland), 16(3), 978. https://doi.org/10.3390/su16030978
  21. Osborne, J. W. . (2014). Best practices in exloratory factor analysis. [CreateSpace Independent Publishing Platform].
  22. Paidican, M., & Arredondo, P. (2022). Evaluación de la validez y fiabilidad del cuestionario de conocimiento tecnológico pedagógico del contenido (TPACK) para docentes de primaria [Evaluation of the validity and reliability of the Pedagogical Content Knowledge Questionnaire (TPACK) for primary school teachers]. Revista Innova Educación, 5(1), 38-58. https://doi.org/10.35622/j.rie.2023.05.003
  23. Paz, D., Pontarolo, E., Santos, G., & Bernartt, M. (2021). Análisis de conteúdo sobre as definições de competência, competência digital e competência digital docente [Content analysis on the definitions of competence, digital competence and teacher digital competence]. Trabalho & Educação, 30(2), 207-225. https://doi.org/10.35699/2238-037x.2021.32817
  24. Peinado, J. (2023). Uso de herramientas digitales y competencias de investigación en estudiantes de posgrado [Use of digital tools and research competencies in graduate students]. Conrado, 19(92), 8-17.
  25. Perdomo, B., Gonzalez, O., & Barrutia, I. (2020). Competencias digitales en docentes universitarios: una revisión sistemática de la literatura [Digital competencies in university teachers: A systematic review of the literature]. EDMETIC, 9(2), 92-115. https://doi.org/10.21071/edmetic.v9i2.12796
  26. Perdomo, B., & Morales, O. A. (2022). Errores y dificultades en la elaboración de las tesis de pre y postgrado del estudiantado peruano: Implicaciones pedagógicas [Errors and Difficulties Faced During the Elaboration of Undergraduate and Graduate Thesis by Peruvian Students: Pedagogical Implications]. Revista Electronica Educare, 26(1), 1-21. https://doi.org/10.15359/ree.26-1.21
  27. Resolution of May 4th 2022, from the General Bureau of Territory Evaluation and Cooperation (2022). https://www.boe.es
  28. Saidi, M., Nasir, G., Musa, J., & Kalinaki, K. (2023). Assessing digital competence in higher education: A gender analysis of DigComp 2.1 framework in Uganda. SAGA: Journal of Technology and Information Systems, 1(4), 114-120. https://doi.org/10.58905/SAGA.vol1i4.210
  29. Sánchez-Caballé, A., Gisbert-Cervera, M., & Esteve-Mon, F. (2020). The digital competence of university students: a systematic literature review. Revista de Psicologia, Ciències de l’Eduació i de l’Esport, 38(1), 63-74.
  30. Saz-Pérez, F., Pizá-Mir, B., & Lizana, A. (2024). Validación y estructura factorial de un cuestionario TPACK en el contexto de Inteligencia Artificial Generativa (IAG). Hachetetepé. Revista Científica de Eeducación y Comunicación, 28, 1-14. https://doi.org/10.25267/hachetetepe.2024.i28.1101
  31. Segura, R. I., Garrido, Y. C., Morueta, R. T., & Rodríguez-Miranda, F. P. (2023). Adapting digital competence 2.1 from the DigCom model in the context of active ageing. 2023 XIII International Conference on Virtual Campus (JICV), 1-4. https://doi.org/10.1109/JICV59748.2023.10565720
  32. Subaveerapandiyan, A., Sinha, P., & Ugwulebo, J. (2024). Digital literacy skills among African library and information science professionals - an exploratory study. Global Knowledge, Memory and Communication, 73(4/5), 521-537. https://doi.org/10.1108/GKMC-06-2022-0138
  33. Tristán-López, A. (2008). Modificación al modelo de Lawshe para el dictamen cuantitativo de la validez de contenido de un instrumento objetivo [Modification to Lawshe’s model for quantitative assessment of the validity of content of an objective instrument]. Avances En Medición, 6(1), 37-48.
  34. Vera, M., & Aguilera, A. (2024). Medición de las competencias digitales en Europa y España una revisión crítica [Medición de las competencias digitales en Europa y España una revisión crítica]. Anales de Documentación, 1-21. https://doi.org/10.6018/analesdoc.587551
  35. Verdú-Pina, M., Lázaro-Cantabrana, J., Grimalt-Álvaro, C., & Usart, M. (2023). El concepto de competencia digital docente: revisión de la literatura [The concept of teaching digital competence: A literature review]. Redie Revista Electrónica de Investigación Educativa, 25, e11.
  36. Vitezić, V., & Perić, M. (2024). The role of digital skills in the acceptance of artificial intelligence. Journal of Business & Industrial Marketing, 39(7), 1546-1566. https://doi.org/10.1108/JBIM-04-2023-0210
  37. Watkins, M. W. (2018). Exploratory Factor Analysis: A guide to best practice. Journal of Black Psychology, 44(3), 219-246. https://doi.org/10.1177/0095798418771807