The pedagogical quality of MOOCs based on a systematic review of JCR and Scopus publications (2013-2015)

Josep M. Duart
Rosabel Roig-Vila
Santiago Mengual-Andrés

Abstract

MOOCs are seen as the latest development in online learning and since their launch in 2008 they have become an integral part of university course curricula. We are currently at an early stage in the development of MOOCs; few studies have been published on their assessment so far. Consequently, this paper is based on a literature review, using the main academic databases JCR and Scopus, on 33 articles published between 2013 and 2015 with the objective of determining the educational quality of MOOCs. The methodology is based on a literature review procedure in which seven categories were distinguished when carrying out the analysis: course planning, contents, methodology, resources and activities, motivation, communication, and assessment and certification. The results of this study show that the assessment of the quality of MOOCs refers to a slightly higher than average quality, except for the three variables of content, resources and activities, and assessment.
However, it warns of a lack of studies that assess the pedagogical quality of MOOCs and so we suggest further studies are needed with greater methodological rigour to obtain conclusive results.

Cite this article as: Duart, J. M., Roig-Vila, R., Mengual-Andrés, S., & Maseda Durán, M.-A. (2017). La calidad pedagógica de los MOOC a partir de la revisión sistemática de las publicaciones JCR | The pedagogical quality of MOOCs based on a systematic review of JCR and Scopus publications (2013-2015). Revista Española de Pedagogía, 75 (266), 29-46. doi: 10.22550/REP75-1-2017-02

Referencias | References

Aguaded, I., Vázquez-Cano, E., & López-Meneses, E. (2016). El impacto bibliométrico del movimiento MOOC en la Comunidad Científica Española. Educación XX1, 19 (2), 77-104. doi: 10.5944/educXX1.13217

Alemán, L. Y., Sancho-Vinuesa, T., & Gómez, M. G. (2015). Indicadores de calidad pedagógica para el diseño de un curso en línea masivo y abierto de actualización docente. RUSC. Universities and Knowledge Society Journal, 12 (1), 104-119.

Alraimi, K. M., Zo, H., & Ciganek, A. P. (2015). Understanding the MOOCs continuance: The role of openness and reputation. Computers & Education, 80, 28-38.

Atenas, J. (2015). Model for democratisation of the contents hosted in MOOCs. RUSC. Universities and Knowledge Society Journal, 12 (1), 3-14.

Baldomero, M. (2015). La valoración de MOOC: Una perspectiva de calidad. RIED. Revista Iberoamericana de Educación a Distancia, 18 (2), 171-195.

Baldomero, M. & Salmerón, J. L. (2015). EduTool ®: Un instrumento para la evaluación y acreditación de la calidad de los MOOCs. Educación XX1, 18 (2), 97-123. doi: 10.5944/educXX1.13233 Baldomero, M., Salmerón, J. L., & López-Meneses, E. (2015). Comparative between quality assessment tools for MOOCs: ADECUR vs Standard UNE 66181:2012. RUSC. Universities and Knowledge Society Journal, 12 (1), 131-144.

Castaño, C., Maiz, I., & Urtza, G. (2015). Diseño, motivación y rendimiento en un curso MOOC cooperativo. Comunicar. Revista Científica de Educomunicación, 44, 19-26.

Castells, M. (2009). Comunicación y poder. Madrid: Alianza Editorial.

Chang, R.I., Hung, Y.H., & Lin, C.F. (2015). Survey of learning experiences and influence of learning style preferences on user intentions regarding MOOCs. British Journal of Educational Technology, 46 (3), 528-541.

Chen, Y. (2014). Investigating MOOCs through blog mining. The International Review of Research in Open and Distance Learning, 15 (2), 85-106.

Chen, Y. H. & Chen, P. J. (2015). MOOC study group: Facilitation strategies, influential factors, and student perceived gains. Computers & Education, 86, 55-70.

Daniel, J., Vázquez, E., & Gisbert, M. (2015). The future of MOOCs: Adaptive learning or business model? RUSC. Universities and Knowledge Society Journal, 12 (1), 64-73.

Darder, A., & Pérez, A. (2015). Online tutoring procedure for research project supervision: management, organization and key elements. Journal of New Approaches in Educational Research, 4 (2), 123-132. doi: 10.7821/naer.2015.4.110

De Freitas, S. I., Morgan, J., & Gibson, D. (2015). Will MOOCs transform learning and teaching in higher education? Engagement and course retention in online learning provision. British Journal of Educational Technology, 46 (3), 455-471.

Diver, P. & Martínez, I. (2015). MOOCs as a massive research laboratory: opportunities and challenges. Distance Education, 36 (1), 5-25.

Downes, S. (2012). Connectivism and connective knowledge: Essays on meaning and learning networks. Stephen Downes Web. Retrieved from: http://www.downes.ca/files/Connective_Knowledge-19May2012.pdf

Escardíbul, J.-O & Mediavilla, M. (2016). El efecto de las TIC en la adquisición de competencias. Un análisis por tipo de centro educativo. revista española de pedagogía, 74 (264), 317-335.

Gallego, M. J., Gámiz, V., & Gutiérrez, E. (2015). Tendencias en la evaluación del aprendizaje en cursos en línea masivos y abiertos. Educación XXI, 18 (2), 77-96.

García, E. (2016). Governance in educational institutions in Portugal. Journal of New Approaches in Educational Research, 5 (1), 17-22. doi: 10.7821/naer.2016.1.156

García, B. J., Tenorio, G. C., & Ramírez, M. S. (2015). Self-motivation challenges for student involvement in the open educational movement with MOOC. RUSC. Universities and Knowledge Society Journal, 12 (1), 91-103.

Gea, M. (Coord.) (2015). Informe MOOC y criterios de calidad. p. 28. Toledo: CRUE. Retrieved from: http://www.crue.org/TIC/Documents/InformeMOOC_CRUETIC_ver1%200.pdf

Gisbert, J. P. & Bonfill, X. (2004). ¿Cómo realizar, evaluar y utilizar revisiones sistemáticas y metaanálisis? Gastroenterol Hepatol, 27 (3), 129-49.

Graham, L. & Fredenberg, V. (2015). Impact of an open online course on the connectivist behaviours of Alaska teachers. Australasian Journal of Educational Technology, 31 (2), 140-149.

Guàrdia, L., Maina, M., & Sangrà, A. (2013). MOOC design principles. A pedagogical approach from the learner’s perspective. eLearning Papers, 33.

Last, J. M. (2001). A dictionary of epidemiology. Oxford: Oxford University Press. Liyanagunawardena, T. R., Adams, A. A., & Williams, S. A. (2013). MOOCs: A systematic study of the published literature 2008-2012. IRRODL. The International Review of Research in open and distributed Learning, 14 (3), 202-227. Retrieved from: http://www.irrodl.org/index.php/irrodl/article/view/1455

López-Meneses, E., Vázquez-Cano, E., & Román, P. (2015). Análisis e implicaciones del impacto del movimiento MOOC en la comunidad científica: JCR y Scopus (2010-13). Comunicar, 44, 73-80.

López-Torrijo, M., Mengual-Andrés, S., & Estellés-Ferrer, R. (2015). Clinical and logopaedic results of simultaneous and sequential bilateral implants in children with severe and/or profound bilateral sensorineural hearing loos: A literature review. International Journal of Pediatric Otorhinolaryngology, 79, 786-792.

Mackness, J., Waite, M., Roberts, G., & Lovegrove, E. (2013). Learning in a small, task-oriented, connectivist MOOC: Pedagogical issues and implications for higher education. The International Review of Research in Open and Distance Learning, 14 (4), 140-159.

Margaryan, A., Bianco, M., & Littlejohn, A. (2015). Instructional quality of Massive Open Online Courses (MOOCs). Computers & Education, 80, 77-83.

Martín, O., González, F., & García, M. A. (2013). Propuesta de evaluación de la calidad de los MOOC a partir de la Guía Afortic. Campus Virtuales, 1 (2), 124-32.

Melendro, M., García, F. J., & Goig, R. (2016). El uso de las TIC en el ocio y la formación de los jóvenes vulnerables. revista española de pedagogía, 74 (218), 71-89.

Mengual, A., & Roig, R. (2015). Validación del Cuestionario de evaluación de la calidad de cursos virtuales adaptado a MOOC. RIED. Revista Iberoamericana de Educación a Distancia, 18 (2), 145-169.

Monroy, F. & Hernández, F. (2014). Factores que influyen en los enfoques de aprendizaje universitario. Una revisión sistemática. Educación XXI, 17 (2), 105-124.

Mullan, B., Smith, L., Sainsbury, K., Vanessa, A., Paterson, H., & Lopez, A. L. (2015). Active behavior change safety interventions in the construction industry: A systematic review. Safety Science, 79, 139-148.

Pappano, L. (2012). The year of the MOOC. The New York Times. Retrieved from: http://goo.gl/PFQcrz

Raposo-Rivas, M., Martínez-Figueira, E., & Sarmiento, J. A. (2015). Un estudio sobre los componentes pedagógicos de los cursos online masivos. Comunicar, Revista Científica de Educomunicación, 44, 27-35.

Roig, R., Mengual-Andrés, S., & Suárez, C. (2014). Evaluación de la calidad pedagógica de los MOOC. Currículum y formación de profesorado, 18 (1), 27-41. Retrieved from: http://www.ugr.es/~recfpro/rev181ART2.pdf

Sánchez, J. (2010). Cómo realizar una revisión sistemática y un meta-análisis. Aula Abierta, 38 (2), 53-64.

Sánchez-Acosta, E., Escribano-Otero, J. J., & Valderrama, F. (2014). Motivación en la educación masiva online. Desarrollo y experimentación de un sistema de acreditación para los MOOC. Digital Education Review, 25, 18-35. Retrieved from: http://greav.ub.edu/der

Sánchez-Vera, M. M. & Prendes-Espinosa, M. P. (2015). Beyond objective testing and peer assessment: Alternative ways of assessment in MOOCs. RUSC. Universities and Knowledge Society Journal, 12 (1), 119-130.

Sangrà, A., González-Sanmamed, M., & Anderson, T. (2015). Metaanálisis de la investigación sobre MOOC en el período 2013-2014. Educación XXI, 18 (2), 21-49.

Terras, M. & Ramsay, J. (2015). Massive open online courses (MOOCs): Insights and challenges from a psychological perspective. British Journal of Educational Technology, 46 (3), 472-487.

Vázquez-Cano, E., López, E., & Barroso, J. (2015). El futuro de los MOOC: Retos de la formación on-line, masiva y abierta. Madrid: Síntesis.

Veletsianos, G., Collier, A., & Schneider, E. (2015). Digging deeper into learners’ experiences in MOOCs: Participation in social networks outside of MOOCs, notetaking and contexts surrounding content consumption. British Journal of Educational Technology, 46 (3), 570-587.

Yousef, A. M. F., Chatti, M. A., Wosnitza, M., & Schroeder, U. (2015). A cluster analysis of MOOC stakeholder perspectives. RUSC. Universities and Knowledge Society Journal, 12 (1), 74-90.

Yu, P.-T., Liao, Y.-H., & Su, M.-H. (2013). A near-reality approach to improve the e-learning open courseware. Educational Technology & Society, 16 (4), 242-257.

Author Biography

Josep M. Duart. Universitat Oberta de Catalunya (UOC).
Rosabel Roig-Vila. Universidad de Alicante.
Santiago Mengual-Andrés. Universidad de Valencia.
Miguel-Ángel Maseda Durán. Universidad de Valencia.

Citación recomendada | Recommended citation

Duart, J. M., Roig-Vila, R., & Mengual-Andrés, S. (2017) . The pedagogical quality of MOOCs based on a systematic review of JCR and Scopus publications (2013-2015). Revista Española de Pedagogía, 75(266). https://www.revistadepedagogia.org/rep/vol75/iss266/11