Adolescents' vulnerability to disinformation: Its measurement and relationship to critical thinking and moral disengagement
La vulnerabilidad de los adolescentes frente a la desinformación: su medición y su relación con el pensamiento crítico y la desconexión moral
Paula Herrero-Diz, Milagrosa Sánchez-Martín, Pilar Aguilar, & José Antonio Muñiz-Velázquez
Young adolescents are more vulnerable to disinformation owing to the time that they spend online and their content consumption habits. The consequences of this phenomenon can be serious, both for the individual and at a social and political level. To alleviate this situation, different agencies recommend healthy practices regarding consumption and exchange of information; from checklists to self-learning exercises for the development of critical thinking. This research proposes a tool for the identification of behaviours among adolescents when giving credibility to information or content and the motives that lead them to share it, contributing at times to the spread of misleading information. After an exhaustive process of design, piloting, and psychometric validation using an English-speaking sample (N = 417), a reliable instrument was obtained. We also measured its correlation with critical thinking and moral disengagement. The results lead us to conclude that this is a new tool with which to observe the information consumption behaviours of young people and thus measure their vulnerability to disinformation. Similarly, we have confirmed how greater critical thinking is positively related to more responsible consumption when giving credibility to content or news, and how moral disengagement is linked to the fact of sharing such items with greater ease.
Please, cite this article as follows: Herrero-Diz, P., Sánchez-Martín, M., Aguilar, P., & Muñiz-Velázquez, J. A. (2023). La vulnerabilidad de los adolescentes frente a la desinformación: su medición y su relación con el pensamiento crítico y la desconexión moral | Adolescents' vulnerability to disinformation: Its measurement and relationship to critical thinking and moral disengagement. Revista Española de Pedagogía, 81 (285), 317-335. https://doi.org/10.22550/REP81-2-2023-04
Ackland, R., & Gwynn, K. (2020). Truth and the dynamics of news diffusion on twitter. In R. Greifeneder, M. E. Jaffé, E. J. Newman, & N. Schwarz (ed.), The Psychology of Fake News (pp. 27-46). Routledge.
Agencia Española de Protección de Datos (2020). Guía de protección de datos por defecto [Default data protection guide]. https://www.aepd.es/es/node/45107
Bandura, A. (2002). Selective moral disengagement in the exercise of moral agency. Journal of Moral Education, 31 (2), 101-119. https://doi.org/10.1080/0305724022014322
Bandura, A., Barbaranelli, C., Caprara, G. V., & Pastorelli, C. (1996). Mechanisms of moral disengagement in the exercise of moral agency. Journal of Personality and Social Psychology, 71 (2), 364- 374. https://doi.org/10.1037/0022-35184.108.40.2064
Blakeslee, S. (2004). The CRAAP test. LOEX Quarterly, 31 (3), 4.
Caulfield, M. (2017). Web literacy for student fact-checkers. Textbooks. 5. https://digitalcommons.liberty.edu/textbooks/5
Corbu, N., Oprea, D. A., & Frunzaru, V. (2021). Romanian adolescents, fake news, and the third-person effect: A cross-sectional Study. Journal of Children and Media, 1-19. https://doi.org/10.1080/17482798.2021.1992460
DeVellis, R. F. (2017). Scale development: Theory and applications. Sage.
Dring, S. (2020). Fact vs fiction: Teaching critical thinking skills in the age of fake news. The School Librarian, 68 (1), 63-63.
Dumitru, E. A. (2020). Testing children and adolescents’ ability to identify fake news: a combined design of quasi-experiment and group discussions. Societies, 10 (3), 71. https://doi.org/10.3390/soc10030071
Dunn, T. J., Baguley, T., & Brunsden, V. (2013). From alpha to omega: A practical solution to the pervasive problem of internal consistency estimation. British Journal of Psychology, 105 (3), 295-441. https://doi.org/10.1111/bjop.12046
Elosúa, P. (2003). Sobre la validez de los tests. Psicothema, 15 (2), 315-321. https://www.psicothema.com/pi?pii=1063
Ferrando, P. J., & Lorenzo-Seva, U. (2014). El análisis factorial exploratorio de los ítems: algunas consideraciones adicionales. Anales de Psicología, 30 (3), 1170-1175. https://dx.doi.org/10.6018/analesps.30.3.199991
Ferrando, P. J., Lorenzo-Seva, U., & Navarro-González, D. (2019). Unival: An FA-based R package for assessing essential unidimensionality using external validity information. The R Journal, 11 (1), 427- 436. https://doi.org/10.32614/rj-2019-040
Fleiss, J. L., Levin, B., & Paik, M. C. (2003). Statistical methods for rates and proportions. Wiley.
Fornell, C., & Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18 (1), 39-50. https://doi.org/10.2307/3151312
Greifeneder, R., Jaffe, M., Newman, E., & Schwarz, N. (2021). The psychology of fake news: Accepting, sharing, and correcting misinformation. Routledge.
Grizzle, A., Wilson, C., Tuazon, R., Cheung, C. K., Lau, J., Fischer, R., Gordon, D., Akyempong, K., Singh, J., Carr, P. R., Stewart, K., Tayie, S., S., Jaakkola, M., Thésée, G., Gulston, C., Andzongo M., Blaise P., Zibi F., & Paul A. (2021). Media and information literate citizens: Think critically, click wisely! UNESCO. https://unesdoc.unesco.org/ark:/48223/pf0000377068
Gómez-Calderón, B., Córdoba-Cabús, A., & Nieto, A. M. (2020). Jóvenes y fake news. Un análisis sociodemográfico aplicado al caso andaluz [Young people and fake news. A socio-demographic analy-sis applied to the case of Andalusia]. IC Revista Científica de Información y Comunicación, 17, 481-504. http://dx.doi.org/10.12795/IC.2020.i01.21
Guan, T., Liu, T., & Yuan, R. (2021). Facing disinformation: Five methods to counter conspiracy theories amid the Covid-19 pandemic. [Combatiendo la desinformación: cinco métodos para contrarrestar las teorías de conspiración en la pandemia de Covid-19]. Comunicar, 69, 71-83. https://doi.org/10.3916/C69-2021-06
Gwet, K. L. (2014). Handbook of inter-rater reliability. Advanced Analytics.
Halstead, J. M. (2010). Moral education. In Clauss- Ehlers, C. S. (Eds.), Encyclopedia of Cross-Cultural School Psychology. Springer. https://doi.org/10.1007/978-0-387-71799-9_260
Hancock, G. R., & Mueller, R. O. (2001). Rethinking construct reliability within latent variable systems. In R. Cudeck, S. du Toit, & D. Srbom (Eds.), Structural equation modeling: Present and future—a festschrift in honor of Karl Joreskog (pp. 195-216). Scientific Software International.
Harkness, J., & Schoua-Glusberg, A. (1998). In J. Harkness (Ed.), Cross-cultural survey equivalence (pp. 87-126). Zentrum für Umfragen, Methoden und Analysen -ZUMA-.
Harris, R. (1997). Evaluating Internet research sources. Virtual salt, 17 (1), 1-17.
Head, A., & Wihbey, J. (2017). The importance of truth workers in an era of factual recession. Medium. https://medium.com/@ajhead1/the-importance-of-truth-workers-in-an-era-of-factual-recession-7487fda8eb3b
Herrero-Diz, P., Conde-Jiménez, J., & Reyes de Cózar, S. (2020). Teens’ motivations to spread fake news on WhatsApp. Social Media + Society, 6 (3). https://doi.org/10.1177/2056305120942879
Herrero-Diz, P., Conde-Jiménez, J., & Reyes-de- Cózar, S. (2021). Spanish adolescents and fake news: level of awareness and credibility of information. Culture and Education, 33 (1), 1-27. https://doi.org/10.1080/11356405.2020.1859739
Hooper, D., Coughlan, J., & Mullen, M. R. (2008). Structural equation modelling: Guidelines for determining model fit. Electronic Journal of Business Research Methods, 6 (1), 53-60. https://doi.org/10.21427/D7CF7R
Jones-Jang, S. M., Mortensen, T., & Liu, J. (2021). Does media literacy help identification of fake news? Information Literacy helps, but other literacies don’t. American Behavioral Scientist, 65 (2), 371- 388. https://doi.org/10.1177/0002764219869406
Kaiser, H. F. (1970). A second-generation little jiffy. Psychometrika, 35, 401-415. https://doi.org/10.1007/BF02291817
Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33, 159-174.
Lawshe, C. H. (1975): A quantitative approach to content validity. Personnel psychology, 28 (4), 563- 575. https://doi.org/10.1111/j.1744-6570.1975.tb01393.x
Lorenzo-Seva, U. (1999). Promin: A Method for Oblique Factor Rotation. Multivariate Behavioral Research, 34, 347-365
Lorenzo-Seva, U., & Ten Berge, J. M. (2006). Tucker’s congruence coefficient as a meaningful index of factor similarity. Methodology, 2, 57-64. https://doi.org/10.1027/1614-2241.2.2.57
Lynn, M. R. (1986): Determination and quantification of content validity. Nursing Research, 35, 382-385.
Mandalios, J. (2013). RADAR: An approach for helping students evaluate Internet sources. Journal of Information Science, 39, 470-478. https://doi.org/10.1177/016555151347888
McGrew, S. (2020). Learning to evaluate: An intervention in civic online reasoning. Computers & Education, 145, 103711. https://doi.org/10.1016/j.compedu.2019.103711
McKay, S., & Tenove, C. (2021). Disinformation as a threat to deliberative democracy. Political Research Quarterly, 74 (3), 703-717. https://doi.org/10.1177/1065912920938143
Newman, E. J., & Zhang, L. (2020). Truthiness: How non-probative photos shape belief. In R. Greifeneder, M. E. Jaffé, E. J. Newman, & N. Schwarz (Ed.), The psychology of fake news (pp. 90-114). Routledge.
Nieto-Isidro, S., Martínez-Abad, F., & Rodríguez- Conde, M.-J. (2021). Presente y futuro de la Competencia Informacional Docente en educación obligatoria [Present and future of Teachers' Information Literacy in compulsory education]. Revista Española de Pedagogía, 79 (280), 477-496. https://doi.org/10.22550/REP79-3-2021-07
Ofcom. (Ed.) (2019). Children and parents: Media use and attitudes report, 2018. https://www.ofcom.org.uk/research-and-data/media-literacy-research/childrens/children-and-parents-media-use-and-attitudes-report-2018
Organic Law 3/2018, of 5 December, on the Protection of Personal Data and Guarantee of Digital Rights. Spanish Official State Gazette, 294, 6 December 2018, pages 119788 to 119857. https://www.boe.es/eli/es/lo/2018/12/05/3
Osborne, J. W., Costello, A. B., & Kellow, J. T. (2014). Best practices in exploratory factor analysis (pp. 86-99). CreateSpace Independent Publishing Platform. https://doi.org/10.4135/9781412995627
Park, N., & Peterson, C. (2006). Moral competence and character strengths among adolescents: the development and validation of the Values in Action Inventory of Strengths for Youth. Journal of Adolescence, 29 (6), 891-909. https://doi.org/10.1016/j.adolescence.2006.04.011
Paul, R., & Scriven, M. (2003). Defining Critical Thinking. The Critical Thinking Community. http://www.criticalthinking.org/pages/defining-critical-thinking/766
Pérez-Escoda, A., Pedrero-Esteban, L. M., Rubio- Romero, J., & Jiménez-Narros, C. (2021). Fake news reaching young people on social networks: Distrust challenging media literacy. Publications, 9 (2), 24. https://doi.org/10.3390/publications9020024
Pithers, R. T., & Soden, R. (2000). Critical thinking in education: A review. Educational research, 42 (3), 237-249.
Plan Internacional (Ed.) (2021). The truth gap (des) informadas online. Cómo la desinformación y la información errónea online afectan a la vida, el aprendizaje y el liderazgo de las niñas, adolescentes y mujeres jóvenes [The truth gap (mis) informed online. How misinformation and inaccurate information online affects the lives, learning and leadership of girls, adolescents and young women]. https://bit.ly/3D7UmTY
Rodríguez, A., Reise, S. P., & Haviland, M. G. (2016). Applying bifactor statistical indices in the evaluation of psychological measures. Journal of Personality Assessment, 98, 223-237. https://doi.org/10.1080/00223891.2015.1089249
Sireci, S., & Faulkner-Bond, M. (2014). Validity evidence based on test content. Psicothema, 26 (1), 100-107.
Tamboer, S. L., Kleemans, M., & Daalmans, S. (2020). ‘We are a neeeew generation’: Early adolescents’ views on news and news literacy. Journalism. https://doi.org/10.1177/1464884920924527
Timmerman, M. E., & Lorenzo-Seva, U. (2011). Dimensionality assessment of ordered polytomous items with parallel analysis. Psychological Methods, 16 (2), 209-220. https://doi.org/10.1037/a0023353
Paula Herrero-Diz holds a PhD in Communication from the Universidad de Sevilla and a Master’s degree in Research Methods in Economic and Business Sciences from the Universidad de Córdoba. She works as an Assitant Professor and researcher in the Department of Communication and Education at Universidad Loyola Andalucía, where she teaches courses in the field of journalism. Her main research interests are young people as creators of digital content and innovation in media.
Milagrosa Sánchez-Martín is a teacher and researcher in the Department of Psychology and Dean of the Faculty of Psychology and Education at Universidad Loyola Andalucía. She holds a PhD in Psychology with a European mention, specializing in the field of Methodology of Behavioural Sciences. She was awarded the Young Researchers Prize by AEMCCO and is a founding member of the spin-off company Metodik. She has led several competitive national research projects and participated in others at European, national, and regional levels, as well as in research contracts with companies such as Pearson Education, Coca Cola’s Institute of Happiness, and the Spanish Red Cross.
Pilar Aguilar is a teacher and researcher at the Universidad Autónoma de Madrid and the Universidad Loyola Andalucía. She has participated in several research projects funded by competitive public calls from the Ministry of Science in the I+D Excellence program and has been Co-IP of a project granted by the Andalusian Agency for International Cooperation for Development. In addition, she has collaborated on European research projects and has carried out scientific stays in the United States, United Kingdom, and Portugal. She has published 11 JCR articles. Since 2015, she has also taught classes and held management positions in the Department of Psychology at Universidad Loyola Andalucía.
José Antonio Muñiz-Velázquez is a Teacher, Researcher, and Director of the Department of Communication and Education at Universidad Loyola Andalucía. He is also responsible for the Positive Communication and Digital Culture research group at the same university. He holds a degree in Information Sciences and Psychology and a PhD in Communication. His research focuses on the relationship between different facets of communication, happiness, and human flourishing. He has numerous publications in top scientific journals and publishers on this topic. He has been a visiting lecturer at universities such as Loyola Chicago University, Università di Siena, Università di Bologna, and Emerson College (Boston), among others.
Data collected by PlumX Metrics. More information on the metrics collected can be found at https://plumanalytics.com/learn/about-metrics/