An economic evaluation of educational interventions in the LOMLOE: Proposals for improvement with Artificial Intelligence

Evaluación económica de intervenciones educativas en la LOMLOE: Propuestas de mejora con Inteligencia Artificial

María Teresa Ballestar, Jorge Sainz Orcid and Ismael Sanz

DOI: https://doi.org/10.22550/REP80-1-2022-09

* Organic Law 3/2020, of 29 December, which amends Organic Law 2/2006, of 3 May, on Education (LOMLOE).

This research aims to demonstrate the need for an economic evaluation of the Or­ganic Law that modifies the Organic Law of Education (LOMLOE), especially after the in­vestment of EU Next Generation funds that open new opportunities that were lacking in the initial drafting of the law. The challenge for Public Administrations is to use this addi­tional investment efficiently.

Our analysis shows that artificial intelli­gence models can predict whether educational support programmes will help increase the like­lihood that students who lag behind will pass the 4th grade of ESO (Compulsory Secondary Education). In this way, we can calculate the social return of one of these programmes and contribute to their ex-ante design to achieve higher success rates for students.

To complement the models already used by Public Administrations, we use robust Machine Learning (ML) models such as CHAID decision trees and artificial neural networks to analyse the characteristics of the groups of students and the interven­tion they have been part of. The conclusions allow us to improve educational reinforce­ment programmes in the coming years to support students with lower chances of ac­ademic success.

 


 

Please, cite this article as follows: Ballestar, M. T., Sainz, J., & Sanz, I. (2022). Evaluación económica de intervenciones educativas en la LOMLOE: propuestas de mejora con inteligencia artificial |An economic evaluation of educational interventions in the LOMLOE*: Proposals for improvement with artificial intelligence. Revista Española de Pedagogía, 80 (281), xxx-xxx. https://doi.org/10.22550/REP80-1-2022-09

Aad, G., Abbott, B., Abdallah, J., Abdelalim, A. A., Abdesselam, A., Abdinov, O., Abi, B., Abolins, M., Abramowicz, H., Abreu, H., Acerbi, E., Acharya, B. S., Adams, D. L., Addy, T. N., Adel­man, J., Aderholz, M., Adomeit, S., Adragna, P., Adye, T., ... Zwalinski, L. (2012). Performance of missing transverse momentum reconstruction in proton-proton collisions at√s = 7 TeV with atlas. European Physical Journal C, 72 (1), 1-35. https://doi.org/10.1140/epjc/s10052-011-1844-6

Akin, M., Eyduran, E., & Reed, B. M. (2017). Use of RSM and CHAID data mining algorithm for predicting mineral nutrition of hazelnut. Plant Cell, Tissue and Organ Culture (PCTOC), 128 (2), 303-316.

Ballestar, M. T., Doncel, L. M., Sainz, J., & Orti­gosa-Blanch, A. (2019). A novel machine learn-ing approach for evaluation of public policies: An application in relation to the performance of university researchers. Technological Fore-casting and Social Change, 149. https://doi.or­g/10.1016/j.techfore.2019.119756

Ballestar, M. T., García-Lázaro, A., & Sainz, J. (2020). All roads lead to education: A first analysis of robotization, education and employ-ment. Papeles de Economía Española, 166, 33- 49.

Ballestar, M. T., Garcia-Lazaro, A., Sainz, J., & Sanz, I. (2022). Why is your company not robotic? The technology and human capital needed by firms to become robotic. Journal of Busi­ness Research, 142, 328-343. https://doi.or­g/10.1016/j.jbusres.2021.12.061

Ballestar, M. T., Grau-Carles, P., & Sainz, J. (2018). Customer segmentation in e-commerce: Appli­cations to the cashback business model. Jour­nal of Business Research, 88, 407-414. https:// doi.org/10.1016/j.jbusres.2017.11.047

Brunello, G., & Paola, M. De. (2014). The costs of early school leaving in Europe. IZA Jour­nal of Labor Policy, 3 (1), 1-31. https://doi.or­g/10.1186/2193-9004-3-22In

Burgess, S. (2020). How we should deal with the loc­kdown learning loss in England’s schools. VOX Cepr Policy Portal. https://bit.ly/3Eom12M

Chassignol, M., Khoroshavin, A., Klimova, A., & Bilyatdinova, A. (2018). Artificial Intelligence trends in education: A narrative overview. Pro­cedia Computer Science, 136, 16-24. https://doi. org/10.1016/j.procs.2018.08.233.

Chatterjee, S., & Bhattacharjee, K. K. (2020). Adoption of artificial intelligence in higher education: a quantitative analysis using struc­tural equation modelling. Education and Infor­mation Technologies, 25 (5), 3443-3463. https:// doi.org/10.1007/s10639-020-10159-7

Crescenzi, R., Giua, M., & Sonzogno, G. V. (2021). Mind the Covid-19 crisis: An evidence-based implementation of Next Generation EU. Jour­nal of Policy Modeling, 43 (2), 278-297. https:// doi.org/10.1016/J.JPOLMOD.2021.03.002

De la Fuente, A., & Jimeno, J. F. (2009). The pri­vate and fiscal returns to schooling in the Eu­ropean Union. Journal of the European Econo­mic Association, 7 (6), 1319-1360. https://doi. org/10.1162/JEEA.2009.7.6.1319

Doncel, L. M., Durá, P., Grau, P., & Sainz, J. (2014). Fiscal sustainability and immigration in the Madrid Region. International Migration, 52 (6), 180-196. https://doi.org/10.1111/imig.12004

Dželihodžić, A., & Jonko, D. (2016). Comparison of ensemble classification techniques and sin­gle classifiers performance for customer credit assessment. Modeling of Artificial Intelligence, 3, 140-150.

European Comission (2010). EUROPE 2020: A strategy for smart, sustainable and inclusi­ve growth. http://eur-lex.europa.eu/LexUri­Serv/LexUriServ.do?uri=COM:2010:2020:­FIN:EN:PDF

Golden, G. (2020). OECD iLibrary | Education policy evaluation: Surveying the OECD lands­cape. (OECD Education Working Papers, 236). OECD Publishing. https://www.oecd-ili­brary.org/education/education-policy-evalua­tion_9f127490-en

Goos, M., Manning, A., & Salomons, A. (2009). Job polarization in Europe. American Economic Review, 99 (2), 58-63. https://doi.org/10.1257/ aer.99.2.58

Gouëdard, P., Pont, B., & Viennet, R. (2020). Edu­cation responses to COVID-19: Implementing a way forward. OECD Education Working Pa­pers, 224. OECD Publishing. https://doi.org/ https://doi.org/10.1787/8e95f977-en

Gregory, T., Salomons, A., & Zierahn, U. (2019). Racing With or Against the Machine ? Eviden­ce from Europe. IZA Institute of Labor Econo­mics, 2019 (12063).

Hosmer Jr., D. W., Lemeshow, S., & Sturdivant, R. X. (2013). Applied logistic regression. John Wiley & Sons.

Kass, G. V. (1980). An exploratory technique for in­vestigating large quantities of categorical data. Journal of the Royal Statistical Society: Series C (Applied Statistics), 29 (2), 119-127. https:// doi.org/10.2307/2986296

Khosravi, P., Kazemi, E., Zhan, Q., Malmsten, J. E., Toschi, M., Zisimopoulos, P., Sigaras, A., La­very, S., Cooper, L. A. D., & Hickman, C. (2019). Deep learning enables robust assessment and selection of human blastocysts after in vitro fertilization. NPJ Digital Medicine, 2 (1), 1-9.

Kraft, M. (2015, August 20). What If Every Stru­ggling Student Had a Tutor? Education Week. https://www.edweek.org/education/opinion-what-if-every-struggling-student-had-a-tu­tor/2015/08

Li, Z., & Eastman, J. R. (2006). Commitment and typicality measurements for fuzzy ARTMAP neural network. Geoinformatics 2006: Geos­patial Information Science, 6420. https://doi. org/10.1117/12.7129986420, 64201I.

Maimon, O., & Rokach, L. (2005). Data mining and knowledge discovery handbook. Springer.

Nickow, A., Oreopoulos, P., & Quan, V. (2020). The impressive effects of tutoring on prek-12 lear­ning: A systematic review and meta-analysis of the experimental evidence. National Bureau of Economic Research Working Papers Series, 27476. https://doi.org/10.3386/w27476

OECD. (2018). Education policy outlook 2018: Put­ting student learning at the centre. OECD.

Organic Law 10/2002, of 23 December 2002, on the Quality of Education (LOCE). Spanish Offi­cial State Gazette, 307, of 24 December 2002, pp. 45188 to 45220. https://www.boe.es/eli/es/ lo/2002/12/23/10

Organic Law 2/2006, of 3 May, on Education (LOE). Spanish Official State Gazette, 106. https://www.boe.es/eli/es/lo/2006/05/03/2/con

Organic Law 8/2013, of 9 December, for the Im­provement of the Quality of Education (LOM­CE). Spanish Official State Gazette, 295, pages 97858 to 97921. https://www.boe.es/eli/es/ lo/2013/12/09/8

Organic Law 3/2020, of 29 December, which amends Organic Law 2/2006, of 3 May, on Education (LOMLOE). Spanish Official State Gazette, 340, 30 December 2020, pages 122868 to 122888. https://www.boe.es/diario_boe/txt. php?id=BOE-A-2020-17264

Paliwal, M., & Kumar, U. A. (2009). Neural networ­ks and statistical techniques: A review of appli­cations. Expert Systems with Applications, 36 (1), 2-17.

Pont, B., & Montt, G. (2014). Education policy out­look. Spain. OECD.

Porte, C. de la, & Jensen, M. D. (2021). The next generation EU: An analysis of the dimensions of conflict behind the deal. Social Policy & Administration, 55 (2), 388-402. https://doi. org/10.1111/SPOL.12709

Ramaswami, M., & Bhaskaran, R. (2010). A CHAID based performance prediction model in educa­tional data mining. International Journal of Computer Science, 7 (1), 10-18.

Saltelli, A., Tarantola, S., Campolongo, F., & Ratto, M. (2004). Sensitivity analysis in practice: a guide to assessing scientific models (Vol. 1). Wi­ley Online Library.

Schleicher, A. (2020). The impact of COVID-19 on education: Insights from education at a glan­ce 2020. OECD Journal: Economic Studies. https://www.oecd.org/education/the-impact-of-covid-19-on-education-insights-education-at-a-glance-2020.pdf

Slavin, R. E. (2016). Evidence-Based Education Po­licies: Transforming Educational Practice and Research. Educational Researcher, 31 (7), 15-21. https://doi. org/10.3102/0013189X031007015

Wolszczak-Derlacz, J., & Parteka, A. (2011). Efficien­cy of European public higher education insti-tutions: A two-stage multicountry approach. Scientometrics, 89 (3), 887-917. https://doi. org/10.1007/s11192-011-0484-9

Yin, L., Ge, Y., Xiao, K., Wang, X., & Quan, X. (2013). Feature selection for high-dimensional imbalanced data. Neurocomputing, 105, 3-11.

Yusuf, A. (2007). Standard-Setting at UNESCO: Conventions, recommendations, declarations and charters adopted by UNESCO, 1948-2006 (Vol. 2). Martinus Nijhoff Publishers.

María Teresa Ballestar holds a de­gree in Statistics from the University of Zaragoza, a degree in Market Research and Techniques and a Master’s degree in Information and Knowledge Society from the Universitat Oberta de Catalunya. PhD in Big Data methodologies and tech­nologies applied to Economics at the Uni­versidad Rey Juan Carlos. She is also an Associate Professor at the Universidad Rey Juan Carlos. In recent years she has held management positions and led pro­jects in digital transformation, innovation, data analytics and data science. She has published more than a dozen scientific pa­pers and collaborated with various media.

 https://orcid.org/0000-0001-8526-7561

Jorge Sainz Orcid holds a degree in Economics from the Universidad Com­plutense de Madrid and in Law from the UNED. He holds a PhD in Economics (URJC) and an MBA (specialising in finance and pub­lic policy) from the Simon School, University of Rochester. He is Professor of Applied Eco­nomics at the Universidad Rey Juan Carlos de Madrid and Visiting Fellow at the Institute for Policy Research, University of Bath.

He has been Advisor to the Cabinet of the Regional Minister of Education and General Deputy Director of Research at the Regional Ministry of Education of the Community of Madrid. In the Ministry of Education, Culture and Sport he has been General Director of University Policy and General Secretary of Universities.

 https://orcid.org/0000-0001-8491-3154

Ismael Sanz is Associate Professor in the Department of Applied Economics I at the Universidad Rey Juan Carlos. He holds a PhD in Applied Economics from the Faculty of Economics and Business Studies at the Universidad Complutense de Madrid (UCM). He has been General Director of Innovation, Scholarships and Grants of the Ministry of Education of the Community of Madrid, Director of the Na­tional Institute for Educational Evaluation (INEE) of the Ministry of Education, Cul­ture and Sport (2012-2015) and Chair of the Strategic Development Group of PISA of the OECD. He is currently Vice-Rector for Quality at the URJC. Author of articles in high impact research journals.

 https://orcid.org/0000-0003-1286-4124

 

Data collected by PlumX Metrics.

This article has been read 689 times