Design and Validation of a Perception Instrument for Educational Communities on the Stimulation of 21st- Century Skills in Students within the School System

Authors

DOI:

https://doi.org/10.31637/epsir-2025-883

Keywords:

instrument, questionnaire, validation, perception, 21st-century skills, educational communities, students, school system

Abstract

Introduction: The objective was to design and validate an instrument that measures the perception of educational communities on the stimulation of 21st- Century Skills in students. Methodology: Complementary. Content validation was conducted with 10 experts using the Delphi method, achieving a consensus of Cns = .525. Reliability yielded a Cronbach's Alpha of α = .919. Construct validity was determined through exploratory factor analysis with a sample of 173 subjects from five educational institutions in the Ñuble and Biobío regions of Chile. Results: The KMO test resulted in .896 and Bartlett's test of sphericity showed a p < .000. Factor analysis identified four factors explaining 65.89% of the total variance, configuring the instrument into four dimensions: Social, Emotional, Digital, and Cognitive, with a total of 19 items. Discussion: The instrument has high reliability and a robust factor structure; however, qualitative studies are recommended to complement its applicability in educational contexts. Conclusion: The instrument presents adequate content and construct validity, assuring its use in studies related to the perception of educational communities and 21st-Century Skills.

Downloads

Download data is not yet available.

Author Biographies

Ignacio Salamanca - Garay, Universidad Bernardo O'Higgins

The author has a PhD in Education from the Doctorate Program in Education in Consortium (UCM-UCSC-UCT-UBB) specializing in Educational Research and Innovation, he also has a Master in Education from the University of Concepción (UDEC), Master in Social Innovation Learning By Helping (Barcelona), Professor of Philosophy at the University of Concepción (UDEC) and Doctoral Fellow (ANID-Folio / 21170028). His line of research is in Innovation and Development in Education in different areas such as: Development of Skills for the XXI Century in Education, Innovative Methodologies of Teaching - Learning, Use of ICT in Teaching - Learning processes and Epistemology.

Emilio Sagredo - Lillo, San Sebastián University

He holds a PhD in Psychology of Communication and Change from the Autonomous University of Barcelona and the University of Barcelona (Ph.D. C&C.) and a PhD in Education from the Catholic University of the Most Holy Conception. He holds several master's degrees: in Psychology, Educational Management and Management Excellence. He is a teacher of Special Education and Psychologist. He has academic and research experience in Chilean and foreign universities and has served as head of career.

References

Ananiadou, K. y Claro, M. (2009). 21st Century Skills and Competences for new Millennium Learners in OECD Countries. EDU Working paper, 41, 1-33. https://doi.org/10.1787/218525261154

Bericat E. (1998). La investigación de los métodos cuantitativo y cualitativo en la investigación social. Ariel Sociología.

Burgos, R. (2006). Metodología de investigación y escritura científica en clínica. Escuela Andaluza de Salud Pública.

Carretero-Dios, H. y Pérez, C. (2007). Normas para el desarrollo y revisión de estudios instrumentales. International Journal of Clinical and Health Psychology, 5(3), 521-551. https://acortar.link/7b94Pz

Esnaola, I. (2005). Elaboración y validación del cuestionario Autokontzeptu Fisikoaren Itaunketa (AFI) de autoconcepto físico. Servicio Editorial de la Universidad del País Vasco, España.

Ferrando, P. J. y Anguiano-Carrasco, C. (2010). El análisis factorial como técnica de investigación en psicología. Papeles del psicólogo, 31(1), 18-33. https://acortar.link/YsD2Yp

Garay, I. S., Quintana, M. G. B. (2019). 21st Century Skills. An Analysis of Theoretical Frameworks to Guide Educational Innovation Processes in Chilean Context. En A. Visvizi, M. Lytras (Eds.), Research & Innovation Forum 2019. RIIFORUM 2019. Springer Proceedings in Complexity (pp. 37-47). Springer, Cham. https://doi.org/10.1007/978-3-030-30809-4_4

George, D. y Mallery, P. (2003). SPSS for Windows step by step: A simple guide and reference (4ª ed.). Allyn & Bacon.

Griffin, P., McGaw, B. y Care, E. (2012). The changing role of education schools. En P. Griffin, B. McGaw y E. Care (Eds.), Assessment and Teaching of 21st Century Skills (pp 1-17), Springer.

Kaiser, H. F. (1974). An index of factorial simplicity. Psychometrika, 39, 31–36. https://doi.org/10.1007/bf02291575

van Laar, E., Van Deursena, A., Van Dijka, J. y De Haan, J. (2019). Determinants of 21st-century digital skills: A large-scale survey among working professionals. Computers in Human Behavior, 100, 93-104. https://doi.org/10.1016/j.chb.2019.06.017

Latiesa, M. (2003). Validez y fiabilidad de las observaciones sociológicas. En M. García Ferrando, J. Ibáñez y F. Alvira (Eds.), El análisis de la realidad social. Métodos y técnicas de investigación (3a ed., pp. 409-443). Alianza Editorial.

Lee, L., Gurnam, K. y Chang, Y. (2015). Exploring 21st century skills among postgraduates in Malaysia. Procedia - Social and Behavioral Sciences, 123, 130-138. https://doi.org/10.1016/j.sbspro.2014.01.1406

Likert, R. (1932). A technique for the measurement of attitude. Archives of Psychology, 140, 5-55. https://acortar.link/ykUeQs

Linstone, H. A. y Turoff, M. (1975). The Delphi method: Techniques and applications. Reading, Addison Wesley Publishing.

Matas, A. (2018). Diseño del formato de escalas tipo Likert: un estado de la cuestión. Revista Electrónica de Investigación Educativa, 20(1), 38-47. https://doi.org/10.24320/redie.2018.20.1.1347

Méndez, C. y Rondón, M. (2012). Introducción al análisis factorial exploratorio. Revista Colombiana de Psiquiatría, 41 (1), 197-207. https://doi.org/10.1016/s0034-7450(14)60077-9

Montoya, O. (2007). Aplicación del análisis factorial a la investigación de mercados. Caso de estudio. Scientia et Technica, 35, 281-286. https://acortar.link/wonDEy

Namthip, O., Sirichai, K. y Chanatip, T. (2015). Development of 21st Century Skill Scales as Perceived by Students. Procedia - Social and Behavioral Sciences, 191, 737-741. https://doi.org/10.1016/j.sbspro.2015.04.716

OECD. (2018). Education 2030: The Future of Education and Skills Project. https://acortar.link/DitCS

Ortega, E., Jiménez, J. M., Palao, J. M. y Sainz, P. (2008). Diseño y validación de un cuestionario para valorar las preferencias y satisfacciones en jóvenes jugadoras de baloncesto. Cuadernos de Psicología del Deporte, 8(2), 39-58. https://acortar.link/i0DgM5

van de Oudeweetering, K. y Voogt, J. (2018). Teachers' conceptualization and enactment of twenty-first century competences: Exploring dimensions for new curricula. Curriculum Journal, 29(1), 116–133. https://doi.org/10.1080/09585176.2017.1369136

P21. Partnership for 21st Century Skills. (2008). 21st Century Skills, Education & Competitiveness. Partnership for 21st Century Skills. https://acortar.link/YX2pRM

Salamanca, I. y Badilla, M. G. (2020). Estudio de marcos referenciales de habilidades para el siglo XXI: un modelo eco-sistémico para orientar procesos de innovación educativa. Synergies Chili, 16, 33-48. https://acortar.link/NYpZuK

SMConectados. (2014). El sistema educativo no prepara a los alumnos para los grandes retos del siglo XXI. https://bit.ly/2yvEoTS

Tastle, W. y Wierman, M. (2007). Consensus and dissention: A measure of ordinal dispersion. International Journal of Approximate Reasoning, 45, 531-545. https://doi.org/10.1016/j.ijar.2006.06.024

Thomsom, B. (2004). Exploratory and confirmatory factor analysis. American Psychological Association.

UNESCO. (2017). Declaración de Buenos Aires: E2030: Educación y habilidades para el siglo 21. UNESCO.

Visauta, B. y Martori, J. C. (2003) Análisis estadístico con SPSS para Windows. Volumen II, Estadística multivariante. McGraw-Hill.

Wiersma, L. D. (2001). Conceptualization and development of the sources of enjoyment in youth sport questionnaire. Measurement in Physical Education and Exercise Science, 5(3), 153-177. https://doi.org/10.1207/s15327841mpee0503_3

Published

2024-09-19

How to Cite

Salamanca - Garay, I., & Sagredo - Lillo, E. (2024). Design and Validation of a Perception Instrument for Educational Communities on the Stimulation of 21st- Century Skills in Students within the School System. European Public & Social Innovation Review, 10, 1–16. https://doi.org/10.31637/epsir-2025-883

Issue

Section

Research articles