Virtual reality in the classroom: students' voices in the assessments of learning objects

Authors

DOI:

https://doi.org/10.31637/epsir-2026-2139

Keywords:

Assessment, Augmented Reality (AR), Extended Reality (XR), Virtual Reality (VR), Educational Technology, Usability, System Usability Scale, SUS

Abstract

Introduction: This study analyzes the usability and technical, aesthetic, and educational aspects of a virtual reality (VR) learning object, evaluated by university students. Methodology: A non-experimental, descriptive, and comparative design was used, with a quantitative and cross-sectional approach. 139 students from Pablo de Olavide University participated and evaluated two versions of the resource using the System Usability Scale (SUS) and a questionnaire on technical, aesthetic, and pedagogical dimensions. Results: Both versions received positive ratings, although version 1 obtained a higher average score on the SUS scale. Statistical analysis showed significant differences in usability (p = .023), but not in technical quality, aesthetics, ease of use, or educational usefulness. Discussion: The findings highlight the importance of a techno-pedagogical design focused on functionality, operational simplicity, and user experience, since better perceived usability may be related to more effective technical integration. Conclusions: Both versions are valid from a student perspective, but it is recommended to advance user-centered design strategies to enhance the educational value of virtual environments in higher education.

Downloads

Download data is not yet available.

Author Biographies

Julio Cabero-Almenara, Universidad de Sevilla

PhD in Educational Sciences. Professor of Didactics and School Organization at the University of Seville. Director of the Secretariat for Educational Innovation (US). Director of the Didactics Research Group. He has held five six-year research positions. He has given lectures at various Spanish, European, and Latin American universities. He has directed R&D&I projects such as teacher training in ICT, digital skills, and augmented and virtual reality. He has supervised 54 doctoral theses at various universities. He was co-director of the doctoral program "Training and Research in the Ibero-American Environment" at the Autonomous University of Tamaulipas (Mexico) and the Juan Michael Saracho University (Bolivia). He was director of the doctoral program in Education at the Department of Didactics and School Organization at the following universities: Moderna (Portugal), Metropolitana, and Carobobo (Venezuela).

Luisa Torres Barzabal, Universidad Pablo de Olavide

Professor in the Department of Education and Social Psychology at the Pablo de Olavide University of Seville and PhD in Educational Sciences. A member of the GEDUPO (SEJ457) research group, she has focused her work on teacher training, social education teaching, educational technology, and the evaluation of training materials. She has participated in R&D&I projects on digital competence, virtual environments, and extended reality. She has supervised four doctoral theses and two in progress. She is currently Academic Director of the Bachelor's Degree in Social Education and teaches in the Bachelor's Degrees in Social Education, Social Work and its double degree, and in the Master's Degree in Education for Development, Social Awareness, and Culture of Peace. She has held various academic management positions.

Almudena Martínez Gimeno, Universidad Pablo de Olavide

PhD in Educational Sciences. Associate Professor in the Department of Education and Social Psychology at the University of Puerto Rico (UPO, Seville). She has participated in various Master's programs and coordinates the module "Evaluation, Quality, and Innovation in Educational Institutions" in the Master's program "Education for Development, Social Awareness, and Culture of Peace" (UPO), where she served as a member of the Academic Committee as Quality Assured. She is a member of GEDUPO (SEJ457). A visiting professor at UNAN Managua since 2013, she is a member of the Academic Council of the first official doctoral program at the Public University of Nicaragua (UNAN Managua), called "Doctorate in Education in Social Intervention." She supervised three doctoral theses in the field of "Evaluation, Quality, and Innovation in University Teaching."

References

Ainscow, M. y Miles, S. (2008). Por una educación para todos que sea inclusiva: ¿Hacia dónde vamos ahora? Perspectivas, 38(1), 17-44.

AlGerafi, M. A. M., Zhou, Y., Oubibi, M. y Wijaya, T. (2023). Unlocking the Potential: A Comprehensive Evaluation of Augmented Reality and Virtual Reality in Education. Electronics, 12, 3953. https://doi.org/10.3390/electronics12183953 DOI: https://doi.org/10.3390/electronics12183953

Barroso, J. y Cabero, J. (2016). Evaluación de objetos de aprendizaje en Realidad Aumentada: estudio piloto en el grado de Medicina. Enseñanza & Teaching, 34(2), 149-167. https://doi.org/10.14201/et2016342149167 DOI: https://doi.org/10.14201/et2016342149167

Brooke, J. (1996). SUS: A “quick and dirty” usability scale. En P. Jordan, B. Thomas y B. Weerdmeester (Eds.), Usability evaluation in industry (pp. 189-194). Taylor & Francis.

Brooke, J. (2013). SUS: A retrospective. Journal of Usability Studies, 8(2), 29-40.

Cabero-Almenara, J., Miravete Gracia, M., Serrano Hidalgo, M. y Núñez Domínguez, T. (2025). Evaluación de objetos de Realidad Virtual en la educación: análisis de la usabilidad y aspectos técnicos y estéticos por estudiantes. Hachetetepé. Revista científica De Educación Y Comunicación, 30, 1101. https://doi.org/10.25267/Hachetetepe.2025.i30.1101 DOI: https://doi.org/10.25267/Hachetetepe.2025.i30.1101

Cabero-Almenara, J. y Valencia-Ortiz, R. (2021). Reflecting on educational research in ICT. Innovaciones Educativas, 23(Especial), 7-11. https://doi.org/10.22458/ie.v23iEspecial.3761 DOI: https://doi.org/10.22458/ie.v23iEspecial.3761

Cabero-Almenara, J., Llorente-Cejudo, C. y Gutiérrez-Castillo, J. J. (2017). Evaluación por y desde los usuarios: objetos de aprendizaje con Realidad aumentada. Revista de Educación a Distancia (RED), 17(53). https://revistas.um.es/red/article/view/289521 DOI: https://doi.org/10.6018/red/53/4

Cahuasa, P. B. (2023). Seis experiencias de realidad virtual y realidad aumentada en el aula. Unifranz Internacionalizaté. Innovación en Educación. http://bit.ly/3SFBkxE

Campbell, D. T. y Stanley, J. C. (1963). Experimental and quasi-experimental designs for research on teaching. Rand McNally.

Campo-Prieto, P., Cancela, J. M., Machado, I. y Rodríguez-Fuentes, G. (2021). Realidad Virtual Inmersiva en personas mayores: estudio de casos. Retos, 39, 101-105. DOI: https://doi.org/10.47197/retos.v0i39.78195

Castilla, D., Jaén, I., Suso-Ribera, C., García-Soriano, G., Zaragoza, I., Breton-López, J., Mira, A., Diaz-García, A. y García-Palacios, A. (2023). Psychometric Properties of the Spanish Full and Short Forms of the System Usability Scale (SUS): Detecting the Effect of Negatively Worded Items. International Journal of Human–Computer Interaction, 40(15), 4145-4151. doi.org/10.1080/10447318.2023.2209840 DOI: https://doi.org/10.1080/10447318.2023.2209840

Cheah, W., Mat, N. Thwe, M. y Amin, A. (2022). Mobile Technology in Medicine: Development and Validation ofan Adapted System Usability Scale (SUS)Questionnaire and Modified Technology Acceptance Model (TAM) to Evaluate User Experience and Acceptability of a Mobile Application in MRI Safety Screening. Indian Journal o Radiology and Imaging, 33(1), 37-45. https://doi.org/10.1055/s-0042-1758198 DOI: https://doi.org/10.1055/s-0042-1758198

Codina, V. y Rodríguez, M. (2020). Codiseño de Objetos de Aprendizaje OA como estrategia de capacitación a docentes de Educación Superior. Edutec. Revista Electrónica De Tecnología Educativa, 74, 114-126. https://doi.org/10.21556/edutec.2020.74.1765 DOI: https://doi.org/10.21556/edutec.2020.74.1765

Cuesta, U. y Mañas, L. (2016). Integración de la realidad virtual inmersiva en los Grados de Comunicación. Icono 14. Revista de Comunicación Audiovisual y Nuevas Tecnologías, 14(2), 1-21. https://doi.org/10.7195/ri14.v14i2.953 DOI: https://doi.org/10.7195/ri14.v14i2.953

Cummings, J. J. y Bailenson, J.N. (2015). How immersive is enough? A meta-analysis of the effect of immersive technology on user presence. Media Psychology, 19(2), 272-309. https://doi.org/10.1080/15213269.2015.1015740 DOI: https://doi.org/10.1080/15213269.2015.1015740

Davis, F. D. (1989). Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology. MIS Quarterly, 13(3), 319-340. https://doi.org/10.2307/249008 DOI: https://doi.org/10.2307/249008

Deci, E. L. y Ryan, R. M. (2000). The “what” and “why” of goal pursuits: Human needs and the self-determination of behavior. Psychological Inquiry, 11(4), 227-268. DOI: https://doi.org/10.1207/S15327965PLI1104_01

Devin, F. (2017). Sistema de Escalas de Usabilidad: ¿qué es y para qué sirve? UUXpañol. https://acortar.link/TorfBD

Etikan, I., Musa, S. A. y Alkassim, R.S. (2016). Comparison of convenience sampling and purposive sampling. American Journal of Theoretical and Applied Statistics, 5(1), 1-4. https://doi.org/10.11648/j.ajtas.20160501.11 DOI: https://doi.org/10.11648/j.ajtas.20160501.11

Fink, M., Eisenlauer, V. y Ertl, B. (2023). What variables are connected with system usability and satisfaction? Results from an educational virtual reality field trip. Computers & Education: X Reality, 3, 100043. https://doi.org/10.1016/j.cexr.2023.100043 DOI: https://doi.org/10.1016/j.cexr.2023.100043

Fokides, E. y Antonopoulos, P. (2024). Development and testing of a model for explaining learning and learning-related factors in immersive virtual reality. Computers & Education: X Reality, 4, 100048. https://doi.org/10.1016/j.cexr.2023.100048 DOI: https://doi.org/10.1016/j.cexr.2023.100048

Fondón-Ludeña, A. (2024). Metacognición y pensamiento crítico en la sociedad de la Inteligencia Artificial: del aula a la sociedad. European Public & Social Innovation Review, 9, 1–19. https://doi.org/10.31637/epsir-2024-492 DOI: https://doi.org/10.31637/epsir-2024-492

Gimeno, S. (2018). Cinco formas de interpretar un SUS. Torresburriel, https://torresburriel.com/weblog/cinco-formas-de-interpretar-un-sus/

Gómez-Galán, J. (2017). Nuevos estilos de enseñanza en la era de la convergencia tecno-mediática: hacia una educación holística e integral. IJERI: International Journal of Educational Research and Innovation, 8, 60-78. https://www.upo.es/revistas/index.php/IJERI/article/view/2601

Gronier, G. y Baudet, A. (2021). Psychometric Evaluation of the F-SUS: Creation and Validation of the French Version of the System Usability Scale. International Journal of Human–Computer Interaction, 37(16), 1571-1582, doi.org/10.1080/10447318.2021.1898828 DOI: https://doi.org/10.1080/10447318.2021.1898828

Kortum, P. T. y Bangor, A. (2013). Usability Ratings for Everyday Products Measured With the System Usability Scale. International Journal of Human–Computer Interaction, 29(2),

67-76. https://doi.org/10.1080/10447318.2012.681221 DOI: https://doi.org/10.1080/10447318.2012.681221

Lewis, J. (2018). The System Usability Scale: Past, Present, and Future. International Journal of Human–Computer Interaction, 34(7), 577-590, doi.org/10.1080/10447318.2018.1455307 DOI: https://doi.org/10.1080/10447318.2018.1455307

Lirola-Sabater, F. R. y Péres-Garcias, A. (2020). La usabilidad percibida por los docentes de la Formación Profesional a distancia en las Islas Baleares. Pixel-Bit. Revista De Medios Y Educación, 59, 183-200. doi.org/10.12795/pixelbit.76299 DOI: https://doi.org/10.12795/pixelbit.76299

Mohamad, M., Yaacob, N. y Yaacob, N. (2018). Translation, Cross-Cultural Adaptation, and Validation of the Malay Version of the System Usability Scale Questionnaire for the Assessment of Mobile Apps. JMIR Human Factors, 5(2), e10308. https://doi.org/10.2196/10308 DOI: https://doi.org/10.2196/10308

Mota, A. y Turrin, R. (2022). Evaluación de la usabilidad de una aplicación móvil para pacientes con catéter central de inserción periférica. Rev. Latino-Am. Enfermagem, 30, e3666, doi.org/10.1590/1518-8345.5817.3666 DOI: https://doi.org/10.1590/1518-8345.5817.3665

Muñoz-Saavedra, L., Miró-Amarante, L. y Domínguez-Morales, M. (2020). Augmented and Virtual Reality Evolution and Future Tendency. Applied Sciences, 10(1), 322. https://doi.org/10.3390/app10010322 DOI: https://doi.org/10.3390/app10010322

Ong, A. K. S., Prasetyo, Y. T., Robas, K. P. E., Persada, S. F., Nadlifatin, R., Matillano, J. S. A., Macababbad, D. C. B., Pabustan, J. R. y Taningco, K. A. C. (2023). Determination of Factors Influencing the Behavioral Intention to Play “Mobile Legends: Bang-Bang” during the COVID-19 Pandemic: Integrating UTAUT2 and System Usability Scale for a Sustainable E-Sport Business. Sustainability, 15(4), 3170. https://doi.org/10.3390/su15043170 DOI: https://doi.org/10.3390/su15043170

Ortega-Rodríguez, P. J. (2022). De la Realidad Extendida al Metaverso: una reflexión crítica sobre las aportaciones a la educación. Teoría de la Educación. Revista Interuniversitaria, 34(2), 189-208. https://doi.org/10.14201/teri.27864 DOI: https://doi.org/10.14201/teri.27864

Otero, A. y Flores, J. (2011). Realidad virtual: Un medio de comunicación de contenidos. Aplicación como herramienta educativa y factores de diseño e implantación en museos y espacios públicos. Icono 14. Revista de Comunicación Audiovisual y Nuevas Tecnologías, 9(2), 185-211. https://doi.org/10.7195/ri14.v9i2.28 DOI: https://doi.org/10.7195/ri14.v9i2.28

Palazón Conca, J. A. (2025). Igualdad de género en el aula a través de las TIC: una experiencia en Educación Primaria. Revista De Estudios Pedagógicos Contemporáneos, 1(1),

1-20. https://doi.org/10.5281/zenodo.16328469

Palinkas, L. A., Horwitz, S. M., Green, C. A., Wisdom, J. P., Duan, N. y Hoagwood, K. (2015). Purposeful sampling for qualitative data collection and analysis in mixed method implementation research. Administration and Policy in Mental Health and Mental Health Services Research, 42, 533-544. https://doi.org/10.1007/s10488-013-0528-y DOI: https://doi.org/10.1007/s10488-013-0528-y

Pedrosa, M. (2022). ¿La usabilidad puede medirse? Escala SUS y test de usuario. Flat101, https://bit.ly/4kVW6oD

Pimentel-Elbert, M. J., Zambrano-Mendoza, B. M., Mazzini-Aguirre, K. A. y Villamar-Cárdenas, M. A. (2023). Realidad virtual, realidad aumentada y realidad extendida en la educación. RECIMUNDO: Revista Científica de la Investigación y el Conocimiento, 7(2),

74-88. https://doi.org/10.26820/recimundo/7.(2).jun.2023.74-88 DOI: https://doi.org/10.26820/recimundo/7.(2).jun.2023.74-88

Radianti, J., Majchrzak, T., Fromm, J. y Wohlgenannt, I. (2020). A systematic review of immersive virtual reality applications for higher education: Design elements, lessons learned, and research agenda. Computers & Education, 147, 103778, 1-19. https://doi.org/10.1016/j.compedu.2019.103778 DOI: https://doi.org/10.1016/j.compedu.2019.103778

Rodríguez, R. y del Valle, J. A. (2021). Usabilidad de un LMS institucional en el contexto de la Enseñanza Remota de Emergencia. RIEE | Revista Internacional De Estudios En Educación, 21(2), 47-61. https://doi.org/10.37354/riee.2021.212r DOI: https://doi.org/10.37354/riee.2021.212r

Sauro, J. y Lewis, J. R. (2016). Quantifying the user experience: Practical statistics for user research (2nd ed.). Morgan Kaufmann. DOI: https://doi.org/10.1016/B978-0-12-802308-2.00002-3

Schrepp, M., Kollmorgen, J. y Thomaschewski, J. (2023). A Comparison of SUS, UMUX-LITE, and UEQ-S. Journal of User Experience, 18(2), 86-104.

Shadish, W. R., Cook, T. D. y Campbell, D. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Houghton Mifflin.

Silva, C. y Turrini, R. (2019). Development of an educational mobile application for patients submitted to orthognathic surgery. Revista. Latino-Americana. Enfermagem, 27, e3143.

https://doi.org/10.1590/1518-8345.2904.3143 DOI: https://doi.org/10.1590/1518-8345.2904.3143

Stufflebeam, D. L. y Shinkfield, A. J. (2007). Evaluation theory, models, and applications. Jossey-Bass.

Universidad de Barcelona (2024). Realidad Virtual aplicada a la docencia para luchar contra las desigualdades de género. UB.Edu. https://acortar.link/73jWUb

Valarezo-Guzmán, G. E., Sánchez-Castro, X. E., Bermúdez-Gallegos, C. y García-Alay, R. (2023). Simulación y realidad virtual aplicadas a la educación. RECIMUNDO, 7(1),

432-444. https://doi.org/10.26820/recimundo/7.(1).enero.2023.432-444 DOI: https://doi.org/10.26820/recimundo/7.(1).enero.2023.432-444

Vera, G., Ortega, J. A. y Burgos, M. A. (2003). La realidad virtual y sus posibilidades didácticas. Etic@net. Revista científica electrónica de Educación y Comunicación en la Sociedad del Conocimiento, 2, 1–17. https://ugr.es/~sevimeco/revistaeticanet/Numero2/Articulos/Realidadvirtual.pdf

Vlachogianni, P. y Tselios, N. (2021). Perceived usability evaluation of educational technology using the System Usability Scale (SUS): A systematic review. Journal of Research on Technology in Education, 54(3), 392-409. https://doi.org/10.1080/15391523.2020.1867938 DOI: https://doi.org/10.1080/15391523.2020.1867938

Published

2025-10-28

How to Cite

Cabero-Almenara, J., Torres Barzabal, L., & Martínez Gimeno, A. (2025). Virtual reality in the classroom: students’ voices in the assessments of learning objects. European Public & Social Innovation Review, 11, 1–19. https://doi.org/10.31637/epsir-2026-2139

Issue

Section

Cover articles

Funding data