Diseño de una herramienta para la evaluación de competencias transversales en la Educación Superior

Daniel Martínez Caballé; Beatriz Amante García; Nuria Salán Ballesteros

doi:10.31637/epsir-2024-1011

Authors

Daniel Martínez Caballé Polytechnic University of Catalonia https://orcid.org/0009-0002-8950-3474
Beatriz Amante García Polytechnic University of Catalonia https://orcid.org/0000-0001-5231-1706
Nuria Salán Ballesteros Polytechnic University of Catalonia https://orcid.org/0000-0001-9323-8883

DOI:

https://doi.org/10.31637/epsir-2024-1011

Keywords:

Teaching innovation; Evaluation, Transversal skills, Higher Education, Educational Software, Chat GPT-4, Portfolio, Rubric

Abstract

Introduction: The adaptation of higher education to the new framework established by the Bologna plan has involved numerous methodological and evaluative changes, which are mainly focused on the development of student competencies. Many of these changes have been implemented in Spanish universities, but the evaluation of competencies is a pending issue, although commitments have been sought to facilitate it. One of the keys to competency evaluation is knowing how said evaluation will be carried out and which instrument will be the most appropriate. Methodology: A search has been carried out in the Web of Knowledge database covering from 2016 to 2023, to determine which competency assessment instruments are most used and easy to implement. Results:. The most notable have been the portfolios and rubrics. Discussions: In addition to knowing the instrument that we will use, we must analyze what evidence will be used and how it will be collected. The design of a tool for this purpose is proposed following some of the principles of Agile methodologies. Conclusions: Its development would allow us to evaluate the competency level of the students throughout their studies and have access to the different evidence that demonstrates the achievement of these competencies.

Downloads

Download data is not yet available.

Author Biographies

Daniel Martínez Caballé, Polytechnic University of Catalonia

Chemical Engineer from the University of Barcelona in 2002 and Master in Experimental Chemical Engineering in 2004. He has developed his entire professional career in the field of formal and non-formal teaching, scientific dissemination and pedagogical innovation. In the period 2005-2007 he worked as an associate professor in the Department of Chemical Engineering of the University of Barcelona and since 2019 he has been a doctoral student at the Polytechnic University of Catalonia (UPC).

Beatriz Amante García, Polytechnic University of Catalonia

PhD from the École Nationale Superieure des Télécommunications in Paris in 2002. She is currently an associate professor in the Department of Project and Construction Engineering at the UPC. He has taught classes at Telecom Paris and at the Paris XII University. Between 2003-2006 she was a professor at the European University of Madrid and director of the Telecommunications Department in the last school year. He has given and teaches training in different areas such as Electronics, Electricity, Radio Systems and Engineering Projects. In recent years and mainly focused on the automotive sector, it has carried out life cycle analysis, battery aging and business model studies.

Nuria Salán Ballesteros, Polytechnic University of Catalonia

Professor and deputy director of the ESEIAAT and president of the Catalan Society of Technology. PhD in Materials Science and Metallurgical Engineering from the UPC. In 2000 she was secretary of the National Congress of Women and Engineering in Terrassa. He has collaborated in all editions of the UPC 'Donate Program' and participates in the 'Here STEAM UPC' program. In June 2011 she was appointed Academic Coordinator of the UPC Gender Program and at the beginning of the 2013-2014 academic year she promoted the M2M Mentoring program. In 2017 she received the 'Woman and Technology' Award and in 2019 she received the Special Mention for Women ICT Spreader and the 1st Prize for Social Commitment-Gender Equality from the UPC.

References

Alcón, M. y Menéndez, J. L. (2018). El diseño de rúbricas: algunos aspectos claves. Observar, 12, 1-19. https://www.observar.eu/ojs/index.php/Observar/article/view/91

Alt, D. (2016). Contemporary constructivist practices in higher education settings and academic motivational factors. Australian Journal of Adult Learning, 56(3), 374-399. https://acortar.link/5Bfupn

Almulla, M. A. (2023). Constructivism learning theory: A paradigm for students’ critical thinking, creativity, and problem solving to affect academic performance in higher education. Cogent Education, 10(1). http://dx.doi.org/10.1080/2331186X.2023.2172929 DOI: https://doi.org/10.1080/2331186X.2023.2172929

Amante, B., Romero, C., Coromines, A., Franch, J., Gragera, D., Vila, M. y Marín, LL. (2019). Planteamiento de gamificación para una formación de cinemática de sistemas mecánicos. Actas del Vigesimoséptimo Congreso Universitario de Innovación Educativa en las Enseñanzas Técnicas. Alcoy.

Baleni, Z. (4-6 de julio de 2016). The role of technology in a constructivist classroom. Actas de Edulearn16: 8th International Conference on Education and new Learning Technologies, Barcelona, España. http://dx.doi.org/10.21125/edulearn.2016.0138 DOI: https://doi.org/10.21125/edulearn.2016.0138

Beckers, J., Dolmans, D. y Van Merriënboer, J. (2016). e-Portfolios enhancing students’ self-directed learning: A systematic review of influencing factors. Australasian Journal of Educational Technology, 32(2), 32-46. http://dx.doi.org/10.14742/ajet.2528 DOI: https://doi.org/10.14742/ajet.2528

Bernardi, F. M. y Pazinato, M. S. (2022). The Case Study Method in Chemistry Teaching: A Systematic Review. Journal of Chemical Education, 99(3), 1211-1219. http://dx.doi.org/10.1021/acs.jchemed.1c00733 DOI: https://doi.org/10.1021/acs.jchemed.1c00733

Bloom, B., Engelhart, M., Furst, E., Hill, W. y Krathwohl, D. (1956). Taxonomy of Educational Objectives: The Classification of Educational Goals. Longmans.

Bodle, K. A., Malin, M. y Wynhoven, A. (2017). Students’ experience toward ePortfolios as a reflective assessment tool in a dual mode indigenous business course. Accounting Research Journal, 30(3), 333-350. http://dx.doi.org/10.1108/arj-06-2015-0089 DOI: https://doi.org/10.1108/ARJ-06-2015-0089

Burchart, M. y Haake, J. (2024). Supporting collaborative writing tasks in large-scale distance education. IEEE Transactions on Learning Technologies, 17, 1051-1068. http://dx.doi.org/10.1109/TLT.2024.3355791 DOI: https://doi.org/10.1109/TLT.2024.3355791

Cabrera, N., Portillo, M. C. y Prades, A. (2016). Las competencias de los graduados universitarios y su evaluación. La perspectiva de los empleadores. En E. Cano y M. Fernández, (Eds.), Evaluación por competencias: la perspectiva de las primeras promociones de graduados en el EEES (pp. 95-112). Octaedro.

Cano, E. y Fernández, M. (2016). Competencias de los egresados del Espacio Europeo de Educación Superior: relatos de vida de los nuevos estudiantes universitarios frente a los antiguos licenciados. REDU. Revista de docencia universitaria, 14(2), 187-203. http://dx.doi.org/10.4995/redu.2016.5933 DOI: https://doi.org/10.4995/redu.2016.5933

Cano, E. y Ion, G. (2016). Innovative Practices for Higher Education Assessment and Measurement. IGI Global. DOI: https://doi.org/10.4018/978-1-5225-0531-0

Cano, E. M., Pons, L. y Lluch, L. (2018). Análisis de experiencias de innovación docente universitarias sobre evaluación. Profesorado: Revista de Currículum y Formación de Profesorado, 22(4), 11-32. http://dx.doi.org/10.30827/profesorado.v22i4.8392 DOI: https://doi.org/10.30827/profesorado.v22i4.8392

Cardoso, I. N. A., Costa, C. J. S. A. y Mercado, L. P. L. (2023). Evaluation of learning using digital portfolios: An analysis of portfolios produced by students in Higher Education. Revista Ibero-Americana de Estudos em Educação, 18. http://dx.doi.org/10.21723/riaee.v18i00.17546 DOI: https://doi.org/10.21723/riaee.v18i00.17546

Chans, G. M. y Portuguez, M. (2021). Gamification as a Strategy to Increase Motivation and Engagement in Higher Education Chemistry Students. Computers, 10(132), 1-24. http://dx.doi.org/10.3390/computers10100132 DOI: https://doi.org/10.3390/computers10100132

Chen, H., Chen, J. y Chiang, F. K. (2024). A study on the influence of learning space on students’ intrinsic learning motivation. European Journal of Education. http://dx.doi.org/10.1111/ejed.12652 DOI: https://doi.org/10.1111/ejed.12652

Corujo-Vélez, M. C., Gómez del Castillo, M. T. y Merla-González, A. E. (2020). Constructivist and collaborative methodology mediated by ICT in higher education using webquest. Pixel-BIT. Revista de Medios y Educación, 57, 7-57. http://dx.doi.org/10.12795/pixelbit.2020.i57.01 DOI: https://doi.org/10.12795/pixelbit.2020.i57.01

Coutinho, K. S., Passerino, L. M., Henriques, R. B. y Avila, M. M. (2018). Práticas pedagógicas inovadoras no ensino universitário: uma análise da motivação e da percepção dos alunos. Educação Por Escrito, 9(2), 310-330. http://dx.doi.org/10.15448/2179-8435.2018.2.31594 DOI: https://doi.org/10.15448/2179-8435.2018.2.31594

Cubero, J., Ibarra, M. S. y Rodríguez, G. (2018). Propuesta metodológica de evaluación para evaluar competencias a través de tareas complejas en entornos virtuales de aprendizaje. Revista de Investigación Educativa, 36(1), 159-184. https://doi.org/10.6018/rie.36.1.278301 DOI: https://doi.org/10.6018/rie.36.1.278301

De la Fe, C., Vidaurreta, I., Gómez, A. y Corrales, J. C. (2015). El método de estudio de casos: Una herramienta docente válida para la adquisición de competencias. Revista Electrónica Interuniversitaria de Formación del Profesorado, 18(3), 127-136. http://dx.doi.org/10.6018/reifop.18.3.239001 DOI: https://doi.org/10.6018/reifop.18.3.239001

De la Torre, J. M., Cordón, E., Hurtado, N., Delgado, B., Gómez, S., Ortiz, N. y Delgado, J. (2021). Habilidades blandas en ingenierías informáticas y de telecomunicaciones. Kit-Book Servicios Editoriales, S.C.P.

Domene-Martos, S., Rodríguez-Gallego, M., Caldevilla-Domínguez, D. y Barrientos-Báez, A. (2021). The Use of Digital Portfolio in Higher Education before and during the COVID-19 Pandemic. International Journal of Environmental Research and Public Health, 18(20), 10904. https://doi.org/10.3390/ijerph182010904 DOI: https://doi.org/10.3390/ijerph182010904

Espinoza, E. E., Samaniego, R. L., Guamán, V. J. y Vélez, E. O. (2020). The cooperative methodology for learning. Revista Publicaciones, 50(2), 41-58. http://dx.doi.org/10.30827/publicaciones.v50i2.13942 DOI: https://doi.org/10.30827/publicaciones.v50i2.13942

European Commission/EACEA/Eurydice (2024). The European Higher Education Area in 2024: Bologna Process Implementation Report. Publications Office of the European Union. http://dx.doi.org/10.2797/63509

Expósito-Langa, M., Nicolau-Juliá, D. y Tomás-Miquel, J.V. (2017). La evaluación por competencias en los grados. Desarrollo de una experiencia en el Grado en Administración y Dirección de Empresas mediante el uso y validación de rúbrica. Revista Complutense de Educación, 28(4), 1155-1171. http://dx.doi.org/10.5209/RCED.51618 DOI: https://doi.org/10.5209/RCED.51618

Falloon, G. (2020). From digital literacy to digital competence: the teacher digital competency (TDC) framework. Educational Technology Research and Development, 68, 2449-2472. http://dx.doi.org/10.1007/s11423-020-09767-4 DOI: https://doi.org/10.1007/s11423-020-09767-4

Feo, R. (2023). Competencia digital docente: Experiencia formativa para la educación superior. Revista Ciencias Pedagógicas e Innovación, 10(2), 74-86. http://dx.doi.org/10.26423/rcpi.v10i2.626 DOI: https://doi.org/10.26423/rcpi.v10i2.626

Fernández, E., Leiva-Olivencia, J. J. y López-Meneses, E. (2018). Competencias digitales en docentes de Educación Superior. Revista Digital de Investigación en Docencia, 12(1), 213-231. http://dx.doi.org/10.19083/ridu.12.558 DOI: https://doi.org/10.19083/ridu.12.558

González-Calatayud, V., Prendes-Espinosa, P. y Roig-Vila, R. (2021). Artificial Intelligence for Student Assessment: A Systematic Review. Applied Sciences, 11, 5467. https://doi.org/10.3390/app11125467 DOI: https://doi.org/10.3390/app11125467

González, N. y Martínez, P. (2020). Relevancia de las competencias transversales en el desarrollo profesional del futuro graduado. Profesorado. Revista de Currículum y Formación de Profesorado, 24(2), 388-413. http://dx.doi.org/10.30827/profesorado.v24i2.15041 DOI: https://doi.org/10.30827/profesorado.v24i2.15041

González, J. y Wagenaar, R. (2003). Tuning Educational Structures in Europe. Informe final Fase Uno. Universidad de Deusto.

González, J. y Wagenaar, R. (2008). Universities’ contribution to the Bologna Process. An introduction. Universidad de Deusto.

Hasanein, A. M. y Sobaih, A. E. E. (2023). Drivers and Consequences of ChatGPT Use in Higher Education: Key Stakeholder Perspectives. European Journal of Investigation in Health, Psychology and Education, 13, 2599-2614. http://dx.doi.org/10.3390/ejihpe13110181 DOI: https://doi.org/10.3390/ejihpe13110181

Jin Cho, H., Zhao, K., Rong Lee, C., Runshe, D. y Krousgrill, C. (2021). Active learning through flipped classroom in mechanical engineering: improving students’ perception of learning and performance. International Journal of STEM Education, 8(46), 1-13. http://dx.doi.org/10.1186/s40594-021-00302-2 DOI: https://doi.org/10.1186/s40594-021-00302-2

Jönsson, A. y Panadero, E. (2016). The Use and Design of Rubrics to Support Assessment for Learning. En D. Carless, S. Bridges, C. Chan y R. Glofcheski (Eds.), Scaling up Assessment for Learning in Higher Education (pp. 99-111). Springer. https://doi.org/10.1007/978-981-10-3045-1 DOI: https://doi.org/10.1007/978-981-10-3045-1_7

Kay, D. y Kibble, J. (2016). Learning theories 101: application to everyday teaching and scholarship. Advances in Physiology Education, 40, 17-25. http://dx.doi.org/10.1152/advan.00132.2015 DOI: https://doi.org/10.1152/advan.00132.2015

Khamitova, A. (2023). Innovative Learning Spaces of Higher Education: a Systematic Mapping Review of Themes. TechTrends, 67(1). http://dx.doi.org/10.1007/s11528-023-00892-4 DOI: https://doi.org/10.1007/s11528-023-00892-4

Kimmons, R. y Caskurlu, S. (2020). The Students’ Guide to Learning Design and Research. EdTech Books. DOI: https://doi.org/10.59668/10

Li, C., Garza, T., Zhang, S. y Jiang, Y. (2023). Constructivist learning environment and strategic learning in engineering education. Learning Environments Research, 26, 743-759. http://dx.doi.org/10.1007/s10984-022-09450-w DOI: https://doi.org/10.1007/s10984-022-09450-w

Lluch, L., Fernández-Ferrer, M., Pons, L. y Cano, E. (2017). Competencias profesionales de los egresados universitarios: estudio de casos en cuatro titulaciones. Curriculum, 30, 49-64. https://riull.ull.es/xmlui/handle/915/6135

Lluch, L. y Portillo, M.C. (2018). La competencia de aprender a aprender en el marco de la educación superior. Revista Iberoamericana de Educación, 78(2), 59-76. http://dx.doi.org/10.35362/rie7823183 DOI: https://doi.org/10.35362/rie7823183

Martínez, M., Amante, B., Cadenato, A. y Gallego, I. (2012). Assessment tasks: center of the learning process. Procedia - Social and Behavioral Sciences, 46, 624-628. http://dx.doi.org/10.1016/j.sbspro.2012.05.174 DOI: https://doi.org/10.1016/j.sbspro.2012.05.174

Mogas, J., Cea, A. M. y Pazos-Justo, C. (2023). The Contribution of Digital Portfolios to Higher Education Students’ Autonomy and Digital Competence. Education Sciences, 13(8). http://dx.doi.org/10.3390/educsci13080829 DOI: https://doi.org/10.3390/educsci13080829

Morales, R. y Villa, C. (2019). Juegos de rol para la enseñanza de las matemáticas. Education in The Knowledge Society, 20. https://doi.org/10.14201/eks2019_20_a7 DOI: https://doi.org/10.14201/eks2019_20_a7

Moreno-Fernández, O. y Moreno-Crespo, P. (2017). El portfolio digital como herramienta didáctica: una evaluación crítica de fortalezas y debilidades. Revista de Humanidades, 30, 11-30. http://dx.doi.org/10.5944/rdh.30.2017.18200 DOI: https://doi.org/10.5944/rdh.30.2017.18200

Naidoo, J. y Sarasvathie, R. (2023). Embedding Sustainable Mathematics Higher Education in the Fourth Industrial Revolution Era Post‐COVID‐19: Exploring Technology‐Based Teaching Methods. Sustainability, 15(12). https://doi.org/10.3390/su15129692 DOI: https://doi.org/10.3390/su15129692

OECD. (2016). La naturaleza del aprendizaje: usando la investigación para inspirar la práctica. Entornos, 29(2), 467-468. http://dx.doi.org/10.25054/01247905.1608 DOI: https://doi.org/10.25054/01247905.1608

Organización Internacional del Trabajo (OIT). (2015). Tendencias mundiales del empleo juvenil 2015. Promover la inversión en empleos decentes para los jóvenes. Ginebra, Suiza.

Osés, A., Gorjón, L. y De la Rica, S. (2022). El futuro del colectivo universitario: calidad del empleo y competencias. Informe ISEAK 2022/1. Universidad Internacional de Andalucía. Recuperado de https://acortar.link/higHuZ

Pacagnella, A. C., y Da Silva, V. R. (2023). 20 years of the Agile Manifesto: A Literature Review on Agile Project Management. Management and Production Engineering Review, 14(2), 37-48. http://dx.doi.org/10.24425/mper.2023.146021 DOI: https://doi.org/10.24425/mper.2023.146021

Pang, T., Kootsookos, A., Fox, K. y Pirogova, E. (2022). Does an assessment rubric provide a better learning experience for undergraduates in developing transferable skills?. Journal of University Teaching & Learning Practice, 19(3). https://ro.uow.edu.au/jutlp/vol19/iss3/03 DOI: https://doi.org/10.53761/1.19.3.03

Pospíšilová, L. y Rohlíková, L. (2023). Reforming higher education with ePortfolio implementation, enhanced by learning analytics. Computers in Human Behavior, 138. http://dx.doi.org/10.1016/j.chb.2022.107449 DOI: https://doi.org/10.1016/j.chb.2022.107449

Prieto, J. R., Alarcón, D. y Fernández, C. B. (2018). Aprendizaje y evaluación de competencias en el alumnado universitario de Ciencias Sociales. REDU: Revista de Docencia Universitaria, 16(1), 193-210. http://dx.doi.org/10.4995/redu.2018.8941 DOI: https://doi.org/10.4995/redu.2018.8941

Rodríguez, G., Ibarra, M. S. y Cubero, J. (2018). Competencias básicas relacionadas con la evaluación. Un estudio sobre la percepción de los estudiantes universitarios. Educación XXI, 21(1), 181-208. https://doi.org/10.5944/educxx1.20184 DOI: https://doi.org/10.5944/educxx1.20184

Sandoval, V. C., Marín, M. B. y Barrios, T. (2021). El aula invertida como estrategia didáctica para la generación de competencias: una revisión sistemática. Revista Iberoamericana de Educación a Distancia, 24(2), 285-308. http://dx.doi.org/10.5944/ried.24.2.29027 DOI: https://doi.org/10.5944/ried.24.2.29027

Sakulvirikitkul, P., Sintanakul, K. y Srisomphan, J. (2020). The Design of a Learning Process for Promoting Teamwork using Project-Based Learning and the Concept of Agile Software Development. International Journal of Emerging Technologies in Learning, 15(3), 207-222. https://doi.org/10.3991/ijet.v15i03.10480 DOI: https://doi.org/10.3991/ijet.v15i03.10480

Saxena, M. y Mishra, D. K. (2021). Gamification and Gen Z in Higher Education: A Systematic Review of Literature. International Journal of Information and Communication Technology Education, 17(4), 1-22. http://dx.doi.org/10.4018/IJICTE.20211001.oa10 DOI: https://doi.org/10.4018/IJICTE.20211001.oa10

Schophuizen, M. y Kalz, M. (2020). Educational innovation projects in Dutch higher education: bottom-up contextual coping to deal with organizational challenges. International Journal of Educational Technology in Higher Education, 17. http://dx.doi.org/10.1186/s41239-020-00197-z DOI: https://doi.org/10.1186/s41239-020-00197-z

Sfez, R. (2023). An interactive platform for formative assessment and immediate feedback in laboratory courses. Chemistry Teacher International. http://dx.doi.org/10.1515/cti-2022-0049 DOI: https://doi.org/10.1515/cti-2022-0049

Shaughnessy, A. F. y Erlich, D. R. (2022). The science of education: using learning theory to solve teaching problems in medical education. Education for Primary Care, 33(4), 194-198. http://dx.doi.org/10.1080/14739879.2022.2053344 DOI: https://doi.org/10.1080/14739879.2022.2053344

Shé, C. N., Mac an Bhaird, C. y Fhloinn, E. N. (2023). Factors that influence student engagement with technology-enhanced resources for formative assessments in first-year undergraduate mathematics. International Journal of Mathematical Education in Science and Technology, 1-19. http://dx.doi.org/10.1080/0020739X.2023.2182725 DOI: https://doi.org/10.1080/0020739X.2023.2182725

Smart, V., Sim, C. y Finger, G. (2015). Professional standards based digital portfolios vs. evidence based digital portfolios: Recommendations for creative, interesting and long-lasting digital portfolios. Actas de Society for Information Technology & Teacher Education International Conference (pp. 1875-1882). https://www.editli b.org/p/150256

Spector, J. M., Ifenthaler, D., Samspon, D., Yang, L., Mukama, E., Warusavitarana, A., Lokuge Dona, K., Eichhorn, K., Fluck, A., Huang, R., Bridges, S., Lu, J., Ren, Y., Gui, X., Deneen, C. C., San Diego, J. y Gibson, D. C. (2016). Technology Enhanced Formative Assessment for 21st Century Learning. Educational Technology & Society, 19(3), 58-71.

Stockert, R., Talmo, T. y Arnesen, K. (7-9 de marzo de 2016). Making space for pedagogy and technology. Experiences with design, implementation and use of a learning space at the norwegian university of science and technology. Actas de 10th International Technology, Education and Development Conference (INTED), Valencia, España. DOI: https://doi.org/10.21125/inted.2016.1683

Taylor, B., Kisby, F. y Reedy, A. (2024). Rubrics in higher education: an exploration of undergraduate students’ understanding and perspectives. Assessment & Evaluation in Higher Education. InPress. http://dx.doi.org/10.1080/02602938.2023.2299330 DOI: https://doi.org/10.1080/02602938.2023.2299330

Torres-Barreto, M.L., Álvarez-Melgarejo, M., y Plata-Gómez, K.R. (2021). Competencias transversales en ingenierías: una aproximación desde los principios de gamificación. Panorama, 15(28). https://doi.org/10.15765/pnrm.v15i28.1820 DOI: https://doi.org/10.15765/pnrm.v15i28.1820

Tur, G., Urbina, S. y Forteza, D. (2019). Rubric-based Formative Assessment in Process Eportfolio: Towards Self-regulated Learning. Digital Education Review, 35, 18-35. https://doi.org/10.1344/der.2019.35.18-35 DOI: https://doi.org/10.1344/der.2019.35.18-35

Vallés, C., Martínez, L. y Romero, M.R. (2018). Instrumentos de Evaluación: Uso y Competencia del Profesorado Universitario en su Aplicación. Estudios Pedagógicos, 44(2), 149-169. https://doi.org/10.4067/s0718-07052018000200149 DOI: https://doi.org/10.4067/S0718-07052018000200149

Villanueva, K. A., Brown, S. A., Pitterson, N. P., Hurwitz, D. S. y Sitomer, A. (2017). Teaching Evaluation Practices in Engineering Programs: Current Approaches and Usefulness. International Journal of Engineering Evaluation, 33(4), 1317-1334.

Wach, A. M. (2016). Constructivist Approach in Teaching in Higher Education. En A. Wach-Kąkolewicz y R. Muffoletto (Eds.), Perspectives on Computer Gaming in Higher Education (pp. 11-20). Bogucki Wydawnictwo Naukowe.