Challenges of impact assessment in Social Innovation: A qualitative study from two European rural regions: Desafíos de la evaluación de impacto en la Innovación Social: Un estudio cualitativo de dos regiones rurales europeas

Marina Novikova

doi:10.31637/epsir-2021-153

Autores/as

Marina Novikova ISCTE-IUL

DOI:

https://doi.org/10.31637/epsir-2021-153

Palabras clave:

social innovation, impact assessment, rural regions, local development initiatives, Austria, Portugal

Resumen

En los últimos años se han desarrollado diversos enfoques para evaluar los impactos de la innovación social (IS) sin que haya surgido un método uniforme. Existen algunas cuestiones en torno a la forma de evaluar los impactos, relacionadas con las preguntas sobre la naturaleza de los impactos, los niveles de análisis y los efectos de un enfoque puramente positivista de la evaluación de impactos. Al intentar evaluar dichos impactos, varias iniciativas de IS se enfrentan a la diversidad de desafíos. Para ello, el objetivo del artículo es investigar la experiencia de dichas iniciativas que promueven la innovación social en relación con la evaluación del impacto de la innovación social. El artículo se basa en un estudio empírico realizado con asociaciones de desarrollo local y grupos de acción local que participan en proyectos de innovación social en dos regiones rurales de Austria y Portugal. Los resultados indican que, a pesar de reconocer la importancia de la evaluación de impacto en relación con las actividades de innovación social y las oportunidades que ofrece, las organizaciones locales en cuestión se enfrentan a muchos retos a la hora de evaluar los impactos de la innovación social, incluyendo dificultades conceptuales y prácticas.

Palabras clave: innovación social; evaluación de impacto; regiones rurales; iniciativas de desarrollo local; Austria; Portugal.

Descargas

Los datos de descargas todavía no están disponibles.

Citas

Antadze, N., & Westley, F. R. (2012). Impact metrics for social innovation: Barriers or bridges to radical change? Journal of Social Entrepreneurship, 3(2), 133-150. https://doi.org/10.1080/19420676.2012.726005 DOI: https://doi.org/10.1080/19420676.2012.726005

Arena, M., Azzone, G., & Bengo, I. (2015). Performance measurement for social enterprises. VOLUNTAS: International Journal of Voluntary and Nonprofit Organizations, 26(2), 649-672. https://www.jstor.org/stable/43654699 DOI: https://doi.org/10.1007/s11266-013-9436-8

Arya, A., & Mittendorf, B. (2015). Supply chain consequences of subsidies for corporate social responsibility. Production and Operations Management, 24(8), 1346-1357. https://doi.org/10.1111/poms.12326 DOI: https://doi.org/10.1111/poms.12326

Avelino, F., Wittmayer, J. M., Pel, B., Weaver, P., Dumitru, A., Haxeltine, A., ... & O'Riordan, T. (2019). Transformative social innovation and (dis) empowerment. Technological Forecasting and Social Change, 145, 195-206. https://doi.org/10.1016/j.techfore.2017.05.002 DOI: https://doi.org/10.1016/j.techfore.2017.05.002

Avelino, F. (2021). Theories of power and social change. Power contestations and their implications for research on social change and innovation. Journal of Political Power, 1-24. https://doi.org/10.1080/2158379X.2021.1875307 DOI: https://doi.org/10.1080/2158379X.2021.1875307

Baturina, D., & Bežovan, G. (2015). Social innovation impact-review. Seventh Framework Programme, Third Sector Impact. Brussels.

BEPA. (2010). Empowering People, Driving Change. Social Innovation in the European Union. Bureau of European Policy Advisers and European Commission.

Bock, B. B. (2016). Rural marginalisation and the role of social innovation; a turn towards nexogenous development and rural reconnection. Sociologia Ruralis, 56(4), 552-573. https://doi.org/10.1111/soru.12119 DOI: https://doi.org/10.1111/soru.12119

Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative research in psychology, 3(2), 77-101. DOI: https://doi.org/10.1191/1478088706qp063oa

Bund, E., Gerhard, U., Hoelscher, M., & Mildenberger, G. (2015). A methodological framework for measuring social innovation. Historical Social Research/Historische Sozialforschung, 48-78.

Burdge, R. J., & Vanclay, F. (1996). Social impact assessment: a contribution to the state of the art series. Impact Assessment, 14(1), 59-86. https://doi.org/10.1080/07349165.1996.9725886 DOI: https://doi.org/10.1080/07349165.1996.9725886

Chatzichristos, G., & Nagopoulos, N. (2020). Regional Institutional Arenas for Social Innovation: mixed methods research. Journal of Social Entrepreneurship, 1-23. https://doi.org/10.1080/19420676.2019.1705378 DOI: https://doi.org/10.1080/19420676.2019.1705378

Clark, C., Rosenzweig, W., Long, D., & Olsen, S. (2004). Double Bottom Line Project Report: Assessing Social Impact in Double Line Ventures. New York. Available online at: http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.516.916&rep=rep1&type=pdf (accessed 21 November).

Cunha, J., & Benneworth, P. (2020). How to measure the impact of social innovation initiatives? International Review on Public and Nonprofit Marketing, 17(1), 59-75. https://doi.org/10.1007/s12208-019-00240-4 DOI: https://doi.org/10.1007/s12208-019-00240-4

Di Iacovo, F., Moruzzo, R., Rossignoli, C., & Scarpellini, P. (2014). Transition management and social innovation in rural areas: Lessons from social farming. The Journal of Agricultural Education and Extension, 20(3), 327-347. https://doi.org/10.1080/1389224X.2014.887761 DOI: https://doi.org/10.1080/1389224X.2014.887761

Ebrahim, A., & Rangan, V. K. (2010). The limits of nonprofit impact: A contingency framework for measuring social performance (No. 10-099). Harvard Business School. DOI: https://doi.org/10.2139/ssrn.1611810

Ebrahim, A., & Rangan, V. K. (2014). What impact? A framework for measuring the scale and scope of social performance. California management review, 56(3), 118-141. https://doi.org/10.1525/cmr.2014.56.3.118 DOI: https://doi.org/10.1525/cmr.2014.56.3.118

Epstein, M.J., & Yuthas, K. (2014). Measuring and improving social impacts: A guide for nonprofits, companies, and impact investors. Berrett-Koehler Publishers. Available online: https://www.bkconnection.com/static/Measuring_and_Improving_Social_Impacts_EXCERPT.pdf (accessed 23 April 2021).

European Commission. (2014). Proposed approaches to social impact measurement in European Commission legislation and in practice relating to EuSEFs and the EaSI: GECES sub-group on impact measurement. European Commission Publications Office. https://data.europa.eu/doi/10.2767/29691

Eurostat. (2019). Available online: https://ec.europa.eu/eurostat/statistics-explained/index.php/Archive:Rural_development_statistics_by_urban-rural_typology (accessed 12 December 2019).

Fougère, M., & Meriläinen, E. (2021). Exposing three dark sides of social innovation through critical perspectives on resilience. Industry and Innovation, 28(1), 1-18. https://doi.org/10.1080/13662716.2019.1709420 DOI: https://doi.org/10.1080/13662716.2019.1709420

Goldstein, J., Hazy, J. K., & Silberstang, J. (2010). A complexity science model of social innovation in social enterprise. Journal of social entrepreneurship, 1(1), 101-125. https://doi.org/10.1080/19420671003629763 DOI: https://doi.org/10.1080/19420671003629763

Grieco, C. (2015). Assessing social impact of social enterprises: Does one size really fit all? Springer. DOI: https://doi.org/10.1007/978-3-319-15314-8

Howaldt, J., Domanski, D., & Kaletka, C. (2016). Social innovation: Towards a new innovation paradigm. RAM. Revista de Administração Mackenzie, 17(6), 20-44. https://doi.org/10.1590/1678-69712016/administracao.v17n6p20-44 DOI: https://doi.org/10.1590/1678-69712016/administracao.v17n6p20-44

Howaldt, J., Kaletka, C., Schröder, A., & Zimgiebl, M. (Eds.). (2018). Atlas of social innovation: new practices for a better future. Technische Universität Dortmund, ZWE Sozialforschungsstelle. DOI: https://doi.org/10.14512/9783962386887

Köhler, J., Geels, F. W., Kern, F., Markard, J., Onsongo, E., Wieczorek, A., ... & Wells, P. (2019). An agenda for sustainability transitions research: State of the art and future directions. Environmental innovation and societal transitions, 31, 1-32. https://doi.org/10.1016/j.eist.2019.01.004 DOI: https://doi.org/10.1016/j.eist.2019.01.004

Kolodinsky, R. W., Madden, T. M., Zisk, D. S., & Henkel, E. T. (2010). Attitudes about corporate social responsibility: Business student predictors. Journal of Business Ethics, 91(2), 167-181. https://doi.org/10.1007/s10551-009-0075-3 DOI: https://doi.org/10.1007/s10551-009-0075-3

Krlev, G., Bund, E., & Mildenberger, G. (2014). Measuring what matters—Indicators of social innovativeness on the national level. Information Systems Management, 31(3), 200-224. https://doi.org/10.1080/10580530.2014.923265 DOI: https://doi.org/10.1080/10580530.2014.923265

Liket, K. C., & Maas, K. (2015). Nonprofit organizational effectiveness: Analysis of best practices. Nonprofit and Voluntary Sector Quarterly, 44(2), 268-296. https://doi.org/10.1177/0899764013510064 DOI: https://doi.org/10.1177/0899764013510064

Liket, K. C., Rey-Garcia, M., & Maas, K. E. (2014). Why aren’t evaluations working and what to do about it: A framework for negotiating meaningful evaluation in nonprofits. American Journal of Evaluation, 35(2), 171-188. https://doi.org/10.1177/1098214013517736 DOI: https://doi.org/10.1177/1098214013517736

Ludvig, A., Weiss, G., Sarkki, S., Nijnik, M., & Živojinović, I. (2018). Mapping European and forest related policies supporting social innovation for rural settings. Forest Policy and Economics, 97, 146-152. https://doi.org/10.1016/j.forpol.2018.09.015 DOI: https://doi.org/10.1016/j.forpol.2018.09.015

Maas, K., & Grieco, C. (2017). Distinguishing game changers from boastful charlatans: Which social enterprises measure their impact? Journal of Social Entrepreneurship, 8(1), 110-128. https://doi.org/10.1080/19420676.2017.1304435 DOI: https://doi.org/10.1080/19420676.2017.1304435

Maas, K., & Liket, K. (2011). Social impact measurement: Classification of methods. In R. Burritt, S. Schaltegger, M. Bennett, T. Pohjola & M. Csutora (Eds.), Environmental management accounting and supply chain management (pp. 171-202). Springer. DOI: https://doi.org/10.1007/978-94-007-1390-1_8

MacCallum, D. (2009). Social innovation and territorial development. Ashgate Publishing.

Moulaert, F., Martinelli, F., Swyngedouw, E., & Gonzalez, S. (2005). Towards alternative model (s) of local innovation. Urban studies, 42(11), 1969-1990. https://doi.org/10.1080/00420980500279893 DOI: https://doi.org/10.1080/00420980500279893

Moulaert, F. (2013). The international handbook on social innovation: collective action, social learning and transdisciplinary research. Edward Elgar Publishing. DOI: https://doi.org/10.4337/9781849809993

Mulgan, G. (2010). Measuring social value. Stanford Social Innovation Review, 8(3), 38-43.

Neumeier, S. (2012). Why do social innovations in rural development matter and should they be considered more seriously in rural development research? –Proposal for a stronger focus on social innovations in rural development research. Sociologia Ruralis, 52(1), 48-69. https://doi.org/10.1111/j.1467-9523.2011.00553.x DOI: https://doi.org/10.1111/j.1467-9523.2011.00553.x

Neumeier, S. (2017). Social innovation in rural development: identifying the key factors of success. The geographical journal, 183(1), 34-46. https://doi.org/10.1111/geoj.12180 DOI: https://doi.org/10.1111/geoj.12180

Nicholls, A., Simon, J., & Gabriel, M. (2015). Introduction: Dimensions of social innovation. In A. Nicholls, J. Simon & M. Gabriel (Eds.), New frontiers in social innovation research (pp. 1-26). Palgrave Macmillan. DOI: https://doi.org/10.1057/9781137506801_1

Niccholls, A. (2015). Synthetic grid: a critical framework to inform the development of social innovation metrics. CRESSI Working papers, 14. Oxford, Creating Economic Space for Social Innovation (CRESSI) project.

Nicholls, A. (2018). A general theory of social impact accounting: Materiality, uncertainty and empowerment. Journal of Social Entrepreneurship, 9(2), 132-153. DOI: https://doi.org/10.1080/19420676.2018.1452785

Nicholls, A., & Dees, J.G. (2015). Social Innovation. In J. D. Wright (Ed.), International Encyclopedia of the Social & Behavioral Sciences (pp. 355-361). Elsevier. DOI: https://doi.org/10.1016/B978-0-08-097086-8.73105-9

Nijnik, M., Secco, L., Miller, D., & Melnykovych, M. (2019). Can social innovation make a difference to forest-dependent communities? Forest Policy and Economics, 100, 207-213. https://doi.org/10.1016/j.forpol.2019.01.001 DOI: https://doi.org/10.1016/j.forpol.2019.01.001

Novikova, M., de Fátima Ferreiro, M., & Stryjakiewicz, T. (2020). Local Development Initiatives as Promoters of Social Innovation: Evidence from Two European Rural Regions. Quaestiones Geographicae, 39(2), 43-53. https://doi.org/10.2478/quageo-2020-0012 DOI: https://doi.org/10.2478/quageo-2020-0012

Novikova, M. (2021). Transformative Social Innovation in Rural Areas: Insights from a Rural Development Initiative in the Portuguese Region of Baixo Alentejo. European Countryside, 13(1), 71-90. https://doi.org/10.2478/euco-2021-0005 DOI: https://doi.org/10.2478/euco-2021-0005

Noy, C. (2008). Sampling knowledge: The hermeneutics of snowball sampling in qualitative research. International Journal of social research methodology, 11(4), 327-344. https://doi.org/10.1080/13645570701401305 DOI: https://doi.org/10.1080/13645570701401305

Nyseth, T., & Hamdouch, A. (2019). The transformative power of social innovation in urban planning and local development. Urban Planning, 4(1), 1-6. https://doi.org/10.17645/up.v4i1.1950 DOI: https://doi.org/10.17645/up.v4i1.1950

Organisation for Economic Cooperation and Development. (2006). The new rural paradigm: Policies and governance. OECD Publishing.

Phills, J. A., Deiglmeier, K., & Miller, D. T. (2008). Rediscovering social innovation. Stanford Social Innovation Review, 6(4), 34-43.

Preskill, H., & Beer, T. (2012). Evaluating social innovation. Available online: https://repository.fteval.at/146/1/2012_Evaluating%20Social%20Innovation.pdf (assessed 11 June 2021). DOI: https://doi.org/10.22163/fteval.2012.119

Ravazzoli, E., Dalla Torre, C., Da Re, R., Marini Govigli, V., Secco, L., Górriz-Mifsud, E., ... & Nijnik, M. (2021). Can social innovation make a change in European and Mediterranean marginalized areas? Social innovation impact assessment in agriculture, fisheries, forestry, and rural development. Sustainability, 13(4), 1823. https://doi.org/10.3390/su13041823 DOI: https://doi.org/10.3390/su13041823

Schuitmaker, T. J. (2012). Identifying and unravelling persistent problems. Technological Forecasting and Social Change, 79(6), 1021-1031. https://doi.org/10.1016/j.techfore.2011.11.008 DOI: https://doi.org/10.1016/j.techfore.2011.11.008

Tracey, P., & Stott, N. (2017). Social innovation: a window on alternative ways of organizing and innovating. Innovation, 19(1), 51-60. https://doi.org/10.1080/14479338.2016.1268924 DOI: https://doi.org/10.1080/14479338.2016.1268924

Vanclay, F., Baines, J. T., & Taylor, C. N. (2013). Principles for ethical research involving humans: ethical professional practice in impact assessment Part I. Impact assessment and project appraisal, 31(4), 243-253. https://doi.org/10.1080/14615517.2013.850307 DOI: https://doi.org/10.1080/14615517.2013.850307

Vanclay, F. (2003). International principles for social impact assessment. Impact assessment and project appraisal, 21(1), 5-12. https://doi.org/10.3152/147154603781766491 DOI: https://doi.org/10.3152/147154603781766491

Vanclay, F. (2020). Reflections on Social Impact Assessment in the 21st century. Impact Assessment and Project Appraisal, 38(2), 126-131. https://doi.org/10.1080/14615517.2019.1685807 DOI: https://doi.org/10.1080/14615517.2019.1685807

Van der Have, R.P. and Rubalcaba, L., 2016. Social innovation research: An emerging area of innovation studies? Research Policy, 45(9), 1923-1935. https://doi.org/10.1016/j.respol.2016.06.010 DOI: https://doi.org/10.1016/j.respol.2016.06.010

Westley, F., & Antadze, N. (2010). Making a difference: Strategies for scaling social innovation for greater impact. Innovation Journal, 15(2), 1-19.

Wittmayer, J. M., Backhaus, J., Avelino, F., Pel, B., Strasser, T., Kunze, I., & Zuijderwijk, L. (2019). Narratives of change: How social innovation initiatives construct societal transformation. Futures, 112, 102433. https://doi.org/10.1016/j.futures.2019.06.005 DOI: https://doi.org/10.1016/j.futures.2019.06.005

Ziegler, R. (2017). Social innovation as a collaborative concept. Innovation: The European Journal of Social Science Research, 30(4), 388-405. https://doi.org/10.1080/13511610.2017.1348935 DOI: https://doi.org/10.1080/13511610.2017.1348935