3D Evaluation Model – Global Architecture And Dimension Weighting
DOI:
https://doi.org/10.29284/w8ncdq32Keywords:
cultural economics; cultural policy; evaluation; OECD; participatory metrics; performing arts.Abstract
This article presents a unified and operational 3D evaluation framework for live and performative arts that integrates economic, cultural-social and participatory dimensions. Grounded in cultural economics and contemporary international evaluation practices (UNESCO, OECD), the framework reduces methodological fragmentation by proposing a compact set of validated methods (a maximum of two to three per dimension), standardised indicators and anchored scoring rubrics. Each dimension generates a partial score on a 0–100 scale, while the composite 3D score ranges from 0 to 300. The model is implemented through structured scoring rubrics, weighting guidelines based on the Analytic Hierarchy Process (AHP), and reliability-enhancing procedures, including multiple assessors, triangulation and calibration. The article includes a complete methodological appendix with indicator definitions and scoring rubrics, and discusses the applicability of the framework for events, promoters and venues. The framework is designed to meet the standards required for submission to Scopus Q1 journals in the fields of arts research and cultural policy.
References
[1] J. Armbrecht, T. D. Andersson, and D. Getz, “The value of events,” in The Value of Events, E. Lundberg, Ed. London, U.K.: Routledge, pp. 1–9, 2017.
[2] E. Belfiore and O. Bennett, “Rethinking the social impacts of the arts,” Int. J. Cultural Policy, vol. 13, no. 2, pp. 135–151, 2007.
[3] T. Bennett, Culture: A Reformer’s Science. London, U.K.: Sage Publications, 1998.
[4] T. Bennett, Making Culture, Changing Society. London, U.K.: Routledge, 2013.
[5] S. R. Black, R. Filgueira, L. McAra, B. Miles, M. Parsons, and M. Terras, “Evaluating events data for cultural analytics: A case study on the economic and social effects of Covid-19 on the Edinburgh Festivals,” Creative Industries Journal, pp. 1–27, 2024.
[6] A. S. Brown, J. L. Novak-Leonard, and S. Gilbride, Getting in on the Act: How Arts Groups Are Creating Opportunities for Active Participation. San Francisco, CA, USA: James Irvine Foundation, 2011.
[7] A. Colombo, “How to evaluate cultural impacts of events? A model and methodology proposal,” Scand. J. Hospitality Tourism, vol. 16, no. 4, pp. 500–511, 2016.
[8] J. L. Crompton, “Economic impact studies: Instruments for political shenanigans?” J. Travel Res., vol. 45, no. 1, pp. 67–82, 2006.
[9] G. Crossick and P. Kaszynska, Understanding the Value of Arts & Culture. Swindon, U.K.: Arts and Humanities Research Council, 2016.
[10] T. Cuccia, “Contingent valuation,” in A Handbook of Cultural Economics, R. Towse, Ed. Cheltenham, U.K.: Edward Elgar, p. 119, 2003.
[11] L. Dwyer, P. Forsyth, and R. Spurr, “Estimating the impacts of special events on an economy,” J. Travel Res., vol. 43, no. 4, pp. 351–359, 2005.
[12] B. S. Frey, “What values should count in the arts? The tension between economic effects and cultural value,” Inst. Empirical Res. Econ., Univ. Zurich, Zurich, Switzerland, 2005.
[13] O. Gergaud and V. Ginsburgh, “Economic impact of cultural events,” J. Cultural Econ., 2017.
[14] J. Holden, Cultural Value and the Crisis of Legitimacy. London, U.K.: Demos, 2006.
[15] C. Madden, “Using ‘economic impact’ studies in arts and cultural advocacy: A cautionary note,” Media Int. Australia, vol. 98, no. 1, pp. 161–178, 2001.
[16] F. Matarasso, Use or Ornament? The Social Impact of Participation in the Arts. Stroud, U.K.: Comedia, 1997.
[17] M. Nardo et al., Handbook on Constructing Composite Indicators. Paris, France: OECD / Joint Research Centre, 2005.
[18] D. O’Brien, Measuring the Value of Culture. London, U.K.: Dept. Culture, Media and Sport, 2010.
[19] OECD, Cost-Benefit Analysis and the Environment: Recent Developments. Paris, France: OECD Publishing, 2006.
[20] OECD, “Culture and local development: Background document,” OECD Local Econ. Employ. Develop. Papers, no. 2018/06, Paris, France, 2018
[21] OECD and ICOM, Culture and Local Development: Maximising the Impact. OECD Local Econ. Employ. Develop. Papers, no. 2019/07. Paris, France: OECD Publishing, 2019.
[22] M. Saisana and S. Tarantola, “State-of-the-art report on current methodologies and practices for composite indicator development,” Eur. Commission, Joint Res. Centre, Ispra, Italy, Rep. 214, pp. 4–15, 2002.
[23] A. Saltelli, M. Saisana, S. Tarantola, A. Hoffmann, and E. Giovannini, Handbook on Constructing Composite Indicators: Methodology and User Guide. Paris, France: OECD Publishing / Joint Research Centre, 2010.
[24] W. Santagata and G. Signorello, “Contingent valuation of a cultural public good and policy design: The case of ‘Napoli Musei Aperti’,” J. Cultural Econ., vol. 24, pp. 181–204, 2000.
[25] W. Santagata, “Cultural districts and economic development,” Econ. Innov. New Technol., vol. 15, no. 4–5, 2006.
[26] J. D. Snowball, Measuring the Value of Culture: Methods and Examples in Cultural Economics. Berlin, Germany: Springer, 2008.
[27] A. H. Sterngold, “Do economic impact studies misrepresent the benefits of arts and cultural organizations?” J. Arts Manag. Law Soc., vol. 34, no. 3, pp. 166–187, 2004.
[28] UNESCO, Framework for Cultural Statistics (FCS). Montreal, Canada: UNESCO Inst. Statistics, 2009.
[29] UNESCO, Culture|2030 Indicators. Paris, France: UNESCO, 2019.
[30] B. Walmsley, Audience Engagement in the Performing Arts: A Critical Analysis. London, U.K.: Palgrave Macmillan, 2019.
Downloads
Published
Issue
Section
License
This work is licensed under a Creative Commons Attribution 4.0 International License.
This work is licensed under a Creative Commons Attribution 4.0 International License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
