Sage Journals: Discover world-class research

Abstract

This paper introduces a computational aesthetics framework utilizing computer vision (CV) and artificial neural networks (ANN) to predict the aesthetic preferences of groups of people for architecture. It relies on part-to-whole theories from aesthetics and cognitive psychology. A survey of a group of people on preferences of images is held to record an average hedonic response (AHR). CV algorithms MSER and SAM recognize parts in images. Birkhoff’s aesthetic measure formula is adapted by employing the number of parts and their connections. These quantities are used as input layers of an ANN, and the AHR is the target output. The ANN evaluates images to output a predicted hedonic response (PHR), which is tested as a criterion in parametric design space navigation and in mapping the latent space of GANs. We conclude that such a framework is a heuristic method for better understanding the design and latent spaces and exploring designs.

Keywords

Artificial neural networks computational aesthetics computer vision design space navigation empirical aesthetics hedonic response heuristics latent space map quantitative aesthetics

Get full access to this article

View all access options for this article.

References

Woodbury

. Elements of parametric design. Illustrated edition London; New York, NY: Taylor & Francis Ltd, 2010.

Goodfellow

Pouget-Abadie

Mirza

, et al. Generative Adversarial Networks. Epub ahead of print 10 June 2014. DOI: 10.48550/arXiv.1406.2661.

Takagi

. Interactive evolutionary computation: fusion of the capabilities of EC optimization and human evaluation. Proc IEEE 2001; 89: 1275–1296.

Birkhoff

. Aesthetic measure. Cambridge, MA: Harvard University Press, 1933.

Bense

. Aesthetica. Berlin: Agis-Verlag, 1965.

Moles

. Information theory and esthetic perception. Champaign, IL: University of Illinois Press, 1966. https://archive.org/details/informationtheor0000mole

Kiemle

. Ästhetische probleme der architektur unter dem aspekt der informationsästhetik. Hyderabad: Schnelle, 1967.

Matas

Chum

Urban

, et al. Robust wide-baseline stereo from maximally stable extremal regions. Image Vis Comput 2004; 22: 761–767.

Kirillov

Mintun

Ravi

, et al. Segment Anything. Epub ahead of print 5 April 2023. DOI: 10.48550/arXiv.2304.02643.

10.

Schuman

. Polykleitos: a canon of beauty and perfection. Student Scholarship 2013. https://digitalcommons.lindenwood.edu/student-research-papers/15

11.

Aristotle . The complete works of Aristotle. Princeton: Princeton University Press, 2014. https://press.princeton.edu/books/ebook/9781400852765/the-complete-works-of-aristotle (accessed 14 December 2022).

12.

Vitruvius

. The ten books on architecture. Cambridge, MA: Harvard University Press, 1914. https://archive.org/details/vitruviustenbook00vitr_0 (accessed 3 January 2023).

13.

Alberti

. De Re aedificatoria. In: Gage

(ed). Aesthetic theory: essential texts for architects and designers. New York, NY: W. W. Norton & Company, Inc., 2011.

14.

Palladio

. The four books on architecture. Reprint edition Cambridge, MA: The MIT Press, 2002.

15.

Goldstein

. Cognitive psychology 3. ed. international student special ed Belmont, Calif: Wadsworth, Cengage Learning, 2011.

16.

Fechner

. Elemente der Psychophysik. Weisbaden: Breitkopf und Härtel, 1860.

17.

Vrachliotis

. The new technological condition: architecture and technical thinking in the age of cybernetics. 1st ed. Boston: Birkhäuser, 2022.

18.

Bense

. Pequena estética. Perspectiva: 3a edição. São Paulo, 2009.

19.

Walther

Max E.

Bense’s Informational and Semiotical Aesthetics, 2000, https://www.stuttgarter-schule.de/bense.html (Accessed 11 August 2023).

20.

Berlyne

. Aesthetics and psychobiology. J Aesthet Art Critic 1973; 31: 553.

21.

Mandelbrot

. How long is the coast of Britain? Statistical self-similarity and fractional dimension. Science 1967; 156: 636–638.

22.

Birkin

. Aesthetic complexity: practice and perception in art & design. Doctoral. Nottingham: Nottingham Trent University, 2010. https://irep.ntu.ac.uk/id/eprint/91/ (accessed 17 January 2023).

23.

Sims

. Artificial evolution for computer graphics. SIGGRAPH Comput Graph 1991; 25: 319–328.

24.

House mutator | William Latham, https://latham-mutator.com/1993/01/house-mutator/ (accessed 9 August 2023).

25.

Biles

. GenJam: a genetic algorithm for generating Jazz Solos, 1994.

26.

Draves

. The electric sheep screen-saver: a case study in aesthetic evolution. In: Rothlauf

Branke

Cagnoni

, et al. (eds). Applications of evolutionary computing. Berlin, Heidelberg: Springer, 2005, pp. 458–467.

27.

Galapagos interactive exhibit by Karl Sims, 1997, https://www.karlsims.com/galapagos/index.html (accessed 9 August 2023).

28.

Hoenig

Defining Computational Aesthetics. The Eurographics Association. Epub ahead of print 2005. DOI: 10.2312/COMPAESTH/COMPAESTH05/013-018.

29.

Zhang

. Computational aesthetics and applications. Vis Comput Ind Biomed Art 2018; 1: 6.

30.

Machado

Cardoso

. Computing aesthetics. In: de Oliveira

(ed). Advances in artificial intelligence. Berlin, Heidelberg: Springer, 1998, pp. 219–228.

31.

Greenfield

. Designing metrics for the purpose of aesthetically evaluating images. In Proceedings of the First Eurographics conference on Computational Aesthetics in Graphics, Visualization and Imaging, Goslar, DEU, 2005, pp. 151–158. Eurographics Association.

32.

Matković

Neumann

, et al. Global contrast factor - a new approach to image contrast. In Proceedings of the First Eurographics conference on Computational Aesthetics in Graphics, Visualization and Imaging, Goslar, DEU, 2005, pp. 159–167. Eurographics Association.

33.

Giannini

Monti

. Design intent-oriented modelling tools for aesthetic design. 2003. https://www.semanticscholar.org/paper/Design-Intent-Oriented-Modelling-Tools-for-Design-Giannini-Monti/4faa4ea219197e2df3a913779c29ff32057c32d2 (accessed 10 November 2023).

34.

Bhattacharya

Sukthankar

Shah

. A framework for photo-quality assessment and enhancement based on visual aesthetics. In Proceedings of the 18th ACM international conference on Multimedia. New York, NY, USA, pp. 271–280. Association for Computing Machinery.

35.

Obrador

Schmidt-Hackenberg

Oliver

. The role of image composition in image aesthetics. In 2010 IEEE International Conference on Image Processing, pp. 3185–3188.

36.

Zhou

Tan

. Computational aesthetic measurement of photographs based on multi-features with saliency. In: Huang

D-S

Bevilacqua

Premaratne

(eds). Intelligent computing theory. Cham: Springer International Publishing, 2014, pp. 357–366.

37.

Datta

Joshi

, et al. Studying aesthetics in photographic images using a computational approach. In: Leonardis

Bischof

Pinz

(eds). Computer Vision – ECCV 2006. Berlin, Heidelberg: Springer, 2006, pp. 288–301.

38.

Dhar

Ordonez

Berg

. High level describable attributes for predicting aesthetics and interestingness, 2011.

39.

Tang

Jing

. The design of high-level features for photo quality assessment, 2006.

40.

Koutamanis

. On the evaluation of architectural figural goodness: a foundation for computational architectural aesthetics. In: CAAD Futures 1997 [Conference Proceedings/ISBN 0-7923-4726-9], München (Germany), 4–6 August 1997, pp. 245–266. CUMINCAD. https://papers.cumincad.org/cgi-bin/works/paper/c669 (1997, accessed 24 April 2023).

41.

Sardenberg

Becker

. Aesthetic measure of architectural photography utilizing computer vision: parts-from-wholes. In Design computation input/output 2022. Design computation. DOI: 10.47330/DCIO.2022.GGNL1577.

42.

Sardenberg

Becker

. Computational Quantitative Aesthetics Evaluation - evaluating architectural images using computer vision, machine learning and social media. In: Pak

Wurzer

Stouffs

(eds.), Co-creating the Future: Inclusion in and through Design - Proceedings of the 40th Conference on Education and Research in Computer Aided Architectural Design in Europe (eCAADe 2022) - Volume 2, Ghent, 13-16 September 2022, pp. 567–574. CUMINCAD, https://papers.cumincad.org/cgi-bin/works/paper/ecaade2022_75 (2022, accessed 14 December 2022).

43.

Sardenberg

Becker

. Aesthetics as a criterion: navigating solution spaces utilizing computer vision, the aesthetic measure, and artificial neural networks. In 2023 Annual Modeling and Simulation Conference (ANNSIM), pp. 496–507.

44.

Sardenberg

Guatelli

Becker

. A walk through the latent space using computational aesthetics as a compass. In Accelerated Landscapes: XXVII SiGraDi - Sociedad Iberoamericana de Gráfica Digital, 2023. https://papers.cumincad.org/cgi-bin/works/paper/sigradi2023_80.

45.

Kant

. Critique of judgment. 1st ed. Indianapolis, IN: Hackett Publishing, 1987.

46.

Hogarth

. The analysis of beauty: written with a view of fixing the fluctuating ideas of taste. London: By William Hogarth, 1753.

47.

Hume

. Of the standard of taste. In: Hume

(ed). Essays moral, political, and literary. Gurnee, IL: Libertyclassics, 1987, vol 1757, pp. 226–249.

48.

Burke

. A philosophical enquiry into the origin of our ideas of the sublime and beautiful. London: Printed for R. and J. Dodsley. https://archive.org/details/enqphilosophical00burkrich(1757 (accessed 19 January 2023).

49.

Schiller

. Kallias or concerning beauty: letters to Gottfried Körner’ (1793). In: Bernstein

(ed). Classic and romantic German aesthetics. Cambridge: Cambridge University Press, pp. 145–184.

50.

Fechner

. Vorschule der aesthetik. Leipzig: Breitkopf, 1876. https://archive.org/details/vorschulederaest12fechuoft (accessed 19 April 2023).

51.

Fechner

. Preschool of aesthetics translated by Brielmann Aenne A, 2020. https://aenneb.github.io/files/Preshool_of_aesthetics_by_Aenne_A_Brielmann.pdf

52.

Sardenberg

Burger

Becker

. Aesthetic quantification as search criteria in architectural design: Archinder. In: Sousa

Xavier

Castro Henriques

(eds.), Architecture in the Age of the 4th Industrial Revolution - Proceedings of the 37th eCAADe and 23rd SIGraDi Conference - Volume 1, Porto, Portugal, 11-13 September 2019, pp. 17–24. University of Porto, https://www.academia.edu/40755775/Aesthetic_Quantification_as_Search_Criteria_in_Architectural_Design_Archinder (2019, accessed 14 December 2022).

53.

Rutten

. Evolutionary principles applied to problem solving. https://www.grasshopper3d.com/profiles/blogs/evolutionary-principles, accessed 17 January 2023).

54.

Rutten

. Galapagos: on the logic and limitations of generic solvers. Architect Des 2013; 83: 132–135.

55.

Wortmann

. Opossum - introducing and evaluating a model-based optimization tool for grasshopper. China: Suzhou, pp. 283–292.

56.

Karras

Laine

Aila

. A Style-Based Generator Architecture for Generative Adversarial Networks. 2019. DOI: 10.48550/arXiv.1812.04948.

57.

Maaten

Hinton

. Visualizing Data using t-SNE. J Mach Learn Res 2008; 9: 2579–2605.

58.

Rombach

Blattmann

Lorenz

, et al. High-resolution image synthesis with latent diffusion models. 2022. DOI: 10.48550/arXiv.2112.10752.

59.

Midjourney. San Francisco: Midjourney, https://www.midjourney.com/ (accessed 28 July 2024).

60.

Zhang

Liu

, et al. IP-adapter: text compatible image prompt adapter for text-to-image diffusion models. 2023. DOI: 10.48550/arXiv.2308.06721.

61.

Zhang

Rao

Agrawala

. Adding conditional control to text-to-image diffusion models. 2023. DOI: 10.48550/arXiv.2302.05543.

62.

Melamid

Komar

. Painting by numbers: Komar and Melamid’s scientific guide to art. Berkeley: University of California Press, 1999. https://archive.org/details/paintingbynumber0000unse (accessed 9 August 2023).

63.

Lavdas

Salingaros

. Architectural beauty: developing a measurable and objective scale. Challenges 2022; 13: 56.

64.

Box

GEP

. Science and statistics. J Am Stat Assoc 1976; 71: 791–799.

65.

Anderson

. The end of theory: the data deluge makes the scientific method obsolete. San Francisco, CA: Wired, 2008, https://www.wired.com/2008/06/pb-theory/ (accessed 13 March 2024).

66.

Horkheimer

Adorno

. Dialectic of enlightenment. Stanford: Stanford University Press, 2002.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

A computational framework for aesthetic preferences in architecture using computer vision and artificial neural networks

Abstract

Keywords

Get full access to this article

References

Supplementary Material