Crossmodal perception and aesthetics: Interactions between stimulus, person and context

Research in empirical aesthetics has mainly been focused on unimodal stimulation conditions, with a heavy emphasis on the visual modality (in relation to the appreciation of images and art) or the auditory modality (in relation to music). In real-life, however, “liking” or “disliking” something – the essence of an aesthetic response – often depends on multimodal stimulation. In this PhD project, we will move significantly beyond the current mainstream research tradition by investigating the following topics regarding crossmodal perception and aesthetics. (1) Crossmodal perception and evaluation of food items, focusing on texture and taste. Extending the work the PhD candidate has conducted for her Master Thesis, we will examine the role of crossmodal correspondences, associations with existing food products, habits and expectations. In this line of work, we will also consider individual and cultural differences. Evaluative responses will include simple preference or liking, as well as judgments and appraisals of richer perceptual dimensions and user experiences. We will try to supplement well-controlled experiments with field research in richer contexts like bars and restaurants, where we can also consider the role of music and ambient sounds, as well as lighting, branding, mood and atmosphere. (2) Crossmodal perception and evaluation of art, focusing on visual art but in combination with other modalities. For instance, we will investigate the perception and evaluation of sculptures with or without the contribution of tactile or haptic inputs, installation art works with or without a significant contribution of sound, textile and fashion with or without the contribution of tactile and auditory inputs (e.g., the rustling of silk). Evaluative responses will include simple preference or liking, as well as judgments and appraisals of richer perceptual dimensions and user experiences. We will try to supplement well-controlled experiments with field research in richer contexts like museums and galleries. An interesting case study will be the perception and evaluation of tapestry, which requires the addition of sound, lighting, and smell to mimic the conditions under which tapestry was originally intended and experienced. In all of this work, we will focus on interactions between stimulus, person and context. This will require important theoretical and methodological developments as a major component of the research.