Titulo Estágio
Drawing sounds - a game to practice music perception
Local do Estágio
CUCFF
Enquadramento
Humans can form cross-domain conceptual associations between two different sensory domains. For example, a fading sound may be associated with a visually shrinking object, as both relate to the experience of increasing distance. Cross-domain mapping combines universal concepts of the human experience (such as bodily experience of gravity) and culturally-specific concepts (for instance, different writing orientations). Cross-domain mapping between visual and audio information has served as inspiration for artistic creation, both in the form of musical compositions and paintings. In those cases, the characteristics of audio objects are perceived, extracted and mapped into characteristics of visual objects with similar meaning (or vice-versa). Empirical research has investigated the cognitive process of cross-domain meaningful association between music and drawings, aiming to understand what aspects of music are perceived and valued, and what visual elements are chosen to represent them.
Objetivo
The main objective of this project is to design a game where listeners must detect changes in different musical parameters and map them to changes in images. Both music and images must be created dynamically in the game, according to defined rules, and not previously loaded. The game may be used to practice music perception or adapted to later experiments aimed at understanding music-image associations. Innovative aspects: Gamification is a powerful tool for learning and a practical mean for empirical research targeted at different ages and contexts. The use of music and image has an universal application that may provide interesting insights into how cultural factors operate in music and image perception.
Plano de Trabalhos - Semestre 1
1. Literature review on empirical research on music and image associations.
2. Low-fidelity prototyping of the game.
3. Intermediate report writing
Plano de Trabalhos - Semestre 2
4. Game development
5. User testing
6. Thesis writing
Condições
Observações
Athanasopoulos, G., & Antović, M. (2018). Conceptual integration of sound and image: A model of perceptual modalities. Musicae Scientiae, 22(1), 72–87. https://doi.org/10.1177/1029864917713244
Orientador
Pedro Martins e Lígia Silva
pjmm@dei.uc.pt 📩