Titulo Estágio
A Playable Systemic Sonification
Áreas de especialidade
Sistemas de Informação
Engenharia de Software
Local do Estágio
CISUC Interactive Media Lab
Enquadramento
The area of Sound Design in games has been growing significantly in the past years. At CISUC we have contributed with diverse studies: design guidelines, a dynamic soundscape composition architecture, a Pattern Language for Sound Design in Games, and more recently the Systemic Sonification research proposal.
The aesthetics of generated soundscapes, their production and how they influence perception, the dynamic composition and balancing of sound layers are challenging tasks. This is especially so for artefacts with a non-linear narrative, such as videogames, whose interactive context requires adaptation to the player’s actions. In sound-only games the role of sound is elevated, from a mere atmospheric or feedback element to the full action context, guiding the entire narrative and the focus of the player's perception.
References:
Pires, Alves, Roque (2014) http://dx.doi.org/10.1145/2544114.2544131
Pattern Language for Sound Design in Games www.soundingames.com
Systemic Sonification https://www.researchgate.net/publication/354459516_A_Systemic_Perspective_for_Sonification_Aesthetics
Objetivo
The main goal of this project is to design and develop a demo of a playable sound-only game scenario. The main sensorial environment is provided through a dynamic sound composition that is generated from sonifying a spatial dataset, according to the player’s movements. This includes exploring a sound spatialization library in a game engine, multiple sound design proposals that may explore musical forms (harmonic contexts, melody scales, notes or rhythmic patterns), the definition of a sonification system from a dataset, and the evaluation of a walkable soundscape. Technical explorations should also include the possibility of having multiple players exploring the same scenario from different points of view, and how we could have multiple sound outputs depending on the position of each player, which may demand a collaborative attitude.
Plano de Trabalhos - Semestre 1
A1. (Sep-Nov) State-of-the-art research - research and document the relevant SoA, publications and hardware/software review; detailed characterization of the problem to be solved stating specific goals and requirements;
A2. (Nov-Dec) Design Proposal - conception of the interaction design proposal, which includes the exploration of multiple software architectures, from the game engine, datasets to be sonified, sound libraries to the hardware output, and sound design possibilities, including interaction models and how the sound dynamically changes with each player.
Plano de Trabalhos - Semestre 2
A3. (Jan-April) Prototyping - implementation of a proof-of-concept prototype, tuning or corrections based on evaluation results;
A4. (May) Evaluation - definition of evaluation criteria and method; performance of evaluation and analysis of results
A5. (June - July) Statement of Learning - production of paper/thesis with process report and reflection on knowledge production
Condições
This project has an opportunity for a scholarship, which requires dedication and establishment of a work base at our lab.
Orientador
Licínio Gomes Roque & Mariana Seiça
lir@dei.uc.pt 📩