Titulo Estágio
Multi-user communication framework for guided tours in VR
Áreas de especialidade
Sistemas de Informação
Comunicações, Serviços e Infraestruturas
Local do Estágio
DEI
Enquadramento
There are various existing virtual tours that allow people to visit museums, ancient cities and architectural heritage. However, these virtual tours are often developed to be experienced by a single user and provide no means for interactive interpretation of the museum or site (like when a human interpreter guides a group of people through a heritage site while explaining and answering questions). Tour guides are able to adapt to the personal experience of individual visitors, to individual culture, to adapt the tour to overall attention, etc., in order to provide a more fulfilling and memorable experience. A study on the practice of tour guiding in the context of museums has demonstrated ". . . how the guided tour is nothing like the monologic lecture it is often seen to be. Instead, it is interactive in subtle and ongoing ways" [1]. Guided tours have also been shown to result in a more positive attitude towards the CH institution, and better information retention in the context of school guided tours [2]. In addition, knowledge about a cultural heritage site or artefacts is not static, new discoveries and understanding are continuously produced. Virtual guides are much harder to update because they are often developed within budget-constrained projects that do not account for periodic updates. Human tour guides are able to immediately incorporate new knowledge into their interactive storytelling.
Implementing a human-guided virtual tour requires a real-time communication infrastructure and framework that allows not only voice communication but also possibly video, and real-time control over the participants virtual environment.
Several questions arise in this setting:
- What locomotion strategies work best?
- How much control over participants' position or gaze should a guide have?
- How should the current tour location be communicated to participants in a non-intrusive way?
- What kind of user interface is the best to give guides aggregated information about where visitors are looking a,t in order to adapt the interpretation to their interests?
Objetivo
The objectives of this project are:
1. To set up and develop the server and software infrastructure required for running multi-user VR environments with shared interactions, audio and video communications.
2. To implement a virtual tour using 360 still pictures or videos (the location is to be defined).
3. To evaluate the experience of participating in such a virtual tour and evaluate the technical infrastructure
Plano de Trabalhos - Semestre 1
1. Study VR architectures for multi-user environments (e.g., [3] and [4])
2. Study real-time communication protocols such as WebRTC
3. Define an architecture for the virtual tour system
4. Implement an initial proof-of-concept prototype
5. Write intermediate report
Plano de Trabalhos - Semestre 2
1. Setup the server infrastructure and framework
2. Implement a virtual tour with 360 content
3. Evaluate the technical infrastructure
4. Evaluate the user experience (both guide and visitors) of the virtual tour
5. Write the final report and a scientific paper
Condições
Equipamento VR disponível no DEI
Orientador
Jorge Carlos dos Santos Cardoso
jorgecardoso@dei.uc.pt 📩