Titulo Estágio
Semi-automatic adaptation of web-based games to mixed-reality
Local do Estágio
DEI/CISUC
Enquadramento
“Mixed reality is a blend of physical and digital worlds, unlocking natural and intuitive 3D human, computer, and environmental interactions” [1]. Mixed reality content is usually experienced by associating different virtual content with physical surfaces in a room, or simply by placing virtual content floating in a specific 3D position of a room.
Although it is possible to navigate web content through mixed-reality devices, this is accomplished by opening a floating browser window in which the content is then viewed as in a traditional browser window. This means that the web content does not take advantage of the potential for distributing different content elements through different surfaces. But what if the mixed-reality browser was able to take the webpage apart and distribute its elements in a more natural way, taking advantage of the 3D space around the user?
The purpose of this work is to take a step in this direction by investigating which annotations to the webpage elements would be necessary, what specific content would need to be specifically created, etc., to allow a mixed-reality system to transform a standard webpage into a mixed-reality webpage. To provide a more focused approach, we are aiming to transform a specific web-based game currently being developed for the Science4Pandemics project [2].
Objetivo
Develop a proof-of-concept semi-automatic adaptation system for the Science4Pandemics web-based game, single player mode. This should entail:
1. Proposing a general mixed-reality layout approach for web-based content, focused on games
2. Proposing an HTML annotation scheme that helps the mixed-reality system understand the meaning of the various web-based game elements
3. Implementing a system capable of inspecting the annotated HTML and generating a mixed-reality version of the web-based game
4. Reflect about the challenges, difficulties, and limitations of the approach
Plano de Trabalhos - Semestre 1
- Research about mixed-reality
- Research about mixed-reality content layout
- Study the existing Science4Pandemics game
- Propose a layout scheme for the game
- Write intermediate report
Plano de Trabalhos - Semestre 2
- Develop an annotation scheme for the HTML
- Implement the adaptation engine
- Perform user evaluation of the system
- Write final report
- Write scientific paper describing the system and results
Condições
Students will have access to mixed-reality equipment such as the Microsoft Hololens, Meta Quest, or Pico 4 headsets.
Observações
References
[1] https://learn.microsoft.com/en-us/windows/mixed-reality/discover/mixed-reality
[2] https://science4pandemics.eu/
Orientador
Jorge C. S. Cardoso / Licínio Roque
jorgecardoso@dei.uc.pt 📩