Titulo Estágio
CardboardSense Interaction Toolkit for VR Applications
Áreas de especialidade
Sistemas de Informação
Engenharia de Software
Local do Estágio
DEI
Enquadramento
Mobile device-based VR systems are increasingly popular due to their low cost and ease of use. Headsets for attaching our personal smartphones are cheap (e.g. Google’s CardBoard project is a low cost, low quality cardboard device that costs about 15 dollars and that anyone can assemble at home) and can be used almost anywhere since it requires no cabling to external computers.
However, mobile based VR systems have an input problem: most controllers for VR input are designed for desktop systems and don't work with smartphones. Additionally, in this kind of VR experiences we are usually interested in low cost solutions.
Objetivo
In this project, the we wish to build on previous work by Yan et al. [1] that developed a technique for interaction with smartphone based VR by detecting tap gestures in the headset. The objectives are:
- implement Yan et al.’s solution as an A-Frame open-source component
- explore the design space of interactions with the tapping technique and implement a toolkit of ready to use components for the A-Frame platform (e.g., selecting objects in the centre of view, menu navigation and selection, button activation, game controls such as fire, left, right, etc.)
- evaluate the implementation (performance such as max rate of tap detection, but also usability of implemented interaction controls)
Plano de Trabalhos - Semestre 1
- Study the original paper by Yan et al. (2016)
- Study gesture recognition techniques
- Study A-Frame programming with focus on smartphone VR development
- Implement the tap recognition as proposed by Yan et al. [1]
- Write intermediate report
Plano de Trabalhos - Semestre 2
- Propose high level interaction components that make sense to use with the tapping technique
- Implement the proposed components and demo applications
- Evaluate the system with users (application users and application developers)
- Write the results as a scientific publication and dissertation
Condições
-
Observações
Required student profile
Good programming skills, passion for HCI/interaction design
References
[1] Yan, X., Fu, C.-W., Mohan, P., & Goh, W. B. (2016). CardboardSense: Interacting with DIY Cardboard VR Headset by Tapping. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems - DIS ’16 (pp. 229–233). New York, New York, USA: ACM Press. http://doi.org/10.1145/2901790.2901813
[2] A-Frame. https://aframe.io/
Orientador
Jorge C. S. Cardoso
jorgecardoso@dei.uc.pt 📩