Titulo Estágio
CardboardSense Interaction Toolkit for VR Applications
Áreas de especialidade
Sistemas de Informação
Local do Estágio
DEI
Enquadramento
Mobile device-based VR systems are increasingly popular due to their low cost and ease of use. Headsets for attaching our personal smartphones are cheap (e.g. Google’s CardBoard project is a low cost, low quality cardboard device that costs about 15 dolars and that anyone can assemble at home) and can be used almost anywhere since it requires no cabling to external computers.
However, mobile based VR systems have an input problem: most controllers for VR input are designed for desktop systems and don't work with smartphones. Additionally, in this kind of VR experiences we are usually interested in low cost solutions.
Objetivo
In this project, the we wish to build on previous work by Yan et al. (2016) that developed a technique for interaction with smartphone based VR by detecting tap gestures in the headset. The objectives are:
- implement Yan et al.’s solution in unity
- explore the design space of interactions with the tapping technique and implement a toolkit of ready to use components for the unity platform (e.g., selecting objects in the centre of view, menu navigation and selection, button activation, game controls such as fire, left, right, etc.)
- evaluate the implementation (performance such as max rate of tap detection, but also usability of implemented interaction controls)
Plano de Trabalhos - Semestre 1
- Study the original paper by Yan et al. (2016)
- Study gesture recognition techniques
- Study Unity programming with focus on smartphone VR development
- Implement the tap recognition as proposed by Yan et al.
Plano de Trabalhos - Semestre 2
- Propose high level interaction components that make sense to use with the tapping technique
- Implement the proposed components and demo applications
- Evaluate the system with users (application users and application developers)
Condições
Workplace at CISUC's lab.
Observações
Required profile
- Good programming skills, passion for HCI/interaction design
References
Yan, X., Fu, C.-W., Mohan, P., & Goh, W. B. (2016). CardboardSense: Interacting with DIY Cardboard VR Headset by Tapping. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems - DIS ’16 (pp. 229–233). New York, New York, USA: ACM Press. http://doi.org/10.1145/2901790.2901813
Orientador
Jorge CS Cardoso
jorgecardoso@dei.uc.pt 📩