propostas submetidas

DEI - FCTUC
Gerado a 2024-03-28 18:58:21 (Europe/Lisbon).
Voltar

Titulo Estágio

CardboardSense Interaction Toolkit for VR Applications

Áreas de especialidade

Sistemas de Informação

Local do Estágio

DEI

Enquadramento

[url=https://docs.google.com/document/d/1GtXzPvxa50Y7qg5dfEPEDppm-W2QHLwFUNTm0yvJFvk/edit#heading=h.pmtqwm1513te][More info.][/url]

Mobile device-based VR systems are increasingly popular due to their low cost and ease of use. Headsets for attaching our personal smartphones are cheap (e.g. Google’s CardBoard project is a low cost, low quality cardboard device that costs about 15 dollars and that anyone can assemble at home) and can be used almost anywhere since it requires no cabling to external computers.
However, mobile based VR systems have an input problem: most controllers for VR input are designed for desktop systems and don't work with smartphones. Additionally, in this kind of VR experiences we are usually interested in low cost solutions.

Objetivo

In this project, the we wish to build on previous work by Yan et al. (2016) that developed a technique for interaction with smartphone based VR by detecting tap gestures in the headset. The objectives are:
- implement Yan et al.’s solution in unity or other high-level tool
- explore the design space of interactions with the tapping technique and implement a toolkit of ready to use components for the unity platform (e.g., selecting objects in the centre of view, menu navigation and selection, button activation, game controls such as fire, left, right, etc.)
- evaluate the implementation (performance such as max rate of tap detection, but also usability of implemented interaction controls)

Plano de Trabalhos - Semestre 1

- Study the original paper by Yan et al. (2016)
- Study gesture recognition techniques
- Study Unity programming with focus on smartphone VR development
- Implement the tap recognition as proposed by Yan et al.

Plano de Trabalhos - Semestre 2

- Propose high level interaction components that make sense to use with the tapping technique
- Implement the proposed components and demo applications
- Evaluate the system with users (application users and application developers)

Condições

.

Observações

Required student profile:
Good programming skills, passion for HCI/interaction design

References
Yan, X., Fu, C.-W., Mohan, P., & Goh, W. B. (2016). CardboardSense: Interacting with DIY Cardboard VR Headset by Tapping. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems - DIS ’16 (pp. 229–233). New York, New York, USA: ACM Press. http://doi.org/10.1145/2901790.2901813

Orientador

Jorge C. S. Cardoso
jorgecardoso@ieee.org 📩