Titulo Estágio
Using the Leap Motion Device as an Augmented Reality Camera for Virtual Reality Applications
Áreas de especialidade
Sistemas de Informação
Local do Estágio
DEI
Enquadramento
The leap motion device is used to detect the position and pose of the user's hands in virtual reality applications for head mounted displays. It can be attached to the VR headset so that it is placed in a position similar to the user’s eyes. The device itself is composed of two infrared cameras and infrared illumination. The hands detection is perform in the computer through stereoscopic image analysis.
Objetivo
The aim of this project is to take advantage of the leap motion device for the purposes of detecting other objects in the users field of view and incorporating virtual representations of the physical objects in the virtual scene. This way, users immersed in the virtual scene can still physically feel some of the objects they are interacting with. Additionally, the physical objects can have many different virtual representations. Imagine a simple scenario where a user immersed in a virtual reality scene physically picks up a sheet of paper from his desk. As he do this, the sheet of paper is virtually represented as a document. As the user physically flips the sheet of paper, the virtual document turns to another page.
The objectives of this project are to:
- try out different visual marker detection algorithms (e.g., AR code markers, image-based markers, etc.)
- assess how well the leap motion device is able to detect these markers and with what constraints (e.g., minimum size and distance, rotation, etc.)
- implement a proof of concept application
Plano de Trabalhos - Semestre 1
- Research about AR marker and recognition types and implementations
- Research about leap motion capabilities and API
- implement AR marker recognition using the leap motion's camera image
Plano de Trabalhos - Semestre 2
- evaluate the performance of different marker types and recognition techniques
- implement a proof of concept application
- write research results
Condições
Workplace at CISUC's lab
Observações
Required profile
- good programming skills, preferably with 3d graphics experience
Orientador
Jorge CS Cardoso
jorgecardoso@dei.uc.pt 📩