Titulo Estágio
Using the Leap Motion Device as an Augmented Reality Camera for Virtual Reality Applications
Áreas de especialidade
Sistemas de Informação
Local do Estágio
DEI
Enquadramento
[url=https://docs.google.com/document/d/1GtXzPvxa50Y7qg5dfEPEDppm-W2QHLwFUNTm0yvJFvk/edit#heading=h.xnqm4q5elklg][More info.][/url]
The leap motion device is used to detect the position and pose of the user's hands in virtual reality applications for head mounted displays. It can be attached to the VR headset so that it is placed in a position similar to the user’s eyes. The device itself is composed of two infrared cameras and infrared illumination. The hands detection is performed in the computer through stereoscopic image analysis.
Objetivo
The aim of this project is to take advantage of the leap motion device for the purposes of detecting other objects in the users field of view and incorporating virtual representations of the physical objects in the virtual scene. This way, users immersed in the virtual scene can still physically feel some of the objects they are interacting with. Additionally, the physical objects can have many different virtual representations. Imagine a simple scenario where a user immersed in a virtual reality scene physically picks up a sheet of paper from his desk. As he do this, the sheet of paper is virtually represented as a document. As the user physically flips the sheet of paper, the virtual document turns to another page.
The objectives of this project are to:
- try out different visual marker detection algorithms (e.g., AR code markers, image-based markers, etc.)
- assess how well the leap motion device is able to detect these markers and with what constraints (e.g., minimum size and distance, rotation, etc.)
- implement a proof of concept application
Plano de Trabalhos - Semestre 1
- Research about AR marker and recognition types and implementations
- Research about Leap Motion capabilities and API
- Implement a prototype that shows the Leap Motion camera used to track AR markers.
Plano de Trabalhos - Semestre 2
- evaluate the performance of different marker types and recognition techniques
- implement a proof of concept application that showcases various uses for the technique
- write research paper/poster describing the technique and demo application
Condições
.
Observações
Required profile:
- good programming skills, preferably with 3d graphics experience
Orientador
Jorge C. S. Cardoso
jorgecardoso@ieee.org 📩