Non-standard and cheap inerfaces for software applications
|Project Type: MSc Project|
|Research Field: Augmented Reality|
|Time span: 09/2011-09/2012|
The next elderly generation belongs to the information society and they want to keep using application that is familiar with and with new ones. Communications, on-line social interaction and visual-audio stimulating games are important to encourage elderly people to perform physical activities and keep the moral high when confined to their houses. Mobility and member atrophy on those ages are problems that tend to difficult the mouse and keyboard interaction. The aim of this work is to investigate new effective, non-intrusive, easier and cheap interfaces to control software applications. Human pose, eye-tracking, head-tracking are the potentials cues for the proposed research. The interface system can be fixed or mobile.
Description of work
Task 1 State of the art
Analyze the state of the art, evaluate and select the interface methods that tend to be intuitive, easy to use, non-invasive, cheap and easily upgradable.
Task 2: Hardware/Software setup
This subtask aims to the construction/setup of of a kinect device and software development to data acquisition and application to application protocol interface. Hardware acquisitin.
Task 3: Person following
This task is devoted to the use of 3D range data, to track and control the mobile robot so that it follows the human interacting with it.
Task 4: Eye and/or head Tracking
Develop and implement an interface that controls an application by tracking eyes and/or head with non invasive and cheap technologies
Task 5: 2D Image and Depth Sensor Fusion
Develop the mathematics that permit to fuse 2D image information from webcams and 3D information from depth sensor (ex: kinect) cameras to use as input. Modeling the system device and model the measures uncertainty.
Task 6: Evaluation
Conduct experiences with several people to evaluate the intuitiveness, applicability and stress associate to the proposed solutions.
- Prototype of the Interface
- Interfaces Demo
Advisors: Professor Paulo Menezes (DEEC), Luís Almeida (IP Tomar)
Requirements: C/C++ programming skills
Useful skill: Computer Graphics Programming (OpenAR - Augmented Reality development tool, OpenCV, OpenGL)