Pilot Eye Gaze and Gesture tracking for Avionics Systems using Unobtrusive Solutions (PEGGASUS)
Cockpit systems are continuously evolving and new models necessitate a change in the way pilots interact with them. Especially, because these novel systems do usually become more complex and thus more challenging for pilots to cope with. The amount of information may even increase their cognitive load, if the solutions are not appropriately designed. Although there is ongoing research in this field, there exists no fully integrated and real-world applicable solution, which utilizes gaze-based interactions.
Within the PEGGASUS project, new innovative smart vision systems are developed and integrated into flight simulators. With the help of computer vision and machine learning algorithms, these systems support the development of new crew interfaces and monitoring systems utilizing eye gaze, face, and gesture tracking technologies. These interfaces involve novel gaze-based interactions, which are further evaluated for their application in aviation training. In particular, the system will be evaluated with actual commercial aviation pilots.
PEGGASUS brings together partners able to cover the complete value chain of innovative product development: SERMA Engineering (FR), an OEM for aeronautical equipment, CSEM (CH) an RTD with proven experience in innovative technologies for aeronautics, ETHZ (CH) represented by the GeoGazeLab that conducts cutting edge research with eye tracking technology, particularly for the use in aviation training, and Swiss (CH), an airline and potential end user who will provide expertise in crew interfaces and monitoring. Our team is supported by Thales (FR), a globally operating avionics company who will integrate the insights into future cockpits.
- Prof. Dr. Martin Raubal (ETH Project Lead, Doctoral student Supervisor)
- Dr. Peter Kiefer (Substitute ETH Project Lead)
- David Rudi (Substitute ETH Project Lead)
- This project is funded by the European Commission within the Clean Sky initiative, which is part of the H2020 program
- Start Date: 01.01.2019
- End Date: 01.01.2021
- Research: Aviation