• eyetracking@ethz.ch
  • +41 44 633 71 59

Category Archives: Outdoor eye tracking

  • -

Eyes4ICU at LBS 2023

In the scope of the MSCA Doctoral Network Eyes4ICU, our doctoral students Lin Che and Yiwei Wang are investigating novel ways of using eye tracking for the improvement of location-based services. They presented and discussed their research at the 18th Conference on Location Based Services in Ghent, Belgium, last week.

Congrats, Lin, for receiving the best short paper award!

Work-in-progress papers (DOI assignment pending):

  • Che, L., Raubal, M., and Kiefer, P. (2023) Towards Personalized Pedestrian Route Recommendation Based on Implicit Visual Preference. In: Huang, H., Van de Weghe, N., and Gartner, G. (editors), Proceedings of the 18th International Conference on Location Based Services, Ghent, Belgium (to appear) [PDF]
  • Wang, Y., Raubal, M., and Kiefer, P. (2023) Towards gaze-supported emotion-enhanced travel experience logging. In: Huang, H., Van de Weghe, N., and Gartner, G. (editors), Proceedings of the 18th International Conference on Location Based Services, Ghent, Belgium (to appear) [PDF]

 

 


  • -

“Do You Need Instructions Again? Predicting Wayfinding Instruction Demand”

In collaboration with colleagues from TU Vienna, we have published a full paper in the proceedings of this year’s GIScience conference, taking place next week in Leeds, U.K.:

The demand for instructions during wayfinding can be considered as an important indicator of the internal cognitive processes during wayfinding. In the paper, we are predicting instruction demand in a real-world wayfinding experiment with 45 participants using different environmental, user, instructional, and gaze-related features. Being able to predict instruction demand can, for instance, be beneficial for navigation systems that adapt instructions in real-time, based on their users’ behavior.

Alinaghi, N., Kwok, T. C., Kiefer, P., & Giannopoulos, I. (2023). Do You Need Instructions Again? Predicting Wayfinding Instruction Demand. In 12th International Conference on Geographic Information Science (GIScience 2023). Schloss Dagstuhl-Leibniz-Zentrum für Informatik.

Download PDF


  • -

Eyes4ICU: 2 open positions in MSCA doctoral network

Exciting news! The geoGAZElab will be participating in the MSCA Doctoral Network “Eyes for Interaction, Communication, and Understanding  (Eyes4ICU)” as an Associated Partner, funded by the Swiss State Secretariat for Education, Research and Innovation.

Eyes4ICU explores novel forms of gaze-based interaction that rely on current psychological theories and findings, computational modelling, as well as expertise in highly promising application domains. Its approach to developing inclusive technology by tracing gaze interaction back to its cognitive and affective foundations results in better models to predict user behaviour. By integrating insights in application fields, gaze-based interaction can be employed in the wild.

In the scope of Eyes4ICU, 12 doctoral candidates (DC) will be working at 7 different host institutions across Europe. Out of these, 2 DCs will be hosted at the geoGAZElab of ETH Zurich (PI: Peter Kiefer). They will be working on the topics Gaze-supported Trip Recommendation (DC6), and Gaze-supported Travel Experience Logging (DC12) respectively.

We are looking for two highly motivated doctoral candidates, starting at the earliest possible date: Position announcement.

 


  • -

PhD graduation Tiffany C.K. Kwok

We congratulate Tiffany C.K. Kwok for successfully completing her doctoral thesis on “Designing Unobtrusive Gaze-Based Interactions: Applications to Audio-Guided Panorama Viewing”. The doctoral graduation has been approved by the Department conference in their last meeting. The research was performed in the scope of the LAMETTA project.

Tiffany is staying with us for a PostDoc, continuing her research in the geoGAZElab. It’s great having you in our team, Tiffany!


  • -

Visit by the Vice President for Research and Corporate Relations

On 11 September, Prof. Dr. Detlef Günther, the Vice President for Research and Corporate Relations of ETH Zurich, has visited the D-BAUG department and informed himself about the exciting research activities of the different institutes.

Our institute was represented by Peter Kiefer, who summarized the research of the GeoGazeLab. The slides provide an overview on our research interests and current projects.

Edit. The presentation includes the PEGGASUS project. This project has received funding from the Clean Sky 2 Joint Undertaking under the European Union’s Horizon 2020 research and innovation program under grant agreement No. 821461


  • -

Meet us at CHI 2019

We’ll present one full paper and two workshop position papers at CHI in Glasgow this year:

Workshop: Designing for Outdoor Play (4th May, Saturday – 08:00 – 14:00, Room: Alsh 1)

Kiefer, P.(2019) Gaze-guided narratives for location-based games. In CHI 2019 Workshop on “Designing for Outdoor Play”, Glasgow, U.K., DOI: https://doi.org/10.3929/ethz-b-000337913

Workshop: Challenges Using Head-Mounted Displays in Shared and Social Spaces (5th May, Sunday – 08:00 – 14:00, Room: Alsh 2)

Göbel, F., Kwok, T.C.K., and Rudi, D.(2019) Look There! Be Social and Share. In CHI 2019 Workshop on “Challenges Using Head-Mounted Displays in Shared and Social Spaces”, Glasgow, U.K., DOI: https://doi.org/10.3929/ethz-b-000331280

Paper Session: Audio Experiences(8th May, Wednesday – 14:00 – 15:20, Room: Alsh 1)

Kwok, T.C.K., Kiefer, P., Schinazi, V.R., Adams, B., and Raubal, M. (2019) Gaze-Guided Narratives: Adapting Audio Guide Content to Gaze in Virtual and Real Environments. In CHI Conference on Human Factors in Computing Systems Proceedings (CHI 2019), Maz 4-9, Glasgow, U.K. [PDF]

We are looking forward to seeing you in Glasgow!
These researches are part of the LAMETTA or IGAMaps projects.


  • -

Full Paper accepted at CHI 2019

Our paper “Gaze-Guided Narratives: Adapting Audio Guide Content to Gaze in Virtual and Real Environments” has been accepted by ACM CHI 2019 as a full paper:

Kwok, T.C.K., Kiefer, P., Schinazi, V.R., Adams, B., and Raubal, M. (2019) Gaze-Guided Narratives: Adapting Audio Guide Content to Gaze in Virtual and Real Environments. In CHI Conference on Human Factors in Computing Systems Proceedings (CHI 2019), ACM (accepted)

This paper proposes Gaze-Guided Narratives as an implicit gaze-based interaction concept for guiding tourists through the hidden stories of a city panorama. It reports on the implementation and evaluation of this concept which has been developed as part of the LAMETTA project. This research has been performed in collaboration between the GeoGazeLab, Victor R. Schinazi (Chair of Cognitive Science, ETH Zurich) and Benjamin Adams (Department of Geography, University of Canterbury).

Abstract. Exploring a city panorama from a vantage point is a popular tourist activity. Typical audio guides that support this activity are limited by their lack of responsiveness to user behavior and by the difficulty of matching audio descriptions to the panorama. These limitations can inhibit the acquisition of information and negatively affect user experience. This paper proposes Gaze-Guided Narratives as a novel interaction concept that helps tourists find specific features in the panorama (gaze guidance) while adapting the audio content to what has been previously looked at (content adaptation). Results from a controlled study in a virtual environment (n=60) revealed that a system featuring both gaze guidance and content adaptation obtained better user experience, lower cognitive load, and led to better performance in a mapping task compared to a classic audio guide. A second study with tourists situated at a vantage point (n=16) further demonstrated the feasibility of this approach in the real world.


  • -

Science City March 2018 – Impressions

The LAMETTA project has been demoed at this year’s “Treffpunkt Science City” event, an educational program of ETH Zurich for the general public where more than 3,000 visitors came.

Our panorama wall installation and the LAMETTA software allowed our visitors to experience as if they were exploring the view from a vantage point. Just by looking at the interested area (such as lakes, mountains and villages), our system can provide related information to the user.


  • -

Position Paper at CHI Workshop on Outdoor HCI

We’ll present our ideas on how to enrich a tourist’s experience with gaze-guided narratives at a CHI workshop in Montreal this year:

Kiefer, P., Adams, B., and Raubal, M. (2018) Gaze-Guided Narratives for Outdoor Tourism. HCI Outdoors: A CHI 2018 Workshop on Understanding Human-Computer Interaction in the Outdoors

This research is part of the LAMETTA project.


  • -

Scientifica 2017 – Impressions

We have demoed the LAMETTA project at this year’s Scientifica, the Zurich science exhibition of ETH Zurich and University of Zurich with more than 30,000 visitors.

Our panorama wall installation enabled visitors to query information about lakes, mountains, and villages just by looking at them. Many visitors found the hidden treasure in the panorama and were rewarded with a piece of Swiss chocolate.

Visitors of all ages tried out and learned more about gaze-based interaction and mobile eye tracking technology. We are happy that so many people were interested and eager to discuss our research and potential applications to tourist guides of the future.


  • -

Open PhD position

We are looking for a PhD candidate (LAMETTA project).

More details and application on the ETH website.


  • -

Gaze-Informed Location Based Services

Our article “Gaze-Informed Location Based Services” has been accepted for publication by the International Journal of Geographical Information Science (IJGIS):

Anagnostopoulos, V.-A., Havlena, M., Kiefer, P., Giannopoulos, I., Schindler, K., and Raubal, M. (2017).  Gaze-informed location based services.  International Journal of Geographical Information Science, 2017. (accepted), PDF

The article introduces the concept of location based services which take the user’s viewing direction into account. It reports on the implementation and evaluation of such gaze-informed location based service which has been developed as part of the LAMETTA project. This research has been performed in collaboration between the GeoGazeLab, Michal Havlena (Computer Vision Laboratory, ETH Zurich) and Konrad Schindler (Institute of Geodesy and Photogrammetry, ETH Zurich).

Abstract
Location-Based Services (LBS) provide more useful, intelligent assistance to users by adapting to their geographic context. For some services that context goes beyond a location and includes further spatial parameters, such as the user’s orientation or field of view. Here, we introduce Gaze-Informed LBS (GAIN-LBS), a novel type of LBS that takes into account the user’s viewing direction. Such a system could, for instance, provide audio information about the specific building a tourist is looking at from a vantage point. To determine the viewing direction relative to the environment, we record the gaze direction
relative to the user’s head with a mobile eye tracker. Image data from the tracker’s forward-looking camera serve as input to determine the orientation of the head w.r.t. the surrounding scene, using computer vision methods that allow one to estimate the relative transformation between the camera and a known view of the scene in real-time and without the need for artificial markers or additional sensors. We focus on how to map the Point of Regard of a user to a reference system, for which the objects of interest are known in advance. In an experimental validation on three real city panoramas, we confirm that the approach can cope with head movements of varying speed, including fast rotations up to 63 deg/s. We further demonstrate the feasibility of GAIN-LBS for tourist assistance with a proof-of-concept experiment in which a tourist explores a city panorama, where the approach achieved a recall that reaches over 99%. Finally, a GAIN-LBS can provide objective and qualitative ways of examining the gaze of a user based on what the user is currently looking at.


  • -

Special Issue Appearing: Spatial Cognition&Computation 17 (1-2)

A double Special Issue on “Eye Tracking for Spatial Research” in Spatial Cognition&Computation, guest-edited by Peter, Ioannis, Martin, and Andrew Duchowski, has appeared [URL].

Nineteen manuscripts were submitted to an open Call for Submissions, out of which seven were finally accepted after a rigorous review process.

The Special Issue commences with an overview article, authored by the Guest Editors: “Eye tracking for spatial research: Cognition, computation, challenges” [URL, PDF].


  • -

Article in Horizonte

The latest issue of the Horizonte magazine, published by the Swiss National Science Foundation, is reporting on our research.

Source: Horizonte 111, December 2016

German (PDF)

English (PDF)


  • -

INNOLEC Lecture

Martin Raubal was invited for the INNOLEC Lecture at the Department of Geography of the Masaryk University Brünn, Czech Republic.

The title of his talk is: Gaze-based assistance for wayfinders in the real world (slides as PDF, all our presentations).


  • 0

PhD graduation

 

ioannis giannopoulos phd hatThank you all for the great teamwork over the last years and for the very cool hat you made for me!


  • -

Vasilis Anagnostopoulos joins the team

Vasilis Anagnostopoulos has started as a PhD student in the LAMETTA project (Location-Aware Mobile Eye Tracking for Tourist Assistance).

Welcome to our team, Vasilis!

[Current Team]


  • -

Full Paper accepted at MobileHCI 2015

Ioannis Giannopoulos, Peter Kiefer, and Martin Raubal (2015). GazeNav: Gaze-Based Pedestrian Navigation.  In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices & Services. ACM, New York, NY, USA.

GazeNav Talk

Leading Mobile HCI researchers from all over the world meet in Copenhagen to present innovative research and gadgets. Our research group is present with 4 contributions. Read More

 


  • -

Department Annual Report 2014

A summary of our research on “Gaze-Based Geographic Human Computer Interaction” (PDF) is included as a research highlight in the annual report 2014 of our department (D-BAUG, Department of Civil, Environmental and Geomatic Engineering).

annualreport2014


  • -

PETMEI 2015

We are co-organizing a workshop at the UbiComp conference: the workshop on “Pervasive Eye Tracking and Mobile Eye-Based Interaction“ (PETMEI 2015). The workshop is concerned with eye tracking and gaze-based interaction in mobile and everyday (“ubiquitous”) situations, such as in pedestrian navigation.


  • -

Open PhD position

We are looking for a PhD candidate (LAMETTA project).

More details and application on the ETH website.


  • -

Master theses started

Two students have started their Master theses in the GeoGazeLab:

Aikaterini Tsampazi, a Master student in Geomatics, will use eye tracking to measure the visual behavior of wayfinders in a virtual environment in her Master thesis titled “Pedestrian Navigation: The use of navigation aids under time pressure in virtual urban environments”. The goal will be to investigate how pedestrian wayfinders behave under time pressure.

Yufan Miao, a Master student in Computational Science from Uppsala University, is visiting our group in spring and summer 2015. He will be working on his Master thesis on “Landmark detection for mobile eye tracking”, co-supervised by our group and the Chair of Photogrammetry and Remote Sensing (Prof. Schindler). The goal is to apply image processing techniques to outdoor eye tracking videos for the automatic computation of the object of regard.


  • 0

Paper accepted at CHI Workshop 2015

Ioannis Giannopoulos, Peter Kiefer, and Martin Raubal. Watch What I Am Looking At! Eye Gaze and Head-Mounted Displays. In Mobile Collocated Interactions: From Smartphones to Wearables, Workshop at CHI 2015, Seoul, Korea, 2015.

[PDF]

 

etglassold


  • -

ETH Zurich Research Grant

Great news right before the holiday season!

ETH Zurich will support our research on “Location-Aware Mobile Eye Tracking for Tourist Assistance” (LAMETTA) with an ETH Zurich Research Grant for a 3-year project, starting in 2015 (PI: Peter Kiefer).

The project will pioneer gaze-based interaction techniques for tourists in outdoor environments. The project envisions mobile assistance systems that trigger information services based on the user’s gaze on touristic areas of interest. For instance, a gaze-based recommender system could notify the observer of a city panorama about buildings that match her interest, given the objects she has looked at before. The main objective of this project consists in the investigation of novel gaze-based interaction methods for tourists exploring a city panorama.

Stay tuned for updates on LAMETTA!

lametta1