Awesome Gaze
A curated list of awesome gaze estimation papers, codes, datasets and other awesomeness.
Table of Content
Review Papers
-
Mohamed Khamis, Florian Alt, Andreas Bulling. The Past, Present, and Future of Gaze-enabled Handheld Mobile Devices: Survey and Lessons Learned PDF
-
Anuradha Kar and Peter Corcoran. A Review and Analysis of Eye-Gaze Estimation Systems, Algorithms and Performance Evaluation Methods in Consumer Platforms PDF
-
kshay A Gawande, Gangotri Nathaney. A Survey on Gaze Estimation Techniques in Smartphone PDF
-
Xiaomeng Wang, Kang Liu, Xu Qian. A Survey on Gaze Estimation PDF
-
M. V. Sireesha, P. A. Vijaya, K. Chellamma. A Survey on Gaze Estimation Techniques PDF
-
D.W. Hansen, Qiang Ji. In the Eye of the Beholder: A Survey of Models for Eyes and Gaze PDF
-
Abdallahi Ould, Mohamed Matthieu, Perreira Da Silva, Vincent Courboulay. A history of eye gaze tracking PDF
-
Carlos H. Morimoto, Marcio R.M. Mimica. Eye gaze tracking techniques for interactive applications PDF
Journal Papers
Conference Papers
AAAI 2019
- Dongze Lian, Ziheng Zhang, Weixin Luo, Lina Hu, Minye Wu, Zechao Li, Jingyi Yu, Shenghua Gao. RGBD Based Gaze Estimation via Multi-Task CNN PDF Code
ECCV 2019
-
Petr Kellnhofer, Adria Recasens, Simon Stent, Wojciech Matusik, Antonio Torralba. Gaze360: Physically Unconstrained Gaze Estimation in the Wild PDF Code
-
Seonwook Park, Shalini De Mello, Pavlo Molchanov, Umar Iqbal, Otmar Hilliges, Jan Kautz. Few-Shot Adaptive Gaze Estimation PDF Code
CVPR 2019
-
Yunyang Xiong, Hyunwoo J. Kim, Vikas Singh. Mixed Effects Convolutional Neural Networks (MeNets) with Applications to Gaze Estimation PDF
-
Yu Yu, Gang Liu, Jean-Marc Odobez. Improving User-Specific Gaze Estimation via Gaze Redirection Synthesis PDF
-
Kang Wang, Hui Su, Qiang Ji. Neuro-inspired Eye Tracking with Eye Movement Dynamics PDF
-
Kang Wang, Rui Zhao, Hui Su, Qiang Ji. Generalizing Eye Tracking with Bayesian Adversarial Learning PDF
CVPR 2018
-
Brian Dolhansky, Cristian Canton Ferrer. Eye In-Painting with Exemplar Generative Adversarial Networks PDF Code
-
Yanyu Xu, Yanbing Dong, Junru Wu, Zhengzhong Sun, Zhiru Shi, Jingyi Yu, Shenghua Gao. Gaze Prediction in Dynamic 360° Immersive Videos PDF Code
-
Kang Wang, Rui Zhao, Qiang Ji. A Hierarchical Generative Model for Eye Image Synthesis and Eye Gaze Estimation PDF
-
Arun Balajee Vasudevan, Dengxin Dai, Luc Van Gool. Object Referring in Videos with Language and Human Gaze PDF Code
-
Fan, Lifeng and Chen, Yixin and Wei, Ping and Wang, Wenguan and Zhu, Song-Chun. Inferring Shared Attention in Social Scene Videos PDF
-
Ping Wei, Yang Liu, Tianmin Shu, Nanning Zheng, Song-Chun Zhu. Where and Why Are They Looking? Jointly Inferring Human Attention and Intentions in Complex Tasks PDF
-
Rajeev Ranjan, Shalini De Mello, Jan Kautz. Light-weight Head Pose Invariant Gaze Tracking PDF
ECCV 2018
-
Tobias Fischer, Hyung Jin Chang, Yiannis Demiris. RT-GENE: Real-Time Eye Gaze Estimation in Natural Environments PDF Code
-
Ernesto Brau, Jinyan Guan, Tanya Jeffries, Kobus Barnard. Multiple-Gaze Geometry: Inferring Novel 3D Locations from Gazes Observed in Monocular Video PDF
-
Yin Li, Miao Liu, James M. Rehg. In the Eye of Beholder: Joint Learning of Gaze and Actions in First Person Video PDF
-
Yifei Huang, Minjie Cai, Zhenqiang Li, Yoichi Sato. Predicting Gaze in Egocentric Video by Learning Task-Dependent Attention Transition PDF Code
-
Eunji Chong and Nataniel Ruiz and Yongxin Wang and Yun Zhang and Agata Rozga and James Rehg. Connecting Gaze, Scene, and Attention: Generalized Attention Estimation via Joint Modeling of Gaze and Scene Saliency PDF
-
Seonwook Park and Adrian Spurr and Otmar Hilliges. Deep Pictorial Gaze Estimation PDF Code
-
Cheng, Yihua and Lu, Feng and Zhang, Xucong. Appearance-Based Gaze Estimation via Evaluation-Guided Asymmetric Regression PDF
-
Yu Yu, Gang Liu, Jean-Marc Odobez. Deep Multitask Gaze Estimation with a Constrained Landmark-Gaze Model PDF
BMVC 2018
-
Cristina Palmero, Javier Selva, Mohammad Ali Bagheri, Sergio Escalera. Recurrent CNN for 3D Gaze Estimation using Appearance and Shape Cues PDF Code
-
Liu, Gang and Yu, Yu and Funes-Mora, Kenneth A and Odobez, Jean-Marc and SA, Eyeware Tech. A Differential Approach for Gaze Estimation with Calibration PDF
ICCV 2017
-
George Leifman, Dmitry Rudoy, Tristan Swedish, Eduardo Bayro-Corrochano, Ramesh Raskar. Learning Gaze Transitions From Depth to Improve Video Saliency Estimation PDF
-
Kang Wang, Qiang Ji. Real Time Eye Gaze Tracking With 3D Deformable Eye-Face Model PDF
-
Haoping Deng and Wangjiang Zhu. Monocular Free-Head 3D Gaze Tracking with Deep Learning and Geometry Constraints PDF Code
-
Adria Recasens and Carl Vondrick and Aditya Khosla and Antonio Torralba. Following Gaze in Video PDF Code
CVPR 2017
-
Nour Karessli, Zeynep Akata, Bernt Schiele, Andreas Bulling. Gaze Embeddings for Zero-Shot Image Classification PDF Code
-
Mengmi Zhang, Keng Teck Ma, Joo Hwee Lim, Qi Zhao, Jiashi Feng. Deep Future Gaze: Gaze Anticipation on Egocentric Videos Using Adversarial Networks PDF Code
-
Xucong Zhang and Yusuke Sugano and Mario Fritz and Andreas Bulling. It's Written All Over Your Face: Full-Face Appearance-Based Gaze Estimation PDF
Other 2017
- Xucong Zhang and Yusuke Sugano and Andreas Bulling. Everyday Eye Contact Detection Using Unsupervised Gaze Target Discovery PDF
ECCV 2016
-
Erroll Wood and Tadas Baltrusaitis and Louis-Philippe Morency and Peter Robinson and Andreas Bulling. A 3D Morphable Eye Region Model for Gaze Estimation PDF
-
Ganin, Yaroslav, Daniil Kononenko, Diana Sungatullina, and Victor Lempitsky. DeepWarp: Photorealistic Image Resynthesis for Gaze Manipulation PDF Code
CVPR 2016
-
Kyle Krafka and Aditya Khosla and Petr Kellnhofer and Harini Kannan and Suchendra Bhandarkar and Wojciech Matusik and Antonio Torralba. Eye Tracking for Everyone PDF Code
-
Pei Yu and Jiahuan Zhou and Ying Wu. Learning Reconstruction-Based Remote Gaze Estimation PDF
-
Laszlo A. Jeni and Jeffrey F. Cohn. Person-Independent 3D Gaze Estimation Using Face Frontalization PDF
arXiv Papers
Datasets
| Dataset | RGB/RGB-D | Image type | Annotation type | Images | Distance | Head pose annot. | Gaze annot. | Head pose orient. |
|---|---|---|---|---|---|---|---|---|
| MPII Gaze | RGB | Face + Eye Patches | Gaze Vector | 213.659 | 40-60cm | Y | Y | Frontal |
| BIWI | RGB-D | Camera frame | Head pose vector | ≈ 15.500 | 100cm | Y | N | All |
| CMU Multi-Pie | RGB | Camera frame | 68 Facial landmarks | 755.370 | ≈ 300cm | Y | N | All |
| Coffeebreak | RGB | Low res. face image | Head pose vector | 18.117 | Varying | Y | N | All |
| Columbia | RGB | High res. camera image | Gaze vector | 5.880 | 200cm | 5 orient. | Y | Frontal |
| Deep Head Pose | RGB-D | Camera frame | Head pose vector | 68.000 | ≈ 200-800cm | Y | N | All |
| EYEDIAP | RGB-D | Face + eye patches | Gaze vector | ≈ 62.500 | 80-120cm | Y | Y | Frontal |
| Gaze Capture | RGB | Face + eye patches | 2D pos on screen | > 2.5M | 80-120cm | Y | Y | Frontal |
| ICT 3D Head pose | RGB-D | Camera frame | Head pose vector | 14.000 | ≈ 100cm | Y | N | All |
| Rice TabletGaze | RGB | Tablet camera video | 2D pos on screen | ≈ 100.000 | 30-50cm | N | Y | Frontal |
| RT-GENE | RGB-D | Face + eye patches | Gaze vector | 122.531 | 80-280cm | Y | Y | All |
| SynthesEyes | RGB | Synthesized eye patches | Gaze vector | 11.382 | Varying | Y | Y | All |
| UnityEyes | RGB | Synthesized eye patches | Gaze vector | 1M | Varying | Y | Y | All |
| UT Multi-view | RGB | Eye area + eye patches | Gaze vector | 1.152.000 | 60cm | Y | Y | All |
| Vernissage | RGB | (Robot) | camera frame | Head pose vector | Unknown | Varying | Y | N |
Reference
Many papers collections are from Awesome-Gaze-Estimation by Computer Vision Research Lab at the University of Birmingham
Contribution
If you have anything that you think they are awesome related to Gaze Estimation, feel free to send a pull request
License
To the extent possible under law, Zhuoran Wu has waived all copyright and related or neighboring rights to this work. If you want to use any items in this list, please refer their own License.