Gaze estimation with semi-supervised eye landmark detection as an auxiliary task
文献类型：期刊论文
| 作者 | Sun, Yunjia1,2; Zeng, Jiabei2; Shan, Shiguang1,2 |
| 刊名 | PATTERN RECOGNITION
 |
| 出版日期 | 2024-02-01 |
| 卷号 | 146页码:11 |
| ISSN号 | 0031-3203 |
| 关键词 | Computer vision Gaze estimation Semi-supervised learning |
| DOI | 10.1016/j.patcog.2023.109980 |
| 英文摘要 | The changes in gaze are often reflected in the movements of eye landmarks, highlighting the relevance of eye landmark learning for accurate gaze estimation. To leverage eye landmarks, we propose a gaze estimation framework that incorporates eye landmark detection as an auxiliary task. However, obtaining eye landmark annotations for real-world gaze datasets is challenging. To address this, we exploit synthetic data, which provides precise eye landmark labels, by jointly training an eye landmark detector using labeled synthetic data and unlabeled real-world data in a semi-supervised manner. To reduce the influence of discrepancy between synthetic and real-world data, we improve the generalization ability of the landmark detector by performing a self-supervised learning strategy on a large scale of unlabeled real-world images. The proposed method outperforms other state-of-the-art gaze estimation methods on three gaze datasets, indicating the effectiveness of leveraging eye landmark detection as an auxiliary task to enhance gaze estimation performance. |
| 资助项目 | National Natural Science Foundation of China[62176248] |
| WOS研究方向 | Computer Science ; Engineering |
| 语种 | 英语 |
| 出版者 | ELSEVIER SCI LTD |
| WOS记录号 | WOS:001097845200001 |
| 源URL | [http://119.78.100.204/handle/2XEOYT63/38111]  |
| 专题 | 中国科学院计算技术研究所 |
| 通讯作者 | Zeng, Jiabei |
| 作者单位 | 1.Univ Chinese Acad Sci, Beijing 100049, Peoples R China 2.Chinese Acad Sci, Inst Comp Technol, Beijing 100190, Peoples R China |
| 推荐引用方式 GB/T 7714 | Sun, Yunjia,Zeng, Jiabei,Shan, Shiguang. Gaze estimation with semi-supervised eye landmark detection as an auxiliary task[J]. PATTERN RECOGNITION,2024,146:11. |
| APA | Sun, Yunjia,Zeng, Jiabei,&Shan, Shiguang.(2024).Gaze estimation with semi-supervised eye landmark detection as an auxiliary task.PATTERN RECOGNITION,146,11. |
| MLA | Sun, Yunjia,et al."Gaze estimation with semi-supervised eye landmark detection as an auxiliary task".PATTERN RECOGNITION 146(2024):11. |
入库方式： OAI收割
来源：计算技术研究所
浏览0
下载0
收藏0
其他版本
除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。