English
Related papers

Related papers: On estimating gaze by self-attention augmented con…

200 papers

Visual attention has been extensively studied for learning fine-grained features in both facial expression recognition (FER) and Action Unit (AU) detection. A broad range of previous research has explored how to use attention modules to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-24 Xiaotian Li , Zhihua Li , Huiyuan Yang , Geran Zhao , Lijun Yin

Despite impressive advancements in Autonomous Driving Systems (ADS), navigation in complex road conditions remains a challenging problem. There is considerable evidence that evaluating the subjective risk level of various decisions can…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 Shih-Yuan Yu , Arnav V. Malawade , Deepan Muthirayan , Pramod P. Khargonekar , Mohammad A. Al Faruque

Perceptual capabilities of artificial systems have come a long way since the advent of deep learning. These methods have proven to be effective, however they are not as efficient as their biological counterparts. Visual attention is a set…

Machine Learning · Computer Science 2018-11-09 Jarryd Son , Amit Mishra

Our project proposes an end-to-end 3D face alignment and reconstruction network. The backbone of our model is built by Bottle-Neck structure via Depth-wise Separable Convolution. We integrate Coordinate Attention mechanism and Spatial…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Yilin Liu , Xuezhou Guo , Xinqi Wang , Fangzhou Du

Convolutional neural networks have enabled major progresses in addressing pixel-level prediction tasks such as semantic segmentation, depth estimation, surface normal prediction and so on, benefiting from their powerful capabilities in…

Computer Vision and Pattern Recognition · Computer Science 2021-12-16 Guanglei Yang , Paolo Rota , Xavier Alameda-Pineda , Dan Xu , Mingli Ding , Elisa Ricci

Eye gaze is an important non-verbal cue for human affect analysis. Recent gaze estimation work indicated that information from the full face region can benefit performance. Pushing this idea further, we propose an appearance-based method…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 Xucong Zhang , Yusuke Sugano , Mario Fritz , Andreas Bulling

Spatio-temporal information is key to resolve occlusion and depth ambiguity in 3D pose estimation. Previous methods have focused on either temporal contexts or local-to-global architectures that embed fixed-length spatio-temporal…

Computer Vision and Pattern Recognition · Computer Science 2020-10-21 Junfa Liu , Juan Rojas , Zhijun Liang , Yihui Li , Yisheng Guan

This study introduces a motion-based learning network with a global-local self-attention module (MoGLo-Net) to enhance 3D reconstruction in handheld photoacoustic and ultrasound (PAUS) imaging. Standard PAUS imaging is often limited by a…

Image and Video Processing · Electrical Eng. & Systems 2025-02-07 SiYeoul Lee , SeonHo Kim , Minkyung Seo , SeongKyu Park , Salehin Imrus , Kambaluru Ashok , DongEon Lee , Chunsu Park , SeonYeong Lee , Jiye Kim , Jae-Heung Yoo , MinWoo Kim

Appearance-based gaze estimation (AGE) has achieved remarkable performance in constrained settings, yet we reveal a significant generalization gap where existing AGE models often fail in practical, unconstrained scenarios, particularly…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Zhenhao Li , Zheng Liu , Seunghyun Lee , Amin Fadaeinejad , Yuanhao Yu

During the past years,deep convolutional neural networks have achieved impressive success in low-light Image Enhancement.Existing deep learning methods mostly enhance the ability of feature extraction by stacking network structures and…

Image and Video Processing · Electrical Eng. & Systems 2021-12-16 Zilong Chen , Yaling Liang , Minghui Du

Despite the recent development of learning-based gaze estimation methods, most methods require one or more eye or face region crops as inputs and produce a gaze direction vector as output. Cropping results in a higher resolution in the eye…

Computer Vision and Pattern Recognition · Computer Science 2023-05-10 Haldun Balim , Seonwook Park , Xi Wang , Xucong Zhang , Otmar Hilliges

In this paper we introduce a novel Depth-Aware Video Saliency approach to predict human focus of attention when viewing RGBD videos on regular 2D screens. We train a generative convolutional neural network which predicts a saliency map for…

Computer Vision and Pattern Recognition · Computer Science 2016-03-14 G. Leifman , D. Rudoy , T. Swedish , E. Bayro-Corrochano , R. Raskar

Gaze estimation is the fundamental basis for many visual tasks. Yet, the high cost of acquiring gaze datasets with 3D annotations hinders the optimization and application of gaze estimation models. In this work, we propose a novel Head-Eye…

Computer Vision and Pattern Recognition · Computer Science 2023-01-02 Pengwei Yin , Jiawu Dai , Jingjing Wang , Di Xie , Shiliang Pu

To make the best use of the underlying structure of faces, the collective information through face datasets and the intermediate estimates during the upsampling process, here we introduce a fully convolutional multi-stage neural network for…

Computer Vision and Pattern Recognition · Computer Science 2019-10-22 Ratheesh Kalarot , Tao Li , Fatih Porikli

Deep learning has become a powerful tool for medical image analysis; however, conventional Convolutional Neural Networks (CNNs) often fail to capture the fine-grained and complex features critical for accurate diagnosis. To address this…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Zahid Ullah , Minki Hong , Tahir Mahmood , Jihie Kim

General image super-resolution techniques have difficulties in recovering detailed face structures when applying to low resolution face images. Recent deep learning based methods tailored for face images have achieved improved performance…

Computer Vision and Pattern Recognition · Computer Science 2021-02-03 Chaofeng Chen , Dihong Gong , Hao Wang , Zhifeng Li , Kwan-Yee K. Wong

In computer-aided diagnosis tools employed for skin cancer treatment and early diagnosis, skin lesion segmentation is important. However, achieving precise segmentation is challenging due to inherent variations in appearance, contrast,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Asim Naveed , Syed S. Naqvi , Tariq M. Khan , Shahzaib Iqbal , M. Yaqoob Wani , Haroon Ahmed Khan

In this paper, we evaluate a synthetic framework to be used in the field of gaze estimation employing deep learning techniques. The lack of sufficient annotated data could be overcome by the utilization of a synthetic evaluation framework…

Computer Vision and Pattern Recognition · Computer Science 2020-06-15 Gonzalo Garde , Andoni Larumbe-Bergera , Benoît Bossavit , Rafael Cabeza , Sonia Porta , Arantxa Villanueva

We devise a graph attention network-based approach for learning a scene triangle mesh representation in order to estimate an image camera position in a dynamic environment. Previous approaches built a scene-dependent model that explicitly…

Computer Vision and Pattern Recognition · Computer Science 2022-10-03 Mohamed Amine Ouali , Mohamed Bouguessa , Riadh Ksantini

The increased availability and accuracy of eye-gaze tracking technology has sparked attention-related research in psychology, neuroscience, and, more recently, computer vision and artificial intelligence. The attention mechanism in…

Image and Video Processing · Electrical Eng. & Systems 2022-02-16 Hongzhi Zhu , Septimiu Salcudean , Robert Rohling