English
Related papers

Related papers: On estimating gaze by self-attention augmented con…

200 papers

Pose estimation is a critical task in computer vision with a wide range of applications from activity monitoring to human-robot interaction. However,most of the existing methods are computationally expensive or have complex architecture.…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Marsha Mariya Kappan , Eduardo Benitez Sandoval , Erik Meijering , Francisco Cruz

In this paper, our focus is on enhancing steering angle prediction for autonomous driving tasks. We initiate our exploration by investigating two veins of widely adopted deep neural architectures, namely ResNets and InceptionNets. Within…

Computer Vision and Pattern Recognition · Computer Science 2024-02-02 Swetha Nadella , Pramiti Barua , Jeremy C. Hagler , David J. Lamb , Qing Tian

The human gaze is a cost-efficient physiological data that reveals human underlying attentional patterns. The selective attention mechanism helps the cognition system focus on task-relevant visual clues by ignoring the presence of…

Computer Vision and Pattern Recognition · Computer Science 2021-12-03 Yifei Huang , Xiaoxiao Li , Lijin Yang , Lin Gu , Yingying Zhu , Hirofumi Seo , Qiuming Meng , Tatsuya Harada , Yoichi Sato

We present a novel attention-based mechanism to learn enhanced point features for point cloud processing tasks, e.g., classification and segmentation. Unlike prior works, which were trained to optimize the weights of a pre-selected set of…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Liqiang Lin , Pengdi Huang , Chi-Wing Fu , Kai Xu , Hao Zhang , Hui Huang

Automatic eye gaze estimation is an important problem in vision based assistive technology with use cases in different emerging topics such as augmented reality, virtual reality and human-computer interaction. Over the past few years, there…

Computer Vision and Pattern Recognition · Computer Science 2022-08-08 Neeru Dubey , Shreya Ghosh , Abhinav Dhall

Gaze behavior is an important non-verbal cue in social signal processing and human-computer interaction. In this paper, we tackle the problem of person- and head pose-independent 3D gaze estimation from remote cameras, using a multi-modal…

Computer Vision and Pattern Recognition · Computer Science 2018-09-18 Cristina Palmero , Javier Selva , Mohammad Ali Bagheri , Sergio Escalera

Recently, self-attention operators have shown superior performance as a stand-alone building block for vision models. However, existing self-attention models are often hand-designed, modified from CNNs, and obtained by stacking one operator…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 Huaijin Pi , Huiyu Wang , Yingwei Li , Zizhang Li , Alan Yuille

Human gesture recognition has drawn much attention in the area of computer vision. However, the performance of gesture recognition is always influenced by some gesture-irrelevant factors like the background and the clothes of performers.…

Computer Vision and Pattern Recognition · Computer Science 2021-03-10 Benjia Zhou , Yunan Li , Jun Wan

In recent years, face recognition systems have achieved exceptional success due to promising advances in deep learning architectures. However, they still fail to achieve expected accuracy when matching profile images against a gallery of…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Moktari Mostofa , Mohammad Saeed Ebrahimi Saadabadi , Sahar Rahimi Malakshan , Nasser M. Nasrabadi

Although gaze estimation methods have been developed with deep learning techniques, there has been no such approach as aim to attain accurate performance in low-resolution face images with a pixel width of 50 pixels or less. To solve a…

Computer Vision and Pattern Recognition · Computer Science 2022-09-22 Jun-Seok Yun , Youngju Na , Hee Hyeon Kim , Hyung-Il Kim , Seok Bong Yoo

Automatic eye gaze estimation has interested researchers for a while now. In this paper, we propose an unsupervised learning based method for estimating the eye gaze region. To train the proposed network "Ize-Net" in self-supervised manner,…

Computer Vision and Pattern Recognition · Computer Science 2019-04-05 Neeru Dubey , Shreya Ghosh , Abhinav Dhall

3D face alignment of monocular images is a crucial process in the recognition of faces with disguise.3D face reconstruction facilitated by alignment can restore the face structure which is helpful in detcting disguise interference.This…

Computer Vision and Pattern Recognition · Computer Science 2019-09-02 Lei Jiang Xiao-Jun Wu Josef Kittler

Convolution exploits locality for efficiency at a cost of missing long range context. Self-attention has been adopted to augment CNNs with non-local interactions. Recent works prove it possible to stack self-attention layers to obtain a…

Computer Vision and Pattern Recognition · Computer Science 2020-08-10 Huiyu Wang , Yukun Zhu , Bradley Green , Hartwig Adam , Alan Yuille , Liang-Chieh Chen

Despite recent advances in appearance-based gaze estimation techniques, the need for training data that covers the target head pose and gaze distribution remains a crucial challenge for practical deployment. This work examines a novel…

Computer Vision and Pattern Recognition · Computer Science 2022-04-28 Jiawei Qin , Takuru Shimoyama , Yusuke Sugano

Attention mechanisms, and most prominently self-attention, are a powerful building block for processing not only text but also images. These provide a parameter efficient method for aggregating inputs. We focus on self-attention in vision…

Computer Vision and Pattern Recognition · Computer Science 2019-11-19 Nichita Diaconu , Daniel E Worrall

Appearance-based gaze estimation has achieved significant improvement by using deep learning. However, many deep learning-based methods suffer from the vulnerability property, i.e., perturbing the raw image using noise confuses the gaze…

Computer Vision and Pattern Recognition · Computer Science 2021-03-25 Mingjie Xu , Haofei Wang , Yunfei Liu , Feng Lu

This paper presents a novel keypoints-based attention mechanism for visual recognition in still images. Deep Convolutional Neural Networks (CNNs) for recognizing images with distinctive classes have shown great success, but their…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Asish Bera , Zachary Wharton , Yonghuai Liu , Nik Bessis , Ardhendu Behera

Estimating human gaze from natural eye images only is a challenging task. Gaze direction can be defined by the pupil- and the eyeball center where the latter is unobservable in 2D images. Hence, achieving highly accurate gaze estimates is…

Computer Vision and Pattern Recognition · Computer Science 2018-12-31 Seonwook Park , Adrian Spurr , Otmar Hilliges

In recent years, the accuracy of gaze estimation techniques has gradually improved, but existing methods often rely on large datasets or large models to improve performance, which leads to high demands on computational resources. In terms…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Zhang Cheng , Yanxia Wang , Guoyu Xia

Transformer attention architectures, similar to those developed for natural language processing, have recently proved efficient also in vision, either in conjunction with or as a replacement for convolutional layers. Typically, visual…

Computer Vision and Pattern Recognition · Computer Science 2021-07-01 Rufin VanRullen , Andrea Alamia