English
Related papers

Related papers: Cognition-aware Cognate Detection

200 papers

We propose a data-driven approach to detect conversational groups by identifying spatial arrangements typical of these focused social encounters. Our approach uses a novel Deep Affinity Network (DANTE) to predict the likelihood that two…

Computer Vision and Pattern Recognition · Computer Science 2020-07-13 Mason Swofford , John Charles Peruzzi , Nathan Tsoi , Sydney Thompson , Roberto Martín-Martín , Silvio Savarese , Marynel Vázquez

Human gaze provides valuable information on human focus and intentions, making it a crucial area of research. Recently, deep learning has revolutionized appearance-based gaze estimation. However, due to the unique features of gaze…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Yihua Cheng , Haofei Wang , Yiwei Bao , Feng Lu

Joint visual attention is characterized by two or more individuals looking at a common target at the same time. The ability to identify joint attention in scenes, the people involved, and their common target, is fundamental to the…

Computer Vision and Pattern Recognition · Computer Science 2018-04-13 Daniel Harari , Joshua B. Tenenbaum , Shimon Ullman

Robust gaze estimation is a challenging task, even for deep CNNs, due to the non-availability of large-scale labeled data. Moreover, gaze annotation is a time-consuming process and requires specialized hardware setups. We propose MTGLS: a…

Computer Vision and Pattern Recognition · Computer Science 2021-12-14 Shreya Ghosh , Munawar Hayat , Abhinav Dhall , Jarrod Knibbe

The article presents performance analysis of a real valued neuro genetic algorithm applied for the detection of proportion of the gases found in manhole gas mixture. The neural network (NN) trained using genetic algorithm (GA) leads to…

Neural and Evolutionary Computing · Computer Science 2012-09-06 Varun Kumar Ojha , Paramartha Dutta , Hiranmay Saha

Gaze estimation, which predicts gaze direction, commonly faces the challenge of interference from complex gaze-irrelevant information in face images. In this work, we propose DMAGaze, a novel gaze estimation framework that exploits…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Haohan Chen , Hongjia Liu , Shiyong Lan , Wenwu Wang , Yixin Qiao , Yao Li , Guonan Deng

This paper presents the selective use of eye-gaze information in learning human actions in Atari games. Vast evidence suggests that our eye movement convey a wealth of information about the direction of our attention and mental states and…

Machine Learning · Computer Science 2020-12-08 Chaitanya Thammineni , Hemanth Manjunatha , Ehsan T. Esfahani

Human eye gaze estimation is an important cognitive ingredient for successful human-robot interaction, enabling the robot to read and predict human behavior. We approach this problem using artificial neural networks and build a modular…

Computer Vision and Pattern Recognition · Computer Science 2024-03-01 Dmytro Herashchenko , Igor Farkaš

This paper is interested in investigating whether human gaze signals can be leveraged to improve state-of-the-art search engine performance and how to incorporate this new input signal marked by human attention into existing neural…

Information Retrieval · Computer Science 2022-07-06 Sibo Dong , Justin Goldstein , Grace Hui Yang

Gaze estimation methods learn eye gaze from facial features. However, among rich information in the facial image, real gaze-relevant features only correspond to subtle changes in eye region, while other gaze-irrelevant features like…

Computer Vision and Pattern Recognition · Computer Science 2021-12-24 Yihua Cheng , Yiwei Bao , Feng Lu

Gaze object detection and gaze following are fundamental tasks for interpreting human gaze behavior or intent. However, most previous methods usually solve these two tasks separately, and their prediction of gaze objects and gaze following…

Computer Vision and Pattern Recognition · Computer Science 2025-10-30 Yang Jin , Guangyu Guo , Binglu Wang

As a critical cue for understanding human intention, human gaze provides a key signal for Human-Computer Interaction(HCI) applications. Appearance-based gaze estimation, which directly regresses the gaze vector from eye images, has made…

Computer Vision and Pattern Recognition · Computer Science 2021-11-24 Shaobo Guo , Xiao Jiang , Zhizhong Su , Rui Wu , Xin Wang

Human gaze is known to be a strong indicator of underlying human intentions and goals during manipulation tasks. This work studies gaze patterns of human teachers demonstrating tasks to robots and proposes ways in which such patterns can be…

Robotics · Computer Science 2021-11-30 Akanksha Saran , Elaine Schaertl Short , Andrea Thomaz , Scott Niekum

Pedestrian detection methods have been significantly improved with the development of deep convolutional neural networks. Nevertheless, robustly detecting pedestrians with a large variant on sizes and with occlusions remains a challenging…

Computer Vision and Pattern Recognition · Computer Science 2020-05-20 Tianrui Liu , Jun-Jie Huang , Tianhong Dai , Guangyu Ren , Tania Stathaki

Recognizing the category of the object and using the features of the object itself to predict grasp configuration is of great significance to improve the accuracy of the grasp detection model and expand its application. Researchers have…

Robotics · Computer Science 2022-03-03 Mingshuai Dong , Shimin Wei , Jianqin Yin , Xiuli Yu

Most previous studies integrate cognitive language processing signals (e.g., eye-tracking or EEG data) into neural models of natural language processing (NLP) just by directly concatenating word embeddings with cognitive features, ignoring…

Computation and Language · Computer Science 2023-11-15 Yuqi Ren , Deyi Xiong

Humans utilize their gaze to concentrate on essential information while perceiving and interpreting intentions in videos. Incorporating human gaze into computational algorithms can significantly enhance model performance in video…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Suleyman Ozdel , Yao Rong , Berat Mert Albaba , Yen-Ling Kuo , Xi Wang , Enkelejda Kasneci

Cognitively inspired Natural Language Pro-cessing uses human-derived behavioral datalike eye-tracking data, which reflect the seman-tic representations of language in the humanbrain to augment the neural nets to solve arange of tasks…

Computation and Language · Computer Science 2021-10-12 Varun Madhavan , Aditya Girish Pawate , Shraman Pal , Abhranil Chandra

Inter-personal anatomical differences limit the accuracy of person-independent gaze estimation networks. Yet there is a need to lower gaze errors further to enable applications requiring higher quality. Further gains can be achieved by…

Computer Vision and Pattern Recognition · Computer Science 2019-10-15 Seonwook Park , Shalini De Mello , Pavlo Molchanov , Umar Iqbal , Otmar Hilliges , Jan Kautz

Gaze estimation methods often experience significant performance degradation when evaluated across different domains, due to the domain gap between the testing and training data. Existing methods try to address this issue using various…

Computer Vision and Pattern Recognition · Computer Science 2024-03-11 Pengwei Yin , Guanzhong Zeng , Jingjing Wang , Di Xie