English
Related papers

Related papers: Trends, Applications, and Challenges in Human Atte…

200 papers

This study analyzes changes in the attention mechanisms of large language models (LLMs) when used to understand natural conversations between humans (human-human). We analyze three use cases of LLMs: interactions over web content, code, and…

Computation and Language · Computer Science 2024-03-11 Toshish Jawale , Chaitanya Animesh , Sekhar Vallath , Kartik Talamadupula , Larry Heck

Deep learning, a branch of artificial intelligence, is a data-driven method that uses multiple layers of interconnected units or neurons to learn intricate patterns and representations directly from raw input data. Empowered by this…

Machine Learning · Computer Science 2025-07-28 Mohd Halim Mohd Noor , Ayokunle Olalekan Ige

We propose a novel attention model that can accurately attends to target objects of various scales and shapes in images. The model is trained to gradually suppress irrelevant regions in an input image via a progressive attentive process…

Computer Vision and Pattern Recognition · Computer Science 2018-08-08 Paul Hongsuck Seo , Zhe Lin , Scott Cohen , Xiaohui Shen , Bohyung Han

Neural language models are becoming the prevailing methodology for the tasks of query answering, text classification, disambiguation, completion and translation. Commonly comprised of hundreds of millions of parameters, these neural network…

Machine Learning · Computer Science 2020-05-13 Blaž Škrlj , Nika Eržen , Shane Sheehan , Saturnino Luz , Marko Robnik-Šikonja , Senja Pollak

Many vision and language models suffer from poor visual grounding - often falling back on easy-to-learn language priors rather than basing their decisions on visual concepts in the image. In this work, we propose a generic approach called…

Computer Vision and Pattern Recognition · Computer Science 2019-10-29 Ramprasaath R. Selvaraju , Stefan Lee , Yilin Shen , Hongxia Jin , Shalini Ghosh , Larry Heck , Dhruv Batra , Devi Parikh

Human activity detection has seen a tremendous growth in the last decade playing a major role in the field of pervasive computing. This emerging popularity can be attributed to its myriad of real-life applications primarily dealing with…

Machine Learning · Computer Science 2015-10-20 Jitenkumar Babubhai Rana , Rashmi Shetty , Tanya Jha

Deep neural network models have recently draw lots of attention, as it consistently produce impressive results in many computer vision tasks such as image classification, object detection, etc. However, interpreting such model and show the…

Machine Learning · Computer Science 2019-01-30 Shipeng Xie , Da Chen , Rong Zhang , Hui Xue

Attention in neural machine translation provides the possibility to encode relevant parts of the source sentence at each translation step. As a result, attention is considered to be an alignment model as well. However, there is no work that…

Computation and Language · Computer Science 2017-10-11 Hamidreza Ghader , Christof Monz

The integration of human and artificial intelligence offers a powerful avenue for advancing our understanding of information processing, as each system provides unique computational insights. However, despite the promise of human-AI…

Neurons and Cognition · Quantitative Biology 2025-04-22 Stephen Chong Zhao , Yang Hu , Jason Lee , Andrew Bender , Trisha Mazumdar , Mark Wallace , David A. Tovar

Attention is a very popular and effective mechanism in artificial neural network-based sequence-to-sequence models. In this survey paper, a comprehensive review of the different attention models used in developing automatic speech…

Sound · Computer Science 2021-02-16 Priyabrata Karmakar , Shyh Wei Teng , Guojun Lu

Visual attention is a mechanism closely intertwined with vision and memory. Top-down information influences visual processing through attention. We designed a neural network model inspired by aspects of human visual attention. This model…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Ruoyang Hu , Robert A. Jacobs

Visual question answering (VQA) usesimage processing algorithms to process the image and natural language processing methods to understand and answer the question. VQA is helpful to a visually impaired person, can be used for the security…

Computer Vision and Pattern Recognition · Computer Science 2023-05-31 Param Ahir , Hiteishi M. Diwanji

A long time ago in the machine learning literature, the idea of incorporating a mechanism inspired by the human visual system into neural networks was introduced. This idea is named the attention mechanism, and it has gone through a long…

Machine Learning · Computer Science 2022-08-10 Derya Soydaner

Selective attention plays an essential role in information acquisition and utilization from the environment. In the past 50 years, research on selective attention has been a central topic in cognitive science. Compared with unimodal…

Computer Vision and Pattern Recognition · Computer Science 2019-09-13 Di Fu , Cornelius Weber , Guochun Yang , Matthias Kerzel , Weizhi Nan , Pablo Barros , Haiyan Wu , Xun Liu , Stefan Wermter

Robust and efficient learning remains a challenging problem in robotics, in particular with complex visual inputs. Inspired by human attention mechanism, with which we quickly process complex visual scenes and react to changes in the…

Robotics · Computer Science 2023-08-30 Daniel Scheuchenstuhl , Stefan Ulmer , Felix Resch , Luigi Berducci , Radu Grosu

Attention mechanisms have been widely used in Visual Question Answering (VQA) solutions due to their capacity to model deep cross-domain interactions. Analyzing attention maps offers us a perspective to find out limitations of current VQA…

Computer Vision and Pattern Recognition · Computer Science 2018-10-10 Wei Li , Zehuan Yuan , Xiangzhong Fang , Changhu Wang

The potential of multimodal generative artificial intelligence (mAI) to replicate human grounded language understanding, including the pragmatic, context-rich aspects of communication, remains to be clarified. Humans are known to use…

Human parsing is a key topic in image processing with many applications, such as surveillance analysis, human-robot interaction, person search, and clothing category classification, among many others. Recently, due to the success of deep…

Computer Vision and Pattern Recognition · Computer Science 2023-01-31 Xiaomei Zhang , Xiangyu Zhu , Ming Tang , Zhen Lei

Deep learning has received extensive research interest in developing new medical image processing algorithms, and deep learning based models have been remarkably successful in a variety of medical imaging tasks to support disease detection…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Xuxin Chen , Ximin Wang , Ke Zhang , Kar-Ming Fung , Theresa C. Thai , Kathleen Moore , Robert S. Mannel , Hong Liu , Bin Zheng , Yuchen Qiu

Most approaches that model time-series data in human activity recognition based on body-worn sensing (HAR) use a fixed size temporal context to represent different activities. This might, however, not be apt for sets of activities with…

Computer Vision and Pattern Recognition · Computer Science 2018-05-22 Vishvak S Murahari , Thomas Ploetz