English
Related papers

Related papers: Passive Attention in Artificial Neural Networks Pr…

200 papers

We propose augmenting deep neural networks with an attention mechanism for the visual object detection task. As perceiving a scene, humans have the capability of multiple fixation points, each attended to scene content at different…

Computer Vision and Pattern Recognition · Computer Science 2017-02-07 Kota Hara , Ming-Yu Liu , Oncel Tuzel , Amir-massoud Farahmand

Human pose estimation is an essential yet challenging task in computer vision. One of the reasons for this difficulty is that there are many redundant regions in the images. In this work, we proposed a convolutional network architecture…

Computer Vision and Pattern Recognition · Computer Science 2019-04-05 Guanxiong Sun , Chengqin Ye , Kuanquan Wang

The spreading of attention has been proposed as a mechanism for how humans group features to segment objects. However, such a mechanism has not yet been implemented and tested in naturalistic images. Here, we leverage the feature maps from…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Hossein Adeli , Seoyoung Ahn , Nikolaus Kriegeskorte , Gregory Zelinsky

Deep Convolutional Neural Networks (DCNNs) were originally inspired by principles of biological vision, have evolved into best current computational models of object recognition, and consequently indicate strong architectural and functional…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Leonard E. van Dyck , Sebastian J. Denzler , Walter R. Gruber

Self-attention networks (SANs) have drawn increasing interest due to their high parallelization in computation and flexibility in modeling dependencies. SANs can be further enhanced with multi-head attention by allowing the model to attend…

Computation and Language · Computer Science 2019-04-08 Baosong Yang , Longyue Wang , Derek Wong , Lidia S. Chao , Zhaopeng Tu

Inspired by the human cognitive system, attention is a mechanism that imitates the human cognitive awareness about specific information, amplifying critical details to focus more on the essential aspects of data. Deep learning has employed…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Mohammed Hassanin , Saeed Anwar , Ibrahim Radwan , Fahad S Khan , Ajmal Mian

Artificial neural networks (ANNs) have emerged as an essential tool in machine learning, achieving remarkable success across diverse domains, including image and speech generation, game playing, and robotics. However, there exist…

Neural and Evolutionary Computing · Computer Science 2023-05-22 Samuel Schmidgall , Jascha Achterberg , Thomas Miconi , Louis Kirsch , Rojin Ziaei , S. Pardis Hajiseyedrazi , Jason Eshraghian

Human decision-making in cognitive tasks and daily life exhibits considerable variability, shaped by factors such as task difficulty, individual preferences, and personal experiences. Understanding this variability across individuals is…

Artificial Intelligence · Computer Science 2025-05-07 Chen Wei , Chi Zhang , Jiachen Zou , Haotian Deng , Dietmar Heinke , Quanying Liu

Recent models for image processing are using the Convolutional neural network (CNN) which requires a pixel per pixel analysis of the input image. This method works well. However, it is time-consuming if we have large images. To increase the…

Machine Learning · Computer Science 2019-12-10 Mohamed Karim Belaid

Visual attention estimation is an active field of research at the crossroads of different disciplines: computer vision, artificial intelligence and medicine. One of the most common approaches to estimate a saliency map representing…

Computer Vision and Pattern Recognition · Computer Science 2022-01-12 Victor Delvigne , Noé Tits , Luca La Fisca , Nathan Hubens , Antoine Maiorca , Hazem Wannous , Thierry Dutoit , Jean-Philippe Vandeborre

Humans can naturally and effectively find salient regions in complex scenes. Motivated by this observation, attention mechanisms were introduced into computer vision with the aim of imitating this aspect of the human visual system. Such an…

Computer Vision and Pattern Recognition · Computer Science 2022-07-06 Meng-Hao Guo , Tian-Xing Xu , Jiang-Jiang Liu , Zheng-Ning Liu , Peng-Tao Jiang , Tai-Jiang Mu , Song-Hai Zhang , Ralph R. Martin , Ming-Ming Cheng , Shi-Min Hu

Computational human attention modeling in free-viewing and task-specific settings is often studied separately, with limited exploration of whether a common representation exists between them. This work investigates this question and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Fatma Youssef Mohammed , Kostas Alexis

This paper presents a novel keypoints-based attention mechanism for visual recognition in still images. Deep Convolutional Neural Networks (CNNs) for recognizing images with distinctive classes have shown great success, but their…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Asish Bera , Zachary Wharton , Yonghuai Liu , Nik Bessis , Ardhendu Behera

Human attention modelling has proven, in recent years, to be particularly useful not only for understanding the cognitive processes underlying visual exploration, but also for providing support to artificial intelligence models that aim to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Giuseppe Cartella , Marcella Cornia , Vittorio Cuculo , Alessandro D'Amelio , Dario Zanca , Giuseppe Boccignone , Rita Cucchiara

Neural processes (NPs) learn stochastic processes and predict the distribution of target output adaptively conditioned on a context set of observed input-output pairs. Furthermore, Attentive Neural Process (ANP) improved the prediction…

Machine Learning · Computer Science 2019-10-22 Shenghao Qin , Jiacheng Zhu , Jimmy Qin , Wenshuo Wang , Ding Zhao

Artificial neural networks (ANNs) have become an important tool for image classification with many applications in research and industry. However, it remains largely unknown how relevant image features are selected and how data properties…

Computer Vision and Pattern Recognition · Computer Science 2019-08-09 Marcell Wolnitza , Babette Dellen

For a considerable time, deep convolutional neural networks (DCNNs) have reached human benchmark performance in object recognition. On that account, computational neuroscience and the field of machine learning have started to attribute…

Computer Vision and Pattern Recognition · Computer Science 2020-12-15 Leonard E. van Dyck , Walter R. Gruber

Attention is a complex and broad concept, studied across multiple disciplines spanning artificial intelligence, cognitive science, psychology, neuroscience, and related fields. Although many of the ideas regarding attention do not…

Artificial Intelligence · Computer Science 2020-12-07 Shriraj P. Sawant , Shruti Singh

Artificial neural networks (ANNs) have become the de facto standard for modeling the human visual system, primarily due to their success in predicting neural responses. However, with many models now achieving similar predictive accuracy, we…

Neurons and Cognition · Quantitative Biology 2025-09-30 Nikolas McNeal , N. Apurva Ratan Murty

Selective prediction aims to learn a reliable model that abstains from making predictions when uncertain. These predictions can then be deferred to humans for further evaluation. As an everlasting challenge for machine learning, in many…

Machine Learning · Computer Science 2024-03-04 Jiefeng Chen , Jinsung Yoon , Sayna Ebrahimi , Sercan Arik , Somesh Jha , Tomas Pfister