English
Related papers

Related papers: Computational models: Bottom-up and top-down aspec…

200 papers

The neural attention mechanism plays an important role in many natural language processing applications. In particular, the use of multi-head attention extends single-head attention by allowing a model to jointly attend information from…

Machine Learning · Computer Science 2020-11-03 Bang An , Jie Lyu , Zhenyi Wang , Chunyuan Li , Changwei Hu , Fei Tan , Ruiyi Zhang , Yifan Hu , Changyou Chen

We investigate attention as the active pursuit of useful information. This contrasts with attention as a mechanism for the attenuation of irrelevant information. We also consider the role of short-term memory, whose use is critical to any…

Machine Learning · Computer Science 2015-11-02 Philip Bachman , David Krueger , Doina Precup

The recurrent neural networks (RNN) can be used to solve the sequence to sequence problem, where both the input and the output have sequential structures. Usually there are some implicit relations between the structures. However, it is hard…

Computer Vision and Pattern Recognition · Computer Science 2016-01-27 Feng Wang , David M. J. Tax

Understanding what makes a video memorable has important applications in advertising or education technology. Towards this goal, we investigate spatio-temporal attention mechanisms underlying video memorability. Different from previous…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Prajneya Kumar , Eshika Khandelwal , Makarand Tapaswi , Vishnu Sreekumar

Computational modeling helps neuroscientists to integrate and explain experimental data obtained through neurophysiological and anatomical studies, thus providing a mechanism by which we can better understand and predict the principles of…

Neurons and Cognition · Quantitative Biology 2023-09-22 Parvin Zarei Eskikand , David B Grayden , Tatiana Kameneva , Anthony N Burkitt , Michael R Ibbotson

Sufficiently perceiving the environment is a critical factor in robot motion generation. Although the introduction of deep visual processing models have contributed in extending this ability, existing methods lack in the ability to actively…

Robotics · Computer Science 2022-06-30 Hyogo Hiruma , Hiroshi Ito , Hiroki Mori , Tetsuya Ogata

Image classification models have achieved satisfactory performance on many datasets, sometimes even better than human. However, The model attention is unclear since the lack of interpretability. This paper investigates the fidelity and…

Computer Vision and Pattern Recognition · Computer Science 2020-09-30 Wenjia Xu , Jiuniu Wang , Yang Wang , Guangluan Xu , Wei Dai , Yirong Wu

Deep Convolutional Neural Networks (DCNNs) were originally inspired by principles of biological vision, have evolved into best current computational models of object recognition, and consequently indicate strong architectural and functional…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Leonard E. van Dyck , Sebastian J. Denzler , Walter R. Gruber

Today's information and communication devices provide always-on connectivity, instant access to an endless repository of information, and represent the most direct point of contact to almost any person in the world. Despite these…

Human-Computer Interaction · Computer Science 2018-06-19 Christoph Anderson , Isabel Hübener , Ann-Kathrin Seipp , Sandra Ohly , Klaus David , Veljko Pejovic

Recently, the advancement of 3D point clouds in deep learning has attracted intensive research in different application domains such as computer vision and robotic tasks. However, creating feature representation of robust, discriminative…

Computer Vision and Pattern Recognition · Computer Science 2021-02-23 Xu Wang , Yi Jin , Yigang Cen , Tao Wang , Yidong Li

Visual attention refers to the human brain's ability to select relevant sensory information for preferential processing, improving performance in visual and cognitive tasks. It proceeds in two phases. One in which visual feature maps are…

Computer Vision and Pattern Recognition · Computer Science 2020-10-02 Dario Zanca , Marco Gori , Stefano Melacci , Alessandra Rufa

Visual attention plays an important role to understand images and demonstrates its effectiveness in generating natural language descriptions of images. On the other hand, recent studies show that language associated with an image can steer…

Computer Vision and Pattern Recognition · Computer Science 2016-12-13 Jonghwan Mun , Minsu Cho , Bohyung Han

Perception of the visually disjoint surfaces of our cluttered world as whole objects, physically distinct from those overlapping them, is a cognitive phenomenon called objectness that forms the basis of our visual perception. Shared by all…

Computer Vision and Pattern Recognition · Computer Science 2024-02-05 Douglas Poland , Amar Saini

The ability to selectively attend to relevant stimuli while filtering out distractions is essential for agents that process complex, high-dimensional sensory input. This paper introduces a model of covert and overt visual attention through…

Computer Vision and Pattern Recognition · Computer Science 2025-05-09 Tin Mišić , Karlo Koledić , Fabio Bonsignorio , Ivan Petrović , Ivan Marković

Computational models pervade all branches of the exact sciences and have in recent times also started to prove to be of immense utility in some of the traditionally 'soft' sciences like ecology, sociology and politics. This volume is a…

The potential of multimodal generative artificial intelligence (mAI) to replicate human grounded language understanding, including the pragmatic, context-rich aspects of communication, remains to be clarified. Humans are known to use…

This study investigates the developmental interaction between top-down (TD) and bottom-up (BU) visual attention in robotic learning. Our goal is to understand how structured, human-like attentional behavior emerges through the mutual…

Robotics · Computer Science 2025-10-14 Hyogo Hiruma , Hiroshi Ito , Hiroki Mori , Tetsuya Ogata

Top-down visual attention mechanisms have been used extensively in image captioning and visual question answering (VQA) to enable deeper image understanding through fine-grained analysis and even multiple steps of reasoning. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2018-03-15 Peter Anderson , Xiaodong He , Chris Buehler , Damien Teney , Mark Johnson , Stephen Gould , Lei Zhang

A variety of computational models have been developed to describe active matter at different length and time scales. The diversity of the methods and the challenges in modeling active matter---ranging from molecular motors and cytoskeletal…

Soft Condensed Matter · Physics 2020-04-21 M Reza Shaebani , Adam Wysocki , Roland G Winkler , Gerhard Gompper , Heiko Rieger

Deep neural networks, including recurrent networks, have been successfully applied to human activity recognition. Unfortunately, the final representation learned by recurrent networks might encode some noise (irrelevant signal components,…

Machine Learning · Computer Science 2018-10-10 Ming Zeng , Haoxiang Gao , Tong Yu , Ole J. Mengshoel , Helge Langseth , Ian Lane , Xiaobing Liu