English
Related papers

Related papers: Dynamic Computational Time for Visual Attention

200 papers

Recent neuroimaging studies have highlighted the importance of network-centric brain analysis, particularly with functional magnetic resonance imaging. The emergence of Deep Neural Networks has fostered a substantial interest in predicting…

Neurons and Cognition · Quantitative Biology 2023-09-06 Xuan Kan , Antonio Aodong Chen Gu , Hejie Cui , Ying Guo , Carl Yang

We design an Enriched Deep Recurrent Visual Attention Model (EDRAM) - an improved attention-based architecture for multiple object recognition. The proposed model is a fully differentiable unit that can be optimized end-to-end by using…

Computer Vision and Pattern Recognition · Computer Science 2017-06-13 Artsiom Ablavatski , Shijian Lu , Jianfei Cai

Driver distractions are known to be the dominant cause of road accidents. While monitoring systems can detect non-driving-related activities and facilitate reducing the risks, they must be accurate and efficient to be applicable.…

Computer Vision and Pattern Recognition · Computer Science 2022-10-19 Yiming Ma , Victor Sanchez , Soodeh Nikan , Devesh Upadhyay , Bhushan Atote , Tanaya Guha

Visual attention, derived from cognitive neuroscience, facilitates human perception on the most pertinent subset of the sensory data. Recently, significant efforts have been made to exploit attention schemes to advance computer vision…

Computer Vision and Pattern Recognition · Computer Science 2018-10-16 Shi Pu , Yibing Song , Chao Ma , Honggang Zhang , Ming-Hsuan Yang

In medical imaging, technical progress or changes in diagnostic procedures lead to a continuous change in image appearance. Scanner manufacturer, reconstruction kernel, dose, other protocol specific settings or administering of contrast…

Machine Learning · Computer Science 2020-07-08 Johannes Hofmanninger , Matthias Perkonigg , James A. Brink , Oleg Pianykh , Christian Herold , Georg Langs

Many road accidents occur due to distracted drivers. Today, driver monitoring is essential even for the latest autonomous vehicles to alert distracted drivers in order to take over control of the vehicle in case of emergency. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2019-07-19 Neslihan Kose , Okan Kopuklu , Alexander Unnervik , Gerhard Rigoll

Evidence accumulation models (EAMs) are the dominant framework for modeling response time (RT) data from speeded decision-making tasks. While providing a good quantitative description of RT data in terms of abstract perceptual…

Neurons and Cognition · Quantitative Biology 2024-12-10 Paul I. Jaffe , Gustavo X. Santiago-Reyes , Robert J. Schafer , Patrick G. Bissett , Russell A. Poldrack

This paper is on video recognition using Transformers. Very recent attempts in this area have demonstrated promising results in terms of recognition accuracy, yet they have been also shown to induce, in many cases, significant computational…

Computer Vision and Pattern Recognition · Computer Science 2021-06-14 Adrian Bulat , Juan-Manuel Perez-Rua , Swathikiran Sudhakaran , Brais Martinez , Georgios Tzimiropoulos

Without relevant human priors, neural networks may learn uninterpretable features. We propose Dynamics of Attention for Focus Transition (DAFT) as a human prior for machine reasoning. DAFT is a novel method that regularizes attention-based…

Machine Learning · Statistics 2019-12-24 Wonjae Kim , Yoonho Lee

Template-matching methods for visual tracking have gained popularity recently due to their good performance and fast speed. However, they lack effective ways to adapt to changes in the target object's appearance, making their tracking…

Computer Vision and Pattern Recognition · Computer Science 2019-12-02 Tianyu Yang , Antoni B. Chan

Modern foundation model architectures rely on attention mechanisms to effectively capture context. However, these methods require linear or quadratic memory in terms of the number of inputs/datapoints, limiting their applicability in…

Machine Learning · Computer Science 2023-06-23 Leo Feng , Frederick Tung , Hossein Hajimirsadeghi , Yoshua Bengio , Mohamed Osama Ahmed

Developing autonomous vehicles (AVs) helps improve the road safety and traffic efficiency of intelligent transportation systems (ITS). Accurately predicting the trajectories of traffic participants is essential to the decision-making and…

Robotics · Computer Science 2022-12-22 Yunlong Lin , Zirui Li , Cheng Gong , Chao Lu , Xinwei Wang , Jianwei Gong

Temporal modeling plays a crucial role in understanding video content. To tackle this problem, previous studies built complicated temporal relations through time sequence thanks to the development of computationally powerful devices. In…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Wenhao Wu , Yuxin Song , Zhun Sun , Jingdong Wang , Chang Xu , Wanli Ouyang

In standard passive imitation learning, the goal is to learn a target policy by passively observing full execution trajectories of it. Unfortunately, generating such trajectories can require substantial expert effort and be impractical in…

Machine Learning · Computer Science 2012-10-19 Kshitij Judah , Alan Fern , Thomas G. Dietterich

Human action recognition is an important task in computer vision. Extracting discriminative spatial and temporal features to model the spatial and temporal evolutions of different actions plays a key role in accomplishing this task. In this…

Computer Vision and Pattern Recognition · Computer Science 2016-11-21 Sijie Song , Cuiling Lan , Junliang Xing , Wenjun Zeng , Jiaying Liu

Efficient inference on GPUs using large language models remains challenging due to memory bandwidth limitations, particularly during data transfers between High Bandwidth Memory (HBM) and SRAM in attention computations. Approximate…

Machine Learning · Computer Science 2025-06-06 Nirav Koley , Prajwal Singhania , Abhinav Bhatele

In this work, we tackle the problem of modeling the vehicle environment as dynamic occupancy grid map in complex urban scenarios using recurrent neural networks. Dynamic occupancy grid maps represent the scene in a bird's eye view, where…

Robotics · Computer Science 2022-05-06 Marcel Schreiber , Vasileios Belagiannis , Claudius Glaeser , Klaus Dietmayer

The attention mechanism has been proven effective on various visual tasks in recent years. In the semantic segmentation task, the attention mechanism is applied in various methods, including the case of both Convolution Neural Networks…

Computer Vision and Pattern Recognition · Computer Science 2024-05-10 Zheng Yuan , Jie Zhang , Yude Wang , Shiguang Shan , Xilin Chen

Multi-scale deformable attention (MSDA) is a flexible and powerful feature extraction mechanism for visual tasks, but its random-access grid sampling strategy poses significant optimization challenges, especially on domain-specific…

Performance · Computer Science 2025-05-21 Chenghuan Huang , Zhigeng Xu , Chong Sun , Chen Li , Ziyang Ma

Recent researches show that machine learning has the potential to learn better heuristics than the one designed by human for solving combinatorial optimization problems. The deep neural network is used to characterize the input instance for…

Machine Learning · Computer Science 2020-02-11 Bo Peng , Jiahai Wang , Zizhen Zhang