English
Related papers

Related papers: Dynamic Attention Mechanism in Spatiotemporal Memo…

200 papers

Purpose: This paper aims to enhance bearing fault diagnosis in industrial machinery by introducing a novel method that combines Graph Attention Network (GAT) and Long Short-Term Memory (LSTM) networks. This approach captures both spatial…

Long-context understanding is crucial for many NLP applications, yet transformers struggle with efficiency due to the quadratic complexity of self-attention. Sparse attention methods alleviate this cost but often impose static, predefined…

Computation and Language · Computer Science 2025-06-16 Hanzhi Zhang , Heng Fan , Kewei Sha , Yan Huang , Yunhe Feng

We present a reward-predictive, model-based deep learning method featuring trajectory-constrained visual attention for local planning in visual navigation tasks. Our method learns to place visual attention at locations in latent image space…

Robotics · Computer Science 2022-05-27 Stefan Wapnick , Travis Manderson , David Meger , Gregory Dudek

Visual object tracking task is constantly gaining importance in several fields of application as traffic monitoring, robotics, and surveillance, to name a few. Dealing with changes in the appearance of the tracked object is paramount to…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Fabio Garcea , Alessandro Cucco , Lia Morra , Fabrizio Lamberti

Recently, attention mechanisms have been extensively investigated in computer vision, but few of them show excellent performance on both large and mobile networks. This paper proposes Dual Rank-1 Tensor Attention Module (DRTAM), a novel…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Hanxing Chi , Baihong Lin , Jun Hu , Liang Wang

Fine-grained object classification is a challenging task due to the subtle inter-class difference and large intra-class variation. Recently, visual attention models have been applied to automatically localize the discriminative regions of…

Computer Vision and Pattern Recognition · Computer Science 2018-02-27 Bo Zhao , Xiao Wu , Jiashi Feng , Qiang Peng , Shuicheng Yan

Attention networks have successfully boosted the performance in various vision problems. Previous works lay emphasis on designing a new attention module and individually plug them into the networks. Our paper proposes a novel-and-simple…

Computer Vision and Pattern Recognition · Computer Science 2019-09-24 Zhongzhan Huang , Senwei Liang , Mingfu Liang , Haizhao Yang

The detection of small objects in aerial images is a fundamental task in the field of computer vision. Moving objects in aerial photography have problems such as different shapes and sizes, dense overlap, occlusion by the background, and…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Haodong Li , Haicheng Qu

Reliable traffic flow prediction is crucial to creating intelligent transportation systems. Many big-data-based prediction approaches have been developed but they do not reflect complicated dynamic interactions between roads considering…

Machine Learning · Computer Science 2023-06-21 Won Kyung Lee , Deuk Sin Kwon , So Young Sohn

We propose a novel memory-based tracker via part-level dense memory and voting-based retrieval, called DMV. Since deep learning techniques have been introduced to the tracking field, Siamese trackers have attracted many researchers due to…

Computer Vision and Pattern Recognition · Computer Science 2020-03-23 Gunhee Nam , Seoung Wug Oh , Joon-Young Lee , Seon Joo Kim

In recent years, the deployment of large-scale pre-trained models in audio-visual downstream tasks has yielded remarkable outcomes. However, these models, primarily trained on single-modality unconstrained datasets, still encounter…

Machine Learning · Computer Science 2023-12-22 Haoyi Duan , Yan Xia , Mingze Zhou , Li Tang , Jieming Zhu , Zhou Zhao

In this paper, we propose a novel on-line visual tracking framework based on the Siamese matching network and meta-learner network, which run at real-time speeds. Conventional deep convolutional feature-based discriminative visual tracking…

Computer Vision and Pattern Recognition · Computer Science 2019-08-19 Janghoon Choi , Junseok Kwon , Kyoung Mu Lee

Real-time video analysis remains a challenging problem in computer vision, requiring efficient processing of both spatial and temporal information while maintaining computational efficiency. Existing approaches often struggle to balance…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Shahla John

Recent progress has been made in using attention based encoder-decoder framework for video captioning. However, most existing decoders apply the attention mechanism to every generated word including both visual words (e.g., "gun" and…

Computer Vision and Pattern Recognition · Computer Science 2017-06-06 Jingkuan Song , Zhao Guo , Lianli Gao , Wu Liu , Dongxiang Zhang , Heng Tao Shen

Multimodal time series (MTS) anomaly detection is crucial for maintaining the safety and stability of working devices (e.g., water treatment system and spacecraft), whose data are characterized by multivariate time series with diverse…

Machine Learning · Computer Science 2023-10-18 Chaoyue Ding , Shiliang Sun , Jing Zhao

Deep neural networks, especially transformer-based architectures, have achieved remarkable success in semantic segmentation for environmental perception. However, existing models process video frames independently, thus failing to leverage…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Serin Varghese , Kevin Ross , Fabian Hueger , Kira Maag

Many query-based approaches for 3D Multi-Object Tracking (MOT) adopt the tracking-by-attention paradigm, utilizing track queries for identity-consistent detection and object queries for identity-agnostic track spawning.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Shuxiao Ding , Lukas Schneider , Marius Cordts , Juergen Gall

In differentiable neural architecture search (NAS) algorithms like DARTS, the training set used to update model weight and the validation set used to update model architectures are sampled from the same data distribution. Thus, the uncommon…

Machine Learning · Computer Science 2021-12-02 Ruisi Zhang , Youwei Liang , Sai Ashish Somayajula , Pengtao Xie

The Long Short-Term Memory (LSTM) neural network based data association algorithm named as DeepDA for multi-target tracking in clutters is proposed to deal with the NP-hard combinatorial optimization problem in this paper. Different from…

Machine Learning · Computer Science 2019-07-29 Huajun Liu , Hui Zhang , Christoph Mertz

In this paper, we investigate the impacts of three main aspects of visual tracking, i.e., the backbone network, the attentional mechanism, and the detection component, and propose a Siamese Attentional Keypoint Network, dubbed SATIN, for…

Computer Vision and Pattern Recognition · Computer Science 2020-01-01 Peng Gao , Ruyue Yuan , Fei Wang , Liyi Xiao , Hamido Fujita , Yan Zhang