English
Related papers

Related papers: Beyond Quadratic: Linear-Time Change Detection wit…

200 papers

In multivariate time series forecasting, the Transformer architecture encounters two significant challenges: effectively mining features from historical sequences and avoiding overfitting during the learning of temporal dependencies. To…

Machine Learning · Computer Science 2024-04-30 Han Zhou , Yuntian Chen

Fault diagnosis of rotating machinery is an important engineering problem. In recent years, fault diagnosis methods based on the Convolutional Neural Network (CNN) and Recurrent Neural Network (RNN) have been mature, but Transformer has not…

Computational Engineering, Finance, and Science · Computer Science 2021-08-31 Yuhong Jin , Lei Hou , Yushu Chen

CNN-LSTM based architectures have played an important role in image captioning, but limited by the training efficiency and expression ability, researchers began to explore the CNN-Transformer based models and achieved great success.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Yiyu Wang , Jungang Xu , Yingfei Sun

This study proposes a novel approach for dynamic load balancing in Software-Defined Networks (SDNs) using a Transformer-based Deep Q-Network (DQN). Traditional load balancing mechanisms, such as Round Robin (RR) and Weighted Round Robin…

We present Recurrent Vision Transformers (RVTs), a novel backbone for object detection with event cameras. Event cameras provide visual information with sub-millisecond latency at a high-dynamic range and with strong robustness against…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Mathias Gehrig , Davide Scaramuzza

In this work, we propose a Multigrain-aware Semantic Prototype Scanning paradigm for pan-sharpening, built upon a high-order RWKV architecture and a tri-token prompting mechanism derived from semantic clustering. Specifically, our method…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Junfeng Li , Wenyang Zhou , Xueheng Li , Xuanhua He , Jianhou Gan , Wenqi Ren

Temporal modeling in complex systems requires capturing dependencies across multiple time scales while managing inherent uncertainties. We propose HierCVAE, a novel architecture that integrates hierarchical attention mechanisms with…

Machine Learning · Computer Science 2025-08-27 Yao Wu

Non-linear (large) time warping is a challenging source of nuisance in time-series analysis. In this paper, we propose a novel diffeomorphic temporal transformer network for both pairwise and joint time-series alignment. Our ResNet-TW (Deep…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Hao Huang , Boulbaba Ben Amor , Xichan Lin , Fan Zhu , Yi Fang

Visual Place Recognition (VPR) estimates the location of query images by matching them with images in a reference database. Conventional methods generally adopt aggregated CNN features for global retrieval and RANSAC-based geometric…

Computer Vision and Pattern Recognition · Computer Science 2023-04-10 Sijie Zhu , Linjie Yang , Chen Chen , Mubarak Shah , Xiaohui Shen , Heng Wang

Local Feature Matching, an essential component of several computer vision tasks (e.g., structure from motion and visual localization), has been effectively settled by Transformer-based methods. However, these methods only integrate…

Computer Vision and Pattern Recognition · Computer Science 2023-10-23 Xinyu Zhang , Li Wang , Zhiqiang Jiang , Kun Dai , Tao Xie , Lei Yang , Wenhao Yu , Yang Shen , Jun Li

Spatial convolution is fundamental in constructing deep Convolutional Neural Networks (CNNs) for visual recognition. While dynamic convolution enhances model accuracy by adaptively combining static kernels, it incurs significant…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Tianyu Zhang , Fan Wan , Haoran Duan , Kevin W. Tong , Jingjing Deng , Yang Long

Convolutional Neural Networks (CNNs) have achieved state-of-the-art performance in many computer vision tasks over the years. However, this comes at the cost of heavy computation and memory intensive network designs, suggesting potential…

Computer Vision and Pattern Recognition · Computer Science 2020-08-11 Kumara Kahatapitiya , Ranga Rodrigo

Accurate and high-resolution precipitation nowcasting from radar echo sequences is crucial for disaster mitigation and economic planning, yet it remains a significant challenge. Key difficulties include modeling complex multi-scale…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Wenjie Luo , Chuanhu Deng , Chaorong Li , Rongyao Deng , Qiang Yang

Image restoration (IR) aims to recover high-quality images from degraded inputs, with recent deep learning advancements significantly enhancing performance. However, existing methods lack a unified training benchmark for iterations and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Yuzhen Du , Teng Hu , Jiangning Zhang , Ran Yi Chengming Xu , Xiaobin Hu , Kai Wu , Donghao Luo , Yabiao Wang , Lizhuang Ma

This paper studies the unsupervised change point detection problem in time series of networks using the Separable Temporal Exponential-family Random Graph Model (STERGM). Inherently, dynamic network patterns are complex due to dyadic and…

Methodology · Statistics 2025-09-01 Yik Lun Kei , Hangjian Li , Yanzhen Chen , Oscar Hernan Madrid Padilla

Table structure recognition (TSR) aims to convert tabular images into a machine-readable format. Although hybrid convolutional neural network (CNN)-transformer architecture is widely used in existing approaches, linear projection…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 ShengYun Peng , Seongmin Lee , Xiaojing Wang , Rajarajeswari Balasubramaniyan , Duen Horng Chau

Despite the recent advancements in offline reinforcement learning via supervised learning (RvS) and the success of the decision transformer (DT) architecture in various domains, DTs have fallen short in several challenging benchmarks. The…

Machine Learning · Computer Science 2023-11-21 Anirudhan Badrinath , Yannis Flet-Berliac , Allen Nie , Emma Brunskill

Change detection, a prominent research area in remote sensing, is pivotal in observing and analyzing surface transformations. Despite significant advancements achieved through deep learning-based methods, executing high-precision change…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Keyan Chen , Chengyang Liu , Wenyuan Li , Zili Liu , Hao Chen , Haotian Zhang , Zhengxia Zou , Zhenwei Shi

Aerial object detection using unmanned aerial vehicles (UAVs) faces critical challenges including sub-10px targets, dense occlusions, and stringent computational constraints. Existing detectors struggle to balance accuracy and efficiency…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Liu Wenbin

Deep learning has shown remarkable success in remote sensing change detection (CD), aiming to identify semantic change regions between co-registered satellite image pairs acquired at distinct time stamps. However, existing convolutional…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Mubashir Noman , Mustansar Fiaz , Hisham Cholakkal , Salman Khan , Fahad Shahbaz Khan