English
Related papers

Related papers: Flexible and Efficient Spatio-Temporal Transformer…

200 papers

Space-time video super-resolution (STVSR) is the task of interpolating videos with both Low Frame Rate (LFR) and Low Resolution (LR) to produce High-Frame-Rate (HFR) and also High-Resolution (HR) counterparts. The existing methods based on…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Zhicheng Geng , Luming Liang , Tianyu Ding , Ilya Zharkov

In many real-world applications, modeling both the internal structure of sets and their temporal relationships is essential for capturing complex underlying patterns. Sequential multiple-instance learning aims to address this challenge by…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Athanasios Efthymiou , Stevan Rudinac , Monika Kackovic , Nachoem Wijnberg , Marcel Worring

Transformers have emerged as viable alternatives to convolutional neural networks owing to their ability to learn non-local region relationships in the spatial domain. The self-attention mechanism of the transformer enables transformers to…

Image and Video Processing · Electrical Eng. & Systems 2023-08-09 Rahul G. S. , Sriprabha Ramnarayanan , Mohammad Al Fahim , Keerthi Ram , Preejith S. P , Mohanasankar Sivaprakasam

The self-attention mechanism in Transformer architecture, invariant to sequence order, necessitates positional embeddings to encode temporal order in time series prediction. We argue that this reliance on positional embeddings restricts the…

Machine Learning · Computer Science 2024-08-21 Yongbo Yu , Weizhong Yu , Feiping Nie , Xuelong Li

Spectral image reconstruction is an important task in snapshot compressed imaging. This paper aims to propose a new end-to-end framework with iterative capabilities similar to a deep unfolding network to improve reconstruction accuracy,…

Image and Video Processing · Electrical Eng. & Systems 2023-05-09 Zeyu Cai , Jian Yu , Ziyu Zhang , Chengqian Jin , Feipeng Da

Fully supervised change detection methods have achieved significant advancements in performance, yet they depend severely on acquiring costly pixel-level labels. Considering that the patch-level annotations also contain abundant information…

Computer Vision and Pattern Recognition · Computer Science 2023-11-17 Zhenglai Li , Chang Tang , Xinwang Liu , Changdong Li , Xianju Li , Wei Zhang

While substantial progress has been made in the absolute performance of localization and Visual Place Recognition (VPR) techniques, it is becoming increasingly clear from translating these systems into applications that other capabilities…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Helen Carson , Jason J. Ford , Michael Milford

Visual Place Recognition (VPR) is a crucial part of mobile robotics and autonomous driving as well as other computer vision tasks. It refers to the process of identifying a place depicted in a query image using only computer vision. At…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Amar Ali-bey , Brahim Chaib-draa , Philippe Giguère

Scene text recognition (STR) involves the task of reading text in cropped images of natural scenes. Conventional models in STR employ convolutional neural network (CNN) followed by recurrent neural network in an encoder-decoder framework.…

Computer Vision and Pattern Recognition · Computer Science 2022-11-10 Yew Lee Tan , Adams Wai-kin Kong , Jung-Jae Kim

Video super-resolution (VSR), with the aim to restore a high-resolution video from its corresponding low-resolution version, is a spatial-temporal sequence prediction problem. Recently, Transformer has been gaining popularity due to its…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Jiezhang Cao , Yawei Li , Kai Zhang , Luc Van Gool

Dynamic scene graph generation aims at generating a scene graph of the given video. Compared to the task of scene graph generation from images, it is more challenging because of the dynamic relationships between objects and the temporal…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Yuren Cong , Wentong Liao , Hanno Ackermann , Bodo Rosenhahn , Michael Ying Yang

Spatial-temporal forecasting is crucial and widely applicable in various domains such as traffic, energy, and climate. Benefiting from the abundance of unlabeled spatial-temporal data, self-supervised methods are increasingly adapted to…

Machine Learning · Computer Science 2024-12-20 Qi Zheng , Zihao Yao , Yaying Zhang

In the last few years, Deep Convolutional Neural Networks (D-CNNs) have shown state-of-the-art (SOTA) performance for Visual Place Recognition (VPR), a pivotal component of long-term intelligent robotic vision (vision-aware localization and…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Ahmad Khaliq , Shoaib Ehsan , Michael Milford , Klaus McDonald-Maier

In this paper, we present a new tracking architecture with an encoder-decoder transformer as the key component. The encoder models the global spatio-temporal feature dependencies between target objects and search regions, while the decoder…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Bin Yan , Houwen Peng , Jianlong Fu , Dong Wang , Huchuan Lu

Traditional visual place recognition (VPR) methods generally use frame-based cameras, which is easy to fail due to dramatic illumination changes or fast motions. In this paper, we propose an end-to-end visual place recognition network for…

Computer Vision and Pattern Recognition · Computer Science 2020-11-09 Delei Kong , Zheng Fang , Haojia Li , Kuanxu Hou , Sonya Coleman , Dermot Kerr

Event cameras sense the intensity changes asynchronously and produce event streams with high dynamic range and low latency. This has inspired research endeavors utilizing events to guide the challenging video superresolution (VSR) task. In…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Yunfan Lu , Zipeng Wang , Minjie Liu , Hongjian Wang , Lin Wang

Recently, transformers have demonstrated great potential for modeling long-term dependencies from skeleton sequences and thereby gained ever-increasing attention in skeleton action recognition. However, the existing transformer-based…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Wenhan Wu , Ce Zheng , Zihao Yang , Chen Chen , Srijan Das , Aidong Lu

Current Deep Learning methods for environment segmentation and velocity estimation rely on Convolutional Recurrent Neural Networks to exploit spatio-temporal relationships within obtained sensor data. These approaches derive scene dynamics…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Marco Braun , Moritz Luszek , Mirko Meuter , Dominic Spata , Kevin Kollek , Anton Kummert

The Transformer-based detectors (i.e., DETR) have demonstrated impressive performance on end-to-end object detection. However, transferring DETR to different data distributions may lead to a significant performance degradation. Existing…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Peidong Jia , Jiaming Liu , Senqiao Yang , Jiarui Wu , Xiaodong Xie , Shanghang Zhang

Self-supervised pre-training and transformer-based networks have significantly improved the performance of object detection. However, most of the current self-supervised object detection methods are built on convolutional-based…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Guoqiang Jin , Fan Yang , Mingshan Sun , Ruyi Zhao , Yakun Liu , Wei Li , Tianpeng Bao , Liwei Wu , Xingyu Zeng , Rui Zhao