English
Related papers

Related papers: Transformer-based Multimodal Change Detection with…

200 papers

Transformers are widely used deep learning architectures. Existing transformers are mostly designed for sequences (texts or time series), images or videos, and graphs. This paper proposes a novel transformer model for massive (up to a…

Machine Learning · Computer Science 2023-11-09 Wenchong He , Zhe Jiang , Tingsong Xiao , Zelin Xu , Shigang Chen , Ronald Fick , Miles Medina , Christine Angelini

The Transformer is a highly successful deep learning model that has revolutionised the world of artificial neural networks, first in natural language processing and later in computer vision. This model is based on the attention mechanism…

Machine Learning · Computer Science 2023-05-09 Riccardo Ughi , Eugenio Lomurno , Matteo Matteucci

In this new digital era, social media has created a severe impact on the lives of people. In recent times, fake news content on social media has become one of the major challenging problems for society. The dissemination of fabricated and…

Multimedia · Computer Science 2023-03-14 Ashima Yadav , Shivani Gaba , Haneef Khan , Ishan Budhiraja , Akansha Singh , Krishan Kant Singh

This paper proposes a network, referred to as MVSTR, for Multi-View Stereo (MVS). It is built upon Transformer and is capable of extracting dense features with global context and 3D consistency, which are crucial to achieving reliable…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Jie Zhu , Bo Peng , Wanqing Li , Haifeng Shen , Zhe Zhang , Jianjun Lei

Semantic Change Detection (SCD) refers to the task of simultaneously extracting the changed areas and the semantic categories (before and after the changes) in Remote Sensing Images (RSIs). This is more meaningful than Binary Change…

Computer Vision and Pattern Recognition · Computer Science 2024-02-23 Lei Ding , Jing Zhang , Kai Zhang , Haitao Guo , Bing Liu , Lorenzo Bruzzone

Modeling hand-object manipulations is essential for understanding how humans interact with their environment. While of practical importance, estimating the pose of hands and objects during interactions is challenging due to the large mutual…

Computer Vision and Pattern Recognition · Computer Science 2020-04-29 Yana Hasson , Bugra Tekin , Federica Bogo , Ivan Laptev , Marc Pollefeys , Cordelia Schmid

Hyperspectral image super-resolution has attained widespread prominence to enhance the spatial resolution of hyperspectral images. However, convolution-based methods have encountered challenges in harnessing the global spatial-spectral…

Image and Video Processing · Electrical Eng. & Systems 2023-11-30 Shi Chen , Lefei Zhang , Liangpei Zhang

This paper studies a text classification algorithm based on an improved Transformer to improve the performance and efficiency of the model in text classification tasks. Aiming at the shortcomings of the traditional Transformer model in…

Computation and Language · Computer Science 2025-01-24 Jia Gao , Guiran Liu , Binrong Zhu , Shicheng Zhou , Hongye Zheng , Xiaoxuan Liao

Accurate segmentation is a crucial step in medical image analysis and applying supervised machine learning to segment the organs or lesions has been substantiated effective. However, it is costly to perform data annotation that provides…

Computer Vision and Pattern Recognition · Computer Science 2021-10-29 Yunxiang Li , Jingxiong Li , Ruilong Dan , Shuai Wang , Kai Jin , Guodong Zeng , Jun Wang , Xiangji Pan , Qianni Zhang , Huiyu Zhou , Qun Jin , Li Wang , Yaqi Wang

Despite significant advancements in environment perception capabilities for autonomous driving and intelligent robotics, cameras and LiDARs remain notoriously unreliable in low-light conditions and adverse weather, which limits their…

Computer Vision and Pattern Recognition · Computer Science 2025-01-31 Lei Cheng , Siyang Cao

Dynamic mode decomposition (DMD) provides a principled approach to extract physically interpretable spatial modes from time-resolved flow field data, along with a linear model for how the amplitudes of these modes evolve in time. Recently,…

Fluid Dynamics · Physics 2020-07-29 Aditya G. Nair , Benjamin Strom , Bingni W. Brunton , Steven L. Brunton

High spectral resolution imagery of the Earth's surface enables users to monitor changes over time in fine-grained scale, playing an increasingly important role in agriculture, defense, and emergency response. However, most current…

Computer Vision and Pattern Recognition · Computer Science 2023-04-19 Meiqi Hu , Chen Wu , Liangpei Zhang

Hyperspectral remote sensing (HIS) enables the detailed capture of spectral information from the Earth's surface, facilitating precise classification and identification of surface crops due to its superior spectral diagnostic capabilities.…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Faxu Guo , Quan Feng , Sen Yang , Wanxia Yang

Online change detection is crucial for mobile robots to efficiently navigate through dynamic environments. Detecting changes in transient settings, such as active construction sites or frequently reconfigured indoor spaces, is particularly…

Robotics · Computer Science 2026-02-10 Seoyeon Jang , Alex Junho Lee , I Made Aswin Nahrendra , Hyun Myung

Near-real-time regional-scale monitoring of ground deformation is increasingly required to support urban planning, critical infrastructure management, and natural hazard mitigation. While Interferometric Synthetic Aperture Radar (InSAR) and…

Signal Processing · Electrical Eng. & Systems 2026-01-01 Wendong Yao , Binhua Huang , Soumyabrata Dev

How to effectively explore multi-scale representations of rain streaks is important for image deraining. In contrast to existing Transformer-based methods that depend mostly on single-scale rain appearance, we develop an end-to-end…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Xiang Chen , Jinshan Pan , Jiangxin Dong

Detecting manipulated media has now become a pressing issue with the recent rise of deepfakes. Most existing approaches fail to generalize across diverse datasets and generation techniques. We thus propose a novel ensemble framework,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Vrushank Ahire , Aniruddh Muley , Shivam Zample , Siddharth Verma , Pranav Menon , Surbhi Madan , Abhinav Dhall

Scene change detection is an image processing problem related to partitioning pixels of a digital image into foreground and background regions. Mostly, visual knowledge-based computer intelligent systems, like traffic monitoring, video…

Computer Vision and Pattern Recognition · Computer Science 2022-12-21 Daniel F. S. Santos , Rafael G. Pires , Danilo Colombo , João P. Papa

Although not all bots are malicious, the vast majority of them are responsible for spreading misinformation and manipulating the public opinion about several issues, i.e., elections and many more. Therefore, the early detection of bots is…

Computation and Language · Computer Science 2024-07-31 Loukas Ilias , Ioannis Michail Kazelidis , Dimitris Askounis

Until now, it has been difficult for volumetric super-resolution to utilize the recent advances in transformer-based models seen in 2D super-resolution. The memory required for self-attention in 3D volumes limits the receptive field.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 August Leander Høeg , Sophia W. Bardenfleth , Hans Martin Kjer , Tim B. Dyrby , Vedrana Andersen Dahl , Anders Dahl