English
Related papers

Related papers: Transformer-based Multi-Modal Learning for Multi L…

200 papers

Self-attention and transformers have been widely used in deep learning. Recent efforts have been devoted to incorporating transformer blocks into different neural architectures, including those with convolutions, leading to various visual…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Yancheng Wang , Yingzhen Yang

With the current ubiquity of deep learning methods to solve computer vision and remote sensing specific tasks, the need for labelled data is growing constantly. However, in many cases, the annotation process can be long and tedious…

Computer Vision and Pattern Recognition · Computer Science 2023-06-19 Paul Berg , Minh-Tan Pham , Nicolas Courty

Multimodalities provide promising performance than unimodality in most tasks. However, learning the semantic of the representations from multimodalities efficiently is extremely challenging. To tackle this, we propose the Transformer based…

Computer Vision and Pattern Recognition · Computer Science 2019-11-14 Wubo Li , Wei Zou , Xiangang Li

As the volume of digital image data increases, the effectiveness of image classification intensifies. This study introduces a robust multi-label classification system designed to assign multiple labels to a single image, addressing the…

Computer Vision and Pattern Recognition · Computer Science 2025-01-06 Haixu Liu , Penghao Jiang , Zerui Tao

In this paper, we propose Mixture of Layer-Wise Tokens (MoLT), a parameter- and memory-efficient adaptation framework for audio-visual learning. The key idea of MoLT is to replace conventional, computationally heavy sequential adaptation at…

Sound · Computer Science 2025-12-02 Kyeongha Rho , Hyeongkeun Lee , Jae Won Cho , Joon Son Chung

Recent progress in multiple object tracking (MOT) has shown that a robust similarity score is key to the success of trackers. A good similarity score is expected to reflect multiple cues, e.g. appearance, location, and topology, over a long…

Computer Vision and Pattern Recognition · Computer Science 2019-04-26 Jiarui Xu , Yue Cao , Zheng Zhang , Han Hu

The fusion of images taken by heterogeneous sensors helps to enrich the information and improve the quality of imaging. In this article, we present a hybrid model consisting of a convolutional encoder and a Transformer-based decoder to fuse…

Computer Vision and Pattern Recognition · Computer Science 2022-10-19 Yu Yuan , Jiaqi Wu , Zhongliang Jing , Henry Leung , Han Pan

In the application of machine learning to remote sensing, labeled data is often scarce or expensive, which impedes the training of powerful models like deep convolutional neural networks. Although unlabeled data is abundant, recent…

Computer Vision and Pattern Recognition · Computer Science 2021-08-12 Aidan M. Swope , Xander H. Rudelis , Kyle T. Story

Remote sensing change detection (RSCD) is a complex task, where changes often appear at different scales and orientations. Convolutional neural networks (CNNs) are good at capturing local spatial patterns but cannot model global semantics…

Computer Vision and Pattern Recognition · Computer Science 2026-01-19 Humza Naveed , Xina Zeng , Mitch Bryson , Nagita Mehrseresht

This study presents a multisensory machine learning architecture for object recognition by employing a novel dataset that was constructed with the iCub robot, which is equipped with three cameras and a depth sensor. The proposed…

Robotics · Computer Science 2020-09-15 Murat Kirtay , Guido Schillaci , Verena V. Hafner

Compared with the vanilla transformer, the window-based transformer offers a better trade-off between accuracy and efficiency. Although the window-based transformer has made great progress, its long-range modeling capabilities are limited…

Computer Vision and Pattern Recognition · Computer Science 2023-01-04 Jiawei Mao , Yuanqi Chang , Xuesong Yin

As remote sensing (RS) data obtained from different sensors become available largely and openly, multimodal data processing and analysis techniques have been garnering increasing interest in the RS and geoscience community. However, due to…

Computer Vision and Pattern Recognition · Computer Science 2021-05-24 Danfeng Hong , Jingliang Hu , Jing Yao , Jocelyn Chanussot , Xiao Xiang Zhu

In several real-world scenarios like autonomous navigation and mobility, to obtain a better visual understanding of the surroundings, image captioning and object detection play a crucial role. This work introduces a novel multitask learning…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Debolena Basak , P. K. Srijith , Maunendra Sankar Desarkar

Various machine learning (ML)-based in-situ monitoring systems have been developed to detect anomalies and defects in laser additive manufacturing (LAM) processes. While multimodal fusion, which integrates data from visual, audio, and other…

Computational Engineering, Finance, and Science · Computer Science 2025-02-11 Jiarui Xie , Mutahar Safdar , Lequn Chen , Seung Ki Moon , Yaoyao Fiona Zhao

Cross-city transfer improves prediction in label-scarce cities by leveraging labeled data from other cities, but it becomes challenging when cities adopt incompatible partitions and no ground-truth region correspondences exist. Existing…

Machine Learning · Computer Science 2026-05-12 Yuyao Wang , Min Yang , Meng Chen , Weiming Huang , Yilong Yin , Yongshun Gong

This paper investigates the optimal selection and fusion of feature encoders across multiple modalities and combines these in one neural network to improve sentiment detection. We compare different fusion methods and examine the impact of…

Computation and Language · Computer Science 2024-06-04 Zehui Wu , Ziwei Gong , Jaywon Koo , Julia Hirschberg

Referring remote sensing image segmentation (RRSIS) is a novel visual task in remote sensing images segmentation, which aims to segment objects based on a given text description, with great significance in practical application. Previous…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Leideng Shi , Juan Zhang

Pansharpening aims to enhance remote sensing image (RSI) quality by merging high-resolution panchromatic (PAN) with multispectral (MS) images. However, prior techniques struggled to optimally fuse PAN and MS images for enhanced spatial and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Wen-Jie Shu , Hong-Xia Dou , Rui Wen , Xiao Wu , Liang-Jian Deng

We introduce a discriminative multimodal descriptor based on a pair of sensor readings: a point cloud from a LiDAR and an image from an RGB camera. Our descriptor, named MinkLoc++, can be used for place recognition, re-localization and loop…

Computer Vision and Pattern Recognition · Computer Science 2021-04-15 Jacek Komorowski , Monika Wysoczanska , Tomasz Trzcinski

Multimodal object detection has attracted significant attention in both academia and industry for its enhanced robustness. Although numerous studies have focused on improving modality fusion strategies, most neglect fusion degradation, and…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 YiKang Shao , Tao Shi