English
Related papers

Related papers: Inconsistency-aware Multimodal Schr\"odinger Bridg…

200 papers

Denoising diffusion bridge models (DDBMs) are a powerful variant of diffusion models for interpolating between two arbitrary paired distributions given as endpoints. Despite their promising performance in tasks like image translation, DDBMs…

Machine Learning · Computer Science 2025-05-01 Kaiwen Zheng , Guande He , Jianfei Chen , Fan Bao , Jun Zhu

Unpaired image-to-image translation has seen significant progress since the introduction of CycleGAN. However, methods based on diffusion models or Schr\"odinger bridges have yet to be widely adopted in real-world applications due to their…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Suhyeon Lee , Kwanyoung Kim , Jong Chul Ye

Driven by the new generation of multi-modal large models, such as Stable Diffusion (SD), image manipulation technologies have advanced rapidly, posing significant challenges to image forensics. However, existing image forgery localization…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Yang Su , Shunquan Tan , Jiwu Huang

Intelligent Reflecting Surfaces (IRSs) are a promising technology for enhancing the spectral and energy efficiency of millimeter-wave (mmWave) multiple-input multiple-output (MIMO) systems. In these systems, accurate channel estimation…

Signal Processing · Electrical Eng. & Systems 2026-05-15 Mehrdad Momen-Tayefeh , Mehrshad Momen-Tayefeh , Maryam Sabbaghian

Balancing fine-grained local modeling with long-range dependency capture under computational constraints remains a central challenge in sequence modeling. While Transformers provide strong token mixing, they suffer from quadratic…

Machine Learning · Computer Science 2026-03-20 Youjin Wang , Jiaqiao Zhao , Rong Fu , Run Zhou , Ruizhe Zhang , Jiani Liang , Suisuai Cao , Feng Zhou

We introduce MM-Mixing, a multi-modal mixing alignment framework for 3D understanding. MM-Mixing applies mixing-based methods to multi-modal data, preserving and optimizing cross-modal connections while enhancing diversity and improving…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Jiaze Wang , Yi Wang , Ziyu Guo , Renrui Zhang , Donghao Zhou , Guangyong Chen , Anfeng Liu , Pheng-Ann Heng

The rapid development of facial manipulation techniques has aroused public concerns in recent years. Following the success of deep learning, existing methods always formulate DeepFake video detection as a binary classification problem and…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Zhihao Gu , Yang Chen , Taiping Yao , Shouhong Ding , Jilin Li , Feiyue Huang , Lizhuang Ma

In this paper, we investigate noncoherent multiple-input multiple-output (MIMO) ultra-wideband (UWB) systems where the signal is encoded by differential space-time block code (DSTBC). DSTBC enables noncoherent MIMO UWB systems to achieve…

Information Theory · Computer Science 2013-06-06 Taotao Wang , Tiejun Lv , Hui Gao , Yueming Lu

Resampling from a target measure whose density is unknown is a fundamental problem in mathematical statistics and machine learning. A setting that dominates the machine learning literature consists of learning a map from an easy-to-sample…

Machine Learning · Computer Science 2026-02-24 Leticia Mattos Da Silva , Silvia Sellán , Francisco Vargas , Justin Solomon

Change detection in optical remote sensing imagery is susceptible to illumination fluctuations, seasonal changes, and variations in surface land-cover materials. Relying solely on RGB imagery often produces pseudo-changes and leads to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Ye Wang , Wei Lu , Zhihui You , Keyan Chen , Tongfei Liu , Kaiyu Li , Hongruixuan Chen , Qingling Shu , Sibao Chen

Multi-Modal Image Fusion (MMIF) aims to integrate complementary image information from different modalities to produce informative images. Previous deep learning-based MMIF methods generally adopt Convolutional Neural Networks (CNNs) or…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Hui Sun , Long Lv , Pingping Zhang , Tongdan Tang , Feng Tian , Weibing Sun , Huchuan Lu

This paper presents a system for detecting fake audio-visual content (i.e., video deepfake), developed for Track 2 of the DDL Challenge. The proposed system employs a two-stage framework, comprising unimodal detection and multimodal score…

Multimedia · Computer Science 2026-02-03 Qingcao Li , Miao He , Liang Yi , Qing Wen , Yitao Zhang , Hongshuo Jin , Peng Cheng , Zhongjie Ba , Li Lu , Kui Ren

Mainstreamed weakly supervised road extractors rely on highly confident pseudo-labels propagated from scribbles, and their performance often degrades gradually as the image scenes tend various. We argue that such degradation is due to the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Jie Feng , Hao Huang , Junpeng Zhang , Weisheng Dong , Dingwen Zhang , Licheng Jiao

Multimodal sentiment analysis has received significant attention across diverse research domains. Despite advancements in algorithm design, existing approaches suffer from two critical limitations: insufficient learning of…

Artificial Intelligence · Computer Science 2025-11-04 Huiting Huang , Tieliang Gong , Kai He , Jialun Wu , Erik Cambria , Mengling Feng

Accurate moving object segmentation is an essential task for autonomous driving. It can provide effective information for many downstream tasks, such as collision avoidance, path planning, and static map construction. How to effectively…

Computer Vision and Pattern Recognition · Computer Science 2022-07-06 Jiadai Sun , Yuchao Dai , Xianjing Zhang , Jintao Xu , Rui Ai , Weihao Gu , Xieyuanli Chen

Deep Metric Learning (DML) plays a critical role in various machine learning tasks. However, most existing deep metric learning methods with binary similarity are sensitive to noisy labels, which are widely present in real-world data. Since…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Jiexi Yan , Lei Luo , Cheng Deng , Heng Huang

Integration of information from non-auditory cues can significantly improve the performance of speech-separation models. Often such models use deep modality-specific networks to obtain unimodal features, and risk being too costly or…

Sound · Computer Science 2025-07-11 Sidong Zhang , Shiv Shankar , Trang Nguyen , Andrea Fanelli , Madalina Fiterau

Traversability estimation is critical for enabling robots to navigate across diverse terrains and environments. While recent self-supervised learning methods achieve promising results, they often fail to capture the characteristics of…

Robotics · Computer Science 2025-08-26 Zipeng Fang , Yanbo Wang , Lei Zhao , Weidong Chen

Binaural reproduction for headphone-centric listening has become a focal point in ongoing research, particularly within the realm of advancing technologies such as augmented and virtual reality (AR and VR). The demand for high-quality…

Audio and Speech Processing · Electrical Eng. & Systems 2024-08-08 Or Berebi , Zamir Ben-Hur , David Lou Alon , Boaz Rafaely

The task of Detecting and Grounding Multi-Modal Media Manipulation (DGM$^4$) is a branch of misinformation detection. Unlike traditional binary classification, it includes complex subtasks such as forgery content localization and forgery…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Xinquan Yu , Wei Lu , Xiangyang Luo