English
Related papers

Related papers: A Modular System for Enhanced Robustness of Multim…

200 papers

Multimodal semantic communication has great potential to enhance downstream task performance by integrating complementary information across modalities. This paper introduces ProMSC-MIS, a novel Prompt-based Multimodal Semantic…

Multimedia · Computer Science 2025-08-28 Haoshuo Zhang , Yufei Bo , Meixia Tao

Current models for point cloud recognition demonstrate promising performance on synthetic datasets. However, real-world point cloud data inevitably contains noise, impacting model robustness. While recent efforts focus on enhancing…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Dingxin Zhang , Jianhui Yu , Tengfei Xue , Chaoyi Zhang , Dongnan Liu , Weidong Cai

Human parsing aims to segment each pixel of the human image with fine-grained semantic categories. However, current human parsers trained with clean data are easily confused by numerous image corruptions such as blur and noise. To improve…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Sanyi Zhang , Xiaochun Cao , Rui Wang , Guo-Jun Qi , Jie Zhou

Data augmentation has been proven effective for training high-accuracy convolutional neural network classifiers by preventing overfitting. However, building deep neural networks in real-world scenarios requires not only high accuracy on…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Zhenglin Huang , Xiaoan Bao , Na Zhang , Qingqi Zhang , Xiaomei Tu , Biao Wu , Xi Yang

We focus on the challenging problem of learning an unbiased classifier from a large number of potentially relevant but noisily labeled web images given only a few clean labeled images. This problem is particularly practical because it…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Chao Liang , Linchao Zhu , Zongxin Yang , Wei Chen , Yi Yang

Deep learning is a very promising technique for low-dose computed tomography (LDCT) image denoising. However, traditional deep learning methods require paired noisy and clean datasets, which are often difficult to obtain. This paper…

Image and Video Processing · Electrical Eng. & Systems 2023-08-15 Yuting Zhu , Qiang He , Yudong Yao , Yueyang Teng

We describe a novel method for training high-quality image denoising models based on unorganized collections of corrupted images. The training does not need access to clean reference images, or explicit pairs of corrupted images, and can…

Machine Learning · Computer Science 2019-10-29 Samuli Laine , Tero Karras , Jaakko Lehtinen , Timo Aila

Deep neural networks have proven to be highly effective when large amounts of data with clean labels are available. However, their performance degrades when training data contains noisy labels, leading to poor generalization on the test…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Fahimeh Fooladgar , Minh Nguyen Nhat To , Parvin Mousavi , Purang Abolmaesumi

Data denoising is a persistent challenge across scientific and engineering domains. Real-world data is frequently corrupted by complex, non-linear noise, rendering traditional rule-based denoising methods inadequate. To overcome these…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Chang Nie , Tianchen Deng , Zhe Liu , Hesheng Wang

We introduce Corrupted Image Modeling (CIM) for self-supervised visual pre-training. CIM uses an auxiliary generator with a small trainable BEiT to corrupt the input image instead of using artificial [MASK] tokens, where some patches are…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Yuxin Fang , Li Dong , Hangbo Bao , Xinggang Wang , Furu Wei

The recently advanced unsupervised learning approaches use the siamese-like framework to compare two "views" from the same image for learning representations. Making the two views distinctive is a core to guarantee that unsupervised methods…

Computer Vision and Pattern Recognition · Computer Science 2022-02-18 Zhiqiang Shen , Zechun Liu , Zhuang Liu , Marios Savvides , Trevor Darrell , Eric Xing

Image-based single-modality compression learning approaches have demonstrated exceptionally powerful encoding and decoding capabilities in the past few years , but suffer from blur and severe semantics loss at extremely low bitrates. To…

Image and Video Processing · Electrical Eng. & Systems 2023-04-27 Xuhao Jiang , Weimin Tan , Tian Tan , Bo Yan , Liquan Shen

For safety-critical applications such as autonomous driving, CNNs have to be robust with respect to unavoidable image corruptions, such as image noise. While previous works addressed the task of robust prediction in the context of…

Computer Vision and Pattern Recognition · Computer Science 2020-11-11 Christoph Kamann , Burkhard Güssefeld , Robin Hutmacher , Jan Hendrik Metzen , Carsten Rother

Introducing training-time augmentations is a key technique to enhance generalization and prepare deep neural networks against test-time corruptions. Inspired by the success of generative diffusion models, we propose a novel approach of…

Computer Vision and Pattern Recognition · Computer Science 2025-05-05 Markus Heinonen , Ba-Hien Tran , Michael Kampffmeyer , Maurizio Filippone

Code datasets, often collected from diverse and uncontrolled sources such as GitHub, potentially suffer from quality issues, thereby affecting the performance and training efficiency of Large Language Models (LLMs) optimized for code…

Hyperspectral image (HSI) denoising is a crucial step in enhancing the quality of HSIs. Noise modeling methods can fit noise distributions to generate synthetic HSIs to train denoising networks. However, the noise in captured HSIs is…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Yingkai Zhang , Tao Zhang , Jing Nie , Ying Fu

Multi-Modal Self-Supervised Learning from videos has been shown to improve model's performance on various downstream tasks. However, such Self-Supervised pre-training requires large batch sizes and a large amount of computation resources…

Computer Vision and Pattern Recognition · Computer Science 2021-12-24 Duo Wang , Salah Karout

While deep neural networks have achieved remarkable performance, they tend to lack transparency in prediction. The pursuit of greater interpretability in neural networks often results in a degradation of their original performance. Some…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Hefeng Wu , Hao Jiang , Keze Wang , Ziyi Tang , Xianghuan He , Liang Lin

Medical images usually suffer from image degradation in clinical practice, leading to decreased performance of deep learning-based models. To resolve this problem, most previous works have focused on filtering out degradation-causing…

Image and Video Processing · Electrical Eng. & Systems 2023-04-17 Haoxuan Che , Siyu Chen , Hao Chen

Due to numerous hardware shortcomings, medical image acquisition devices are susceptible to producing low-quality (i.e., low contrast, inappropriate brightness, noisy, etc.) images. Regrettably, perceptually degraded images directly impact…

Image and Video Processing · Electrical Eng. & Systems 2025-03-12 S M A Sharif , Rizwan Ali Naqvi , Mithun Biswas , Woong-Kee Loh