English
Related papers

Related papers: A Modular System for Enhanced Robustness of Multim…

200 papers

Most dataset distillation methods struggle to accommodate large-scale datasets due to their substantial computational and memory requirements. Recent research has begun to explore scalable disentanglement methods. However, there are still…

Computer Vision and Pattern Recognition · Computer Science 2025-07-14 Zhiheng Ma , Anjia Cao , Funing Yang , Yihong Gong , Xing Wei

Recovering images corrupted by multiplicative noise is a well known challenging task. Motivated by the success of multiscale hierarchical decomposition methods (MHDM) in image processing, we adapt a variety of both classical and new…

Numerical Analysis · Mathematics 2023-10-11 Joel Barnett , Wen Li , Elena Resmerita , Luminita Vese

All-in-one image restoration aims to handle diverse degradations (e.g., noise, blur, adverse weather) within a unified framework, yet existing methods increasingly rely on complex architectures (e.g., Mixture-of-Experts, diffusion models)…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Wenlong Jiao , Heyang Lee , Ping Wang , Pengfei Zhu , Qinghua Hu , Dongwei Ren

When designing a diagnostic model for a clinical application, it is crucial to guarantee the robustness of the model with respect to a wide range of image corruptions. Herein, an easy-to-use benchmark is established to evaluate how deep…

Computer Vision and Pattern Recognition · Computer Science 2022-07-01 Yunlong Zhang , Yuxuan Sun , Honglin Li , Sunyi Zheng , Chenglu Zhu , Lin Yang

In this paper we propose a novel data-level algorithm for handling data imbalance in the classification task, Synthetic Majority Undersampling Technique (SMUTE). SMUTE leverages the concept of interpolation of nearby instances, previously…

Machine Learning · Computer Science 2021-04-20 Michał Koziarski

Supervised deep learning performance is heavily tied to the availability of high-quality labels for training. Neural networks can gradually overfit corrupted labels if directly trained on noisy datasets, leading to severe performance…

Machine Learning · Computer Science 2021-02-02 Ziyi Huang , Haofeng Zhang , Andrew Laine , Elsa Angelini , Christine Hendon , Yu Gan

Recent advancements in Large Multimodal Models (LMMs) have significantly improved multimodal understanding and generation. However, these models still struggle to generate tightly interleaved image-text outputs, primarily due to the limited…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Yukang Feng , Jianwen Sun , Chuanhao Li , Zizhen Li , Jiaxin Ai , Fanrui Zhang , Yifan Chang , Sizhuo Zhou , Shenglin Zhang , Yu Dai , Kaipeng Zhang

Automated image captioning has the potential to be a useful tool for people with vision impairments. Images taken by this user group are often noisy, which leads to incorrect and even unsafe model predictions. In this paper, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Lu Yu , Malvina Nikandrou , Jiali Jin , Verena Rieser

This paper proposes a training data augmentation pipeline that combines synthetic image data with neural style transfer in order to address the vulnerability of deep vision models to common corruptions. We show that although applying style…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Georg Siedel , Rojan Regmi , Abhirami Anand , Weijia Shao , Silvia Vock , Andrey Morozov

In this paper, we introduce the Selective Image Guided Network (SigNet), a novel degradation-aware framework that transforms depth completion into depth enhancement for the first time. Moving beyond direct completion using convolutional…

Computer Vision and Pattern Recognition · Computer Science 2025-03-10 Zhiqiang Yan , Zhengxue Wang , Kun Wang , Jun Li , Jian Yang

The development of neural networks has greatly improved the performance in various computer vision tasks. In the filed of image denoising, convolutional neural network based methods such as DnCNN break through the limits of classical…

Image and Video Processing · Electrical Eng. & Systems 2021-01-26 Xiaoqi Ma

In recent years, Multi-Modality Image Fusion (MMIF) has been applied to many fields, which has attracted many scholars to endeavour to improve the fusion performance. However, the prevailing focus has predominantly been on the architecture…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Yanglin Deng , Tianyang Xu , Chunyang Cheng , Xiao-Jun Wu , Josef Kittler

This research introduces a transformative framework for integrating Vision-Enhanced Large Language Models (LLMs) with advanced transformer-based architectures to tackle challenges in high-resolution image synthesis and multimodal data…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Karthikeya KV

Semantic segmentation is a fundamental task in multimedia processing, which can be used for analyzing, understanding, editing contents of images and videos, among others. To accelerate the analysis of multimedia data, existing segmentation…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Zhiyan Wang , Deyin Liu , Lin Yuanbo Wu , Song Wang , Xin Guo , Lin Qi

The denoising process of diffusion models can be interpreted as an approximate projection of noisy samples onto the data manifold. Moreover, the noise level in these samples approximates their distance to the underlying manifold. Building…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Abulikemu Abuduweili , Chenyang Yuan , Changliu Liu , Frank Permenter

In recent years, the advancement of AI technologies has accelerated the development of smart factories. In particular, the automatic monitoring of product assembly progress is crucial for improving operational efficiency, minimizing the…

Computer Vision and Pattern Recognition · Computer Science 2026-01-05 Kazuma Miura , Sarthak Pathak , Kazunori Umeda

Purpose: To systematically investigate the influence of various data consistency layers, (semi-)supervised learning and ensembling strategies, defined in a $\Sigma$-net, for accelerated parallel MR image reconstruction using deep learning.…

Image and Video Processing · Electrical Eng. & Systems 2019-12-20 Kerstin Hammernik , Jo Schlemper , Chen Qin , Jinming Duan , Ronald M. Summers , Daniel Rueckert

Large Vision Language Models (LVLMs) have demonstrated remarkable capabilities, yet their proficiency in understanding and reasoning over multiple images remains largely unexplored. While existing benchmarks have initiated the evaluation of…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Anurag Das , Adrian Bulat , Alberto Baldrati , Ioannis Maniadis Metaxas , Bernt Schiele , Georgios Tzimiropoulos , Brais Martinez

To improve the quality of underwater images, various kinds of underwater image enhancement (UIE) operators have been proposed during the past few years. However, the lack of effective objective evaluation methods limits the further…

Computer Vision and Pattern Recognition · Computer Science 2021-02-02 Zhenqi Fu , Xueyang Fu , Yue Huang , Xinghao Ding

Multi-modality image fusion aims at fusing modality-specific (complementarity) and modality-shared (correlation) information from multiple source images. To tackle the problem of the neglect of inter-feature relationships, high-frequency…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Xiaoli Zhang , Liying Wang , Libo Zhao , Xiongfei Li , Siwei Ma