English
Related papers

Related papers: Self-Evolving Vision-Language Models for Image Qua…

200 papers

With the rapid advancement of Vision Language Models (VLMs), VLM-based Image Quality Assessment (IQA) seeks to describe image quality linguistically to align with human expression and capture the multifaceted nature of IQA tasks. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Zhiyuan You , Jinjin Gu , Xin Cai , Zheyuan Li , Kaiwen Zhu , Chao Dong , Tianfan Xue

Traditional Image Quality Assessment (IQA) metrics typically fall into one of two extremes: rigid, hand-crafted mathematical models or "black-box" deep learning architectures that completely lack interpretability. To bridge this gap, we…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Ruchika Gupta , Illya Bakurov , Nathan Haut , Wolfgang Banzhaf

Image Quality Assessment (IQA) is a long-standing problem in computer vision. Previous methods typically focus on predicting numerical scores without explanation or providing low-level descriptions lacking precise scores. Recent…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Guoqiang Liang , Jianyi Wang , Zhonghua Wu , Shangchen Zhou

Designing learning-based no-reference (NR) video quality assessment (VQA) algorithms for camera-captured videos is cumbersome due to the requirement of a large number of human annotations of quality. In this work, we propose a…

Image and Video Processing · Electrical Eng. & Systems 2022-12-01 Shankhanil Mitra , Saiyam Jogani , Rajiv Soundararajan

When people query Vision-Language Models (VLMs) but cannot see the accompanying visual context (e.g. for blind and low-vision users), augmenting VLM predictions with natural language explanations can signal which model predictions are…

Computation and Language · Computer Science 2026-04-23 Keyu He , Tejas Srinivasan , Brihi Joshi , Xiang Ren , Jesse Thomason , Swabha Swayamdipta

Vision language models (VLMs) are increasingly capable of reasoning over images, but robust visual reasoning often requires re-grounding intermediate steps in the underlying visual evidence. Recent approaches typically rely on external…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Zeru Shi , Kai Mei , Yihao Quan , Dimitris N. Metaxas , Ruixiang Tang

Visual Language Models (VLMs) are now sufficiently advanced to support a broad range of applications, including answering complex visual questions, and are increasingly expected to interact with images in varied ways. To evaluate them,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Ludovic Arnould , Salim Khazem , Hugues Ali Mehenni

Recent Multimodal Large Language Models (MLLMs) excel on benchmark vision-language tasks, yet little is known about how input visual quality shapes their responses. Does higher perceptual quality of images already translate to better MLLM…

Computer Vision and Pattern Recognition · Computer Science 2025-06-19 Shuo Xing , Lanqing Guo , Hongyuan Hua , Seoyoung Lee , Peiran Li , Yufei Wang , Zhangyang Wang , Zhengzhong Tu

While text-to-image (T2I) generation models have achieved remarkable progress in recent years, existing evaluation methodologies for vision-language alignment still struggle with the fine-grained semantic matching. Current approaches based…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Zijian Zhang , Xuhui Zheng , Xuecheng Wu , Chong Peng , Xuezhi Cao

Current visual evaluation approaches are typically constrained to a single task. To address this, we propose OmniQuality-R, a unified reward modeling framework that transforms multi-task quality reasoning into continuous and interpretable…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Yiting Lu , Fengbin Guan , Yixin Gao , Yan Zhong , Xinge Peng , Jiakang Yuan , Yihao Liu , Bo Zhang , Xin Li , Zhibo Chen , Weisi Lin

Image Quality Assessment (IQA) models are increasingly deployed as perceptual critics to guide generative models and image restoration. This role demands not only accurate scores but also actionable, localized feedback. However, current…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Xudong Li , Jiaxi Tan , Ziyin Zhou , Yan Zhong , Zihao Huang , Jingyuan Zheng , Yan Zhang , Xiawu Zheng , Rongrong Ji

Large language models (LLMs) are increasingly trained with reinforcement learning from verifiable rewards (RLVR), yet real-world deployment demands models that can self-improve without labels or external judges. Existing self-improvement…

Machine Learning · Computer Science 2026-02-19 Yujun Zhou , Zhenwen Liang , Haolin Liu , Wenhao Yu , Kishan Panaganti , Linfeng Song , Dian Yu , Xiangliang Zhang , Haitao Mi , Dong Yu

8 years after the visual question answering (VQA) task was proposed, accuracy remains the primary metric for automatic evaluation. VQA Accuracy has been effective so far in the IID evaluation setting. However, our community is undergoing a…

Computer Vision and Pattern Recognition · Computer Science 2024-01-11 Oscar Mañas , Benno Krojer , Aishwarya Agrawal

Face Image Quality Assessment (FIQA) is a crucial control step in biometric pipelines. It ensures only reliable samples are processed to maintain system accuracy. State-of-the-art FIQA methods achieve high utility but typically operate as…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Erdi Sarıtaş , Eren Onaran , Vitomir Štruc , Hazım Kemal Ekenel

Image Quality Assessment (IQA) predicts perceptual quality scores consistent with human judgments. Recent RL-based IQA methods built on MLLMs focus on generating visual quality descriptions and scores, ignoring two key reliability…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Wulin Xie , Rui Dai , Ruidong Ding , Kaikui Liu , Xiangxiang Chu , Xinwen Hou , Jie Wen

Vision-language models (VLMs) can learn high-quality representations from a large-scale training dataset of image-text pairs. Prompt learning is a popular approach to fine-tuning VLM to adapt them to downstream tasks. Despite the satisfying…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Zhifang Zhang , Yuwei Niu , Xin Liu , Beibei Li

With recent progress in joint modeling of visual and textual representations, Vision-Language Pretraining (VLP) has achieved impressive performance on many multimodal downstream tasks. However, the requirement for expensive annotations…

Computer Vision and Pattern Recognition · Computer Science 2022-05-17 Zirui Wang , Jiahui Yu , Adams Wei Yu , Zihang Dai , Yulia Tsvetkov , Yuan Cao

Vision Language Models (VLMs) are increasingly adopted as central reasoning modules for embodied agents. Existing benchmarks evaluate their capabilities under ideal, well-lit conditions, yet robust 24/7 operation demands performance under a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Yohan Park , Hyunwoo Ha , Wonjun Jo , Tae-Hyun Oh

Vision-Language Model (VLM)-based image quality assessment (IQA) has been significantly advanced by incorporating Chain-of-Thought (CoT) reasoning. Recent work has refined image quality reasoning by applying reinforcement learning (RL) and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Yuxuan Jiang , Yixuan Li , Hanwei Zhu , Siyue Teng , Fan Zhang , David Bull

Recent advances in Image Quality Assessment (IQA) have leveraged Multi-modal Large Language Models (MLLMs) to generate descriptive explanations. However, despite their strong visual perception modules, these models often fail to reliably…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Yuan Li , Zitang Sun , Yen-Ju Chen , Shin'ya Nishida