English
Related papers

Related papers: Q-Boost: On Visual Quality Assessment Ability of L…

200 papers

The advent and proliferation of large multi-modal models (LMMs) have introduced new paradigms to computer vision, transforming various tasks into a unified visual question answering framework. Video Quality Assessment (VQA), a classic field…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Ziheng Jia , Zicheng Zhang , Jiaying Qian , Haoning Wu , Wei Sun , Chunyi Li , Xiaohong Liu , Weisi Lin , Guangtao Zhai , Xiongkuo Min

Image Quality Assessment (IQA) is a long-standing problem in computer vision. Previous methods typically focus on predicting numerical scores without explanation or providing low-level descriptions lacking precise scores. Recent…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Guoqiang Liang , Jianyi Wang , Zhonghua Wu , Shangchen Zhou

Long video understanding remains a formidable challenge for Multimodal Large Language Models (MLLMs) due to the prohibitive computational cost of processing dense frame sequences. Prevailing solutions, which select a keyframe subset,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Shaoguang Wang , Weiyu Guo , Ziyang Chen , Xuming Hu , Hui Xiong

Multimodal large language models (MLLMs) still struggle with complex reasoning tasks in Visual Question Answering (VQA). While current methods have advanced by incorporating visual prompts, our study uncovers critical limitations: these…

Computation and Language · Computer Science 2025-06-03 Songtao Jiang , Chenyi Zhou , Yan Zhang , Yeying Jin , Zuozhu Liu

Reinforcement Learning (RL) has empowered Multimodal Large Language Models (MLLMs) to achieve superior human preference alignment in Image Quality Assessment (IQA). However, existing RL-based IQA models typically rely on coarse-grained…

Image and Video Processing · Electrical Eng. & Systems 2026-05-11 Xiang Li , Xueheng Li , Yu Wang , Xuanhua He , Zhangchi Hu , Weiwei Yu , Chengjun Xie

In this paper, we explore effective prompting techniques to enhance zero- and few-shot Visual Question Answering (VQA) performance in contemporary Vision-Language Models (VLMs). Central to our investigation is the role of question templates…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Rabiul Awal , Le Zhang , Aishwarya Agrawal

Multimodal Large Language Models (MLLMs) have demonstrated impressive capabilities in cross-modal understanding, but remain vulnerable to adversarial attacks through visual inputs despite robust textual safety mechanisms. These…

Cryptography and Security · Computer Science 2025-11-21 Wei Zhao , Zhe Li , Yige Li , Jun Sun

Recent advances in reasoning-induced image quality assessment (IQA) have demonstrated the power of reinforcement learning to rank (RL2R) for training vision-language models (VLMs) to assess perceptual quality. However, existing approaches…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Xiangyong Chen , Xiaochuan Lin , Haoran Liu , Xuan Li , Yichen Su , Xiangwei Guo

Image quality scoring and interpreting are two fundamental components of Image Quality Assessment (IQA). The former quantifies image quality, while the latter enables descriptive question answering about image quality. Traditionally, these…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Zicheng Zhang , Haoning Wu , Ziheng Jia , Weisi Lin , Guangtao Zhai

Reasoning-induced vision-language models (VLMs) advance image quality assessment (IQA) with textual reasoning, yet their scalar scores often lack sensitivity and collapse to a few values, so-called discrete collapse. We introduce ME-IQA, a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Kanglong Fan , Tianhe Wu , Wen Wen , Jianzhao Liu , Le Yang , Yabin Zhang , Yiting Liao , Junlin Li , Li Zhang

Recent advances in multimodal large language models (MLLMs) have demonstrated impressive performance on existing low-level vision benchmarks, which primarily focus on generic images. However, their capabilities to perceive and assess…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Sijing Wu , Yunhao Li , Zicheng Zhang , Qi Jia , Xinyue Li , Huiyu Duan , Xiongkuo Min , Guangtao Zhai

The rise of short-form videos, characterized by diverse content, editing styles, and artifacts, poses substantial challenges for learning-based blind video quality assessment (BVQA) models. Multimodal large language models (MLLMs), renowned…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 Wen Wen , Yilin Wang , Neil Birkbeck , Balu Adsumilli

Accurate and efficient Video Quality Assessment (VQA) has long been a key research challenge. Current mainstream VQA methods typically improve performance by pretraining on large-scale classification datasets (e.g., ImageNet, Kinetics-400),…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Yachun Mi , Yu Li , Yanting Li , Chen Hui , Tong Zhang , Zhixuan Li , Chenyue Song , Wei Yang Bryan Lim , Shaohui Liu

Despite rapid advancements in video generation models, aligning their outputs with complex user intent remains challenging. Existing test-time optimization methods are typically either computationally expensive or require white-box access…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Yiwen Song , Tomas Pfister , Yale Song

Large Multimodal Models (LMMs) often rely on in-context learning (ICL) to perform new visual question answering (VQA) tasks with minimal supervision. However, ICL performance, especially in smaller LMMs, does not always improve…

Artificial Intelligence · Computer Science 2026-03-03 Akash Gupta , Amos Storkey , Mirella Lapata

The linguistic capabilities of Multimodal Large Language Models (MLLMs) are critical for their effective application across diverse tasks. This study aims to evaluate the performance of MLLMs on the VALSE benchmark, focusing on the efficacy…

Computation and Language · Computer Science 2024-07-18 Mustafa Dogan , Ilker Kesen , Iacer Calixto , Aykut Erdem , Erkut Erdem

Image Quality Assessment (IQA) remains an unresolved challenge in computer vision due to complex distortions, diverse image content, and limited data availability. Existing Blind IQA (BIQA) methods largely rely on extensive human…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Xudong Li , Zihao Huang , Yan Zhang , Yunhang Shen , Ke Li , Xiawu Zheng , Liujuan Cao , Rongrong Ji

Zero-shot Visual Question Answering (VQA) is a prominent vision-language task that examines both the visual and textual understanding capability of systems in the absence of training data. Recently, by converting the images into captions,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-16 Yunshi Lan , Xiang Li , Xin Liu , Yang Li , Wei Qin , Weining Qian

Image Quality Assessment (IQA) has progressed from scalar quality prediction to more interpretable, human-aligned evaluation paradigms. In this work, we address the emerging challenge of detailed and explainable IQA by proposing iDETEX-a…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Zhaoran Zhao , Xinli Yue , Jianhui Sun , Yuhao Xie , Tao Shao , Liangchao Yao , Fan Xia , Yuetang Deng

Medical Image Quality Assessment (IQA) serves as the first-mile safety gate for clinical AI, yet existing approaches remain constrained by scalar, score-based metrics and fail to reflect the descriptive, human-like reasoning process central…