English
Related papers

Related papers: Revisiting MLLM Based Image Quality Assessment: Er…

200 papers

The rise of short-form videos, characterized by diverse content, editing styles, and artifacts, poses substantial challenges for learning-based blind video quality assessment (BVQA) models. Multimodal large language models (MLLMs), renowned…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 Wen Wen , Yilin Wang , Neil Birkbeck , Balu Adsumilli

Although large multi-modality models (LMMs) have seen extensive exploration and application in various quality assessment studies, their integration into Point Cloud Quality Assessment (PCQA) remains unexplored. Given LMMs' exceptional…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Zicheng Zhang , Haoning Wu , Yingjie Zhou , Chunyi Li , Wei Sun , Chaofeng Chen , Xiongkuo Min , Xiaohong Liu , Weisi Lin , Guangtao Zhai

The rapid advancement of AI-generated image (AIGI) models presents new challenges for evaluating image quality, particularly across three aspects: perceptual quality, prompt correspondence, and authenticity. To address these challenges, we…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Chuan Cui , Kejiang Chen , Zhihua Wei , Wen Shen , Weiming Zhang , Nenghai Yu

Image quality assessment (IQA) forms a natural and often straightforward undertaking for humans, yet effective automation of the task remains highly challenging. Recent metrics from the deep learning community commonly compare image pairs…

Computer Vision and Pattern Recognition · Computer Science 2022-11-11 William Thong , Jose Costa Pereira , Sarah Parisot , Ales Leonardis , Steven McDonagh

Large Vision-Language Models (LVLMs) achieve strong performance on single-image tasks, but their performance declines when multiple images are provided as input. One major reason is the cross-image information leakage, where the model…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Minyoung Lee , Yeji Park , Dongjun Hwang , Yejin Kim , Seong Joon Oh , Junsuk Choe

While abundant research has been conducted on improving high-level visual understanding and reasoning capabilities of large multimodal models~(LMMs), their visual quality assessment~(IQA) ability has been relatively under-explored. Here we…

Computer Vision and Pattern Recognition · Computer Science 2024-02-05 Hanwei Zhu , Xiangjie Sui , Baoliang Chen , Xuelin Liu , Peilin Chen , Yuming Fang , Shiqi Wang

Recent advances in image editing have heightened the need for reliable Image Editing Quality Assessment (IEQA). Unlike traditional methods, IEQA requires complex reasoning over multimodal inputs and multi-dimensional assessments. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Xinjie Zhang , Qiang Li , Xiaowen Ma , Axi Niu , Li Yan , Qingsen Yan

Recent advances in multimodal large language models (MLLMs) have greatly improved image understanding and captioning capabilities. However, existing image captioning benchmarks typically suffer from limited diversity in caption length, the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Zitong Xu , Huiyu Duan , Shengyao Qin , Guangyu Yang , Guangji Ma , Xiongkuo Min , Ke Gu , Guangtao Zhai , Patrick Le Callet

With the rapid advancement of Vision Language Models (VLMs), VLM-based Image Quality Assessment (IQA) seeks to describe image quality linguistically to align with human expression and capture the multifaceted nature of IQA tasks. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Zhiyuan You , Jinjin Gu , Xin Cai , Zheyuan Li , Kaiwen Zhu , Chao Dong , Tianfan Xue

Image restoration (IR) often faces various complex and unknown degradations in real-world scenarios, such as noise, blurring, compression artifacts, and low resolution, etc. Training specific models for specific degradation may lead to poor…

Image and Video Processing · Electrical Eng. & Systems 2026-04-14 Yingjie Zhou , Jiezhang Cao , Farong Wen , Zicheng Zhang , Yu Zhou , Yue Shi , Xiaohong Liu , Radu Timofte , Luc Van Gool , Guangtao Zhai

Multimodal Large Language Models (MLLM) classification performance depends critically on evaluation protocol and ground truth quality. Studies comparing MLLMs with supervised and vision-language models report conflicting conclusions, and we…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Nikita Kisel , Illia Volkov , Klara Janouskova , Jiri Matas

As Large Language Models (LLMs) advance, their potential for widespread societal impact grows simultaneously. Hence, rigorous LLM evaluations are both a technical necessity and social imperative. While numerous evaluation benchmarks have…

Computation and Language · Computer Science 2025-04-22 Jaime Raldua Veuthey , Zainab Ali Majid , Suhas Hariharan , Jacob Haimes

Image quality plays an important role in the performance of deep neural networks (DNNs) that have been widely shown to exhibit sensitivity to changes in imaging conditions. Conventional image quality assessment (IQA) seeks to measure and…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Nathan Drenkow , Mathias Unberath

Recent methods have made notable progress in accelerating Large Vision-Language Models (LVLMs) by exploiting the inherent redundancy in visual inputs. Most existing approaches, however, focus narrowly on reducing image tokens before or…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Lianyu Hu , Liqing Gao , Fanhua Shang , Liang Wan , Wei Feng

With the rapid advancement of Multimodal Large Language Models (MLLMs), a variety of benchmarks have been introduced to evaluate their capabilities. While most evaluations have focused on complex tasks such as scientific comprehension and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Huan Liu , Lingyu Xiao , Jiangjiang Liu , Xiaofan Li , Ze Feng , Sen Yang , Jingdong Wang

Reinforcement Learning (RL) has empowered Multimodal Large Language Models (MLLMs) to achieve superior human preference alignment in Image Quality Assessment (IQA). However, existing RL-based IQA models typically rely on coarse-grained…

Image and Video Processing · Electrical Eng. & Systems 2026-05-11 Xiang Li , Xueheng Li , Yu Wang , Xuanhua He , Zhangchi Hu , Weiwei Yu , Chengjun Xie

The design of image and video quality assessment (QA) algorithms is extremely important to benchmark and calibrate user experience in modern visual systems. A major drawback of the state-of-the-art QA methods is their limited ability to…

Image and Video Processing · Electrical Eng. & Systems 2025-12-30 Shankhanil Mitra , Diptanu De , Shika Rao , Rajiv Soundararajan

Recent advances in multimodal large language models (MLLMs) have demonstrated impressive performance on existing low-level vision benchmarks, which primarily focus on generic images. However, their capabilities to perceive and assess…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Sijing Wu , Yunhao Li , Zicheng Zhang , Qi Jia , Xinyue Li , Huiyu Duan , Xiongkuo Min , Guangtao Zhai

Image quality assessment (IQA) plays a critical role in optimizing radiation dose and developing novel medical imaging techniques in computed tomography (CT). Traditional IQA methods relying on hand-crafted features have limitations in…

Image and Video Processing · Electrical Eng. & Systems 2023-11-15 Tao Song , Ruizhi Hou , Lisong Dai , Lei Xiang

The evaluation of machine-generated image captions is a complex and evolving challenge. With the advent of Multimodal Large Language Models (MLLMs), image captioning has become a core task, increasing the need for robust and reliable…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Sara Sarto , Marcella Cornia , Rita Cucchiara