English
Related papers

Related papers: iDETEX: Empowering MLLMs for Intelligent DETailed …

200 papers

The rapid expansion of mobile internet has resulted in a substantial increase in user-generated content (UGC) images, thereby making the thorough assessment of UGC images both urgent and essential. Recently, multimodal large language models…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Mingxing Li , Rui Wang , Lei Sun , Yancheng Bai , Xiangxiang Chu

Medical image quality assessment (Med-IQA) is a prerequisite for clinical AI deployment, yet multimodal large language models (MLLMs) still fall substantially short of human experts, particularly when required to provide descriptive…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Jiyao Liu , Junzhi Ning , Wanying Qu , Lihao Liu , Chenglong Ma , Junjun He , Ningsheng Xu

Multimodal Large Language Models (MLLMs) have demonstrated impressive abilities across various tasks, including visual question answering and chart comprehension, yet existing benchmarks for chart-related tasks fall short in capturing the…

Computation and Language · Computer Science 2025-02-11 Zifeng Zhu , Mengzhao Jia , Zhihan Zhang , Lang Li , Meng Jiang

The rapid advancement of Large Multi-modal Foundation Models (LMM) has paved the way for the possible Explainable Image Quality Assessment (EIQA) with instruction tuning from two perspectives: overall quality explanation, and attribute-wise…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Yiting Lu , Xin Li , Haoning Wu , Bingchen Li , Weisi Lin , Zhibo Chen

With the dramatic upsurge in the volume of ultrasound examinations, low-quality ultrasound imaging has gradually increased due to variations in operator proficiency and imaging circumstances, imposing a severe burden on diagnosis accuracy…

Image and Video Processing · Electrical Eng. & Systems 2025-01-07 Hongyi Miao , Jun Jia , Yankun Cao , Yingjie Zhou , Yanwei Jiang , Zhi Liu , Guangtao Zhai

Question decomposition has emerged as an effective strategy for prompting Large Language Models (LLMs) to answer complex questions. However, while existing methods primarily focus on unimodal language models, the question decomposition…

Computation and Language · Computer Science 2024-10-08 Haowei Zhang , Jianzhe Liu , Zhen Han , Shuo Chen , Bailan He , Volker Tresp , Zhiqiang Xu , Jindong Gu

Image quality assessment (IQA) serves as the golden standard for all models' performance in nearly all computer vision fields. However, it still suffers from poor out-of-distribution generalization ability and expensive training costs. To…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Kai Liu , Ziqing Zhang , Wenbo Li , Renjing Pei , Fenglong Song , Xiaohong Liu , Linghe Kong , Yulun Zhang

Multimodal large language models (MLLMs), which integrate language and visual cues for problem-solving, are crucial for advancing artificial general intelligence (AGI). However, current benchmarks for measuring the intelligence of MLLMs…

Significant advancements has recently been achieved in the field of multi-modal large language models (MLLMs), demonstrating their remarkable capabilities in understanding and reasoning across diverse tasks. However, these models are often…

Computation and Language · Computer Science 2024-08-06 Zhaowei Li , Wei Wang , YiQing Cai , Xu Qi , Pengyu Wang , Dong Zhang , Hang Song , Botian Jiang , Zhida Huang , Tao Wang

While recent advancements in large multimodal models (LMMs) have significantly improved their abilities in image quality assessment (IQA) relying on absolute quality rating, how to transfer reliable relative quality comparison outputs to…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Hanwei Zhu , Haoning Wu , Yixuan Li , Zicheng Zhang , Baoliang Chen , Lingyu Zhu , Yuming Fang , Guangtao Zhai , Weisi Lin , Shiqi Wang

We present IQA-Spider, the first image quality assessment (IQA) framework that unifies reasoning, grounding, and referring into a single LMM-based framework for multi-granularity quality understanding. Existing LMM-based IQA methods…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Xinge Peng , Yiting Lu , Xin Li , Zhibo Chen

Rapid advances in medical imaging technology underscore the critical need for precise and automated image quality assessment (IQA) to ensure diagnostic accuracy. Existing medical IQA methods, however, struggle to generalize across diverse…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Siyi Xun , Yue Sun , Jingkun Chen , Zitong Yu , Tong Tong , Xiaohong Liu , Mingxiang Wu , Tao Tan

The rapid evolution of Multi-modality Large Language Models (MLLMs) has catalyzed a shift in computer vision from specialized models to general-purpose foundation models. Nevertheless, there is still an inadequacy in assessing the abilities…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Haoning Wu , Zicheng Zhang , Erli Zhang , Chaofeng Chen , Liang Liao , Annan Wang , Chunyi Li , Wenxiu Sun , Qiong Yan , Guangtao Zhai , Weisi Lin

The rapid advancement of educational applications, artistic creation, and AI-generated content (AIGC) technologies has substantially increased practical requirements for comprehensive Image Aesthetics Assessment (IAA), particularly…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Shuo Cao , Nan Ma , Jiayang Li , Xiaohui Li , Lihao Shao , Kaiwen Zhu , Yu Zhou , Yuandong Pu , Jiarui Wu , Jiaquan Wang , Bo Qu , Wenhai Wang , Yu Qiao , Dajuin Yao , Yihao Liu

In no-reference image quality assessment (NR-IQA), the challenge of limited dataset sizes hampers the development of robust and generalizable models. Conventional methods address this issue by utilizing large datasets to extract rich…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Daekyu Kwon , Dongyoung Kim , Sehwan Ki , Younghyun Jo , Hyong-Euk Lee , Seon Joo Kim

As an alternative to expensive expert evaluation, Image Aesthetic Assessment (IAA) stands out as a crucial task in computer vision. However, traditional IAA methods are typically constrained to a single data source or task, restricting the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Zhaokun Zhou , Qiulin Wang , Bin Lin , Yiwei Su , Rui Chen , Xin Tao , Amin Zheng , Li Yuan , Pengfei Wan , Di Zhang

Recent advancements in Multi-modality Large Language Models (MLLMs) have demonstrated remarkable capabilities in complex high-level vision tasks. However, the exploration of MLLM potential in visual quality assessment, a vital aspect of…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Zicheng Zhang , Haoning Wu , Zhongpeng Ji , Chunyi Li , Erli Zhang , Wei Sun , Xiaohong Liu , Xiongkuo Min , Fengyu Sun , Shangling Jui , Weisi Lin , Guangtao Zhai

With the rapid advancement of Multi-modal Large Language Models (MLLMs), MLLM-based Image Quality Assessment (IQA) methods have shown promising performance in linguistic quality description. However, current methods still fall short in…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Zhiyuan You , Xin Cai , Jinjin Gu , Tianfan Xue , Chao Dong

With the rapid advancement of text-to-image (T2I) generation models, assessing the semantic alignment between generated images and text descriptions has become a significant research challenge. Current methods, including those based on…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Xinli Yue , JianHui Sun , Junda Lu , Liangchao Yao , Fan Xia , Tianyi Wang , Fengyun Rao , Jing Lyu , Yuetang Deng

Multimodal Large Language Models (MLLMs) have achieved significant advances in integrating visual and linguistic information, yet their ability to reason about complex and real-world scenarios remains limited. The existing benchmarks are…