中文
相关论文

相关论文: Teaching LMMs for Image Quality Scoring and Interp…

200 篇论文

The rapid development of Multi-modality Large Language Models (MLLMs) has navigated a paradigm shift in computer vision, moving towards versatile foundational models. However, evaluating MLLMs in low-level visual perception and…

计算机视觉与模式识别 · 计算机科学 2024-08-13 Zicheng Zhang , Haoning Wu , Erli Zhang , Guangtao Zhai , Weisi Lin

We present MILO (Metric for Image- and Latent-space Optimization), a lightweight, multiscale, perceptual metric for full-reference image quality assessment (FR-IQA). MILO is trained using pseudo-MOS (Mean Opinion Score) supervision, in…

计算机视觉与模式识别 · 计算机科学 2025-09-03 Uğur Çoğalan , Mojtaba Bemana , Karol Myszkowski , Hans-Peter Seidel , Colin Groth

In this paper, we present an overview of the NTIRE 2026 challenge on the 3rd Restore Any Image Model in the Wild, specifically focusing on Track 1: Professional Image Quality Assessment. Conventional Image Quality Assessment (IQA) typically…

Image Quality Assessment (IQA) is a core task in computer vision. Multimodal methods based on vision-language models, such as CLIP, have demonstrated exceptional generalization capabilities in IQA tasks. To address the issues of excessive…

计算机视觉与模式识别 · 计算机科学 2025-07-24 Yongkang Hou , Jiarun Song

Image Super-Resolution (SR) techniques improve visual quality by enhancing the spatial resolution of images. Quality evaluation metrics play a critical role in comparing and optimizing SR algorithms, but current metrics achieve only limited…

图像与视频处理 · 电气工程与系统科学 2020-12-17 Tiesong Zhao , Yuting Lin , Yiwen Xu , Weiling Chen , Zhou Wang

Image quality assessment (IQA) forms a natural and often straightforward undertaking for humans, yet effective automation of the task remains highly challenging. Recent metrics from the deep learning community commonly compare image pairs…

计算机视觉与模式识别 · 计算机科学 2022-11-11 William Thong , Jose Costa Pereira , Sarah Parisot , Ales Leonardis , Steven McDonagh

Image Quality Assessment (IQA) models benefit significantly from semantic information, which allows them to treat different types of objects distinctly. Currently, leveraging semantic information to enhance IQA is a crucial research…

计算机视觉与模式识别 · 计算机科学 2024-05-21 Wensheng Pan , Timin Gao , Yan Zhang , Runze Hu , Xiawu Zheng , Enwei Zhang , Yuting Gao , Yutao Liu , Yunhang Shen , Ke Li , Shengchuan Zhang , Liujuan Cao , Rongrong Ji

Reasoning-based image quality assessment (IQA) models trained through reinforcement learning (RL) exhibit exceptional generalization, yet the underlying mechanisms and critical factors driving this capability remain underexplored in current…

计算机视觉与模式识别 · 计算机科学 2026-03-04 Shijie Zhao , Xuanyu Zhang , Weiqi Li , Junlin Li , Li Zhang , Tianfan Xue , Jian Zhang

Reinforcement Learning (RL) has empowered Multimodal Large Language Models (MLLMs) to achieve superior human preference alignment in Image Quality Assessment (IQA). However, existing RL-based IQA models typically rely on coarse-grained…

图像与视频处理 · 电气工程与系统科学 2026-05-11 Xiang Li , Xueheng Li , Yu Wang , Xuanhua He , Zhangchi Hu , Weiwei Yu , Chengjun Xie

Large Multimodal Models (LMMs) have made significant breakthroughs with the advancement of instruction tuning. However, while existing models can understand images and videos at a holistic level, they still struggle with instance-level…

计算机视觉与模式识别 · 计算机科学 2026-03-17 Wujian Peng , Lingchen Meng , Yitong Chen , Yiweng Xie , Yang Liu , Tao Gui , Hang Xu , Xipeng Qiu , Zuxuan Wu , Yu-Gang Jiang

End-to-end text-image machine translation (TIMT), which directly translates textual content in images across languages, is crucial for real-world multilingual scene understanding. Despite advances in vision-language large models (VLLMs),…

计算机视觉与模式识别 · 计算机科学 2026-03-26 Gengluo Li , Chengquan Zhang , Yupu Liang , Huawen Shen , Yaping Zhang , Pengyuan Lyu , Weinong Wang , Xingyu Wan , Gangyan Zeng , Han Hu , Can Ma , Yu Zhou

Although large multi-modality models (LMMs) have seen extensive exploration and application in various quality assessment studies, their integration into Point Cloud Quality Assessment (PCQA) remains unexplored. Given LMMs' exceptional…

计算机视觉与模式识别 · 计算机科学 2024-08-07 Zicheng Zhang , Haoning Wu , Yingjie Zhou , Chunyi Li , Wei Sun , Chaofeng Chen , Xiongkuo Min , Xiaohong Liu , Weisi Lin , Guangtao Zhai

The quality of a face crop in an image is decided by many factors such as camera resolution, distance, and illumination condition. This makes the discrimination of face images with different qualities a challenging problem in realistic…

计算机视觉与模式识别 · 计算机科学 2025-10-07 Youzhe Song , Feng Wang

Reinforcement fine-tuning (RFT) is a proliferating paradigm for LMM training. Analogous to high-level reasoning tasks, RFT is similarly applicable to low-level vision domains, including image quality assessment (IQA). Existing RFT-based IQA…

计算机视觉与模式识别 · 计算机科学 2025-08-18 Ziheng Jia , Jiaying Qian , Zicheng Zhang , Zijian Chen , Xiongkuo Min

Generative models for image restoration, enhancement, and generation have significantly improved the quality of the generated images. Surprisingly, these models produce more pleasant images to the human eye than other methods, yet, they may…

图像与视频处理 · 电气工程与系统科学 2022-04-28 Marcos V. Conde , Maxime Burchi , Radu Timofte

Q-learning excels in learning from feedback within sequential decision-making tasks but often requires extensive sampling to achieve significant improvements. While reward shaping can enhance learning efficiency, non-potential-based methods…

机器学习 · 计算机科学 2024-05-27 Xiefeng Wu

Traditional image quality assessment (IQA) methods rely on mean opinion scores (MOS), which are resource-intensive to collect and fail to provide interpretable, localized feedback on specific image distortions. We overcome these limitations…

计算机视觉与模式识别 · 计算机科学 2026-05-05 Fadeel Sher Khan , Long N. Le , Abhinau K. Venkataramanan , Seok-Jun Lee , Hamid R. Sheikh

While abundant research has been conducted on improving high-level visual understanding and reasoning capabilities of large multimodal models~(LMMs), their visual quality assessment~(IQA) ability has been relatively under-explored. Here we…

计算机视觉与模式识别 · 计算机科学 2024-02-05 Hanwei Zhu , Xiangjie Sui , Baoliang Chen , Xuelin Liu , Peilin Chen , Yuming Fang , Shiqi Wang

Image recognition and quality assessment are two important viewing tasks, while potentially following different visual mechanisms. This paper investigates if the two tasks can be performed in a multitask learning manner. A sequential…

计算机视觉与模式识别 · 计算机科学 2023-02-01 Junyong You , Zheng Zhang

No-Reference Image Quality Assessment (NR-IQA) remains a challenging task due to the diversity of distortions and the lack of large annotated datasets. Many studies have attempted to tackle these challenges by developing more accurate…

计算机视觉与模式识别 · 计算机科学 2024-09-09 Nasim Jamshidi Avanaki , Abhijay Ghildyal , Nabajeet Barman , Saman Zadtootaghaj