English
Related papers

Related papers: MMRQA: Signal-Enhanced Multimodal Large Language M…

200 papers

The increasing application of multi-modal large language models (MLLMs) across various sectors have spotlighted the essence of their output reliability and accuracy, particularly their ability to produce content grounded in factual…

Visual quality assessment (VQA) is increasingly shifting from scalar score prediction toward interpretable quality understanding -- a paradigm that demands \textit{fine-grained spatiotemporal perception} and \textit{auxiliary contextual…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Linhan Cao , Wei Sun , Weixia Zhang , Xiangyang Zhu , Kaiwei Zhang , Jun Jia , Dandan Zhu , Guangtao Zhai , Xiongkuo Min

Despite their sophisticated capabilities, large language models (LLMs) encounter a major hurdle in effective assessment. This paper first revisits the prevalent evaluation method-multiple choice question answering (MCQA), which allows for…

Computation and Language · Computer Science 2024-03-13 Fangyun Wei , Xi Chen , Lin Luo

Magnetic Resonance Imaging (MRI) suffers from several artifacts, the most common of which are motion artifacts. These artifacts often yield images that are of non-diagnostic quality. To detect such artifacts, images are prospectively…

Image and Video Processing · Electrical Eng. & Systems 2019-12-09 Jeffrey Ma , Ukash Nakarmi , Cedric Yue Sik Kin , Christopher Sandino , Joseph Y. Cheng , Ali B. Syed , Peter Wei , John M. Pauly , Shreyas Vasanawala

Image quality assessment (IQA) focuses on the perceptual visual quality of images, playing a crucial role in downstream tasks such as image reconstruction, compression, and generation. The rapid advancement of multi-modal large language…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Weiqi Li , Xuanyu Zhang , Shijie Zhao , Yabin Zhang , Junlin Li , Li Zhang , Jian Zhang

The development of multimodal large language models (MLLMs) enables the evaluation of image quality through natural language descriptions. This advancement allows for more detailed assessments. However, these MLLM-based IQA methods…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Zheng Chen , Xun Zhang , Wenbo Li , Renjing Pei , Fenglong Song , Xiongkuo Min , Xiaohong Liu , Xin Yuan , Yong Guo , Yulun Zhang

While recent advancements in large multimodal models (LMMs) have significantly improved their abilities in image quality assessment (IQA) relying on absolute quality rating, how to transfer reliable relative quality comparison outputs to…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Hanwei Zhu , Haoning Wu , Yixuan Li , Zicheng Zhang , Baoliang Chen , Lingyu Zhu , Yuming Fang , Guangtao Zhai , Weisi Lin , Shiqi Wang

The emergence of Multimodal Large Language Models (MLLMs) that integrate vision and language modalities has unlocked new potentials for scientific reasoning, outperforming prior benchmarks in both natural language and coding domains.…

Computational Engineering, Finance, and Science · Computer Science 2025-05-27 Sifan Wu , Huan Zhang , Yizhan Li , Farshid Effaty , Amirreza Ataei , Bang Liu

High-quality, multi-modal benchmarks are crucial for advancing scientific reasoning in large models yet their manual creation is costly and unscalable. To address this bottleneck, we explore the potential for transforming Text-Only QA Pairs…

Computation and Language · Computer Science 2025-10-01 Junying Wang , Zicheng Zhang , Ye Shen , Yalun Wu , Yingji Liang , Yijin Guo , Farong Wen , Wenzhe Li , Xuezhi Zhao , Qi Jia , Guangtao Zhai

Medical Visual Question Answering (MVQA) systems can interpret medical images in response to natural language queries. However, linguistic variability in question phrasing often undermines the consistency of these systems. To address this…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Yongpei Ma , Pengyu Wang , Adam Dunn , Usman Naseem , Jinman Kim

Magnetic Resonance Fingerprinting (MRF) and other highly accelerated transient-state parameter mapping techniques enable simultaneous quantification of multiple tissue properties, but often suffer from aliasing artifacts due to compressed…

Brain tumor diagnosis is largely dependent on Magnetic Resonance Imaging (MRI) evaluation, which requires radiologists to synthesize thousands of images across multiple 3D sequences and longitudinal studies. This process requires advanced…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Shiv Ghosh , Junayd Lateef , Chih-Hua Liu , Yannan Yu , Andreas M. Rauschecker , Madhumita Sushil

Fetal brain MRI is becoming an increasingly relevant complement to neurosonography for perinatal diagnosis, allowing fundamental insights into fetal brain development throughout gestation. However, uncontrolled fetal motion and…

Recent advances in multimodal large language models (LLMs) have enabled unified reasoning across images, audio, and video, but extending such capability to brain imaging remains largely unexplored. Bridging this gap is essential to link…

Computation and Language · Computer Science 2026-05-15 Yuxiang Wei , Yanteng Zhang , Xi Xiao , Chengxuan Qian , Tianyang Wang , Vince D. Calhoun

Multimodal Large Language Models (MLLMs) have tremendous potential to improve the accuracy, availability, and cost-effectiveness of healthcare by providing automated solutions or serving as aids to medical professionals. Despite promising…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Mohammad Shahab Sepehri , Zalan Fabian , Maryam Soltanolkotabi , Mahdi Soltanolkotabi

Recent advances in image editing have heightened the need for reliable Image Editing Quality Assessment (IEQA). Unlike traditional methods, IEQA requires complex reasoning over multimodal inputs and multi-dimensional assessments. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Xinjie Zhang , Qiang Li , Xiaowen Ma , Axi Niu , Li Yan , Qingsen Yan

New multinuclear MRI techniques, such as sodium MRI, generally suffer from low image quality due to an inherently low signal. Postprocessing methods, such as image denoising, have been developed for image enhancement. However, the…

The rise of short-form videos, characterized by diverse content, editing styles, and artifacts, poses substantial challenges for learning-based blind video quality assessment (BVQA) models. Multimodal large language models (MLLMs), renowned…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 Wen Wen , Yilin Wang , Neil Birkbeck , Balu Adsumilli

Spectra are a prevalent yet highly information-dense form of scientific imagery, presenting substantial challenges to multimodal large language models (MLLMs) due to their unstructured and domain-specific characteristics. Here we introduce…

Artificial Intelligence · Computer Science 2026-05-01 Jialu Shen , Han Lyu , Suyang Zhong , Hanzheng Li , Haoyi Tao , Nan Wang , Changhong Chen , Xi Fang

Reconstruction-based methods, particularly those leveraging autoencoders, have been widely adopted for anomaly detection task in brain MRI. Unlike most existing works try to improve the task accuracy through architectural or algorithmic…

Image and Video Processing · Electrical Eng. & Systems 2025-10-14 Zixuan Pan , Jun Xia , Zheyu Yan , Guoyue Xu , Yifan Qin , Xueyang Li , Yawen Wu , Zhenge Jia , Jianxu Chen , Yiyu Shi