English
Related papers

Related papers: MMRQA: Signal-Enhanced Multimodal Large Language M…

200 papers

Objective speech quality assessment is central to telephony, VoIP, and streaming systems, where large volumes of degraded audio must be monitored and optimized at scale. Classical metrics such as PESQ and POLQA approximate human mean…

Sound · Computer Science 2025-12-10 Mahathir Monjur , Shahriar Nirjon

Multimodal Large Language Models are increasingly applied to biomedical imaging, yet scientific reasoning for microscopy remains limited by the scarcity of large-scale, high-quality training data. We introduce MicroVQA++, a three-stage,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Manyu Li , Ruian He , Chenxi Ma , Weimin Tan , Bo Yan

Multimodal Large Language Models (MLLMs) have significantly advanced AI-assisted medical diagnosis, but they often generate factually inconsistent responses that deviate from established medical knowledge. Retrieval-Augmented Generation…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Jinhong Wang , Tajamul Ashraf , Zongyan Han , Jorma Laaksonen , Rao Mohammad Anwer

While Large Language Models (LLMs) have demonstrated high proficiency on English-centric medical examinations, their performance often declines when faced with non-English languages and multimodal diagnostic tasks. This study protocol…

Background and Objectives: Cardiovascular magnetic resonance (CMR) imaging is a powerful modality in functional and anatomical assessment for various cardiovascular diseases. Sufficient image quality is essential to achieve proper diagnosis…

Image and Video Processing · Electrical Eng. & Systems 2023-10-02 Shahabedin Nabavi , Hossein Simchi , Mohsen Ebrahimi Moghaddam , Ahmad Ali Abin , Alejandro F. Frangi

Real-world clinical practice demands multi-image comparative reasoning, yet current medical benchmarks remain limited to single-frame interpretation. We present MedFrameQA, the first benchmark explicitly designed to test multi-image medical…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Suhao Yu , Haojin Wang , Juncheng Wu , Luyang Luo , Jingshen Wang , Cihang Xie , Pranav Rajpurkar , Carl Yang , Yang Yang , Kang Wang , Yannan Yu , Yuyin Zhou

With the dramatic upsurge in the volume of ultrasound examinations, low-quality ultrasound imaging has gradually increased due to variations in operator proficiency and imaging circumstances, imposing a severe burden on diagnosis accuracy…

Image and Video Processing · Electrical Eng. & Systems 2025-01-07 Hongyi Miao , Jun Jia , Yankun Cao , Yingjie Zhou , Yanwei Jiang , Zhi Liu , Guangtao Zhai

Blind image quality assessment (BIQA) aims at automatically and accurately forecasting objective scores for visual signals, which has been widely used to monitor product and service quality in low-light applications, covering smartphone…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Miaohui Wang , Zhuowei Xu , Mai Xu , Weisi Lin

Question answering (QA) models have shown rapid progress enabled by the availability of large, high-quality benchmark datasets. Such annotated datasets are difficult and costly to collect, and rarely exist in languages other than English,…

Computation and Language · Computer Science 2020-05-05 Patrick Lewis , Barlas Oğuz , Ruty Rinott , Sebastian Riedel , Holger Schwenk

Image Quality Assessment (IQA) is of great value in the workflow of Magnetic Resonance Imaging (MRI)-based analysis. Blind IQA (BIQA) methods are especially required since high-quality reference MRI images are usually not available.…

Image and Video Processing · Electrical Eng. & Systems 2021-07-16 Kehan Qi , Haoran Li , Chuyu Rong , Yu Gong , Cheng Li , Hairong Zheng , Shanshan Wang

Recent advances in large language models (LLMs) offer new opportunities for scalable, interactive mental health assessment, but excessive querying by LLMs burdens users and is inefficient for real-world screening across transdiagnostic…

Computation and Language · Computer Science 2025-11-21 Vasudha Varadarajan , Hui Xu , Rebecca Astrid Boehme , Mariam Marlan Mirstrom , Sverker Sikstrom , H. Andrew Schwartz

Quantitative magnetic resonance imaging (qMRI) is concerned with estimating (in physical units) values of magnetic and tissue parameters e.g., relaxation times $T_1$, $T_2$, or proton density $\rho$. Recently in [Ma et al., Nature, 2013],…

Optimization and Control · Mathematics 2019-03-29 Guozhi Dong , Michael Hintermüller , Kostas Papafitsoros

A dataset of 3D-GRE and 3D-TSE brain 3T post contrast T1-weighted images as part of a quality improvement project were collected and shown to five neuro-radiologists who evaluated each sequence for both image quality and imaging artifacts.…

Multimodal information extraction (MIE) aims to extract structured information from unstructured multimedia content. Due to the diversity of tasks and settings, most current MIE models are task-specific and data-intensive, which limits…

Computation and Language · Computer Science 2023-10-05 Yuxuan Sun , Kai Zhang , Yu Su

As conversational multimodal AI tools are increasingly adopted to process patient data for health assessment, robust benchmarks are needed to measure progress and expose failure modes under realistic conditions. Despite the importance of…

Sound · Computer Science 2026-03-06 Gaia A. Bertolino , Yuwei Zhang , Tong Xia , Domenico Talia , Cecilia Mascolo

Reliable image quality assessment is essential in applications where large volumes of images are acquired automatically and must be filtered before further analysis. In many practical scenarios, a pristine reference image is unavailable,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Koffi Titus Sergio Aglin , Anthony K. Muchiri , Celestin Nkundineza

Recent advances in reasoning-induced image quality assessment (IQA) have demonstrated the power of reinforcement learning to rank (RL2R) for training vision-language models (VLMs) to assess perceptual quality. However, existing approaches…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Xiangyong Chen , Xiaochuan Lin , Haoran Liu , Xuan Li , Yichen Su , Xiangwei Guo

Image Quality Assessment (IQA) models benefit significantly from semantic information, which allows them to treat different types of objects distinctly. Currently, leveraging semantic information to enhance IQA is a crucial research…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Wensheng Pan , Timin Gao , Yan Zhang , Runze Hu , Xiawu Zheng , Enwei Zhang , Yuting Gao , Yutao Liu , Yunhang Shen , Ke Li , Shengchuan Zhang , Liujuan Cao , Rongrong Ji

Quality assessment of brain structural MR images is critical for large-scale neuroimaging studies, where motion artifacts can significantly bias clinical estimates. While visual rating remains the gold standard, it is time-consuming and…

Image and Video Processing · Electrical Eng. & Systems 2026-03-20 Prabhjot Kaur , John S. Thornton , Frederik Barkhof , Tarek A. Yousry , Sjoerd B. Vos , Hui Zhang

Although large multi-modality models (LMMs) have seen extensive exploration and application in various quality assessment studies, their integration into Point Cloud Quality Assessment (PCQA) remains unexplored. Given LMMs' exceptional…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Zicheng Zhang , Haoning Wu , Yingjie Zhou , Chunyi Li , Wei Sun , Chaofeng Chen , Xiongkuo Min , Xiaohong Liu , Weisi Lin , Guangtao Zhai