English
Related papers

Related papers: Talk, Snap, Complain: Validation-Aware Multimodal …

200 papers

Large visual language models (VLMs) have shown strong multi-modal medical reasoning ability, but most operate as end-to-end black boxes, diverging from clinicians' evidence-based, staged workflows and hindering clinical accountability.…

Artificial Intelligence · Computer Science 2026-03-12 Yuexi Du , Jinglu Wang , Shujie Liu , Nicha C. Dvornek , Yan Lu

With the rapid advancement of mathematical reasoning capabilities in Large Language Models (LLMs), AI systems are increasingly being adopted in educational settings to support students' comprehension of problem-solving processes. However, a…

Computation and Language · Computer Science 2025-12-18 Jaewoo Park , Jungyang Park , Dongju Jang , Jiwan Chung , Byungwoo Yoo , Jaewoo Shin , Seonjoon Park , Taehyeong Kim , Youngjae Yu

Evaluating the alignment between textual prompts and generated images is critical for ensuring the reliability and usability of text-to-image (T2I) models. However, most existing evaluation methods rely on coarse-grained metrics or static…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Fulin Shi , Wenyi Xiao , Bin Chen , Liang Din , Leilei Gan

The prevalence of user-generated content (UGC) on platforms such as YouTube and TikTok has rendered no-reference (NR) perceptual video quality assessment (VQA) vital for optimizing video delivery. Nonetheless, the characteristics of…

Image and Video Processing · Electrical Eng. & Systems 2025-11-11 Xinyi Wang , Angeliki Katsenou , Junxiao Shen , David Bull

Fine-grained vehicle recognition (FGVR) is an essential fundamental technology for intelligent transportation systems, but very difficult because of its inherent intra-class variation. Most previous FGVR studies only focus on the…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Dichao Liu

Large multimodal reasoning models have achieved rapid progress, but their advancement is constrained by two major limitations: the absence of open, large-scale, high-quality long chain-of-thought (CoT) data, and the instability of…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Sicong Leng , Jing Wang , Jiaxi Li , Hao Zhang , Zhiqiang Hu , Boqiang Zhang , Yuming Jiang , Hang Zhang , Xin Li , Lidong Bing , Deli Zhao , Wei Lu , Yu Rong , Aixin Sun , Shijian Lu

This work studies how we can obtain feature-level ratings of the mobile products from the customer reviews and review votes to influence decision making, both for new customers and manufacturers. Such a rating system gives a more…

Computation and Language · Computer Science 2020-07-21 Koteswar Rao Jerripothula , Ankit Rai , Kanu Garg , Yashvardhan Singh Rautela

Document visual question answering requires models not only to answer questions correctly, but also to precisely localize answers within complex document layouts. While large vision-language models (VLMs) achieve strong spatial grounding,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Pinaki Prasad Guha Neogi , Ahmad Mohammadshirazi , Ser-Nam Lim , Rajiv Ramnath

The rapid development of diffusion models has greatly advanced AI-generated videos in terms of length and consistency recently, yet assessing AI-generated videos still remains challenging. Previous approaches have often focused on…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Jiaze Li , Haoran Xu , Shiding Zhu , Junwei He , Haozhao Wang

Recent advances in large language models have significantly improved textual reasoning through the effective use of Chain-of-Thought (CoT) and reinforcement learning. However, extending these successes to vision-language tasks remains…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Minheng Ni , Zhengyuan Yang , Linjie Li , Chung-Ching Lin , Kevin Lin , Wangmeng Zuo , Lijuan Wang

Spatial reasoning from monocular images is essential for autonomous driving, yet current Vision-Language Models (VLMs) still struggle with fine-grained geometric perception, particularly under large scale variation and ambiguous object…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Yanchun Cheng , Rundong Wang , Xulei Yang , Alok Prakash , Daniela Rus , Marcelo H Ang , ShiJie Li

Human-in-the-loop validation is essential in safety-critical clinical AI, yet the transition between initial model inference and expert correction is rarely analyzed as a structured signal. We introduce a diagnostic alignment framework in…

Artificial Intelligence · Computer Science 2026-02-27 Dimitrios P. Panagoulias , Evangelia-Aikaterini Tsichrintzi , Georgios Savvidis , Evridiki Tsoureli-Nikita

Vision-Language Models (VLMs) continue to struggle to make morally salient judgments in multimodal and socially ambiguous contexts. Prior works typically rely on binary or pairwise supervision, which often fail to capture the continuous and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Eunkyu Park , Wesley Hanwen Deng , Cheyon Jin , Matheus Kunzler Maldaner , Jordan Wheeler , Jason I. Hong , Hong Shen , Adam Perer , Ken Holstein , Motahhare Eslami , Gunhee Kim

The ability to perform Chain-of-Thought (CoT) reasoning marks a major milestone for multimodal models (MMs), enabling them to solve complex visual reasoning problems. Yet a critical question remains: is such reasoning genuinely grounded in…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Jusheng Zhang , Kaitong Cai , Xiaoyang Guo , Sidi Liu , Qinhan Lv , Ruiqi Chen , Jing Yang , Yijia Fan , Xiaofei Sun , Jian Wang , Ziliang Chen , Liang Lin , Keze Wang

Radiology reports for the same patient examination may contain clinically meaningful discrepancies arising from interpretation differences, reporting variability, or evolving assessments. Systematic analysis of such discrepancies is…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Zhaoyi Sun , Minal Jagtiani , Wen-wai Yim , Fei Xia , Martin Gunn , Meliha Yetisgen , Asma Ben Abacha

Multimodal representation is crucial for E-commerce tasks such as identical product retrieval. Large representation models (e.g., VLM2Vec) demonstrate strong multimodal understanding capabilities, yet they struggle with fine-grained…

Computation and Language · Computer Science 2026-04-23 Biao Zhang , Lixin Chen , Bin Zhang , Zongwei Wang , Tong Liu , Bo Zheng

E-commerce platforms increasingly rely on Large Language Models (LLMs) and Vision Language Models (VLMs) to detect illicit or misleading product content. However, these models remain vulnerable to evasive content, which refers to inputs…

Computation and Language · Computer Science 2026-05-28 Ancheng Xu , Zhihao Yang , Jingpeng Li , Guanghu Yuan , Longze Chen , Liang Yan , Jiehui Zhou , Zhen Qin , Hengyu Chang , Yukun Chen , Hamid Alinejad-Rokny , Min Yang

Multimodal large language models (MLLMs) are now routinely deployed for visual understanding, generation, and curation. A substantial fraction of these applications require an explicit aesthetic judgment. Most existing solutions reduce this…

The application of visual instruction tuning and other post-training techniques has significantly enhanced the capabilities of Large Language Models (LLMs) in visual understanding, enriching Vision-Language Models (VLMs) with more…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Mingjie Xu , Andrew Estornell , Hongzheng Yang , Yuzhi Zhao , Zhaowei Zhu , Qi Xuan , Jiaheng Wei

We introduce Vibe-Eval: a new open benchmark and framework for evaluating multimodal chat models. Vibe-Eval consists of 269 visual understanding prompts, including 100 of hard difficulty, complete with gold-standard responses authored by…