English
Related papers

Related papers: An Online Reference-Free Evaluation Framework for …

200 papers

When answering questions about images, humans naturally point, label, and draw to explain their reasoning. In contrast, modern vision-language models (VLMs) such as Gemini-3-Pro and GPT-5 only respond with text, which can be difficult for…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Brandon Collins , Logan Bolton , Hung Huy Nguyen , Mohammad Reza Taesiri , Trung Bui , Anh Totti Nguyen

Vision-Language Models (VLMs) have demonstrated strong capabilities in aligning visual and textual modalities, enabling a wide range of applications in multimodal understanding and generation. While they excel in zero-shot and transfer…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Hao Dong , Moru Liu , Jian Liang , Eleni Chatzi , Olga Fink

Real-world dark images commonly exhibit not only low visibility and contrast but also complex noise and blur, posing significant restoration challenges. Existing methods often rely on paired data or fail to model dynamic illumination and…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Wei Dong , Han Zhou , Junwei Lin , Jun Chen

Large vision-language models (LVLMs) have made significant progress in recent years. While LVLMs exhibit excellent ability in language understanding, question answering, and conversations of visual inputs, they are prone to producing…

Computation and Language · Computer Science 2024-11-20 Qing Li , Jiahui Geng , Chenyang Lyu , Derui Zhu , Maxim Panov , Fakhri Karray

Augmenting pretrained language models (LMs) with a vision encoder (e.g., Flamingo) has obtained the state-of-the-art results in image-to-text generation. However, these models store all the knowledge within their parameters, thus often…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Zhuolin Yang , Wei Ping , Zihan Liu , Vijay Korthikanti , Weili Nie , De-An Huang , Linxi Fan , Zhiding Yu , Shiyi Lan , Bo Li , Ming-Yu Liu , Yuke Zhu , Mohammad Shoeybi , Bryan Catanzaro , Chaowei Xiao , Anima Anandkumar

Multimodal vision-language models (VLMs) continue to achieve ever-improving scores on chart understanding benchmarks. Yet, we find that this progress does not fully capture the breadth of visual reasoning capabilities essential for…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Kushin Mukherjee , Donghao Ren , Dominik Moritz , Yannick Assogba

Vision-language models (VLMs) can read text from images, but where does this optical character recognition (OCR) information enter the language processing stream? We investigate the OCR routing mechanism across three architecture families…

Computation and Language · Computer Science 2026-05-18 Jonathan Steinberg , Oren Gal

Semantic retrieval of remote sensing (RS) images is a critical task fundamentally challenged by the \textquote{semantic gap}, the discrepancy between a model's low-level visual features and high-level human concepts. While large…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 J. Xiao , Y. Guo , X. Zi , K. Thiyagarajan , C. Moreira , M. Prasad

Despite significant advancements in vision-language models (VLMs), there lacks effective approaches to enhance response quality by scaling inference-time computation. This capability is known to be a core step towards the self-improving…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Xiyao Wang , Zhengyuan Yang , Linjie Li , Hongjin Lu , Yuancheng Xu , Chung-Ching Lin , Kevin Lin , Furong Huang , Lijuan Wang

Multimodal Large Language Models (MLLMs) have advanced VQA and now support Vision-DeepResearch systems that use search engines for complex visual-textual fact-finding. However, evaluating these visual and textual search abilities is still…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Yu Zeng , Wenxuan Huang , Zhen Fang , Shuang Chen , Yufan Shen , Yishuo Cai , Xiaoman Wang , Zhenfei Yin , Lin Chen , Zehui Chen , Shiting Huang , Yiming Zhao , Xu Tang , Yao Hu , Philip Torr , Wanli Ouyang , Shaosheng Cao

The task of automated code review has recently gained a lot of attention from the machine learning community. However, current review comment evaluation metrics rely on comparisons with a human-written reference for a given code change…

Software Engineering · Computer Science 2025-03-18 Atharva Naik , Marcus Alenius , Daniel Fried , Carolyn Rose

Video and image quality assessment has long been projected as a regression problem, which requires predicting a continuous quality score given an input stimulus. However, recent efforts have shown that accurate quality score regression on…

Computer Vision and Pattern Recognition · Computer Science 2021-02-02 Zhengzhong Tu , Chia-Ju Chen , Li-Heng Chen , Yilin Wang , Neil Birkbeck , Balu Adsumilli , Alan C. Bovik

Vision-Language Models (VLMs) are essential for embodied AI and safety-critical applications, such as robotics and autonomous systems. However, existing benchmarks primarily focus on static or curated visual inputs, neglecting the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Hanwen Wan , Zexin Lin , Yixuan Deng , Xiaoqiang Ji

Vision Language Models (VLMs) often struggle with chart understanding tasks, particularly in accurate chart description and complex reasoning. Synthetic data generation is a promising solution, while usually facing the challenge of noise…

Artificial Intelligence · Computer Science 2025-08-19 Gongyao Jiang , Qiong Luo

Vision-Language Models (VLMs) leverage aligned visual encoders to transform images into visual tokens, allowing them to be processed similarly to text by the backbone large language model (LLM). This unified input paradigm enables VLMs to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Bangzheng Li , Fei Wang , Wenxuan Zhou , Nan Xu , Ben Zhou , Sheng Zhang , Hoifung Poon , Muhao Chen

Despite the rapid advancements in Vision-Language Models (VLMs), a critical gap remains in their ability to handle structured, controllable diagrammatic tasks essential for professional workflows. Existing methods predominantly rely on…

Computation and Language · Computer Science 2026-05-18 Xiaoyan Su , Peijie Dong , Zhenheng Tang , Song Tang , Yuyao Zhai , Kaitao Lin , Liang Chen , Gai Yuhang , Yuyu Luo , Qiang Wang , Xiaowen Chu

Vision Language Models excel in handling a wide range of complex tasks, including Optical Character Recognition (OCR), Visual Question Answering (VQA), and advanced geometric reasoning. However, these models fail to perform well on…

Computation and Language · Computer Science 2024-10-30 Ayush Singh , Mansi Gupta , Shivank Garg

Recent advances in vision-language models (VLMs) have enabled end-to-end document parsing and understanding, achieving strong performance on diverse optical character recognition (OCR) tasks. However, VLMs are prone to generate words that…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Qian Chen , Xianyin Zhang , Lifan Guo , Feng Chen , Chi Zhang

We present a no-reference video quality model and algorithm that delivers standout performance for High Dynamic Range (HDR) videos, which we call HDR-ChipQA. HDR videos represent wider ranges of luminances, details, and colors than Standard…

Image and Video Processing · Electrical Eng. & Systems 2023-04-27 Joshua P. Ebenezer , Zaixi Shang , Yongjun Wu , Hai Wei , Sriram Sethuraman , Alan C. Bovik

Efficient creation of accurate and editable 3D CAD models is critical in engineering design, significantly impacting cost and time-to-market in product innovation. Current manual workflows remain highly time-consuming and demand extensive…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Anna C. Doris , Md Ferdous Alam , Amin Heyrani Nobari , Faez Ahmed