English
Related papers

Related papers: Patchfinder: Leveraging Visual Language Models for…

200 papers

Background: Log messages provide valuable information about the status of software systems. This information is provided in an unstructured fashion and automated approaches are applied to extract relevant parameters. To ease this process,…

Software Engineering · Computer Science 2024-09-05 Merve Astekin , Max Hort , Leon Moonen

Professionals in academia, law, and finance audit their documents because inconsistencies can result in monetary, reputational, and scientific costs. Language models (LMs) have the potential to dramatically speed up this auditing process.…

Computation and Language · Computer Science 2025-12-23 Charles J. Lovering , Seth Ebner , Brandon Smock , Michael Krumdick , Saad Rabbani , Ahmed Muhammad , Varshini Reddy , Chris Tanner

The rapid advancement of Large Language Models (LLMs) has led to a multitude of application opportunities. One traditional task for Information Retrieval systems is the summarization and classification of texts, both of which are important…

Computation and Language · Computer Science 2025-02-25 Gautam Kishore Shahi , Oliver Hummel

Contrastively-trained Vision-Language Models (VLMs), such as CLIP, have become the standard approach for learning discriminative vision-language representations. However, these models often exhibit shallow language understanding,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Ioanna Ntinou , Alexandros Xenos , Yassine Ouali , Adrian Bulat , Georgios Tzimiropoulos

The growing sophistication of deepfakes presents substantial challenges to the integrity of media and the preservation of public trust. Concurrently, vision-language models (VLMs), large language models enhanced with visual reasoning…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Shahroz Tariq , David Nguyen , M. A. P. Chamikara , Tingmin Wu , Alsharif Abuadbba , Kristen Moore

With the rapid development of web technology, more and more software applications have become web-based in the past decades. To ensure software quality and user experience, various techniques have been proposed to automatically test web…

Software Engineering · Computer Science 2024-10-17 Siyi Wang , Sinan Wang , Yujia Fan , Xiaolei Li , Yepang Liu

Vision language models (VLMs) can flexibly address various vision tasks through text interactions. Although successful in semantic understanding, state-of-the-art VLMs including GPT-5 still struggle in understanding 3D from 2D inputs. On…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Zhipeng Cai , Ching-Feng Yeh , Hu Xu , Zhuang Liu , Gregory Meyer , Xinjie Lei , Changsheng Zhao , Shang-Wen Li , Vikas Chandra , Yangyang Shi

Face verification systems have seen substantial advancements; however, they often lack transparency in their decision-making processes. In this paper, we introduce an innovative Vision-Language Model (VLM) for Face Verification, which not…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Syed Abdul Hannan , Hazim Bukhari , Thomas Cantalapiedra , Eman Ansar , Massa Baali , Rita Singh , Bhiksha Raj

Objective: This study aims to summarize the usage of Large Language Models (LLMs) in the process of creating a scientific review. We look at the range of stages in a review that can be automated and assess the current state-of-the-art…

Digital Libraries · Computer Science 2025-05-16 Dmitry Scherbakov , Nina Hubig , Vinita Jansari , Alexander Bakumenko , Leslie A. Lenert

Vision-language models (VLMs) excel in various visual benchmarks but are often constrained by the lack of high-quality visual fine-tuning data. To address this challenge, we introduce VisCon-100K, a novel dataset derived from interleaved…

Computation and Language · Computer Science 2025-02-25 Gokul Karthik Kumar , Iheb Chaabane , Kebin Wu

For the ACMMM25 challenge, we present a practical engineering approach to multimedia news source verification, utilizing Large Language Models (LLMs) like GPT-4o as the backbone of our pipeline. Our method processes images and videos…

This project investigates the capabilities of large language models (LLMs) to determine the difficulty of data visualization literacy test items. We explore whether features derived from item text (question and answer options), the…

Artificial Intelligence · Computer Science 2026-03-06 Samin Khan

The proliferation of multimodal Large Language Models has significantly advanced the ability to analyze and understand complex data inputs from different modalities. However, the processing of long documents remains under-explored, largely…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Goeric Huybrechts , Srikanth Ronanki , Sai Muralidhar Jayanthi , Jack Fitzgerald , Srinivasan Veeravanallur

The development of large language models (LLMs) has achieved superior performance in a range of downstream tasks, including LLM-based retrieval-augmented generation (RAG). The quality of generated content heavily relies on the usefulness of…

Computation and Language · Computer Science 2026-01-27 Fengran Mo , Zhan Su , Yuchen Hui , Jinghan Zhang , Jia Ao Sun , Zheyuan Liu , Chao Zhang , Tetsuya Sakai , Jian-Yun Nie

The success of Vision Language Models (VLMs) on various vision-language tasks heavily relies on pre-training with large scale web-crawled datasets. However, the noisy and incomplete nature of web data makes dataset scale crucial for…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Yiyi Tao , Zhuoyue Wang , Hang Zhang , Lun Wang

Vision-Language Models (VLMs) have achieved remarkable progress on a wide range of challenging multimodal understanding and reasoning tasks. However, existing reasoning paradigms, such as the classical Chain-of-Thought (CoT), rely solely on…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Yukun Qi , Pei Fu , Hang Li , Yuhan Liu , Chao Jiang , Bin Qin , Zhenbo Luo , Jian Luan

The recent developments in deep learning led to the integration of natural language processing (NLP) with computer vision, resulting in powerful integrated Vision and Language Models (VLMs). Despite their remarkable capabilities, these…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Harshit , Tolga Tasdizen

Recent advancements in dialogue systems have highlighted the significance of integrating multimodal responses, which enable conveying ideas through diverse modalities rather than solely relying on text-based interactions. This enrichment…

Computation and Language · Computer Science 2024-07-08 Chang-Sheng Kao , Yun-Nung Chen

Large visual-language models (LVLMs) exhibit exceptional performance in visual-language reasoning across diverse cross-modal benchmarks. Despite these advances, recent research indicates that Large Language Models (LLMs), like…

Computation and Language · Computer Science 2025-04-17 Ye Jiang , Yimin Wang

Vision-language models (VLMs) excel at extracting and reasoning about information from images. Yet, their capacity to leverage internal knowledge about specific entities remains underexplored. This work investigates the disparity in model…

Computation and Language · Computer Science 2026-01-06 Ido Cohen , Daniela Gottesman , Mor Geva , Raja Giryes