English
Related papers

Related papers: Exploring the Capability of LLMs in Performing Low…

200 papers

Scientific data visualization plays a crucial role in research by enabling the direct display of complex information and assisting researchers in identifying implicit patterns. Despite its importance, the use of Large Language Models (LLMs)…

Computation and Language · Computer Science 2024-03-20 Zhiyu Yang , Zihan Zhou , Shuo Wang , Xin Cong , Xu Han , Yukun Yan , Zhenghao Liu , Zhixing Tan , Pengyuan Liu , Dong Yu , Zhiyuan Liu , Xiaodong Shi , Maosong Sun

Recent studies have demonstrated the effectiveness of Large Language Models (LLMs) as reasoning modules that can deconstruct complex tasks into more manageable sub-tasks, particularly when applied to visual reasoning tasks for images. In…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Ahmad Mahmood , Ashmal Vayani , Muzammal Naseer , Salman Khan , Fahad Shahbaz Khan

Vision Language Models (VLMs) have demonstrated significant potential in various downstream tasks, including Image/Video Generation, Visual Question Answering, Multimodal Chatbots, and Video Understanding. However, these models often…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Ahmad Mustafa Anis , Hasnain Ali , Saquib Sarfraz

Scalable Vector Graphics (SVG) has become the de facto standard for vector graphics in digital design, offering resolution independence and precise control over individual elements. Despite their advantages, creating high-quality SVG…

Computer Vision and Pattern Recognition · Computer Science 2025-11-13 Ronghuan Wu , Wanchao Su , Jing Liao

Visual-Language Models (VLMs) have become a powerful tool for bridging the gap between visual and linguistic understanding. However, the conventional learning approaches for VLMs often suffer from limitations, such as the high resource…

Computation and Language · Computer Science 2025-04-01 Dasol Choi , Guijin Son , Soo Yong Kim , Gio Paik , Seunghyeok Hong

The integration of language instructions with robotic control, particularly through Vision Language Action (VLA) models, has shown significant potential. However, these systems are often hindered by high computational costs, the need for…

Robotics · Computer Science 2025-02-04 Marie Samson , Bastien Muraccioli , Fumio Kanehiro

Context: Traditional software security analysis methods struggle to keep pace with the scale and complexity of modern codebases, requiring intelligent automation to detect, assess, and remediate vulnerabilities more efficiently and…

Software Engineering · Computer Science 2026-01-14 Shaznin Sultana , Sadia Afreen , Nasir U. Eisty

Web-scale visual entity recognition, the task of associating images with their corresponding entities within vast knowledge bases like Wikipedia, presents significant challenges due to the lack of clean, large-scale training data. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Mathilde Caron , Alireza Fathi , Cordelia Schmid , Ahmet Iscen

Vision language models (VLMs) like CLIP show stellar zero-shot capability on classification benchmarks. However, selecting the VLM with the highest performance on the unlabeled downstream task is non-trivial. Existing VLM selection methods…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Yuhe Ding , Bo Jiang , Aihua Zheng , Qin Xu , Jian Liang

Vision-Language Models (VLMs) have demonstrated remarkable capabilities in aligning and understanding multimodal signals, yet their potential to reason over structured data, where multimodal entities are connected through explicit…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Jiajin Liu , Dongzhe Fan , Chuanhao Ji , Daochen Zha , Qiaoyu Tan

Large Language Models (LLMs) have demonstrated the ability to solve complex tasks through In-Context Learning (ICL), where models learn from a few input-output pairs without explicit fine-tuning. In this paper, we explore the capacity of…

Machine Learning · Computer Science 2024-11-26 Paimon Goulart , Evangelos E. Papalexakis

With recent progress in joint modeling of visual and textual representations, Vision-Language Pretraining (VLP) has achieved impressive performance on many multimodal downstream tasks. However, the requirement for expensive annotations…

Computer Vision and Pattern Recognition · Computer Science 2022-05-17 Zirui Wang , Jiahui Yu , Adams Wei Yu , Zihang Dai , Yulia Tsvetkov , Yuan Cao

Large vision-language models (LVLMs) are markedly proficient in deriving visual representations guided by natural language. Recent explorations have utilized LVLMs to tackle zero-shot visual anomaly detection (VAD) challenges by pairing…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Jiaqi Zhu , Shaofeng Cai , Fang Deng , Beng Chin Ooi , Junran Wu

The success of VLMs often relies on the dynamic high-resolution schema that adaptively augments the input images to multiple crops, so that the details of the images can be retained. However, such approaches result in a large number of…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Jiayi Han , Liang Du , Yiwen Wu , Xiangguo Zhou , Hongwei Du , Weibo Zheng

When answering questions about images, humans naturally point, label, and draw to explain their reasoning. In contrast, modern vision-language models (VLMs) such as Gemini-3-Pro and GPT-5 only respond with text, which can be difficult for…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Brandon Collins , Logan Bolton , Hung Huy Nguyen , Mohammad Reza Taesiri , Trung Bui , Anh Totti Nguyen

This paper proposes LayoutLLM, a more flexible document analysis method for understanding imaged documents. Visually Rich Document Understanding tasks, such as document image classification and information extraction, have gained…

Computation and Language · Computer Science 2024-03-22 Masato Fujitake

The emergence of Small Language Models (SLMs) as privacy-preserving alternatives for sensitive applications raises a fundamental question about their inherent understanding capabilities compared to Large Language Models (LLMs). This paper…

Computation and Language · Computer Science 2025-07-15 Hong Jia , Shiya Fu , Feng Xia , Vassilis Kostakos , Ting Dang

Vision-language models (VLMs) classify the query video by calculating a similarity score between the visual features and text-based class label representations. Recently, large language models (LLMs) have been used to enrich the text-based…

Computer Vision and Pattern Recognition · Computer Science 2023-10-25 Adeel Yousaf , Muzammal Naseer , Salman Khan , Fahad Shahbaz Khan , Mubarak Shah

Charts play a critical role in conveying numerical data insights through structured visual representations. However, semantic visual understanding and numerical reasoning requirements hinder the accurate description of charts, interpreting…

Computation and Language · Computer Science 2026-05-29 Yutong Qu , Wei Zhang

Recently, Large Language Models (LLMs) have been serving as general-purpose interfaces, posing a significant demand for comprehensive visual knowledge. However, it remains unclear how well current LLMs and their visually augmented…

Computation and Language · Computer Science 2023-10-24 Heming Xia , Qingxiu Dong , Lei Li , Jingjing Xu , Tianyu Liu , Ziwei Qin , Zhifang Sui