English
Related papers

Related papers: Animation Needs Attention: A Holistic Approach to …

200 papers

Generalizing Multimodal Large Language Models (MLLMs) to novel video domains is essential for real-world deployment but remains challenging due to the scarcity of labeled data. While In-Context Learning (ICL) offers a training-free…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Ryo Fujii , Hideo Saito , Ryo Hachiuma

Large language models are powerful but costly. We ask whether meta-learning can make the pretraining of small language models not only better but also more interpretable. We integrate first-order MAML with subset-masked LM pretraining,…

Computation and Language · Computer Science 2025-11-10 David Demitri Africa , Yuval Weiss , Paula Buttery , Richard Diehl Martinez

Video-based numerical reasoning provides a premier arena for testing whether Vision-Language Models (VLMs) truly "understand" real-world dynamics, as accurate numerical deduction necessitates a profound grasp of temporal events, object…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Shaoyang Cui , Lingbei Meng

Vision-Language Models (VLMs) acquire real-world knowledge and general reasoning ability through Internet-scale image-text corpora. They can augment robotic systems with scene understanding and task planning, and assist visuomotor policies…

Robotics · Computer Science 2025-06-23 Kaiyuan Chen , Shuangyu Xie , Zehan Ma , Pannag R Sanketi , Ken Goldberg

The advent of Vision Language Models (VLM) has allowed researchers to investigate the visual understanding of a neural network using natural language. Beyond object classification and detection, VLMs are capable of visual comprehension and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-12 Haz Sameen Shahgir , Khondker Salman Sayeed , Abhik Bhattacharjee , Wasi Uddin Ahmad , Yue Dong , Rifat Shahriyar

Vision-Language Models have made significant progress on many perception-focused tasks. However, their progress on reasoning-focused tasks remains limited due to the lack of high-quality and diverse training data. In this work, we aim to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Yiming Jia , Jiachen Li , Xiang Yue , Bo Li , Ping Nie , Kai Zou , Wenhu Chen

Video Question Answering (VideoQA) has been significantly advanced from the scaling of recent Large Language Models (LLMs). The key idea is to convert the visual information into the language feature space so that the capacity of LLMs can…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Junting Pan , Ziyi Lin , Yuying Ge , Xiatian Zhu , Renrui Zhang , Yi Wang , Yu Qiao , Hongsheng Li

Humans naturally share information with those they are connected to, and video has become one of the dominant mediums for communication and expression on the Internet. To support the creation of high-quality large-scale video content, a…

The rapid evolution of Large Language Models (LLMs) has fostered diverse paradigms for automated slide generation, ranging from code-driven layouts to image-centric synthesis. However, evaluating these heterogeneous systems remains…

Computation and Language · Computer Science 2026-01-15 Yunqiao Yang , Wenbo Li , Houxing Ren , Zimu Lu , Ke Wang , Zhiyuan Huang , Zhuofan Zong , Mingjie Zhan , Hongsheng Li

When answering questions about images, humans naturally point, label, and draw to explain their reasoning. In contrast, modern vision-language models (VLMs) such as Gemini-3-Pro and GPT-5 only respond with text, which can be difficult for…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Brandon Collins , Logan Bolton , Hung Huy Nguyen , Mohammad Reza Taesiri , Trung Bui , Anh Totti Nguyen

Large language models (LLMs) exhibit cultural bias from overrepresented viewpoints in training data, yet cultural alignment remains a challenge due to limited cultural knowledge and a lack of exploration into effective learning approaches.…

Computation and Language · Computer Science 2025-12-16 Chunhua Liu , Kabir Manandhar Shrestha , Sukai Huang

Vision-Language Models (VLMs) are crucial for applications requiring integrated understanding textual and visual information. However, existing VLMs struggle with long videos due to computational inefficiency, memory limitations, and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Anxhelo Diko , Tinghuai Wang , Wassim Swaileh , Shiyan Sun , Ioannis Patras

Vision-Language Models (VLMs) have achieved strong results in video understanding, yet a key question remains: do they truly comprehend visual content or only learn shallow correlations between vision and language? Real visual…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Zongxia Li , Xiyang Wu , Guangyao Shi , Yubin Qin , Hongyang Du , Fuxiao Liu , Tianyi Zhou , Dinesh Manocha , Jordan Lee Boyd-Graber

Vision-Language Models (VLMs) have emerged as general purpose tools for addressing a variety of complex computer vision problems. Such models have been shown to be highly capable, but, at the same time, also lacking some basic visual…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Shivam Chandhok , Wan-Cyuan Fan , Leonid Sigal

Recent Multimodal Large Language Models(MLLMs) often use a large number of visual tokens to compensate their visual shortcoming, leading to excessive computation and obvious visual redundancy. In this paper, we investigate what kind of…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Yutao Jiang , Qiong Wu , Wenhao Lin , Wei Yu , Yiyi Zhou

In real-world settings, vision language models (VLMs) should robustly handle naturalistic, noisy visual content as well as domain-specific language and concepts. For example, K-12 educators using digital learning platforms may need to…

Computation and Language · Computer Science 2025-01-28 Sami Baral , Li Lucy , Ryan Knight , Alice Ng , Luca Soldaini , Neil T. Heffernan , Kyle Lo

Vision-Language Models (VLMs) have achieved remarkable success in various multi-modal tasks, but they are often bottlenecked by the limited context window and high computational cost of processing high-resolution image inputs and videos.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Xubing Ye , Yukang Gan , Xiaoke Huang , Yixiao Ge , Yansong Tang

Vision Language Models (VLMs) have recently been leveraged to generate robotic actions, forming Vision-Language-Action (VLA) models. However, directly adapting a pretrained VLM for robotic control remains challenging, particularly when…

Multi-modal Large Language Models (MLLMs) have shown remarkable capabilities in various multi-modal tasks. Nevertheless, their performance in fine-grained image understanding tasks is still limited. To address this issue, this paper…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Shiyu Xuan , Qingpei Guo , Ming Yang , Shiliang Zhang

The integration of Vision-Language-Action (VLA) models into autonomous driving systems offers a unified framework for interpreting complex scenes and executing control commands. However, the necessity to incorporate historical multi-view…

Robotics · Computer Science 2026-03-30 Yiru Wang , Anqing Jiang , Shuo Wang , Yuwen Heng , Zichong Gu , Hao Sun