English
Related papers

Related papers: It's Time to Get It Right: Improving Analog Clock …

200 papers

Vision-Language Models (VLMs), such as CLIP, have achieved significant zero-shot performance on downstream tasks with various fine-tuning adaptation methods. However, recent studies have proven that adversarial attacks can significantly…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Jia-Wei Hai , Yijun Wang , Xiu-Shen Wei

While large language models (LLMs) have demonstrated remarkable reasoning capabilities, they are not without their flaws and inaccuracies. Recent studies have introduced various methods to mitigate these limitations. Temporal reasoning…

Computation and Language · Computer Science 2024-10-10 Siheng Xiong , Ali Payani , Ramana Kompella , Faramarz Fekri

Training vision language models (VLMs) aims to align visual representations from a vision encoder with the textual representations of a pretrained large language model (LLM). However, many VLMs exhibit reduced factual recall performance…

Machine Learning · Computer Science 2025-12-04 Constantin Venhoff , Ashkan Khakzar , Sonia Joseph , Philip Torr , Neel Nanda

Multimodal Vision Language Models (VLMs) have emerged as a transformative topic at the intersection of computer vision and natural language processing, enabling machines to perceive and reason about the world through both visual and textual…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Zongxia Li , Xiyang Wu , Hongyang Du , Fuxiao Liu , Huy Nghiem , Guangyao Shi

Audio is essential for multimodal video understanding. On the one hand, video inherently contains audio, which supplies complementary information to vision. Besides, video large language models (Video-LLMs) can encounter many audio-centric…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Yuxin Guo , Shuailei Ma , Shijie Ma , Xiaoyi Bao , Chen-Wei Xie , Kecheng Zheng , Tingyu Weng , Siyang Sun , Yun Zheng , Wei Zou

Vision-language models (VLMs) integrate visual and textual information, enabling a wide range of applications such as image captioning and visual question answering, making them crucial for modern AI systems. However, their high…

Computer Vision and Pattern Recognition · Computer Science 2025-07-03 Gaurav Shinde , Anuradha Ravi , Emon Dey , Shadman Sakib , Milind Rampure , Nirmalya Roy

Large language models (LLMs) have gained increasing popularity in robotic task planning due to their exceptional abilities in text analytics and generation, as well as their broad knowledge of the world. However, they fall short in decoding…

Robotics · Computer Science 2024-08-01 Aoran Mei , Guo-Niu Zhu , Huaxiang Zhang , Zhongxue Gan

Most existing sign language translation (SLT) datasets are limited in scale, lack multilingual coverage, and are costly to curate due to their reliance on expert annotation and controlled recording setup. Recently, Vision Language Models…

Computation and Language · Computer Science 2025-10-30 Shakib Yazdani , Yasser Hamidullah , Cristina España-Bonet , Josef van Genabith

Vision-language object detectors (VLODs) such as YOLO-World and Grounding DINO exhibit strong zero-shot generalization, but their performance degrades under distribution shift. Test-time adaptation (TTA) offers a practical way to adapt…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Atif Belal , Heitor R. Medeiros , Marco Pedersoli , Eric Granger

Understanding time series is crucial for its application in real-world scenarios. Recently, large language models (LLMs) have been increasingly applied to time series tasks, leveraging their strong language capabilities to enhance various…

Artificial Intelligence · Computer Science 2026-01-06 Zhe Xie , Zeyan Li , Xiao He , Longlong Xu , Xidao Wen , Tieying Zhang , Jianjun Chen , Rui Shi , Dan Pei

Detecting temporal changes in geographical landscapes is critical for applications like environmental monitoring and urban planning. While remote sensing data is abundant, existing vision-language models (VLMs) often fail to capture…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Hosam Elgendy , Ahmed Sharshar , Ahmed Aboeitta , Yasser Ashraf , Mohsen Guizani

We present a novel prompt design for Large Language Models (LLMs) tailored to Asynchronous Time Series. Unlike regular time series, which assume values at evenly spaced time points, asynchronous time series consist of timestamped events…

Machine Learning · Computer Science 2025-02-05 Shubham Gupta , Thibaut Durand , Graham Taylor , Lilian W. Białokozowicz

Web service administrators must ensure the stability of multiple systems by promptly detecting anomalies in Key Performance Indicators (KPIs). Achieving the goal of "train once, infer across scenarios" remains a fundamental challenge for…

Machine Learning · Computer Science 2025-10-07 Zexin Wang , Changhua Pei , Yang Liu , Hengyue Jiang , Quan Zhou , Haotian Si , Hang Cui , Jianhui Li , Gaogang Xie , Jingjing Li , Dan Pei

Vision-language-action (VLA) models have recently emerged as a powerful paradigm for building generalist robots. However, traditional VLA models that generate actions through flow matching (FM) typically rely on rigid and uniform time…

Robotics · Computer Science 2026-05-08 Yuhua Jiang , Shuang Cheng , Yan Ding , Feifei Gao , Biqing Qi

To address a fundamental limitation in cognitive systems, namely the absence of a time-updatable mediating thought space between semantics and continuous control, this work constructs and trains a vision-language-action model termed Sigma,…

Machine Learning · Computer Science 2026-01-23 Libo Wang

The Arrow of Time (AoT)-time's irreversible flow shaping physical events-is fundamental to video comprehension, yet remains a significant challenge for modern large multimodal models (LMMs). Current LMMs struggle to perceive and utilize…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Zihui Xue , Mi Luo , Kristen Grauman

Large language models (LLMs) and time-series language models (TSLMs) are increasingly applied to time-series question answering (TSQA). Unlike text-only QA, TSQA requires models to ground answers in temporal signals whose patterns may occur…

Computation and Language · Computer Science 2026-05-26 Liying Han , Kang Yang , Oliver Wang , Jason Wu , Pengrui Quan , Gaofeng Dong , Ozan Baris Mulayim , Sizhe Ma , Yuyang Yuan , Dezhi Hong , Mario Berges , Mani Srivastava

Large Vision-Language Models (LVLMs) or multimodal large language models represent a significant advancement in artificial intelligence, enabling systems to understand and generate content across both visual and textual modalities. While…

Machine Learning · Computer Science 2025-09-09 Thanh Thi Nguyen , Campbell Wilson , Janis Dalins

Inducing reasoning in multimodal large language models (MLLMs) is critical for achieving human-level perception and understanding. Existing methods mainly leverage LLM reasoning to analyze parsed visuals, often limited by static perception…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Ziang Yan , Xinhao Li , Yinan He , Zhengrong Yue , Xiangyu Zeng , Yali Wang , Yu Qiao , Limin Wang , Yi Wang

Understanding 3D spatial relationships remains a major limitation of current Vision-Language Models (VLMs). Prior work has addressed this issue by creating spatial question-answering (QA) datasets based on single images or indoor videos.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Mohsen Gholami , Ahmad Rezaei , Zhou Weimin , Sitong Mao , Shunbo Zhou , Yong Zhang , Mohammad Akbari