English
Related papers

Related papers: Harnessing Vision-Language Models for Time Series …

200 papers

Temporal understanding in autonomous driving (AD) remains a significant challenge, even for recent state-of-the-art (SoTA) Vision-Language Models (VLMs). Prior work has introduced datasets and benchmarks aimed at improving temporal…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Kevin Cannons , Saeed Ranjbar Alvar , Mohammad Asiful Hossain , Ahmad Rezaei , Mohsen Gholami , Alireza Heidarikhazaei , Zhou Weimin , Yong Zhang , Mohammad Akbari

Vision and Language Models (VLMs), such as CLIP, have enabled visual recognition of a potentially unlimited set of categories described by text prompts. However, for the best visual recognition performance, these models still require tuning…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 M. Jehanzeb Mirza , Leonid Karlinsky , Wei Lin , Horst Possegger , Rogerio Feris , Horst Bischof

Video Anomaly Detection~(VAD) focuses on identifying anomalies within videos. Supervised methods require an amount of in-domain training data and often struggle to generalize to unseen anomalies. In contrast, training-free methods leverage…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Yihua Shao , Haojin He , Sijie Li , Siyu Chen , Xinwei Long , Fanhu Zeng , Yuxuan Fan , Muyang Zhang , Ziyang Yan , Ao Ma , Xiaochen Wang , Hao Tang , Yan Wang , Shuyan Li

Vision-Language Models (VLMs) have demonstrated strong capabilities in aligning visual and textual modalities, enabling a wide range of applications in multimodal understanding and generation. While they excel in zero-shot and transfer…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Hao Dong , Moru Liu , Jian Liang , Eleni Chatzi , Olga Fink

Vision language models (VLMs) have seen growing adoption in recent years, but many still struggle with basic spatial reasoning errors. We hypothesize that this is due to VLMs adopting pre-trained vision backbones, specifically vision…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Ian Covert , Tony Sun , James Zou , Tatsunori Hashimoto

Time series data plays a critical role across diverse domains such as healthcare, energy, and finance, where tasks like classification, anomaly detection, and forecasting are essential for informed decision-making. Recently, large language…

Machine Learning · Computer Science 2024-12-18 Francis Tang , Ying Ding

Recent breakthroughs in vision-language models (VLMs) start a new page in the vision community. The VLMs provide stronger and more generalizable feature embeddings compared to those from ImageNet-pretrained models, thanks to the training on…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Jieneng Chen , Qihang Yu , Xiaohui Shen , Alan Yuille , Liang-Chieh Chen

Industrial anomaly detection is a critical component of modern manufacturing, yet the scarcity of defective samples restricts traditional detection methods to scenario-specific applications. Although Vision-Language Models (VLMs)…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Yanhui Li , Yunkang Cao , Chengliang Liu , Yuan Xiong , Xinghui Dong , Chao Huang

Latent Action Models (LAMs) have rapidly gained traction as an important component in the pre-training pipelines of leading Vision-Language-Action models. However, they fail when observations contain action-correlated distractors, often…

Existing semi-supervised video anomaly detection (VAD) methods often struggle with detecting complex anomalies involving object interactions and generally lack explainability. To overcome these limitations, we propose a novel VAD framework…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Furkan Mumcu , Michael J. Jones , Anoop Cherian , Yasin Yilmaz

Lesion detection, symptom tracking, and visual explainability are central to real-world medical image analysis, yet current medical Vision-Language Models (VLMs) still lack mechanisms that translate their broad knowledge into clinically…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Woohyeon Park , Jaeik Kim , Sunghwan Steve Cho , Pa Hong , Wookyoung Jeong , Yoojin Nam , Namjoon Kim , Ginny Y. Wong , Ka Chun Cheung , Jaeyoung Do

Reliable prediction by classifiers is crucial for their deployment in high security and dynamically changing situations. However, modern neural networks often exhibit overconfidence for misclassified predictions, highlighting the need for…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Fanhu Zeng , Zhen Cheng , Fei Zhu , Xu-Yao Zhang

Test-time scaling (TTS) has emerged as a powerful paradigm for improving the reasoning ability of Large Language Models (LLMs) by allocating additional computation at inference, yet its application to multimodal systems such as…

Recent breakthroughs in Multimodal Large Language Models (MLLMs) have gained significant recognition within the deep learning community, where the fusion of the Video Foundation Models (VFMs) and Large Language Models(LLMs) has proven…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Quan Zhang , Jinwei Fang , Rui Yuan , Xi Tang , Yuxin Qi , Ke Zhang , Chun Yuan

Large language models (LLMs) have demonstrated that large-scale pretraining enables systems to adapt rapidly to new problems with little supervision in the language domain. This success, however, has not translated as effectively to the…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Pablo Acuaviva , Aram Davtyan , Mariam Hassan , Sebastian Stapf , Ahmad Rahimi , Alexandre Alahi , Paolo Favaro

Detecting visual anomalies in diverse, multi-class real-world images is a significant challenge. We introduce \ours, a novel unsupervised multi-class visual anomaly detection framework. It integrates a Latent Diffusion Model (LDM) with a…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Samet Hicsonmez , Abd El Rahman Shabayek , Djamila Aouada

Time series anomaly detection (TSAD) plays a vital role in many industrial applications. While contrastive learning has gained momentum in the time series domain for its prowess in extracting meaningful representations from unlabeled data,…

Machine Learning · Computer Science 2025-01-28 Katrina Chen , Mingbin Feng , Tony S. Wirjanto

Vision-Language Model (VLM) have gained widespread adoption in Open-Vocabulary (OV) object detection and segmentation tasks. Despite they have shown promise on OV-related tasks, their effectiveness in conventional vision tasks has thus far…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Yongchao Feng , Yajie Liu , Shuai Yang , Wenrui Cai , Jinqing Zhang , Qiqi Zhan , Ziyue Huang , Hongxi Yan , Qiao Wan , Chenguang Liu , Junzhe Wang , Jiahui Lv , Ziqi Liu , Tengyuan Shi , Qingjie Liu , Yunhong Wang

A visual-language model (VLM) pre-trained on natural images and text pairs poses a significant barrier when applied to medical contexts due to domain shift. Yet, adapting or fine-tuning these VLMs for medical use presents considerable…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Aisha Urooj Khan , John Garrett , Tyler Bradshaw , Lonie Salkowski , Jiwoong Jason Jeong , Amara Tariq , Imon Banerjee

Vision-Language Models (VLMs) offer the ability to generate high-level, interpretable descriptions of complex activities from images and videos, making them valuable for situational awareness (SA) applications. In such settings, the focus…

Computer Vision and Pattern Recognition · Computer Science 2026-01-19 Pavana Pradeep , Krishna Kant , Suya Yu