中文
相关论文

相关论文: Harnessing Vision-Language Models for Time Series …

200 篇论文

Recent works have shown huge success of deep learning models for common in vocabulary (IV) scene text recognition. However, in real-world scenarios, out-of-vocabulary (OOV) words are of great importance and SOTA recognition models usually…

计算机视觉与模式识别 · 计算机科学 2023-10-31 Jinshui Hu , Chenyu Liu , Qiandong Yan , Xuyang Zhu , Jiajia Wu , Jun Du , Lirong Dai

Large Language Models (LLMs) have seen significant use in domains such as natural language processing and computer vision. Going beyond text, image and graphics, LLMs present a significant potential for analysis of time series data,…

机器学习 · 计算机科学 2024-05-08 Xiyuan Zhang , Ranak Roy Chowdhury , Rajesh K. Gupta , Jingbo Shang

Video temporal grounding aims to identify video segments within untrimmed videos that are most relevant to a given natural language query. Existing video temporal localization models rely on specific datasets for training and have high data…

计算机视觉与模式识别 · 计算机科学 2024-08-30 Minghang Zheng , Xinhao Cai , Qingchao Chen , Yuxin Peng , Yang Liu

Understanding abnormal events in videos is a vital and challenging task that has garnered significant attention in a wide range of applications. Although current video understanding Multi-modal Large Language Models (MLLMs) are capable of…

计算机视觉与模式识别 · 计算机科学 2025-11-04 Yingxian Chen , Jiahui Liu , Ruidi Fan , Yanwei Li , Chirui Chang , Shizhen Zhao , Wilton W. T. Fok , Xiaojuan Qi , Yik-Chung Wu

Multivariate time-series forecasting is vital in various domains, e.g., economic planning and weather prediction. Deep train-from-scratch models have exhibited effective performance yet require large amounts of data, which limits real-world…

机器学习 · 计算机科学 2025-02-21 Ching Chang , Wei-Yao Wang , Wen-Chih Peng , Tien-Fu Chen

The surge in real-time data collection across various industries has underscored the need for advanced anomaly detection in both univariate and multivariate time series data. This paper introduces TransNAS-TSAD, a framework that synergizes…

机器学习 · 计算机科学 2024-03-06 Ijaz Ul Haq , Byung Suk Lee , Donna M. Rizzo

Vision-language models (VLMs) have achieved impressive performance across a wide range of multimodal tasks. However, they often fail on tasks that require fine-grained visual perception, even when the required information is still present…

计算机视觉与模式识别 · 计算机科学 2026-04-16 Haz Sameen Shahgir , Xiaofu Chen , Yu Fu , Erfan Shayegani , Nael Abu-Ghazaleh , Yova Kementchedjhieva , Yue Dong

In recent years, we have witnessed significant progress in emerging deep learning models, particularly Large Language Models (LLMs) and Vision-Language Models (VLMs). These models have demonstrated promising results, indicating a new era of…

计算机视觉与模式识别 · 计算机科学 2025-03-18 Paola Natalia Cañas , Marcos Nieto , Oihana Otaegui , Igor Rodríguez

Vision Language Models (VLMs) are pivotal for advancing perception in intelligent agents. Yet, evaluation of VLMs remains limited to predominantly English-centric benchmarks in which the image-text pairs comprise short texts. To evaluate…

计算与语言 · 计算机科学 2025-10-16 Jesse Atuhurra , Iqra Ali , Tomoya Iwakura , Hidetaka Kamigaito , Tatsuya Hiraoka

Recent advances in visual industrial anomaly detection have demonstrated exceptional performance in identifying and segmenting anomalous regions while maintaining fast inference speeds. However, anomaly classification-distinguishing…

计算机视觉与模式识别 · 计算机科学 2025-05-06 Sassan Mokhtar , Arian Mousakhan , Silvio Galesso , Jawad Tayyub , Thomas Brox

Owing to their ability to extract relevant spatio-temporal video embeddings, Vision Transformers (ViTs) are currently the best performing models in video action understanding. However, their generalization over domains or datasets is…

计算机视觉与模式识别 · 计算机科学 2024-03-26 Hui Lu , Hu Jian , Ronald Poppe , Albert Ali Salah

Time series data is ubiquitous in the real-world problems across various domains including healthcare, social media, and crime surveillance. Detecting anomalies, or irregular and rare events, in time series data, can enable us to find…

机器学习 · 计算机科学 2021-10-05 Abilasha S , Sahely Bhadra , Deepak P , Anish Mathew

LLM-driven Anomaly Detection (AD) helps enhance the understanding and explanatory abilities of anomalous behaviors in Time Series (TS). Existing methods face challenges of inadequate reasoning ability, deficient multi-turn dialogue…

人工智能 · 计算机科学 2026-01-21 Hui Sun , Chang Xu , Haonan Xie , Hao Li , Yuhao Huang , Chuheng Zhang , Ming Jin , Xiaoguang Liu , Gang Wang , Jiang Bian

This report introduces an enhanced method for the Foundational Few-Shot Object Detection (FSOD) task, leveraging the vision-language model (VLM) for object detection. However, on specific datasets, VLM may encounter the problem where the…

计算机视觉与模式识别 · 计算机科学 2024-06-19 Hongpeng Pan , Shifeng Yi , Shouwei Yang , Lei Qi , Bing Hu , Yi Xu , Yang Yang

Handling anomalies is a critical preprocessing step in multivariate time series prediction. However, existing approaches that separate anomaly preprocessing from model training for multivariate time series prediction encounter significant…

机器学习 · 计算机科学 2025-01-15 Yuanyuan Liang , Tianhao Zhang , Tingyu Xie

Vision-language model (VLM) embeddings have been shown to encode biases present in their training data, such as societal biases that prescribe negative characteristics to members of various racial and gender identities. VLMs are being…

计算机视觉与模式识别 · 计算机科学 2024-11-08 Walter Gerych , Haoran Zhang , Kimia Hamidieh , Eileen Pan , Maanas Sharma , Thomas Hartvigsen , Marzyeh Ghassemi

Addressing hard cases in autonomous driving, such as anomalous road users, extreme weather conditions, and complex traffic interactions, presents significant challenges. To ensure safety, it is crucial to detect and manage these scenarios…

计算机视觉与模式识别 · 计算机科学 2024-06-03 Yi Yang , Qingwen Zhang , Kei Ikemura , Nazre Batool , John Folkesson

Time series anomaly detection is a critical machine learning task for numerous applications, such as finance, healthcare, and industrial systems. However, even high-performing models may exhibit potential issues such as biases, leading to…

人机交互 · 计算机科学 2025-06-24 Ziquan Deng , Xiwei Xuan , Kwan-Liu Ma , Zhaodan Kong

Vision-Language models (VLMs) have excelled in the image-domain -- especially in zero-shot settings -- thanks to the availability of vast pretraining data (i.e., paired image-text samples). However for videos, such paired data is not as…

计算机视觉与模式识别 · 计算机科学 2024-04-01 Kumara Kahatapitiya , Anurag Arnab , Arsha Nagrani , Michael S. Ryoo

Visual-Language Models (VLMs) have become a powerful tool for bridging the gap between visual and linguistic understanding. However, the conventional learning approaches for VLMs often suffer from limitations, such as the high resource…

计算与语言 · 计算机科学 2025-04-01 Dasol Choi , Guijin Son , Soo Yong Kim , Gio Paik , Seunghyeok Hong