English
Related papers

Related papers: MADLLM: Multivariate Anomaly Detection via Pre-tra…

200 papers

Anomaly detection in complex industrial environments poses unique challenges, particularly in contexts characterized by data sparsity and evolving operational conditions. Predictive maintenance (PdM) in such settings demands methodologies…

Machine Learning · Computer Science 2025-03-12 Alicia Russell-Gilbert , Sudip Mittal , Shahram Rahimi , Maria Seale , Joseph Jabour , Thomas Arnold , Joshua Church

Multivariate Time Series (MVTS) anomaly detection is a long-standing and challenging research topic that has attracted tremendous research effort from both industry and academia recently. However, a careful study of the literature makes us…

Machine Learning · Computer Science 2023-11-02 Mohamed El Amine Sehili , Zonghua Zhang

Large language model (LLM) decoding involves generating a sequence of tokens based on a given context, where each token is predicted one at a time using the model's learned probabilities. The typical autoregressive decoding method requires…

Computation and Language · Computer Science 2024-08-20 Xukun Liu , Bowen Lei , Ruqi Zhang , Dongkuan Xu

We present MeshLLM, a novel framework that leverages large language models (LLMs) to understand and generate text-serialized 3D meshes. Our approach addresses key limitations in existing methods, including the limited dataset scale when…

Anomaly Detection in multivariate time series is a major problem in many fields. Due to their nature, anomalies sparsely occur in real data, thus making the task of anomaly detection a challenging problem for classification algorithms to…

Machine Learning · Computer Science 2023-08-08 Anastasios Iliopoulos , John Violos , Christos Diou , Iraklis Varlamis

Network or physical attacks on industrial equipment or computer systems may cause massive losses. Therefore, a quick and accurate anomaly detection (AD) based on monitoring data, especially the multivariate time-series (MTS) data, is of…

Machine Learning · Computer Science 2022-11-03 Jun Zhan , Chengkun Wu , Canqun Yang , Qiucheng Miao , Xiandong Ma

Anomaly detection of multivariate time series is meaningful for system behavior monitoring. This paper proposes an anomaly detection method based on unsupervised Short- and Long-term Mask Representation learning (SLMR). The main idea is to…

Machine Learning · Computer Science 2022-08-24 Qiucheng Miao , Chuanfu Xu , Jun Zhan , Dong Zhu , Chengkun Wu

Effective analysis of time series data presents significant challenges due to the complex temporal dependencies and cross-channel interactions in multivariate data. Inspired by the way human analysts visually inspect time series to uncover…

Machine Learning · Computer Science 2025-10-10 Qinghua Liu , Sam Heshmati , Zheda Mai , Zubin Abraham , John Paparrizos , Liu Ren

Video Anomaly Detection (VAD) aims to identify and locate deviations from normal patterns in video sequences. Traditional methods often struggle with substantial computational demands and a reliance on extensive labeled datasets, thereby…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Zhaolin Cai , Fan Li , Ziwei Zheng , Yanjun Qin

With the rapid development of multi-cloud environments, it is increasingly important to ensure the security and reliability of intelligent monitoring systems. In this paper, we propose an anomaly detection and early warning mechanism for…

Machine Learning · Computer Science 2025-06-10 Yihong Jin , Ze Yang , Juntian Liu , Xinhe Xu

Recently, large-scale visual language pre-trained (VLP) models have demonstrated impressive performance across various downstream tasks. Motivated by these advancements, pioneering efforts have emerged in multi-label image recognition with…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Leilei Ma , Hongxing Xie , Lei Wang , Yanping Fu , Dengdi Sun , Haifeng Zhao

Deep learning (DL) methods are widely used to extract high-dimensional patterns from the sequence features of radar echo signals. However, conventional DL algorithms face challenges such as redundant feature segments, and constraints from…

Signal Processing · Electrical Eng. & Systems 2025-09-16 Qiying Hu , Linping Zhang , Xueqian Wang , Gang Li , Yu Liu , Xiao-Ping Zhang

Multimodal large language models (MLLMs) have demonstrated impressive general competence in video understanding, yet their reliability for real-world Video Anomaly Detection (VAD) remains largely unexplored. Unlike conventional pipelines…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Shanle Yao , Armin Danesh Pazho , Narges Rashvand , Hamed Tabkhi

Anomaly detection on multivariate time-series is of great importance in both data mining research and industrial applications. Recent approaches have achieved significant progress in this topic, but there is remaining limitations. One major…

Machine Learning · Computer Science 2020-09-07 Hang Zhao , Yujing Wang , Juanyong Duan , Congrui Huang , Defu Cao , Yunhai Tong , Bixiong Xu , Jing Bai , Jie Tong , Qi Zhang

Recent studies have adapted generative Multimodal Large Language Models (MLLMs) into embedding extractors for vision tasks, typically through fine-tuning to produce universal representations. However, their performance on video remains…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Issar Tzachor , Dvir Samuel , Rami Ben-Ari

Multimodal Large Models (MLLMs) have achieved remarkable progress in vision-language understanding and generation tasks. However, existing MLLMs typically rely on static modality fusion strategies, which treat all modalities equally…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Hiroshi Tanaka , Anika Rao , Hana Satou , Michael Johnson , Sofia García

Large Language Models (LLMs) have emerged as a new paradigm for recommendation by converting interacted item history into language modeling. However, constrained by the limited context length of LLMs, existing approaches have to truncate…

Information Retrieval · Computer Science 2025-05-20 Jiayi Liao , Ruobing Xie , Sihang Li , Xiang Wang , Xingwu Sun , Zhanhui Kang , Xiangnan He

Large language models (LLMs) have recently achieved significant success across various application domains, garnering substantial attention from different communities. Unfortunately, even for the best LLM, many \textit{faults} still exist…

Software Engineering · Computer Science 2024-11-06 Qiang Hu , Jin Wen , Maxime Cordy , Yuheng Huang , Wei Ma , Xiaofei Xie , Lei Ma

Large language models (LLMs) have shown their potential in long-context understanding and mathematical reasoning. In this paper, we study the problem of using LLMs to detect tabular anomalies and show that pre-trained LLMs are zero-shot…

Machine Learning · Computer Science 2024-06-25 Aodong Li , Yunhan Zhao , Chen Qiu , Marius Kloft , Padhraic Smyth , Maja Rudolph , Stephan Mandt

We propose an unsupervised method to obtain cross-lingual embeddings without any parallel data or pre-trained word embeddings. The proposed model, which we call multilingual neural language models, takes sentences of multiple languages as…

Computation and Language · Computer Science 2018-09-10 Takashi Wada , Tomoharu Iwata