English
Related papers

Related papers: MADLLM: Multivariate Anomaly Detection via Pre-tra…

200 papers

Large language models (LLMs) have transformed human writing by enhancing grammar correction, content expansion, and stylistic refinement. However, their widespread use raises concerns about authorship, originality, and ethics, even…

Computation and Language · Computer Science 2024-10-21 Zhen Tao , Zhiyu Li , Runyu Chen , Dinghao Xi , Wei Xu

Irregularly sampled time series (ISTS) are widespread in real-world scenarios, exhibiting asynchronous observations on uneven time intervals across variables. Existing ISTS forecasting methods often solely utilize historical observations to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Zhi Lei , Chenxi Liu , Hao Miao , Wanghui Qiu , Bin Yang , Chenjuan Guo

When adapting Large Language Models for Recommendation (LLMRec), it is crucial to integrate collaborative information. Existing methods achieve this by learning collaborative embeddings in LLMs' latent space from scratch or by mapping from…

Information Retrieval · Computer Science 2024-06-06 Yang Zhang , Keqin Bao , Ming Yan , Wenjie Wang , Fuli Feng , Xiangnan He

Irregular multivariate time series (IMTS) is characterized by the lack of synchronized observations across its different channels. In this paper, we point out that this channel-wise asynchrony can lead to poor channel-wise modeling of…

Machine Learning · Computer Science 2025-09-23 Shuhan Zhong , Weipeng Zhuo , Sizhe Song , Guanyao Li , Zhongyi Yu , S. -H. Gary Chan

Large language models (LLMs) have demonstrated impressive task-solving capabilities through prompting techniques and system designs, including solving planning tasks (e.g., math proofs, basic travel planning) when sufficient data is…

Artificial Intelligence · Computer Science 2025-04-25 Wenjun Li , Changyu Chen , Pradeep Varakantham

Typical deep clustering methods, while achieving notable progress, can only provide one clustering result per dataset. This limitation arises from their assumption of a fixed underlying data distribution, which may fail to meet user needs…

Machine Learning · Computer Science 2025-12-02 Xinyue Wang , Yuheng Jia , Hui Liu , Junhui Hou

Multi-modal Large Language Models (MLLMs) integrate visual and linguistic reasoning to address complex tasks such as image captioning and visual question answering. While MLLMs demonstrate remarkable versatility, MLLMs appears limited…

Computation and Language · Computer Science 2025-03-07 Wenke Huang , Jian Liang , Xianda Guo , Yiyang Fang , Guancheng Wan , Xuankun Rong , Chi Wen , Zekun Shi , Qingyun Li , Didi Zhu , Yanbiao Ma , Ke Liang , Bin Yang , He Li , Jiawei Shao , Mang Ye , Bo Du

This work summarizes two ways to accomplish Time-Series (TS) tasks in today's Large Language Model (LLM) context: LLM-for-TS (model-centric) designs and trains a fundamental large model, or fine-tunes a pre-trained LLM for TS data;…

Computation and Language · Computer Science 2024-02-23 Chenxi Sun , Hongyan Li , Yaliang Li , Shenda Hong

The recently proposed xLSTM is a powerful model that leverages expressive multiplicative gating and residual connections, providing the temporal capacity needed for long-horizon forecasting and representation learning. This architecture has…

Machine Learning · Computer Science 2026-03-03 Kamil Faber , Marcin Pietroń , Dominik Żurek , Roberto Corizzo

The rapid adoption of large language models (LLMs), such as GPT-4 and Claude 3.5, underscores the need to distinguish LLM-generated text from human-written content to mitigate the spread of misinformation and misuse in education. One…

Machine Learning · Statistics 2025-11-11 Xingchi Li , Xiaochi Liu , Guanxun Li

Pre-trained Large Language Models (LLMs) often struggle on out-of-domain datasets like healthcare focused text. We explore specialized pre-training to adapt smaller LLMs to different healthcare datasets. Three methods are assessed:…

Computation and Language · Computer Science 2024-04-01 Niall Taylor , Dan Schofield , Andrey Kormilitzin , Dan W Joyce , Alejo Nevado-Holgado

With growing public safety demands, text-based person anomaly search has emerged as a critical task, aiming to retrieve individuals with abnormal behaviors via natural language descriptions. Unlike conventional person search, this task…

Computer Vision and Pattern Recognition · Computer Science 2025-09-08 Hao Ju , Hu Zhang , Zhedong Zheng

Anomaly detection of time series, especially multivariate time series(time series with multiple sensors), has been focused on for several years. Though existing method has achieved great progress, there are several challenging problems to…

Machine Learning · Computer Science 2022-11-29 Weixuan Xiong , Xiaochen Sun

Humans possess the capability to comprehend diverse modalities and seamlessly transfer information between them. In this work, we introduce ModaVerse, a Multi-modal Large Language Model (MLLM) capable of comprehending and transforming…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Xinyu Wang , Bohan Zhuang , Qi Wu

Recently, there has been great success in leveraging pre-trained large language models (LLMs) for time series analysis. The core idea lies in effectively aligning the modality between natural language and time series. However, the…

Machine Learning · Computer Science 2026-03-03 Zongjiang Shang , Dongliang Cui , Binqing Wu , Ling Chen

This chapter explores advancements in decoding strategies for large language models (LLMs), focusing on enhancing the Locally Typical Sampling (LTS) algorithm. Traditional decoding methods, such as top-k and nucleus sampling, often struggle…

Computation and Language · Computer Science 2025-06-12 Jaydip Sen , Saptarshi Sengupta , Subhasis Dasgupta

As a substantial amount of multivariate time series data is being produced by the complex systems in Smart Manufacturing, improved anomaly detection frameworks are needed to reduce the operational risks and the monitoring burden placed on…

Machine Learning · Computer Science 2022-01-25 Tareq Tayeh , Sulaiman Aburakhia , Ryan Myers , Abdallah Shami

The rapid evolution of malware variants requires robust classification methods to enhance cybersecurity. While Large Language Models (LLMs) offer potential for generating malware descriptions to aid family classification, their utility is…

Cryptography and Security · Computer Science 2025-05-01 Ivan Montoya Sanchez , Shaswata Mitra , Aritran Piplai , Sudip Mittal

Multivariate time series forecasting (MTSF) aims to learn temporal dynamics among variables to forecast future time series. Existing statistical and deep learning-based methods suffer from limited learnable parameters and small-scale…

Machine Learning · Computer Science 2025-04-01 Chenxi Liu , Qianxiong Xu , Hao Miao , Sun Yang , Lingzheng Zhang , Cheng Long , Ziyue Li , Rui Zhao

Recent Multimodal Large Language Models (MLLMs) have demonstrated significant progress in perceiving and reasoning over multimodal inquiries, ushering in a new research era for foundation models. However, vision-language misalignment in…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Wei-Yao Wang , Zhao Wang , Helen Suzuki , Yoshiyuki Kobayashi