English
Related papers

Related papers: MADLLM: Multivariate Anomaly Detection via Pre-tra…

200 papers

This paper presents a study on strategies to enhance the translation capabilities of large language models (LLMs) in the context of machine translation (MT) tasks. The paper proposes a novel paradigm consisting of three stages: Secondary…

Computation and Language · Computer Science 2024-04-16 Jiaxin Guo , Hao Yang , Zongyao Li , Daimeng Wei , Hengchao Shang , Xiaoyu Chen

Large Language Models (LLMs) have been extensively applied in time series analysis. Yet, their utility in the few-shot classification (i.e., a crucial training scenario due to the limited training data available in industrial applications)…

Machine Learning · Computer Science 2025-02-04 Yakun Chen , Zihao Li , Chao Yang , Xianzhi Wang , Guandong Xu

Large language models (LLMs) are reshaping automated fact-checking (AFC) by enabling unified, end-to-end verification pipelines rather than isolated components. While large proprietary models achieve strong performance, their closed…

Computation and Language · Computer Science 2026-01-19 Malin Astrid Larsson , Harald Fosen Grunnaleite , Vinay Setty

Recent advances in product bundling have leveraged multimodal information through sophisticated encoders, but remain constrained by limited semantic understanding and a narrow scope of knowledge. Therefore, some attempts employ In-context…

Information Retrieval · Computer Science 2025-02-04 Xiaohao Liu , Jie Wu , Zhulin Tao , Yunshan Ma , Yinwei Wei , Tat-seng Chua

Skill composition is the ability to combine previously learned skills to solve new tasks. As neural networks acquire increasingly complex skills during their pretraining, it is not clear how successfully they can compose them. In this…

Computation and Language · Computer Science 2026-03-10 Paula Ontalvilla , Aitor Ormazabal , Gorka Azkune

Detection of anomalous situations for complex mission-critical systems hold paramount importance when their service continuity needs to be ensured. A major challenge in detecting anomalies from the operational data arises due to the…

Machine Learning · Computer Science 2025-05-20 Shanay Mehta , Shlok Mehendale , Nicole Fernandes , Jyotirmoy Sarkar , Santonu Sarkar , Snehanshu Saha

Biological multimodal large language models (MLLMs) have emerged as powerful foundation models for scientific discovery. However, existing models are specialized to a single modality, limiting their ability to solve inherently cross-modal…

Machine Learning · Computer Science 2026-03-17 Wonbin Lee , Dongki Kim , Sung Ju Hwang

Multivariate time series (MTS) anomaly detection is essential for maintaining the reliability of industrial systems, yet real-world deployment is hindered by two critical challenges: training data contamination (noises and hidden anomalies)…

Machine Learning · Computer Science 2025-10-28 Songhan Zhang , Yuanhao Lai , Pengfei Zheng , Boxi Yu , Xiaoying Tang , Qiuai Fu , Pinjia He

While large language models (LLMs) demonstrate impressive capabilities across numerous applications, their robustness remains a critical concern. This paper is motivated by a specific vulnerability: the order sensitivity of LLMs. This…

Machine Learning · Computer Science 2025-05-22 Beni Egressy , Jan Stühmer

This paper introduces a novel problem, distributional information embedding, motivated by the practical demands of multi-bit watermarking for large language models (LLMs). Unlike traditional information embedding, which embeds information…

Cryptography and Security · Computer Science 2025-07-03 Haiyun He , Yepeng Liu , Ziqiao Wang , Yongyi Mao , Yuheng Bu

In recent years, the use of large language models (LLMs) for text classification has attracted widespread attention. Despite this, the classification accuracy of LLMs has not yet universally surpassed that of smaller models. LLMs can…

Computation and Language · Computer Science 2024-12-11 Min Zeng , Caiquan Liu , Shiqi Zhang , Li Xie , Chen Sang , Xiaoxin Chen

Text clustering is an important method for organising the increasing volume of digital content, aiding in the structuring and discovery of hidden patterns in uncategorised data. The effectiveness of text clustering largely depends on the…

Computation and Language · Computer Science 2024-12-06 Alina Petukhova , João P. Matos-Carvalho , Nuno Fachada

This paper investigates unsupervised anomaly detection in multivariate time-series data using reinforcement learning (RL) in the latent space of an autoencoder. A significant challenge is the limited availability of anomalous data, often…

Machine Learning · Computer Science 2025-02-11 Saba Sanami , Amir G. Aghdam

We study anomaly detection and introduce an algorithm that processes variable length, irregularly sampled sequences or sequences with missing values. Our algorithm is fully unsupervised, however, can be readily extended to supervised or…

Machine Learning · Statistics 2020-05-26 Oguzhan Karaahmetoglu , Fatih Ilhan , Ismail Balaban , Suleyman Serdar Kozat

Autoregressive Large Language Models (LLMs) demonstrate exceptional performance in language understanding and generation. However, their application in text embedding tasks has been relatively slow, along with the analysis of their semantic…

Computation and Language · Computer Science 2025-10-03 Zhaoxin Feng , Jianfei Ma , Emmanuele Chersoni , Xiaojing Zhao , Xiaoyi Bao

Detecting anomalies in time series data is crucial for finance, healthcare, sensor networks, and industrial monitoring applications. However, time series anomaly detection often suffers from sparse labels, complex temporal patterns, and…

Machine Learning · Computer Science 2026-01-07 Bahareh Golchin , Banafsheh Rekabdar , Danielle Justo

Multimodal Large Language Models (MLLMs) are experiencing rapid growth, yielding a plethora of noteworthy contributions in recent months. The prevailing trend involves adopting data-driven methodologies, wherein diverse…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Xin He , Longhui Wei , Lingxi Xie , Qi Tian

Recently, there has been a surge in the popularity of pre trained large language models (LLMs) (such as GPT-4), sweeping across the entire Natural Language Processing (NLP) and Computer Vision (CV) communities. These LLMs have demonstrated…

Computer Vision and Pattern Recognition · Computer Science 2024-01-09 Shuxiao Ma , Linyuan Wang , Senbao Hou , Bin Yan

Although vision models such as Contrastive Language-Image Pre-Training (CLIP) show impressive generalization performance, their zero-shot robustness is still limited under Out-of-Distribution (OOD) scenarios without fine-tuning. Instead of…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Zhuo Huang , Chang Liu , Yinpeng Dong , Hang Su , Shibao Zheng , Tongliang Liu

With the success of pre-trained visual-language (VL) models such as CLIP in visual representation tasks, transferring pre-trained models to downstream tasks has become a crucial paradigm. Recently, the prompt tuning paradigm, which draws…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Jingsheng Gao , Jiacheng Ruan , Suncheng Xiang , Zefang Yu , Ke Ji , Mingye Xie , Ting Liu , Yuzhuo Fu