English
Related papers

Related papers: FAME: Failure-Aware Mixture-of-Experts for Message…

200 papers

In this paper we present the first investigation into the effectiveness of Large Language Models (LLMs) for Failure Mode Classification (FMC). FMC, the task of automatically labelling an observation with a corresponding failure mode code,…

Computation and Language · Computer Science 2023-09-18 Michael Stewart , Melinda Hodkiewicz , Sirui Li

Log anomaly detection using traditional rule based or deep learning based methods is often challenging due to the large volume and highly complex nature of log sequence. So effective way of detection of anomalous sequence of logs is crucial…

Machine Learning · Computer Science 2025-07-16 Isaiah Thompson Ocansey , Ritwik Bhattacharya , Tanmay Sen

Software systems often record important runtime information in logs to help with troubleshooting. Log-based anomaly detection has become a key research area that aims to identify system issues through log data, ultimately enhancing the…

Software Engineering · Computer Science 2025-04-15 Wei Guan , Jian Cao , Shiyou Qian , Jianqi Gao , Chun Ouyang

Understanding how data moves, transforms, and persists, known as data flow, is fundamental to reasoning in procedural tasks. Despite their fluency in natural and programming languages, large language models (LLMs), although increasingly…

Artificial Intelligence · Computer Science 2025-06-02 Vishal Pallagani , Nitin Gupta , John Aydin , Biplav Srivastava

Most log-based anomaly detectors assume logs are stable, though logs are often unstable due to software or environmental changes. Anomaly detection on unstable logs (ULAD) is therefore a more realistic, yet under-investigated challenge.…

Software Engineering · Computer Science 2025-10-10 Fatemeh Hadadi , Qinghua Xu , Domenico Bianculli , Lionel Briand

This project explores large language models (LLMs) for anomaly detection across heterogeneous log sources. Traditional intrusion detection systems suffer from high false positive rates, semantic blindness, and data scarcity, as logs are…

Cryptography and Security · Computer Science 2026-02-09 Yassine Chagna , Antal Goldschmidt

Large Language Models (LLMs) have demonstrated impressive performance across various tasks, and their application in edge scenarios has attracted significant attention. However, sparse-activated Mixture-of-Experts (MoE) models, which are…

Artificial Intelligence · Computer Science 2025-05-08 Zhiyuan Fang , Zicong Hong , Yuegui Huang , Yufeng Lyu , Wuhui Chen , Yue Yu , Fan Yu , Zibin Zheng

Anomaly detection in computational workflows is critical for ensuring system reliability and security. However, traditional rule-based methods struggle to detect novel anomalies. This paper leverages large language models (LLMs) for…

Software Engineering · Computer Science 2024-07-26 Hongwei Jin , George Papadimitriou , Krishnan Raghavan , Pawel Zuk , Prasanna Balaprakash , Cong Wang , Anirban Mandal , Ewa Deelman

With increasing scale and complexity of cloud operations, automated detection of anomalies in monitoring data such as logs will be an essential part of managing future IT infrastructures. However, many methods based on artificial…

Machine Learning · Computer Science 2021-11-29 Thorsten Wittkopp , Philipp Wiesner , Dominik Scheinert , Alexander Acker

Code contains security and functional bugs. The process of identifying and localizing them is difficult and relies on human labor. In this work, we present a novel approach (FLAG) to assist human debuggers. FLAG is based on the lexical…

Cryptography and Security · Computer Science 2023-06-23 Baleegh Ahmad , Benjamin Tan , Ramesh Karri , Hammond Pearce

Telecom industries lose globally 46.3 Billion USD due to fraud. Data mining and machine learning techniques (apart from rules oriented approach) have been used in past, but efficiency has been low as fraud pattern changes very rapidly. This…

Machine Learning · Computer Science 2023-11-03 Sudarson Roy Pratihar , Subhadip Paul , Pranab Kumar Dash , Amartya Kumar Das

Edge streams are commonly used to capture interactions in dynamic networks, such as email, social, or computer networks. The problem of detecting anomalies or rare events in edge streams has a wide range of applications. However, it…

Social and Information Networks · Computer Science 2021-02-08 Yen-Yu Chang , Pan Li , Rok Sosic , M. H. Afifi , Marco Schweighauser , Jure Leskovec

This paper introduces a scalable Anomaly Detection Service with a generalizable API tailored for industrial time-series data, designed to assist Site Reliability Engineers (SREs) in managing cloud infrastructure. The service enables…

Machine Learning · Computer Science 2025-01-29 Nimesh Jha , Shuxin Lin , Srideepika Jayaraman , Kyle Frohling , Christodoulos Constantinides , Dhaval Patel

Hyperscale large language model (LLM) inference places extraordinary demands on cloud systems, where even brief failures can translate into significant user and business impact. To better understand and mitigate these risks, we present one…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-12 Bhala Ranganathan , Mickey Zhang , Kai Wu

Mixture-of-Experts (MoE) activates only a subset of experts during inference, allowing the model to maintain low inference FLOPs and latency even as the parameter count scales up. However, since MoE dynamically selects the experts, all the…

Machine Learning · Computer Science 2025-05-27 Shibo Jie , Yehui Tang , Kai Han , Yitong Li , Duyu Tang , Zhi-Hong Deng , Yunhe Wang

Node classification on graphs often requires labeled nodes, yet obtaining labels at graph scale is expensive. When node attributes contain semantic content, such as paper abstracts, web pages, or product descriptions, large language models…

Machine Learning · Computer Science 2026-05-28 Safal Thapaliya , Jiatan Huang , Chuxu Zhang

Large language models (LLMs) offer strategy researchers powerful tools for annotating text at scale, but treating LLM-generated labels as deterministic overlooks substantial instability. Grounded in content analysis and generalizability…

Computers and Society · Computer Science 2026-01-21 Arnaldo Camuffo , Alfonso Gambardella , Saeid Kazemi , Jakub Malachowski , Abhinav Pandey

LLMs trained on web-scale data raise concerns about privacy and the right to be forgotten. To address these issues, Machine Unlearning provides techniques to remove specific information from trained models without retraining from scratch.…

Computation and Language · Computer Science 2025-12-18 Claudio Savelli , Moreno La Quatra , Alkis Koudounas , Flavio Giobergia

Recent large language models such as Gemini-1.5, DeepSeek-V3, and Llama-4 increasingly adopt Mixture-of-Experts (MoE) architectures, which offer strong efficiency-performance trade-offs by activating only a fraction of the model per token.…

Computation and Language · Computer Science 2025-05-27 Hao Kang , Zichun Yu , Chenyan Xiong

Deep networks achieve excellent results on large-scale clean data but degrade significantly when learning from noisy labels. To suppressing the impact of mislabeled data, this paper proposes a conceptually simple yet efficient training…

Computer Vision and Pattern Recognition · Computer Science 2020-10-30 Xiaojiang Peng , Kai Wang , Zhaoyang Zeng , Qing Li , Jianfei Yang , Yu Qiao