English
Related papers

Related papers: Towards Token-Level Text Anomaly Detection

200 papers

Anomaly detection or outlier detection is a common task in various domains, which has attracted significant research efforts in recent years. Existing works mainly focus on structured data such as numerical or categorical data; however,…

Computation and Language · Computer Science 2021-10-29 Zeyu You , Yichu Zhou , Tao Yang , Wei Fan

We propose a novel and efficient method, that we shall call TopRank in the following paper, for detecting change-points in high-dimensional data. This issue is of growing concern to the network security community since network anomalies…

Applications · Statistics 2009-08-18 Céline Lévy-Leduc , François Roueff

Semi-supervised anomaly detection, which aims to improve the anomaly detection performance by using a small amount of labeled anomaly data in addition to unlabeled data, has attracted attention. Existing semi-supervised approaches assume…

Machine Learning · Statistics 2025-02-11 Hiroshi Takahashi , Tomoharu Iwata , Atsutoshi Kumagai , Yuuki Yamanaka

Anomaly detection (AD) is an important machine learning task with many real-world uses, including fraud detection, medical diagnosis, and industrial monitoring. Within natural language processing (NLP), AD helps detect issues like spam,…

Computation and Language · Computer Science 2025-10-13 Tiankai Yang , Yi Nian , Shawn Li , Ruiyao Xu , Yuangang Li , Jiaqi Li , Zhuo Xiao , Xiyang Hu , Ryan Rossi , Kaize Ding , Xia Hu , Yue Zhao

Increasing the semantic understanding and contextual awareness of machine learning models is important for improving robustness and reducing susceptibility to data shifts. In this work, we leverage contextual awareness for the anomaly…

Machine Learning · Computer Science 2022-03-22 Nathan Vaska , Kevin Leahy , Victoria Helus

The complexity and ubiquity of modern computing systems is a fertile ground for anomalies, including security and privacy breaches. In this paper, we propose a new methodology that addresses the practical challenges to implement anomaly…

Cryptography and Security · Computer Science 2020-06-17 Charles F. Gonçalves , Daniel S. Menasché , Alberto Avritzer , Nuno Antunes , Marco Vieira

Two-step approaches combining pre-trained large language model embeddings and anomaly detectors demonstrate strong performance in text anomaly detection by leveraging rich semantic representations. However, high-dimensional dense embeddings…

Computation and Language · Computer Science 2026-01-08 Yang Cao , Sikun Yang , Yujiu Yang , Lianyong Qi , Ming Liu

Due to the diversity of scene text in aspects such as font, color, shape, and size, accurately and efficiently detecting text is still a formidable challenge. Among the various detection approaches, segmentation-based approaches have…

Computer Vision and Pattern Recognition · Computer Science 2024-09-26 Xu Han , Junyu Gao , Chuang Yang , Yuan Yuan , Qi Wang

Content delivery networks (CDNs) provide efficient content distribution over the Internet. CDNs improve the connectivity and efficiency of global communications, but their caching mechanisms may be breached by cyber-attackers. Among the…

Cryptography and Security · Computer Science 2021-07-27 Li Yang , Abdallah Moubayed , Abdallah Shami , Parisa Heidari , Amine Boukhtouta , Adel Larabi , Richard Brunner , Stere Preda , Daniel Migault

Anomaly detection is generally acknowledged as an important problem that has already drawn attention to various domains and research areas, such as, network security. For such "classic" application domains a wide range of surveys and…

Cryptography and Security · Computer Science 2017-05-19 Kristof Böhmer , Stefanie Rinderle-Ma

System logs are some of the most important information for the maintenance of software systems, which have become larger and more complex in recent years. The goal of log-based anomaly detection is to automatically detect system anomalies…

Machine Learning · Computer Science 2024-02-19 Yuuki Yamanaka , Tomokatsu Takahashi , Takuya Minami , Yoshiaki Nakajima

Anomaly detection aims at identifying data points that show systematic deviations from the majority of data in an unlabeled dataset. A common assumption is that clean training data (free of anomalies) is available, which is often violated…

Machine Learning · Computer Science 2022-07-20 Chen Qiu , Aodong Li , Marius Kloft , Maja Rudolph , Stephan Mandt

Detecting unusual patterns in graph data is a crucial task in data mining. However, existing methods face challenges in consistently achieving satisfactory performance and often lack interpretability, which hinders our understanding of…

Machine Learning · Computer Science 2024-06-28 Yifei Yang , Peng Wang , Xiaofan He , Dongmian Zou

With the recent proliferation of Large Language Models (LLMs), there has been an increasing demand for tools to detect machine-generated text. The effective detection of machine-generated text face two pertinent problems: First, they are…

Computation and Language · Computer Science 2024-04-04 Mazal Bethany , Brandon Wherry , Emet Bethany , Nishant Vishwamitra , Anthony Rios , Peyman Najafirad

Anomaly detection is defined as the problem of finding data points that do not follow the patterns of the majority. Among the various proposed methods for solving this problem, classification-based methods, including one-class Support…

Optimization and Control · Mathematics 2023-12-05 Amir Hossein Noormohammadia , Seyed Ali MirHassania , Farnaz Hooshmand Khaligh

Botnets (networks of compromised computers) are often used for malicious activities such as spam, click fraud, identity theft, phishing, and distributed denial of service (DDoS) attacks. Most of previous researches have introduced fully or…

Cryptography and Security · Computer Science 2018-11-05 Sajjad Arshad , Maghsoud Abbaspour , Mehdi Kharrazi , Hooman Sanatkar

The widespread adoption of Large Language Models (LLMs) has made the detection of AI-Generated text a pressing and complex challenge. Although many detection systems report high benchmark accuracy, their reliability in real-world settings…

Computation and Language · Computer Science 2026-04-23 Shushanta Pudasaini , Luis Miralles-Pechuán , David Lillis , Marisa Llorens Salvador

Detecting problematic content, such as hate speech, is a multifaceted and ever-changing task, influenced by social dynamics, user populations, diversity of sources, and evolving language. There has been significant efforts, both in academia…

Computation and Language · Computer Science 2023-10-09 Ali Omrani , Alireza S. Ziabari , Preni Golazizian , Jeffrey Sorensen , Morteza Dehghani

Anomalies represent deviations from the intended system operation and can lead to decreased efficiency as well as partial or complete system failure. As the causes of anomalies are often unknown due to complex system dynamics, efficient…

Machine Learning · Computer Science 2021-08-31 Benjamin Lindemann , Benjamin Maschler , Nada Sahlab , Michael Weyrich

Text anomaly detection (TAD) plays a critical role in various language-driven real-world applications, including harmful content moderation, phishing detection, and spam review filtering. While two-step "embedding-detector" TAD methods have…

Computation and Language · Computer Science 2026-01-27 Yixin Liu , Kehan Yan , Shiyuan Li , Qingfeng Chen , Shirui Pan