English
Related papers

Related papers: SENTRA: Selected-Next-Token Transformer for LLM Te…

200 papers

The emergence of large language models (LLMs) has resulted in the production of LLM-generated texts that is highly sophisticated and almost indistinguishable from texts written by humans. However, this has also sparked concerns about the…

Computation and Language · Computer Science 2023-06-06 Ruixiang Tang , Yu-Neng Chuang , Xia Hu

The rapid adoption of large language models (LLMs), such as GPT-4 and Claude 3.5, underscores the need to distinguish LLM-generated text from human-written content to mitigate the spread of misinformation and misuse in education. One…

Machine Learning · Statistics 2025-11-11 Xingchi Li , Xiaochi Liu , Guanxun Li

Unsupervised text representation learning (TRL) is a fundamental task in natural language processing, which is beneficial for improving search and recommendations with the web's unlabeled texts. A recent empirical study finds that the…

Computation and Language · Computer Science 2025-10-14 Ruize An , Richong Zhang , Zhijie Nie , Zhanyu Wu , Yanzhao Zhang , Dingkun Long

An ideal detection system for machine generated content is supposed to work well on any generator as many more advanced LLMs come into existence day by day. Existing systems often struggle with accurately identifying AI-generated content…

Extreme multi-label text classification (XMTC) is the task of tagging each document with the relevant labels from a very large space of predefined categories. Recently, large pre-trained Transformer models have made significant performance…

Computation and Language · Computer Science 2022-04-05 Ruohong Zhang , Yau-Shian Wang , Yiming Yang , Tom Vu , Likun Lei

Text spotting end-to-end methods have recently gained attention in the literature due to the benefits of jointly optimizing the text detection and recognition components. Existing methods usually have a distinct separation between the…

Computer Vision and Pattern Recognition · Computer Science 2022-02-15 Yair Kittenplon , Inbal Lavi , Sharon Fogel , Yarin Bar , R. Manmatha , Pietro Perona

Large language models (LLMs) have grown more powerful in language generation, producing fluent text and even imitating personal style. Yet, this ability also heightens the risk of identity impersonation. To the best of our knowledge, no…

Computation and Language · Computer Science 2026-05-01 Lang Gao , Xuhui Li , Chenxi Wang , Mingzhe Li , Wei Liu , Zirui Song , Jinghui Zhang , Rui Yan , Preslav Nakov , Xiuying Chen

Transformer, as one of the most advanced neural network models in Natural Language Processing (NLP), exhibits diverse applications in the field of anomaly detection. To inspire research on Transformer-based anomaly detection, this review…

Machine Learning · Computer Science 2024-02-15 Mingrui Ma , Lansheng Han , Chunjie Zhou

Speculative Decoding (SD) is a recently proposed technique for faster inference using Large Language Models (LLMs). SD operates by using a smaller draft LLM for autoregressively generating a sequence of tokens and a larger target LLM for…

Machine Learning · Computer Science 2025-07-09 Meiyu Zhong , Noel Teku , Ravi Tandon

Scene text recognition (STR) enables computers to recognize and read the text in various real-world scenes. Recent STR models benefit from taking linguistic information in addition to visual cues into consideration. We propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2022-11-10 Jie Wu , Ying Peng , Shengming Zhang , Weigang Qi , Jian Zhang

Large language models (LLMs) has experienced exponential growth, they demonstrate remarkable performance across various tasks. Notwithstanding, contemporary research primarily centers on enhancing the size and quality of pretraining data,…

Programming Languages · Computer Science 2024-04-16 Mengnan Qi , Yufan Huang , Yongqiang Yao , Maoquan Wang , Bin Gu , Neel Sundaresan

Large decoder-only language models (LLMs) are the state-of-the-art models on most of today's NLP tasks and benchmarks. Yet, the community is only slowly adopting these models for text embedding tasks, which require rich contextualized…

Computation and Language · Computer Science 2024-08-23 Parishad BehnamGhader , Vaibhav Adlakha , Marius Mosbach , Dzmitry Bahdanau , Nicolas Chapados , Siva Reddy

With the advancement in capabilities of Large Language Models (LLMs), one major step in the responsible and safe use of such LLMs is to be able to detect text generated by these models. While supervised AI-generated text detectors perform…

Computation and Language · Computer Science 2024-03-26 Amrita Bhattacharjee , Raha Moraffah , Joshua Garland , Huan Liu

Detecting texts generated by Large Language Models (LLMs) could cause grave mistakes due to incorrect decisions, such as undermining students' academic dignity. LLM text detection thus needs to ensure the interpretability of the decision,…

Computation and Language · Computer Science 2026-05-06 Ryuto Koike , Masahiro Kaneko , Ayana Niwa , Preslav Nakov , Naoaki Okazaki

Our research focuses on the crucial challenge of discerning text produced by Large Language Models (LLMs) from human-generated text, which holds significance for various applications. With ongoing discussions about attaining a model with…

Computation and Language · Computer Science 2023-11-28 Raghav Gaggar , Ashish Bhagchandani , Harsh Oza

The recent proliferation of AI-generated content has prompted significant interest in developing reliable detection methods. This study explores techniques for identifying AI-generated text through sentence-level evaluation within hybrid…

Computation and Language · Computer Science 2024-12-30 Dima Galat

Large language models (LLMs) are increasingly being used for generating text in a variety of use cases, including journalistic news articles. Given the potential malicious nature in which these LLMs can be used to generate disinformation at…

Computation and Language · Computer Science 2023-09-22 Amrita Bhattacharjee , Tharindu Kumarage , Raha Moraffah , Huan Liu

Real-time detection of out-of-context LLM outputs is crucial for enterprises looking to safely adopt RAG applications. In this work, we train lightweight models to discriminate LLM-generated text that is semantically out-of-context from…

Computation and Language · Computer Science 2024-11-07 Ian Poey , Jiajun Liu , Qishuai Zhong , Adrien Chenailler

Short text classification is a crucial and challenging aspect of Natural Language Processing. For this reason, there are numerous highly specialized short text classifiers. However, in recent short text research, State of the Art (SOTA)…

Computation and Language · Computer Science 2023-08-14 Fabian Karl , Ansgar Scherp

A latent-variable model is introduced for text matching, inferring sentence representations by jointly optimizing generative and discriminative objectives. To alleviate typical optimization challenges in latent-variable models for text, we…

Computation and Language · Computer Science 2017-11-23 Dinghan Shen , Yizhe Zhang , Ricardo Henao , Qinliang Su , Lawrence Carin