English
Related papers

Related papers: Benchmarking of LLM Detection: Comparing Two Compe…

200 papers

Detecting texts generated by Large Language Models (LLMs) could cause grave mistakes due to incorrect decisions, such as undermining students' academic dignity. LLM text detection thus needs to ensure the interpretability of the decision,…

Computation and Language · Computer Science 2026-05-06 Ryuto Koike , Masahiro Kaneko , Ayana Niwa , Preslav Nakov , Naoaki Okazaki

The pursuit of leaderboard rankings in Large Language Models (LLMs) has created a fundamental paradox: models excel at standardized tests while failing to demonstrate genuine language understanding and adaptability. Our systematic analysis…

Computation and Language · Computer Science 2024-12-06 Sourav Banerjee , Ayushi Agarwal , Eishkaran Singh

Large Language Models (LLMs) have experienced rapid advancements, with applications spanning a wide range of fields, including sentiment classification, review generation, and question answering. Due to their efficiency and versatility,…

Cryptography and Security · Computer Science 2025-06-17 Yugeng Liu , Tianshuo Cong , Michael Backes , Zheng Li , Yang Zhang

Most Machine Learning research evaluates the best solutions in terms of performance. However, in the race for the best performing model, many important aspects are often overlooked when, on the contrary, they should be carefully considered.…

Computation and Language · Computer Science 2024-02-06 Sinan Gultekin , Achille Globo , Andrea Zugarini , Marco Ernandes , Leonardo Rigutini

Large Language Models (LLMs) have the potential to semi-automate some process mining (PM) analyses. While commercial models are already adequate for many analytics tasks, the competitive level of open-source LLMs in PM tasks is unknown. In…

Computation and Language · Computer Science 2024-07-19 Alessandro Berti , Humam Kourani , Wil M. P. van der Aalst

The rapid proliferation of Large Language Models has significantly increased the difficulty of distinguishing between human-written and AI generated texts, raising critical issues across academic, editorial, and social domains. This paper…

Computation and Language · Computer Science 2026-03-20 Cristian Buttaro , Irene Amerini

Large Language Models (LLMs) have achieved human-level fluency in text generation, making it difficult to distinguish between human-written and LLM-generated texts. This poses a growing risk of misuse of LLMs and demands the development of…

Computation and Language · Computer Science 2024-02-20 Ryuto Koike , Masahiro Kaneko , Naoaki Okazaki

With their advanced capabilities, Large Language Models (LLMs) can generate highly convincing and contextually relevant fake news, which can contribute to disseminating misinformation. Though there is much research on fake news detection…

Computation and Language · Computer Science 2026-02-05 Rupak Kumar Das , Jonathan Dodge

The rapid development of Large Language Models (LLMs) has intensified concerns about content traceability and potential misuse. Existing watermarking schemes for sampled text often face trade-offs between maintaining text quality and…

Computation and Language · Computer Science 2025-04-17 Shizhan Cai , Liang Ding , Dacheng Tao

The widespread use of large language models (LLMs) is increasing the demand for methods that detect machine-generated text to prevent misuse. The goal of our study is to stress test the detectors' robustness to malicious attacks under…

Computation and Language · Computer Science 2024-02-20 Yichen Wang , Shangbin Feng , Abe Bohan Hou , Xiao Pu , Chao Shen , Xiaoming Liu , Yulia Tsvetkov , Tianxing He

Large language models (LLMs) have achieved human-level text generation, emphasizing the need for effective AI-generated text detection to mitigate risks like the spread of fake news and plagiarism. Existing research has been constrained by…

Computation and Language · Computer Science 2024-05-22 Yafu Li , Qintong Li , Leyang Cui , Wei Bi , Zhilin Wang , Longyue Wang , Linyi Yang , Shuming Shi , Yue Zhang

Evaluating large language models (LLMs) for tasks like fact extraction in support of knowledge graph construction frequently involves computing accuracy metrics using a ground truth benchmark based on a knowledge graph (KG). These…

Computation and Language · Computer Science 2025-02-06 Bradley P. Allen , Paul T. Groth

Natural Language Processing (NLP) is witnessing a remarkable breakthrough driven by the success of Large Language Models (LLMs). LLMs have gained significant attention across academia and industry for their versatile applications in text…

Computation and Language · Computer Science 2024-04-16 Taojun Hu , Xiao-Hua Zhou

As LLMs rapidly advance, increasing concerns arise regarding risks about actual authorship of texts we see online and in real world. The task of distinguishing LLM-authored texts is complicated by the nuanced and overlapping behaviors of…

Computation and Language · Computer Science 2025-06-25 Jiazhou Ji , Ruizhe Li , Shujun Li , Jie Guo , Weidong Qiu , Zheng Huang , Chiyu Chen , Xiaoyu Jiang , Xinru Lu

Watermarking for large language models (LLMs) has emerged as an effective tool for distinguishing AI-generated text from human-written content. Statistically, watermark schemes induce dependence between generated tokens and a pseudo-random…

Methodology · Statistics 2026-04-13 Weijie Su , Ruodu Wang , Zinan Zhao

Large Language Models (LLMs) have drawn widespread attention and research due to their astounding performance in text generation and reasoning tasks. Derivative products, like ChatGPT, have been extensively deployed and highly sought after.…

Software Engineering · Computer Science 2024-12-11 Zibin Zheng , Kaiwen Ning , Qingyuan Zhong , Jiachi Chen , Wenqing Chen , Lianghong Guo , Weicheng Wang , Yanlin Wang

The ease of access to large language models (LLMs) has enabled a widespread of machine-generated texts, and now it is often hard to tell whether a piece of text was human-written or machine-generated. This raises concerns about potential…

Large language model (LLM) evaluation is increasingly costly, prompting interest in methods that speed up evaluation by shrinking benchmark datasets. Benchmark prediction (also called efficient LLM evaluation) aims to select a small subset…

Machine Learning · Computer Science 2025-06-10 Guanhua Zhang , Florian E. Dorner , Moritz Hardt

Recent Large Language Models (LLMs) have demonstrated remarkable capabilities in generating text that closely resembles human writing across wide range of styles and genres. However, such capabilities are prone to potential abuse, such as…

Computation and Language · Computer Science 2023-11-09 Harika Abburi , Kalyani Roy , Michael Suesserman , Nirmala Pudota , Balaji Veeramani , Edward Bowen , Sanmitra Bhattacharya

This paper investigates the ability of large language models (LLMs) to recognise and solve tasks which have been obfuscated beyond recognition. Focusing on competitive programming and benchmark tasks (LeetCode and MATH), we compare…

Machine Learning · Computer Science 2025-05-30 Radzim Sendyka , Christian Cabrera , Andrei Paleyes , Diana Robinson , Neil Lawrence
‹ Prev 1 3 4 5 6 7 10 Next ›