English
Related papers

Related papers: Tokenization Matters! Degrading Large Language Mod…

200 papers

With the recent unprecedented advancements in Artificial Intelligence (AI) computing, progress in Large Language Models (LLMs) is accelerating rapidly, presenting challenges in establishing clear guidelines, particularly in the field of…

Cryptography and Security · Computer Science 2024-09-04 Nafis Tanveer Islam , Joseph Khoury , Andrew Seong , Elias Bou-Harb , Peyman Najafirad

Large language models (LLMs) have emerged as powerful tools for medical information retrieval, yet their accuracy and depth remain limited in specialized domains such as Alzheimer's disease (AD), a growing global health challenge. To…

Given the widespread use of deep learning models in safety-critical applications, ensuring that the decisions of such models are robust against adversarial exploitation is of fundamental importance. In this thesis, we discuss recent…

Machine Learning · Computer Science 2025-09-24 Alexander Robey

Consistency is a key requirement of high-quality translation. It is especially important to adhere to pre-approved terminology and adapt to corrected translations in domain-specific projects. Machine translation (MT) has achieved…

Computation and Language · Computer Science 2023-05-10 Yasmin Moslem , Rejwanul Haque , John D. Kelleher , Andy Way

Real-world simultaneous machine translation (SimulMT) systems face more challenges than just the quality-latency trade-off. They also need to address issues related to robustness with noisy input, processing long contexts, and flexibility…

Computation and Language · Computer Science 2025-11-18 Minghan Wang , Jinming Zhao , Thuy-Trang Vu , Fatemeh Shiri , Ehsan Shareghi , Gholamreza Haffari

Large Language Models (LLMs) have demonstrated an alarming ability to impersonate humans in conversation, raising concerns about their potential misuse in scams and deception. Humans have a right to know if they are conversing to an LLM. We…

Computation and Language · Computer Science 2024-12-23 Gilad Gressel , Rahul Pankajakshan , Yisroel Mirsky

Although Large Language Models (LLMs) are becoming increasingly powerful, they still exhibit significant but subtle weaknesses, such as mistakes in instruction-following or coding tasks. As these unexpected errors could lead to severe…

Computation and Language · Computer Science 2024-12-11 Jiale Cheng , Yida Lu , Xiaotao Gu , Pei Ke , Xiao Liu , Yuxiao Dong , Hongning Wang , Jie Tang , Minlie Huang

Tokenization is an understudied and often neglected component of modern LLMs. Most published works use a single tokenizer for all experiments, often borrowed from another model, without performing ablations or analysis to optimize…

Computation and Language · Computer Science 2024-02-08 Gautier Dagan , Gabriel Synnaeve , Baptiste Rozière

Recently, Large Language Models (LLMs) have showcased their potential in various natural language processing tasks, including code generation. However, while significant progress has been made in adapting LLMs to generate code for several…

Machine Learning · Computer Science 2024-07-29 Erica Coppolillo , Francesco Calimeri , Giuseppe Manco , Simona Perri , Francesco Ricca

This paper investigates the capabilities of large language models (LLMs) in formulating and solving decision-making problems using mathematical programming. We first conduct a systematic review and meta-analysis of recent literature to…

Artificial Intelligence · Computer Science 2025-08-26 Mohammad J. Abdel-Rahman , Yasmeen Alslman , Dania Refai , Amro Saleh , Malik A. Abu Loha , Mohammad Yahya Hamed

Large language models (LLMs) have attracted considerable attention as they are capable of showcasing impressive capabilities generating comparable high-quality responses to human inputs. LLMs, can not only compose textual scripts such as…

Computational Engineering, Finance, and Science · Computer Science 2024-05-31 Denish Omondi Otieno , Faranak Abri , Sima Siami-Namini , Akbar Siami Namin

Nowadays, powerful large language models (LLMs) such as ChatGPT have demonstrated revolutionary power in a variety of tasks. Consequently, the detection of machine-generated texts (MGTs) is becoming increasingly crucial as LLMs become more…

Cryptography and Security · Computer Science 2024-01-17 Xinlei He , Xinyue Shen , Zeyuan Chen , Michael Backes , Yang Zhang

Large Language Models (LLMs) are becoming vital tools that help us solve and understand complex problems by acting as digital assistants. LLMs can generate convincing explanations, even when only given the inputs and outputs of these…

Computation and Language · Computer Science 2024-10-14 Rohan Ajwani , Shashidhar Reddy Javaji , Frank Rudzicz , Zining Zhu

Large language models (LLMs) have demonstrated immense utility across various industries. However, as LLMs advance, the risk of harmful outputs increases due to incorrect or malicious instruction prompts. While current methods effectively…

Computation and Language · Computer Science 2025-06-19 Xinyi Zeng , Yuying Shang , Jiawei Chen , Jingyuan Zhang , Yu Tian

Large Language Models (LLMs) represent a class of deep learning models adept at understanding natural language and generating coherent responses to various prompts or queries. These models far exceed the complexity of conventional neural…

Machine Learning · Computer Science 2024-12-05 Minghao Shao , Abdul Basit , Ramesh Karri , Muhammad Shafique

The increasing prevalence of large language models (LLMs) has significantly advanced text generation, but the human-like quality of LLM outputs presents major challenges in reliably distinguishing between human-authored and LLM-generated…

Computation and Language · Computer Science 2024-12-18 Zhen Tao , Yanfang Chen , Dinghao Xi , Zhiyu Li , Wei Xu

Large Language Models (LLMs) have presented impressive performance across several transformative tasks. However, it is non-trivial to efficiently utilize large-scale cluster resources to develop LLMs, often riddled with numerous challenges…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-05 Qinghao Hu , Zhisheng Ye , Zerui Wang , Guoteng Wang , Meng Zhang , Qiaoling Chen , Peng Sun , Dahua Lin , Xiaolin Wang , Yingwei Luo , Yonggang Wen , Tianwei Zhang

Existing anomaly detection (AD) methods for tabular data usually rely on some assumptions about anomaly patterns, leading to inconsistent performance in real-world scenarios. While Large Language Models (LLMs) show remarkable reasoning…

Machine Learning · Computer Science 2026-03-31 Hangting Ye , Jinmeng Li , He Zhao , Mingchen Zhuge , Dandan Guo , Yi Chang , Hongyuan Zha

Large language models (LLMs) have exhibited remarkable fluency across various tasks. However, their unethical applications, such as disseminating disinformation, have become a growing concern. Although recent works have proposed a number of…

Computation and Language · Computer Science 2024-10-07 James Wang , Ran Li , Junfeng Yang , Chengzhi Mao

The integration of large language models (LLMs) into automated algorithm design has shown promising potential. A prevalent approach embeds LLMs within search routines to iteratively generate and refine candidate algorithms. However, most…

Machine Learning · Computer Science 2026-05-20 Fei Liu , Rui Zhang , Xi Lin , Zhichao Lu , Qingfu Zhang