English
Related papers

Related papers: LongSafety: Enhance Safety for Long-Context LLMs

200 papers

As safety remains a crucial concern throughout the development lifecycle of Large Language Models (LLMs), researchers and industrial practitioners have increasingly focused on safeguarding and aligning LLM behaviors with human preferences…

Computation and Language · Computer Science 2024-07-11 Jiayang Song , Yuheng Huang , Zhehua Zhou , Lei Ma

Large context window is a desirable feature in large language models (LLMs). However, due to high fine-tuning costs, scarcity of long texts, and catastrophic values introduced by new token positions, current extended context windows are…

Computation and Language · Computer Science 2024-02-22 Yiran Ding , Li Lyna Zhang , Chengruidong Zhang , Yuanyuan Xu , Ning Shang , Jiahang Xu , Fan Yang , Mao Yang

Existing large language models (LLMs) can only afford fix-sized inputs due to the input length limit, preventing them from utilizing rich long-context information from past inputs. To address this, we propose a framework, Language Models…

Computation and Language · Computer Science 2023-06-13 Weizhi Wang , Li Dong , Hao Cheng , Xiaodong Liu , Xifeng Yan , Jianfeng Gao , Furu Wei

Safety for Large Language Models (LLMs) has been an ongoing research focus since their emergence and is even more relevant nowadays with the increasing capacity of those models. Currently, there are several guardrails in place for all…

Computation and Language · Computer Science 2025-12-25 Eduard Stefan Dinuta , Iustin Sirbu , Traian Rebedea

Fine-tuning a general-purpose large language model (LLM) for a specific domain or task has become a routine procedure for ordinary users. However, fine-tuning is known to remove the safety alignment features of the model, even when the…

Computation and Language · Computer Science 2025-06-23 Kathleen C. Fraser , Hillary Dawkins , Isar Nejadgholi , Svetlana Kiritchenko

Recent breakthroughs in Large Language Models (LLMs) have led to their adoption across a wide range of tasks, ranging from code generation to machine translation and sentiment analysis, etc. Red teaming/Safety alignment efforts show that…

Computation and Language · Computer Science 2024-09-25 Essa Jan , Nouar AlDahoul , Moiz Ali , Faizan Ahmad , Fareed Zaffar , Yasir Zaki

Safety evaluations of large language models (LLMs) typically focus on universal risks like dangerous capabilities or undesirable propensities. However, millions use LLMs for personal advice on high-stakes topics like finance and health,…

Artificial Intelligence · Computer Science 2026-04-21 Manon Kempermann , Sai Suresh Macharla Vasu , Mahalakshmi Raveenthiran , Theo Farrell , Ingmar Weber

Current advanced long-context language models offer great potential for real-world software engineering applications. However, progress in this critical domain remains hampered by a fundamental limitation: the absence of a rigorous…

Software Engineering · Computer Science 2025-03-07 Jia Li , Xuyuan Guo , Lei Li , Kechi Zhang , Ge Li , Jia Li , Zhengwei Tao , Fang Liu , Chongyang Tao , Yuqi Zhu , Zhi Jin

While Large Language Models (LLMs) have shown significant advancements in performance, various jailbreak attacks have posed growing safety and ethical risks. Malicious users often exploit adversarial context to deceive LLMs, prompting them…

Cryptography and Security · Computer Science 2025-08-15 Jinhwa Kim , Ian G. Harris

Large language models (LLMs) have achieved record adoption in a short period of time across many different sectors including high importance areas such as education [4] and healthcare [23]. LLMs are open-ended models trained on diverse data…

Cryptography and Security · Computer Science 2024-12-24 Herve Debar , Sven Dietrich , Pavel Laskov , Emil C. Lupu , Eirini Ntoutsi

Vulnerability detection is a critical aspect of software security. Accurate detection is essential to prevent potential security breaches and protect software systems from malicious attacks. Recently, vulnerability detection methods…

Software Engineering · Computer Science 2025-04-24 Yixin Yang , Bowen Xu , Xiang Gao , Hailong Sun

As Large Language Models (LLMs) evolve in natural language processing (NLP), their ability to stably follow instructions in long-context inputs has become critical for real-world applications. However, existing benchmarks seldom focus on…

Computation and Language · Computer Science 2025-07-25 Xiaodong Wu , Minhao Wang , Yichen Liu , Xiaoming Shi , He Yan , Xiangju Lu , Junmin Zhu , Wei Zhang

Managing long sequences has become an important and necessary feature for large language models (LLMs). However, it is still an open question of how to comprehensively and systematically evaluate the long-sequence capability of LLMs. One of…

Computation and Language · Computer Science 2024-07-30 Wai-Chung Kwan , Xingshan Zeng , Yufei Wang , Yusen Sun , Liangyou Li , Lifeng Shang , Qun Liu , Kam-Fai Wong

The growing awareness of safety concerns in large language models (LLMs) has sparked considerable interest in the evaluation of safety. This study investigates an under-explored issue about the evaluation of LLMs, namely the substantial…

Computation and Language · Computer Science 2024-04-02 Yixu Wang , Yan Teng , Kexin Huang , Chengqi Lyu , Songyang Zhang , Wenwei Zhang , Xingjun Ma , Yu-Gang Jiang , Yu Qiao , Yingchun Wang

Training large language models to follow instructions makes them perform better on a wide range of tasks and generally become more helpful. However, a perfectly helpful model will follow even the most malicious instructions and readily…

Computation and Language · Computer Science 2024-03-20 Federico Bianchi , Mirac Suzgun , Giuseppe Attanasio , Paul Röttger , Dan Jurafsky , Tatsunori Hashimoto , James Zou

Large language models (LLMs) have achieved impressive performance in numerous domains but often struggle to process lengthy inputs effectively and efficiently due to limited length generalization and attention's quadratic computational…

Computation and Language · Computer Science 2024-03-26 Yi Lu , Xin Zhou , Wei He , Jun Zhao , Tao Ji , Tao Gui , Qi Zhang , Xuanjing Huang

Modern large language models (LLMs) that rely on attention mechanisms are typically trained with fixed context lengths which enforce upper limits on the length of input sequences that they can handle at evaluation time. To use these models…

Artificial Intelligence · Computer Science 2023-08-22 Arka Pal , Deep Karkhanis , Manley Roberts , Samuel Dooley , Arvind Sundararajan , Siddartha Naidu

Recent advancements in long-context Large Language Models (LLMs) have primarily concentrated on processing extended input contexts, resulting in significant strides in long-context comprehension. However, the equally critical aspect of…

Computation and Language · Computer Science 2025-03-10 Yuhao Wu , Yushi Bai , Zhiqing Hu , Shangqing Tu , Ming Shan Hee , Juanzi Li , Roy Ka-Wei Lee

Large Language Models (LLMs) often exhibit behavioral artifacts such as laziness (premature truncation of responses or partial compliance with multi-part requests), decoding suboptimality (failure to select higher-quality sequences due to…

Artificial Intelligence · Computer Science 2025-12-25 Yiqing Ma , Jung-Hua Liu

The long-context capability of the Large Language Models (LLM) has made significant breakthroughs, but the maximum supported context length in length extrapolation remains a critical bottleneck limiting their practical applications. The…

Computation and Language · Computer Science 2025-03-20 Xiaoran Liu , Ruixiao Li , Qipeng Guo , Zhigeng Liu , Yuerong Song , Kai Lv , Hang Yan , Linlin Li , Qun Liu , Xipeng Qiu