中文
相关论文

相关论文: Reasoning as an Attack Surface: Adaptive Evolution…

200 篇论文

Large Language Models (LLMs) have become increasingly popular for their advanced text generation capabilities across various domains. However, like any software, they face security challenges, including the risk of 'jailbreak' attacks that…

密码学与安全 · 计算机科学 2024-01-31 Jie Li , Yi Liu , Chongyang Liu , Ling Shi , Xiaoning Ren , Yaowen Zheng , Yang Liu , Yinxing Xue

Recent advances have enabled Large Language Models (LLMs) to tackle reasoning tasks by generating chain-of-thought (CoT) rationales, yet these gains have largely applied to high-resource languages, leaving low-resource languages behind. In…

计算与语言 · 计算机科学 2025-11-27 Khanh-Tung Tran , Barry O'Sullivan , Hoang D. Nguyen

Large Language Models (LLMs) demonstrate outstanding performance in their reservoir of knowledge and understanding capabilities, but they have also been shown to be prone to illegal or unethical reactions when subjected to jailbreak…

Large Language Model (LLM) alignment aims to ensure that LLM outputs match with human values. Researchers have demonstrated the severity of alignment problems with a large spectrum of jailbreak techniques that can induce LLMs to produce…

计算与语言 · 计算机科学 2024-02-06 Xiaolong Jin , Zhuo Zhang , Xiangyu Zhang

Despite the remarkable performance of Large Language Models (LLMs), they remain vulnerable to jailbreak attacks, which can compromise their safety mechanisms. Existing studies often rely on brute-force optimization or manual design, failing…

计算与语言 · 计算机科学 2025-06-30 Haoming Yang , Ke Ma , Xiaojun Jia , Yingfei Sun , Qianqian Xu , Qingming Huang

Logical reasoning is a critical benchmark for evaluating the capabilities of large language models (LLMs), as it reflects their ability to derive valid conclusions from given premises. While the combination of test-time scaling with…

计算与语言 · 计算机科学 2025-08-28 Ramya Keerthy Thatikonda , Wray Buntine , Ehsan Shareghi

As LLMs become more common, non-expert users can pose risks, prompting extensive research into jailbreak attacks. However, most existing black-box jailbreak attacks rely on hand-crafted heuristics or narrow search spaces, which limit…

密码学与安全 · 计算机科学 2025-11-21 Zhen Sun , Zongmin Zhang , Deqi Liang , Han Sun , Yule Liu , Yun Shen , Xiangshan Gao , Yilong Yang , Shuai Liu , Yutao Yue , Xinlei He

Long chain-of-thought~(CoT) has become a dominant paradigm for enhancing the reasoning capability of large reasoning models~(LRMs); however, the performance gains often come with a substantial increase in reasoning budget. Recent studies…

人工智能 · 计算机科学 2026-03-03 Jie Cao , Tianwei Lin , Zhenxuan Fan , Bo Yuan , Ziyuan Zhao , Rolan Yan , Wenqiao Zhang , Siliang Tang

Vision-Language Models (VLMs) with multimodal reasoning capabilities are high-value attack targets, given their potential for handling complex multimodal harmful tasks. Mainstream black-box jailbreak attacks on VLMs work by distributing…

密码学与安全 · 计算机科学 2026-02-12 Yu Yan , Sheng Sun , Shengjia Cheng , Teli Liu , Mingfeng Li , Min Liu

Large Language Models (LLMs) face significant accuracy degradation due to insufficient reasoning ability when dealing with complex and abstract tasks. Thought structures such as Chain of Thought (CoT) and Tree of Thought (ToT) focus on…

计算与语言 · 计算机科学 2025-09-29 Fengxiao Tang , Yufeng Li , Zongzong Wu , Ming Zhao

Chain-of-thought (CoT) reasoning has become the standard paradigm for enabling Large Language Models (LLMs) to solve complex problems. However, recent studies reveal a sharp performance drop in reasoning hop generalization scenarios, where…

计算与语言 · 计算机科学 2026-05-04 Zhaoyi Li , Jiatong Li , Gangwei Jiang , Linqi Song , Defu Lian , Ying Wei

Despite efforts to align large language models (LLMs) with societal and moral values, these models remain susceptible to jailbreak attacks -- methods designed to elicit harmful responses. Jailbreaking black-box LLMs is considered…

计算与语言 · 计算机科学 2025-09-23 Muyang Zheng , Yuanzhi Yao , Changting Lin , Caihong Kai , Yanxiang Chen , Zhiquan Liu

Large language models (LLMs) excel in complex tasks through advanced prompting techniques like Chain-of-Thought (CoT) and Tree-of-Thought (ToT), but their reliance on manually crafted, task-specific prompts limits adaptability and…

计算与语言 · 计算机科学 2025-07-04 Tao Xiong , Xavier Hu , Wenyan Fan , Shengyu Zhang

Large language models (LLMs) remain vulnerable to sophisticated prompt engineering attacks that exploit contextual framing to bypass safety mechanisms, posing significant risks in cybersecurity applications. We introduce Jailbreak Mimicry,…

密码学与安全 · 计算机科学 2025-10-28 Pavlos Ntais

Emerging large reasoning models (LRMs), such as DeepSeek-R1 models, leverage long chain-of-thought (CoT) reasoning to generate structured intermediate steps, enhancing their reasoning capabilities. However, long CoT does not inherently…

人工智能 · 计算机科学 2025-02-18 Fengqing Jiang , Zhangchen Xu , Yuetai Li , Luyao Niu , Zhen Xiang , Bo Li , Bill Yuchen Lin , Radha Poovendran

Chain-of-thought (CoT) reasoning has become the default strategy for enhancing LLM capabilities, yet its application raises a fundamental question: when is explicit reasoning actually beneficial? Empirical evidence reveals a striking…

机器学习 · 计算机科学 2026-05-25 Wei Xia , Haoqing Wang , Zhi-Hong Deng , Yehui Tang

Although large language models (LLMs) demonstrate impressive proficiency in various tasks, they present potential safety risks, such as `jailbreaks', where malicious inputs can coerce LLMs into generating harmful content bypassing safety…

计算与语言 · 计算机科学 2025-11-26 Isack Lee , Haebin Seong

The evolution of generative models from next-token predictors to autonomous engines of complex systems necessitates rigorous safety hardening. Adversarial jailbreaking, the strategic manipulation of models to elicit harmful output, remains…

机器学习 · 计算机科学 2026-05-11 Montaser Mohammedalamen , Kevin Roice , Reginald McLean , Alyssa Lefaivre Škopac

Large language models (LLMs), despite being safety-aligned, exhibit brittle refusal behaviors that can be circumvented by simple linguistic changes. As tense jailbreaking demonstrates that models refusing harmful requests often comply when…

人工智能 · 计算机科学 2026-04-15 Yein Park , Jungwoo Park , Jaewoo Kang

Extensive work has been devoted to improving the safety mechanism of Large Language Models (LLMs). However, LLMs still tend to generate harmful responses when faced with malicious instructions, a phenomenon referred to as "Jailbreak…

计算与语言 · 计算机科学 2024-02-26 Yanrui Du , Sendong Zhao , Ming Ma , Yuhan Chen , Bing Qin
‹ 上一页 1 8 9 10 下一页 ›