中文
相关论文

相关论文: Stepwise Reasoning Error Disruption Attack of LLMs

200 篇论文

With the burgeoning advancements in the field of natural language processing (NLP), the demand for training data has increased significantly. To save costs, it has become common for users and businesses to outsource the labor-intensive task…

计算与语言 · 计算机科学 2024-08-22 Ziqiang Li , Yueqi Zeng , Pengfei Xia , Lei Liu , Zhangjie Fu , Bin Li

Large Language Models (LLMs) have emerged as powerful tools, but their inherent safety risks - ranging from harmful content generation to broader societal harms - pose significant challenges. These risks can be amplified by the recent…

Large language models (LLMs) have shown potential in supporting decision-making applications, particularly as personal assistants in the financial, healthcare, and legal domains. While prompt engineering strategies have enhanced the…

计算与语言 · 计算机科学 2025-11-04 Yougang Lyu , Shijie Ren , Yue Feng , Zihan Wang , Zhumin Chen , Zhaochun Ren , Maarten de Rijke

Multivariate time series forecasting requires models to simultaneously capture variable-wise structural dependencies and generalize across diverse tasks. While structural encoders are effective in modeling feature interactions, they lack…

计算与语言 · 计算机科学 2025-06-26 Fengze Li , Yue Wang , Yangle Liu , Ming Huang , Dou Hong , Jieming Ma

Large Vision-Language Models (LVLMs) unlock powerful multimodal reasoning but also expand the attack surface, particularly through adversarial inputs that conceal harmful goals in benign prompts. We propose SHIELD, a lightweight,…

计算与语言 · 计算机科学 2025-10-16 Juan Ren , Mark Dras , Usman Naseem

Prompt injection attacks pose a pervasive threat to the security of Large Language Models (LLMs). State-of-the-art prevention-based defenses typically rely on fine-tuning an LLM to enhance its security, but they achieve limited…

密码学与安全 · 计算机科学 2025-11-17 Yupei Liu , Yanting Wang , Yuqi Jia , Jinyuan Jia , Neil Zhenqiang Gong

In this paper, we present a challenging code reasoning task: vulnerability detection. Large Language Models (LLMs) have shown promising results in natural-language and math reasoning, but state-of-the-art (SOTA) models reported only 54.5%…

Large language models (LLMs) present an opportunity to scale high-quality personalized education to all. A promising approach towards this means is to build dialog tutoring models that scaffold students' problem-solving. However, even…

计算与语言 · 计算机科学 2024-07-15 Nico Daheim , Jakub Macina , Manu Kapur , Iryna Gurevych , Mrinmaya Sachan

Large language models (LLMs) have been shown to be capable of impressive few-shot generalisation to new tasks. However, they still tend to perform poorly on multi-step logical reasoning problems. Here we carry out a comprehensive evaluation…

人工智能 · 计算机科学 2022-05-20 Antonia Creswell , Murray Shanahan , Irina Higgins

Reasoning-enhanced large language models (LLMs) explicitly generate intermediate reasoning steps prior to generating final answers, helping the model excel in complex problem-solving. In this paper, we demonstrate that this emerging…

机器学习 · 计算机科学 2025-05-22 Tong Wu , Chong Xiang , Jiachen T. Wang , G. Edward Suh , Prateek Mittal

Modern large reasoning models (LRMs) exhibit impressive multi-step problem-solving via chain-of-thought (CoT) reasoning. However, this iterative thinking mechanism introduces a new vulnerability surface. We present the Deadlock Attack, a…

机器学习 · 计算机科学 2025-10-21 Mohan Zhang , Yihua Zhang , Jinghan Jia , Zhangyang Wang , Sijia Liu , Tianlong Chen

With the rapid rise of personalized AI, customized large language models (LLMs) equipped with Chain of Thought (COT) reasoning now power millions of AI agents. However, their complex reasoning processes introduce new and largely unexplored…

密码学与安全 · 计算机科学 2025-11-25 Zhen Guo , Shanghao Shi , Shamim Yazdani , Ning Zhang , Reza Tourani

Large language models (LLMs) employ safety mechanisms to prevent harmful outputs, yet these defenses primarily rely on semantic pattern matching. We show that encoding harmful prompts as coherent mathematical problems -- using formalisms…

密码学与安全 · 计算机科学 2026-05-06 Haoyu Zhang , Mohammad Zandsalimy , Shanu Sushmita

Large Language Models (LLMs) have achieved remarkable success in tasks requiring complex reasoning, such as code generation, mathematical problem solving, and algorithmic synthesis -- especially when aided by reasoning tokens and…

计算与语言 · 计算机科学 2025-06-13 Jaechul Roh , Varun Gandhi , Shivani Anilkumar , Arin Garg

Large language models (LLMs) are being rapidly integrated into decision-support tools, automation workflows, and AI-enabled software systems. However, their behavior in production environments remains poorly understood, and their failure…

人工智能 · 计算机科学 2025-11-27 Vaishali Vinay

This paper proposes CES, a task to evaluate the abilities of LLMs in simulating program execution and using that reasoning in programming tasks. Besides measuring the correctness of variable predictions during execution simulation, CES…

软件工程 · 计算机科学 2026-04-08 Changshu Liu , Yang Chen , Reyhaneh Jabbarvand

Although large language models (LLMs) have transformed AI, they still make mistakes and can explore unproductive reasoning paths. Self-correction capability is essential for deploying LLMs in safety-critical applications. We uncover a…

计算与语言 · 计算机科学 2025-10-07 Ken Tsui

Reasoning over procedural sequences, where the order of steps directly impacts outcomes, is a critical capability for large language models (LLMs). In this work, we study the task of reconstructing globally ordered sequences from shuffled…

计算与语言 · 计算机科学 2025-11-18 Adrita Anika , Md Messal Monem Miah

Large Language Models (LLMs) have become key components of modern software, with prompts acting as their de-facto programming interface. However, prompt design remains largely empirical and small mistakes can cascade into unreliable,…

软件工程 · 计算机科学 2025-09-19 Haoye Tian , Chong Wang , BoYang Yang , Lyuye Zhang , Yang Liu

This study investigates the reasoning robustness of large language models (LLMs) on mathematical problem-solving tasks under systematically introduced input perturbations. Using the GSM8K dataset as a controlled testbed, we evaluate how…

人工智能 · 计算机科学 2025-04-04 Giannis Chatziveroglou , Richard Yun , Maura Kelleher