English
Related papers

Related papers: STAR: Detecting Inference-time Backdoors in LLM Re…

200 papers

Although Large Language Models (LLMs) achieve remarkable performance across various tasks, they often struggle with complex reasoning tasks, such as answering mathematical questions. Recent efforts to address this issue have primarily…

Machine Learning · Computer Science 2024-06-27 Jikun Kang , Xin Zhe Li , Xi Chen , Amirreza Kazemi , Qianyi Sun , Boxing Chen , Dong Li , Xu He , Quan He , Feng Wen , Jianye Hao , Jun Yao

A new generation of language models reasons entirely in continuous hidden states, producing no tokens and leaving no audit trail. We show that this silence creates a fundamentally new attack surface. ThoughtSteer perturbs a single embedding…

Machine Learning · Computer Science 2026-04-02 Swapnil Parekh

Recent years have witnessed the rapid development of Large Language Model-based Multi-Agent Systems (MAS), which excel at collaborative decision-making and complex problem-solving. However, malicious agents in MAS may inject misinformation…

Artificial Intelligence · Computer Science 2026-05-28 Yaoyang Luo , Zhi Zheng , Ziwei Zhao , Tong Xu , Zhao Jielun , Wenjun Xue , Yong Chen , Enhong Chen

Ensuring the safety and harmlessness of Large Language Models (LLMs) has become equally critical as their performance in applications. However, existing safety alignment methods typically suffer from safety-performance trade-offs and the…

Computation and Language · Computer Science 2025-06-30 Yichi Zhang , Siyuan Zhang , Yao Huang , Zeyu Xia , Zhengwei Fang , Xiao Yang , Ranjie Duan , Dong Yan , Yinpeng Dong , Jun Zhu

The reasoning abilities of large language models (LLMs) have improved with chain-of-thought (CoT) prompting, allowing models to solve complex tasks stepwise. However, training CoT capabilities requires detailed reasoning data, which is…

Artificial Intelligence · Computer Science 2025-04-11 Fu-Chieh Chang , Yu-Ting Lee , Hui-Ying Shih , Yi Hsuan Tseng , Pei-Yuan Wu

Recent progress in large language models (LLMs) offers promising new approaches for recommendation system tasks. While the current state-of-the-art methods rely on fine-tuning LLMs to achieve optimal results, this process is costly and…

Information Retrieval · Computer Science 2025-02-21 Dong-Ho Lee , Adam Kraft , Long Jin , Nikhil Mehta , Taibai Xu , Lichan Hong , Ed H. Chi , Xinyang Yi

This paper introduces STAR-1, a high-quality, just-1k-scale safety dataset specifically designed for large reasoning models (LRMs) like DeepSeek-R1. Built on three core principles -- diversity, deliberative reasoning, and rigorous filtering…

Computation and Language · Computer Science 2025-11-12 Zijun Wang , Haoqin Tu , Yuhan Wang , Juncheng Wu , Yanqing Liu , Jieru Mei , Brian R. Bartoldson , Bhavya Kailkhura , Cihang Xie

Recently, deep reinforcement learning (DRL) has emerged as a promising approach for robotic control. However, the deployment of DRL in real-world robots is hindered by its sensitivity to environmental perturbations. While existing whitebox…

Machine Learning · Computer Science 2025-03-27 Zongyuan Zhang , Tianyang Duan , Zheng Lin , Dong Huang , Zihan Fang , Zekai Sun , Ling Xiong , Hongbin Liang , Heming Cui , Yong Cui

While Time Series Foundation Models (TSFMs) have demonstrated remarkable success in Multivariate Time Series Anomaly Detection (MTSAD), however, in real-world industrial scenarios, many time series comprise not only numerical variables such…

Machine Learning · Computer Science 2025-10-21 Hanyin Cheng , Ruitong Zhang , Yuning Lu , Peng Chen , Meng Wang , Yang Shu , Bin Yang , Chenjuan Guo

Structured spatial navigation is a core benchmark for Large Language Models (LLMs) spatial reasoning. Existing paradigms like Visualization-of-Thought (VoT) are prone to cascading errors in complex topologies. To solve this, we propose…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Pukun Zhao , Longxiang Wang , Chen Chen , Peicheng Wang , Fanqing Zhou , Runze Li , Haojian Huang

Unified Multimodal understanding and generation Models (UMMs) have demonstrated remarkable capabilities in both understanding and generation tasks. However, we identify a vulnerability arising from the generation-understanding coupling in…

Artificial Intelligence · Computer Science 2025-10-01 Shaoxiong Guo , Tianyi Du , Lijun Li , Yuyao Wu , Jie Li , Jing Shao

Compositional spatiotemporal reasoning often requires a system to invoke multiple heterogeneous specialists, such as geometric, temporal, topological, and trajectory agents. A central question is how such a system should route among…

Artificial Intelligence · Computer Science 2026-05-18 Ruiyi Yang , Lihuan Li , Hao Xue , Flora D. Salim

Traditional language model-based theorem proving assumes that by training on a sufficient amount of formal proof data, a model will learn to prove theorems. Our key observation is that a wealth of informal information that is not present in…

Artificial Intelligence · Computer Science 2025-03-18 Haohan Lin , Zhiqing Sun , Sean Welleck , Yiming Yang

Stance detection aims to identify the attitude expressed in a document towards a given target. Techniques such as Chain-of-Thought (CoT) prompting have advanced this task, enhancing a model's reasoning capabilities through the derivation of…

Computation and Language · Computer Science 2023-09-08 Kairui Hu , Ming Yan , Joey Tianyi Zhou , Ivor W. Tsang , Wen Haw Chong , Yong Keong Yap

As Large Language Models (LLMs) gain traction across critical domains, ensuring secure and trustworthy training processes has become a major concern. Backdoor attacks, where malicious actors inject hidden triggers into training data, are…

Cryptography and Security · Computer Science 2025-10-20 Issam Seddik , Sami Souihi , Mohamed Tamaazousti , Sara Tucci Piergiovanni

We introduce ASTRO, the "Autoregressive Search-Taught Reasoner", a framework for training language models to reason like search algorithms, explicitly leveraging self-reflection, backtracking, and exploration in their outputs. Recently,…

Artificial Intelligence · Computer Science 2025-07-02 Joongwon Kim , Anirudh Goyal , Liang Tan , Hannaneh Hajishirzi , Srinivasan Iyer , Tianlu Wang

State machines are essential for enhancing protocol analysis to identify vulnerabilities. However, inferring state machines from network protocol implementations is challenging due to complex code syntax and semantics. Traditional dynamic…

Cryptography and Security · Computer Science 2025-03-28 Haiyang Wei , Ligeng Chen , Zhengjie Du , Yuhan Wu , Haohui Huang , Yue Liu , Guang Cheng , Fengyuan Xu , Linzhang Wang , Bing Mao

Recently, large language models (LLMs) have shown remarkable reasoning capabilities via large-scale reinforcement learning (RL). However, leveraging the RL algorithm to empower effective multi-tool collaborative reasoning in LLMs remains an…

Computation and Language · Computer Science 2025-05-23 Guanting Dong , Yifei Chen , Xiaoxi Li , Jiajie Jin , Hongjin Qian , Yutao Zhu , Hangyu Mao , Guorui Zhou , Zhicheng Dou , Ji-Rong Wen

Large reasoning models (LRMs) generate extended solutions, yet it remains unclear whether these traces reflect substantive internal computation or merely verbosity and overthinking. Although recent hidden-state analyses suggest that…

Computation and Language · Computer Science 2026-05-05 Kotaro Furuya , Takahito Tanimura

Latent reasoning compresses the chain-of-thought (CoT) into continuous hidden states, yet existing methods rely on dense latent transitions that remain difficult to interpret and control. Meanwhile, sparse representation models uncover…

Artificial Intelligence · Computer Science 2026-02-03 Yadong Wang , Haodong Chen , Yu Tian , Chuanxing Geng , Dong Liang , Xiang Chen