English
Related papers

Related papers: TRACES: Proactive Safety Auditing for Multi-Turn L…

200 papers

LLM-based agents have demonstrated promising adaptability in real-world applications. However, these agents remain vulnerable to a wide range of attacks, such as tool poisoning and malicious instructions, that compromise their execution…

Cryptography and Security · Computer Science 2025-10-14 Jiahao Liu , Bonan Ruan , Xianglin Yang , Zhiwei Lin , Yan Liu , Yang Wang , Tao Wei , Zhenkai Liang

Predicting the near-term behavior of a reactive agent is crucial in many robotic scenarios, yet remains challenging when observations of that agent are sparse or intermittent. Vision-Language Models (VLMs) offer a promising avenue by…

The field of Language Reasoning Models (LRMs) has been very active over the past few years with advances in training and inference techniques enabling LRMs to reason longer, and more accurately. However, a growing body of studies show that…

Computation and Language · Computer Science 2026-04-24 Yannis Belkhiter , Seshu Tirupathi , Giulio Zizzo , John D. Kelleher

Despite the growing capabilities of autonomous agents powered by large language models (LLMs), their adoption in high-stakes domains remains limited. A key barrier is security: the inherently nondeterministic behavior of LLM agents defies…

Software Engineering · Computer Science 2026-02-12 Adam AlSayyad , Kelvin Yuxiang Huang , Richik Pal

Large Language Models (LLMs) deployed in agentic environments must exercise multiple capabilities across different task instances, where a capability is performing one or more actions in a trajectory that are necessary for successfully…

Artificial Intelligence · Computer Science 2026-04-08 Hangoo Kang , Tarun Suresh , Jon Saad-Falcon , Azalia Mirhoseini

Although recent tool-augmented benchmarks involve complex requests, evaluation remains limited to answer matching, neglecting critical trajectory aspects like efficiency, hallucination, and adaptivity. The most straightforward method for…

Artificial Intelligence · Computer Science 2026-05-26 Wonjoong Kim , Sangwu Park , Yeonjun In , Sein Kim , Dongha Lee , Chanyoung Park

Large Language Model (LLM) agents increasingly operate across domains such as robotics, virtual assistants, and web automation. However, their stochastic decision-making introduces safety risks that are difficult to anticipate during…

Artificial Intelligence · Computer Science 2026-03-30 Haoyu Wang , Christopher M. Poskitt , Jiali Wei , Jun Sun

Estimating uncertainty for AI agents in real-world multi-turn tool-using interaction with humans is difficult because failures are often triggered by sparse critical episodes (e.g., looping, incoherent tool use, or user-agent…

Artificial Intelligence · Computer Science 2026-02-13 Sina Tayebati , Divake Kumar , Nastaran Darabi , Davide Ettori , Ranganath Krishnan , Amit Ranjan Trivedi

Large Language Models (LLMs) are increasingly deployed as autonomous agents that reason, use tools, and act over multiple steps. Yet most hallucination benchmarks still evaluate only the final output, missing failures that originate in…

Artificial Intelligence · Computer Science 2026-05-27 Harshada Badave , Santosh Borse , Andrea Gomez , Harshitha Narahari , Sara Carter , Vishwa Bhatt , Aishani Rachakonda , Shuxin Lin , Dhaval Patel

Evaluating the safety of LLM-based agents is increasingly important because risks in realistic deployments often emerge over multi-step interactions rather than isolated prompts or final responses. Existing trajectory-level benchmarks…

Artificial Intelligence · Computer Science 2026-05-14 Yu Li , Haoyu Luo , Yuejin Xie , Yuqian Fu , Zhonghao Yang , Shuai Shao , Qihan Ren , Wanying Qu , Yanwei Fu , Yujiu Yang , Jing Shao , Xia Hu , Dongrui Liu

LLM-based deep research agents are largely built on the ReAct framework. This linear design makes it difficult to revisit earlier states, branch into alternative search directions, or maintain global awareness under long contexts, often…

Temporal causal representation learning methods assume that causal mechanisms switch instantaneously between discrete domains, yet real-world systems often exhibit continuous mechanism transitions. For example, a vehicle's dynamics evolve…

Machine Learning · Computer Science 2026-01-30 Shicheng Fan , Kun Zhang , Lu Cheng

The advent of tool-using LLM agents shifts safety monitoring from output moderation to auditing long, noisy interaction trajectories, where risk-critical evidence is sparse-making standard binary supervision poorly suited for credit…

Machine Learning · Computer Science 2026-04-07 Lin Wang , Junfeng Fang , Dan Zhang , Fei Shen , Xiang Wang , Tat-Seng Chua

As LLM-based agents increasingly browse the web on users' behalf, a natural question arises: can websites passively identify which underlying model powers an agent? Doing so would represent a significant security risk, enabling targeted…

Cryptography and Security · Computer Science 2026-05-15 William Lugoloobi , Samuelle Marro , Jabez Magomere , Joss Wright , Chris Russell

This paper addresses motion forecasting in multi-agent environments, pivotal for ensuring safety of autonomous vehicles. Traditional as well as recent data-driven marginal trajectory prediction methods struggle to properly learn non-linear…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Prarthana Bhattacharyya , Chengjie Huang , Krzysztof Czarnecki

As large language models (LLMs) evolve from static chatbots into autonomous agents, the primary vulnerability surface shifts from final outputs to intermediate execution traces. While safety guardrails are well-benchmarked for natural…

Cryptography and Security · Computer Science 2026-04-09 Yen-Shan Chen , Sian-Yao Huang , Cheng-Lin Yang , Yun-Nung Chen

Multi-agent LLM systems introduce a security risk in which sensitive information accessed by one agent can propagate through shared context and reappear in downstream outputs, even without explicit adversarial intent. We formalise this…

Artificial Intelligence · Computer Science 2026-05-12 Riya Tapwal , Abhishek Kumar , Carsten Maple

Reasoning models improve their problem-solving ability through inference-time scaling, allocating more compute via longer token budgets. Identifying which reasoning traces are likely to succeed remains a key opportunity: reliably predicting…

Artificial Intelligence · Computer Science 2025-10-14 Martina G. Vilas , Safoora Yousefi , Besmira Nushi , Eric Horvitz , Vidhisha Balachandran

Agent skills extend LLM agents with reusable instructions, tool interfaces, and executable code, and users increasingly install third-party skills from marketplaces, repositories, and community channels. Because a skill exposes both…

Cryptography and Security · Computer Science 2026-05-13 Zhaojiacheng Zhou

Recent work on activation and latent steering has demonstrated that modifying internal representations can effectively guide large language models (LLMs) toward improved reasoning and efficiency without additional training. However, most…

Machine Learning · Computer Science 2026-01-07 Tuc Nguyen , Thai Le
‹ Prev 1 2 3 10 Next ›