中文
相关论文

相关论文: Building a Foundational Guardrail for General Agen…

200 篇论文

Unmanned Aerial Vehicles (UAVs) are increasingly used in defense, surveillance, and disaster response, yet most systems still operate at SAE Level 2 to 3 autonomy. Their dependence on rule-based control and narrow AI limits adaptability in…

人工智能 · 计算机科学 2025-12-03 Anis Koubaa , Khaled Gabr

Large foundation models enable powerful reasoning for autonomous systems, but mapping semantic intent to reliable real-time control remains challenging. Existing approaches either (i) let Large Language Models (LLMs) generate trajectories…

机器人学 · 计算机科学 2026-04-03 Jiayi Chen , Shuai Wang , Guangxu Zhu , Chengzhong Xu

The proliferation of autonomous AI agents capable of executing real-world actions - filesystem operations, API calls, database modifications, financial transactions - introduces a class of safety risk not addressed by existing…

人工智能 · 计算机科学 2026-03-17 Florin Adrian Chitan

We present GuardReasoner-Omni, a reasoning-based guardrail model designed to moderate text, image, video, and audio data. First, we construct a comprehensive training corpus comprising 181k samples spanning these four modalities. Our…

密码学与安全 · 计算机科学 2026-05-28 Zhenhao Zhu , Yue Liu , Yanpei Guo , Wenjie Qu , Cancan Chen , Yufei He , Yibo Li , Yulin Chen , Tianyi Wu , Huiying Xu , Xinzhong Zhu , Jiaheng Zhang

Unmanned aerial vehicular network (UAVN) is envisioned to provide flexible connectivity, wide-area coverage, and low-latency services in dynamic environments. From an agentic artificial intelligence (Agentic AI) perspective, UAVNs naturally…

分布式、并行与集群计算 · 计算机科学 2026-05-12 Xin Tang , Xiaohuan Li , Qian Chen , Binhan Liao , Yaqi Zhang , Jianxin Chen , Changyuan Zhao , Junchuan Fan , Junxi Tian

Generalizable manipulation involving cross-type object interactions is a critical yet challenging capability in robotics. To reliably accomplish such tasks, robots must address two fundamental challenges: "where to manipulate" (contact…

机器人学 · 计算机科学 2026-05-13 Zhenhao Shen , Zeming Yang , Yue Chen , Yuran Wang , Shengqiang Xu , Mingleyang Li , Hao Dong , Ruihai Wu

With the rapid proliferation of digital media, the need for efficient and transparent safeguards against unsafe content is more critical than ever. Traditional image guardrail models, constrained by predefined categories, often misclassify…

计算机视觉与模式识别 · 计算机科学 2025-10-29 Peiyang Xu , Minzhou Pan , Zhaorun Chen , Shuang Yang , Chaowei Xiao , Bo Li

Reinforcement learning (RL) algorithms can achieve state-of-the-art performance in decision-making and continuous control tasks. However, applying RL algorithms on safety-critical systems still needs to be well justified due to the…

机器人学 · 计算机科学 2022-11-22 Mahmoud Selim , Amr Alanwar , M. Watheq El-Kharashi , Hazem M. Abbas , Karl H. Johansson

LLM-based agents are deployed in safety-critical applications, yet current guardrail systems fail to prevent violations of temporal safety policies, requirements that govern the ordering and sequencing of agent actions. For instance, agents…

编程语言 · 计算机科学 2026-01-01 Adharsh Kamath , Sishen Zhang , Calvin Xu , Shubham Ugare , Gagandeep Singh , Sasa Misailovic

The increasing complexity of Beyond 5G and 6G networks necessitates new paradigms for autonomy and assur- ance. Traditional O-RAN control loops rely heavily on RIC- based orchestration, which centralizes intelligence and exposes the system…

网络与互联网体系结构 · 计算机科学 2025-10-21 Sukhdeep Singh , Avinash Bhat , Shweta M , Subhash K Singh , Moonki Hong , Madhan Raj K , Kandeepan Sithamparanathan , Sunder A. Khowaja , Kapal Dev

The rapid advancement of large language models (LLMs) has increased the need for guardrail models to ensure responsible use, particularly in detecting unsafe and illegal content. While substantial safety data exist in English, multilingual…

计算与语言 · 计算机科学 2025-02-10 Yihe Deng , Yu Yang , Junkai Zhang , Wei Wang , Bo Li

The use of reward functions to structure AI learning and decision making is core to the current reinforcement learning paradigm; however, without careful design of reward functions, agents can learn to solve problems in ways that may be…

人工智能 · 计算机科学 2025-01-22 Jonathan Keane , Sam Keyser , Jeremy Kedziora

Data scarcity and confidentiality in finance often impede model development and robust testing. This paper presents a unified multi-criteria evaluation framework for synthetic financial data and applies it to three representative generative…

机器学习 · 计算机科学 2025-12-29 Christophe D. Hounwanou , Yae Ulrich Gaba , Pierre Ntakirutimana

We consider joint trajectory generation and tracking control for under-actuated robotic systems. A common solution is to use a layered control architecture, where the top layer uses a simplified model of system dynamics for trajectory…

机器人学 · 计算机科学 2023-07-27 Anusha Srikanthan , Fengjun Yang , Igor Spasojevic , Dinesh Thakur , Vijay Kumar , Nikolai Matni

We address the problem of data scarcity in harmful text classification for guardrailing applications and introduce GRAID (Geometric and Reflective AI-Driven Data Augmentation), a novel pipeline that leverages Large Language Models (LLMs)…

计算与语言 · 计算机科学 2025-08-26 Melissa Kazemi Rad , Alberto Purpura , Himanshu Kumar , Emily Chen , Mohammad Shahed Sorower

Retrieval-Augmented Generation (RAG) enables large language models (LLMs) to access external knowledge sources, but the effectiveness of RAG relies on the coordination between the retriever and the generator. Since these components are…

计算与语言 · 计算机科学 2025-09-24 Junlin Wang , Zehao Wu , Shaowei Lu , Yanlan Li , Xinghao Huang

AI-based systems, currently driven largely by LLMs and tool-using agentic harnesses, are increasingly discussed as a possible threat to software engineering. Foundation models get stronger, agents can plan and act across multiple steps, and…

软件工程 · 计算机科学 2026-04-24 Robert Feldt , Per Lenberg , Julian Frattini , Dhasarathy Parthasarathy

To cope with the large contexts that long-horizon LLM agents produce, modern frameworks increasingly rely on compaction -- invoking an LLM to rewrite the accumulated trajectory into a shorter summary that the agent resumes from. Today,…

多智能体系统 · 计算机科学 2026-05-12 Zhuofu Chen , Rui Pan , Yinwei Dai , Ravi Netravali

Large Language Models (LLMs) are increasingly used for decision making in embodied agents, yet existing safety evaluations often rely on coarse success rates and domain-specific setups, making it difficult to diagnose why and where these…

人工智能 · 计算机科学 2025-05-27 Yejin Son , Minseo Kim , Sungwoong Kim , Seungju Han , Jian Kim , Dongju Jang , Youngjae Yu , Chanyoung Park

The Agentic Paradigm faces a significant Software Engineering Absence, yielding Agentic systems commonly lacking robustness, observability, and evolvability. To address these deficiencies, we propose a principled engineering framework…

人工智能 · 计算机科学 2025-12-02 Jiazheng Sun , Ruimeng Yang , Xu Han , Jiayang Niu , Mingxuan Li , Te Yang , Yongyong Lu , Xin Peng