中文
相关论文

相关论文: TIDE: Trajectory-based Diagnostic Evaluation of Te…

200 篇论文

Large language models (LLMs) have demonstrated remarkable capabilities across a range of text-generation tasks. However, LLMs still struggle with problems requiring multi-step decision-making and environmental feedback, such as online…

人工智能 · 计算机科学 2025-02-18 Zhenfang Chen , Delin Chen , Rui Sun , Wenjun Liu , Chuang Gan

Agentic AI workflows (systems that autonomously plan and act) are becoming widespread, yet their task success rate on complex tasks remains low. A promising solution is inference-time alignment, which uses extra compute at test time to…

Test-time evolution of agent memory serves as a pivotal paradigm for achieving AGI by bolstering complex reasoning through experience accumulation. However, even during benign task evolution, agent safety alignment remains vulnerable-a…

人工智能 · 计算机科学 2026-02-04 Yu Cheng , Jiuan Zhou , Yongkang Hu , Yihang Chen , Huichi Zhou , Mingang Chen , Zhizhong Zhang , Kun Shao , Yuan Xie , Zhaoxia Yin

Agentic LLM frameworks promise autonomous behavior via task decomposition, tool use, and iterative planning, but most deployed systems remain brittle. They lack runtime introspection, cannot diagnose their own failure modes, and do not…

人工智能 · 计算机科学 2025-12-10 Christopher Cruz

Large Language Models demonstrate strong reasoning and generation abilities, yet their behavior in multi-turn tasks often lacks reliability and verifiability. We present a task completion framework that enables LLM-based agents to act under…

人工智能 · 计算机科学 2025-12-15 Gonca Gürsun

Large language models (LLMs) are increasingly deployed in teams, yet existing coordination approaches often occupy two extremes. Highly structured methods rely on fixed roles, pipelines, or task decompositions assigned a priori. In…

Large Language Model (LLM) agents are increasingly improved through interaction, yet most self-evolution methods adapt either the policy or the learning environment in isolation. We identify this structural gap as \emph{Agent-Environment…

计算与语言 · 计算机科学 2026-05-26 Yihao Hu , Zhihao Wen , Xiujin Liu , Pan Wang , Xin Zhang , Wei Wu

Even though high-level synthesis (HLS) tools mitigate the challenges of programming domain-specific accelerators (DSAs) by raising the abstraction level, optimizing hardware directive parameters remains a significant hurdle. Existing…

硬件体系结构 · 计算机科学 2025-11-24 Hanyu Wang , Xinrui Wu , Zijian Ding , Su Zheng , Chengyue Wang , Neha Prakriya , Tony Nowatzki , Yizhou Sun , Jason Cong

Large Language Models (LLMs) are widely used as judges to evaluate response quality, providing a scalable alternative to human evaluation. However, most LLM judges operate solely on intrinsic text-based reasoning, limiting their ability to…

计算与语言 · 计算机科学 2026-02-24 Ran Xu , Jingjing Chen , Jiayu Ye , Yu Wu , Jun Yan , Carl Yang , Hongkun Yu

Agentic systems are becoming more capable: agents define strategies, take actions, and interact with different environments. This autonomy poses serious challenges for overseeing and assessing agent behavior. Most current tools are limited,…

计算与语言 · 计算机科学 2026-05-22 Asaf Yehudai , Lilach Eden , Michal Shmueli-Scheuer

Large Language Models have demonstrated remarkable capabilities across diverse domains, yet significant challenges persist when deploying them as AI agents for real-world long-horizon tasks. Existing LLM agents suffer from a critical…

Large Language Model (LLM) agents, which integrate planning, memory, reflection, and tool-use modules, have shown promise in solving complex, multi-step tasks. Yet their sophisticated architectures amplify vulnerability to cascading…

Large language model (LLM) agents often struggle in environments where rules and required domain knowledge frequently change, such as regulatory compliance and user risk screening. Current approaches, like offline fine-tuning and standard…

机器学习 · 计算机科学 2025-10-13 Yufei He , Ruoyu Li , Alex Chen , Yue Liu , Yulin Chen , Yuan Sui , Cheng Chen , Yi Zhu , Luca Luo , Frank Yang , Bryan Hooi

Large Action Models (LAMs) for AI Agents offer incredible potential but face challenges due to the need for high-quality training data, especially for multi-steps tasks that involve planning, executing tool calls, and responding to…

Historically, scientific discovery has been a lengthy and costly process, demanding substantial time and resources from initial conception to final results. To accelerate scientific discovery, reduce research costs, and improve research…

Large Language Models (LLMs) are increasingly deployed as autonomous agents capable of reasoning, planning, and acting within interactive environments. Despite their growing capability to perform multi-step reasoning and decision-making…

LLM-based agents execute real-world workflows via tools and memory. These affordances enable ill-intended adversaries to also use these agents to carry out complex misuse scenarios. Existing agent misuse benchmarks largely test…

计算与语言 · 计算机科学 2026-05-19 Nivya Talokar , Ayush K Tarun , Murari Mandal , Maksym Andriushchenko , Antoine Bosselut

Large Language Model (LLM) agents have shown promising potential in automating Instructional Systems Design (ISD), a systematic approach to developing educational programs. However, evaluating these agents remains challenging due to the…

软件工程 · 计算机科学 2026-02-12 YoungHoon Jeon , Suwan Kim , Haein Son , Sookbun Lee , Yeil Jeong , Unggi Lee

Recent advancements in Large Language Models (LLMs) have empowered LLM agents to autonomously collect world information, over which to conduct reasoning to solve complex problems. Given this capability, increasing interests have been put…

计算与语言 · 计算机科学 2024-07-02 Chenchen Ye , Ziniu Hu , Yihe Deng , Zijie Huang , Mingyu Derek Ma , Yanqiao Zhu , Wei Wang

This paper considers how heterogeneous multi-agent teams can leverage their different capabilities to mutually improve individual agent performance. We present Capability-Augmenting Tasks (CATs), which encode how agents can augment their…

系统与控制 · 电气工程与系统科学 2024-09-17 Carter Berlind , Wenliang Liu , Alyssa Pierson , Calin Belta