中文
相关论文

相关论文: BenchTrace: A Benchmark for Testing Reflection Abi…

200 篇论文

LLM agents increasingly perform end-to-end ML engineering tasks where success is judged by a single scalar test metric. This creates a structural vulnerability: an agent can increase the reported score by compromising the evaluation…

人工智能 · 计算机科学 2026-03-13 Yonas Atinafu , Robin Cohen

Post-training algorithms based on deep reinforcement learning can push the limits of robotic models for specific objectives, such as generalizability, accuracy, and robustness. However, Intervention-requiring Failures (IR Failures) (e.g., a…

机器人学 · 计算机科学 2026-01-13 Huanyu Li , Kun Lei , Sheng Zang , Kaizhe Hu , Yongyuan Liang , Bo An , Xiaoli Li , Huazhe Xu

Large Language Models (LLMs) show promise in code generation tasks. However, their code-writing abilities are often limited in scope: while they can successfully implement simple functions, they struggle with more complex tasks. A…

软件工程 · 计算机科学 2024-07-30 Jialin Song , Jonathan Raiman , Bryan Catanzaro

Alignment faking (AF) occurs when an LLM strategically complies with training objectives to avoid value modification, reverting to prior preferences once monitoring is lifted. Current detection methods focus on conversational settings and…

密码学与安全 · 计算机科学 2026-04-30 Matteo Leonesi , Francesco Belardinelli , Flavio Corradini , Marco Piangerelli

Large Language Models (LLMs) have demonstrated remarkable capabilities in interactive decision-making tasks, but existing methods often struggle with error accumulation and lack robust self-correction mechanisms. We introduce "Reflect…

机器学习 · 计算机科学 2025-09-24 Qiuhai Zeng , Sarvesh Rajkumar , Di Wang , Narendra Gyanchandani , Wenbo Yan

Large language models (LLMs) have improved significantly in their reasoning through extensive training on massive datasets. However, relying solely on additional data for improvement is becoming increasingly impractical, highlighting the…

计算与语言 · 计算机科学 2025-10-01 Gaurav Srivastava , Zhenyu Bi , Meng Lu , Xuan Wang

Reinforcement Learning (RL) has emerged as a crucial method for training or fine-tuning large language models (LLMs), enabling adaptive, task-specific optimizations through interactive feedback. Multi-Agent Reinforcement Learning (MARL), in…

机器学习 · 计算机科学 2026-02-10 Junwei Su , Chuan Wu

Training large language models (LLMs) to spend more time thinking and reflection before responding is crucial for effectively solving complex reasoning tasks in fields such as science, coding, and mathematics. However, the effectiveness of…

Recent advances in reinforcement learning (RL) heavily rely on a variety of well-designed benchmarks, which provide environmental platforms and consistent criteria to evaluate existing and novel algorithms. Specifically, in multi-agent RL…

多智能体系统 · 计算机科学 2024-06-25 Wenzhe Li , Zihan Ding , Seth Karten , Chi Jin

Federated Learning (FL) has emerged as a promising paradigm for collaborative model training while preserving data privacy across decentralized participants. As FL adoption grows, numerous techniques have been proposed to tackle its…

Large Language Models (LLMs) exhibit robust problem-solving capabilities for diverse tasks. However, most LLM-based agents are designed as specific task solvers with sophisticated prompt engineering, rather than agents capable of learning…

人工智能 · 计算机科学 2024-06-10 Wenqi Zhang , Ke Tang , Hai Wu , Mengna Wang , Yongliang Shen , Guiyang Hou , Zeqi Tan , Peng Li , Yueting Zhuang , Weiming Lu

Large language model agents rely on effective model context to obtain task-relevant information for decision-making. Many existing context engineering approaches primarily rely on the context generated from the past experience and retrieval…

人工智能 · 计算机科学 2026-04-10 Linbo Liu , Guande Wu , Han Ding , Yawei Wang , Qiang Zhou , Yuzhe Lu , Zhichao Xu , Huan Song , Panpan Xu , Lin Lee Cheong

While recent advances in large reasoning models have demonstrated remarkable performance, efficient reasoning remains critical due to the rapid growth of output length. Existing optimization approaches highlights a tendency toward…

计算与语言 · 计算机科学 2025-06-17 Kaiyuan Liu , Chen Shen , Zhanwei Zhang , Junjie Liu , Xiaosong Yuan , Jieping ye

As the focus in LLM-based coding shifts from static single-step code generation to multi-step agentic interaction with tools and environments, understanding which tasks will challenge agents and why becomes increasingly difficult. This is…

人工智能 · 计算机科学 2026-04-02 Chris Ge , Daria Kryvosheieva , Daniel Fried , Uzay Girit , Kaivalya Hariharan

Large language models (LLMs) often produce confident but incorrect answers in settings where abstention would be safer. Standard evaluation protocols, however, require a response and do not account for how confidence should guide decisions…

计算与语言 · 计算机科学 2026-04-06 Sean Wu , Fredrik K. Gustafsson , Edward Phillips , Boyan Gao , Anshul Thakur , David A. Clifton

Motivated by the challenge presented by non-Markovian objectives in reinforcement learning (RL), we present a novel framework to track and represent the progress of autonomous agents through complex, multi-stage tasks. Given a specification…

机器学习 · 计算机科学 2026-04-21 Noel Brindise , Cedric Langbort , Melkior Ornik

Large Language Models (LLMs) trained via Reinforcement Learning (RL) have exhibited strong reasoning capabilities and emergent reflective behaviors, such as rethinking and error correction, as a form of in-context exploration. However, the…

机器学习 · 计算机科学 2025-12-09 Shenao Zhang , Yaqing Wang , Yinxiao Liu , Tianqi Liu , Peter Grabowski , Eugene Ie , Zhaoran Wang , Yunxuan Li

LLM agents are emerging as a key enabler for autonomous wireless network management. Reliably deploying them, however, demands benchmarks that reflect real engineering risk. Existing wireless benchmarks evaluate single isolated capabilities…

网络与互联网体系结构 · 计算机科学 2026-03-24 Jingwen Tong , Fang Liu , Linkai Xv , Shiliang Lu , Kangqi Li , Yiqian Zhang , Yijie Song , Zeyang Xue , Jun Zhang

Skills have become the de facto way to enable LLM agents to perform complex real-world tasks with customized instructions, workflows, and tools, but how to learn them automatically and effectively remains unclear. We introduce…

Test-time inference has emerged as a powerful paradigm for enabling language models to ``think'' longer and more carefully about complex challenges, much like skilled human experts. While reinforcement learning (RL) can drive…

计算与语言 · 计算机科学 2025-08-18 Kanishk Gandhi , Ayush Chakravarthy , Anikait Singh , Nathan Lile , Noah D. Goodman
‹ 上一页 1 8 9 10 下一页 ›