中文
相关论文

相关论文: Iterative Tool Usage Exploration for Multimodal Ag…

200 篇论文

Optimal action selection in decision problems characterized by sparse, delayed rewards is still an open challenge. For these problems, current deep reinforcement learning methods require enormous amounts of data to learn controllers that…

人工智能 · 计算机科学 2018-06-18 Miquel Junyent , Anders Jonsson , Vicenç Gómez

Multimodal recommender systems leverage diverse data sources, such as user interactions, content features, and contextual information, to address challenges like cold-start and data sparsity. However, existing methods often suffer from one…

信息检索 · 计算机科学 2026-02-24 Adamya Shyam , Venkateswara Rao Kagita , Bharti Rana , Vikas Kumar

Augmenting an agent's control with useful higher-level behaviors called options can greatly reduce the sample complexity of reinforcement learning, but manually designing options is infeasible in high-dimensional and abstract state spaces.…

机器学习 · 计算机科学 2017-10-06 Roy Fox , Sanjay Krishnan , Ion Stoica , Ken Goldberg

With current state-of-the-art approaches aimed at enhancing the reasoning capabilities of Large Language Models(LLMs) through iterative preference learning inspired by AlphaZero, we propose to further enhance the step-wise reasoning…

机器学习 · 计算机科学 2024-12-24 Huchen Jiang , Yangyang Ma , Chaofan Ding , Kexin Luan , Xinhan Di

Real-world applications of reinforcement learning for recommendation and experimentation faces a practical challenge: the relative reward of different bandit arms can evolve over the lifetime of the learning agent. To deal with these…

机器学习 · 计算机科学 2022-06-29 Srivas Chennu , Andrew Maher , Jamie Martin , Subash Prabanantham

The aim of path planning is to reach the goal from starting point by searching for the route of an agent. In the path planning, the routes may vary depending on the number of variables such that it is important for the agent to reach…

人工智能 · 计算机科学 2022-05-23 GyeongTaek Lee

Training multimodal networks requires a vast amount of data due to their larger parameter space compared to unimodal networks. Active learning is a widely used technique for reducing data annotation costs by selecting only those samples…

多媒体 · 计算机科学 2023-08-22 Meng Shen , Yizheng Huang , Jianxiong Yin , Heqing Zou , Deepu Rajan , Simon See

We introduce VisTA, a new reinforcement learning framework that empowers visual agents to dynamically explore, select, and combine tools from a diverse library based on empirical performance. Existing methods for tool-augmented reasoning…

计算机视觉与模式识别 · 计算机科学 2025-07-22 Zeyi Huang , Yuyang Ji , Anirudh Sundara Rajan , Zefan Cai , Wen Xiao , Haohan Wang , Junjie Hu , Yong Jae Lee

Tool-Integrated Reasoning (TIR) enables large language models (LLMs) to solve complex tasks by interacting with external tools, yet existing approaches depend on high-quality synthesized trajectories selected by scoring functions and sparse…

人工智能 · 计算机科学 2026-02-02 Siyu Gong , Linan Yue , Weibo Gao , Fangzhou Yao , Shimin Di , Lei Feng , Min-Ling Zhang

Users often omit essential details in their requests to LLM-based agents, resulting in under-specified inputs for tool use. This poses a fundamental challenge for tool-augmented agents, as API execution typically requires complete…

计算与语言 · 计算机科学 2026-04-21 Yejin Yoon , Minseo Kim , Taeuk Kim

To acquire a new skill, humans learn better and faster if a tutor, based on their current knowledge level, informs them of how much attention they should pay to particular content or practice problems. Similarly, a machine learning model…

机器学习 · 计算机科学 2021-06-18 Xinyi Wang , Hieu Pham , Paul Michel , Antonios Anastasopoulos , Jaime Carbonell , Graham Neubig

Large language models (LLMs) increasingly rely on multi-turn tool-integrated planning for knowledge-intensive and complex reasoning tasks. Existing implementations typically rely on a single agent, but they suffer from limited context…

计算与语言 · 计算机科学 2025-10-07 Zhanfeng Mo , Xingxuan Li , Yuntao Chen , Lidong Bing

In this paper we consider infinite horizon discounted dynamic programming problems with finite state and control spaces, partial state observations, and a multiagent structure. We discuss and compare algorithms that simultaneously or…

机器人学 · 计算机科学 2020-11-10 Sushmita Bhattacharya , Siva Kailas , Sahil Badyal , Stephanie Gil , Dimitri Bertsekas

Multi-agent trajectory data collected from domains such as team sports often suffer from missing values due to various factors. While many imputation methods have been proposed for spatiotemporal data, they are not well-suited for…

人工智能 · 计算机科学 2025-07-16 Han-Jun Choi , Hyunsung Kim , Minho Lee , Minchul Jeong , Chang-Jo Kim , Jinsung Yoon , Sang-Ki Ko

Multi-trait essay scoring aims to provide fine-grained evaluation of writing quality across multiple dimensions. However, how to effectively post-train autoregressive scoring models remains underexplored. In this paper, we propose…

计算与语言 · 计算机科学 2026-05-27 Zhengyang Wang , Sanwoo Lee , Jiaxin Wang , Chenxi Miao , Weikang Li , Yunfang Wu

Designing protocols enhancing cooperation for multi-agent systems remains a grand challenge. Cheap talk, defined as costless, non-binding communication before formal action, serves as a pivotal solution. However, existing theoretical…

多智能体系统 · 计算机科学 2026-03-03 Zhao Song , Chen Shen , Zhen Wang , The Anh Han

We present $\varepsilon$-retrain, an exploration strategy encouraging a behavioral preference while optimizing policies with monotonic improvement guarantees. To this end, we introduce an iterative procedure for collecting retrain areas --…

人工智能 · 计算机科学 2025-04-15 Luca Marzari , Priya L. Donti , Changliu Liu , Enrico Marchesini

Despite recent advances in AI, the development of systems capable of executing complex, multi-step reasoning tasks involving multiple tools remains a significant challenge. Current benchmarks fall short in capturing the real-world…

计算与语言 · 计算机科学 2025-01-03 Vaskar Nath , Pranav Raja , Claire Yoon , Sean Hendryx

Multimodal Large Language Models (MLLMs) are evolving from passive observers into active agents, solving problems through Visual Expansion (invoking visual tools) and Knowledge Expansion (open-web search). However, existing evaluations fall…

Training machine learning models inherently involves a resource-intensive and noisy iterative learning procedure that allows epoch-wise monitoring of the model performance. However, the insights gained from the iterative learning procedure…

机器学习 · 计算机科学 2025-05-22 Wenyu Wang , Zheyi Fan , Szu Hui Ng