English
Related papers

Related papers: Iterative Tool Usage Exploration for Multimodal Ag…

200 papers

Multimodal scene search of conversations is essential for unlocking valuable insights into social dynamics and enhancing our communication. While experts in conversational analysis have their own knowledge and skills to find key scenes, a…

Human-Computer Interaction · Computer Science 2024-02-20 Riku Arakawa , Kiyosu Maeda , Hiromu Yakura

Training multimodal agents via reinforcement learning for knowledge-intensive visual reasoning is fundamentally hindered by the extreme sparsity of outcome-based supervision and the unpredictability of live web environments. To resolve…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Wentao Yan , Shengqin Wang , Huichi Zhou , Yihang Chen , Kun Shao , Yuan Xie , Zhizhong Zhang

Current multimodal large language models (MLLMs) struggle with fine-grained or precise understanding of visuals although they give comprehensive perception and reasoning in a spectrum of vision applications. Recent studies either develop…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Ziang Yan , Zhilin Li , Yinan He , Chenting Wang , Kunchang Li , Xinhao Li , Xiangyu Zeng , Zilei Wang , Yali Wang , Yu Qiao , Limin Wang , Yi Wang

Strategic classification studies the problem where self-interested individuals or agents manipulate their response to obtain favorable decision outcomes made by classifiers, typically turning to dishonest actions when they are less costly…

Machine Learning · Computer Science 2026-05-07 Ziyuan Huang , Lina Alkarmi , Mingyan Liu

Recent advancements in agentic test-time scaling allow models to gather environmental feedback before committing to final actions. A key limitation of existing methods is that they typically employ undifferentiated exploration strategies,…

Artificial Intelligence · Computer Science 2026-05-13 Xingyuan Hua , Sheng Yue , Ju Ren

Multi-step dexterous manipulation is a fundamental skill in household scenarios, yet remains an underexplored area in robotics. This paper proposes a modular approach, where each step of the manipulation process is addressed with dedicated…

We introduce a novel large language model (LLM)-driven agent framework, which iteratively refines queries and filters contextual evidence by leveraging dynamically evolving knowledge. A defining feature of the system is its decoupling of…

Artificial Intelligence · Computer Science 2025-04-02 Seyoung Song

Researchers have been studying approaches to steer the behavior of Large Language Models (LLMs) and build personalized LLMs tailored for various applications. While fine-tuning seems to be a direct solution, it requires substantial…

Computation and Language · Computer Science 2024-07-31 Yuanpu Cao , Tianrong Zhang , Bochuan Cao , Ziyi Yin , Lu Lin , Fenglong Ma , Jinghui Chen

Developing a generalist agent is a longstanding objective in artificial intelligence. Previous efforts utilizing extensive offline datasets from various tasks demonstrate remarkable performance in multitasking scenarios within Reinforcement…

Artificial Intelligence · Computer Science 2024-11-19 Yonggang Jin , Ge Zhang , Hao Zhao , Tianyu Zheng , Jarvi Guo , Liuyu Xiang , Shawn Yue , Stephen W. Huang , Zhaofeng He , Jie Fu

An important feature of pervasive, intelligent assistance systems is the ability to dynamically adapt to the current needs of their users. Hence, it is critical for such systems to be able to recognize those goals and needs based on…

Artificial Intelligence · Computer Science 2023-01-16 Nils Wilken , Lea Cohausz , Johannes Schaum , Stefan Lüdtke , Heiner Stuckenschmidt

Autonomous multi-agent systems such as hospital robots and package delivery drones often operate in highly uncertain environments and are expected to achieve complex temporal task objectives while ensuring safety. While learning-based…

Multiagent Systems · Computer Science 2024-11-19 Sheryl Paul , Anand Balakrishnan , Xin Qin , Jyotirmoy V. Deshmukh

The level of challenge in stroke rehabilitation has to be carefully chosen to keep the patient engaged and motivated while not frustrating them. This paper presents a simulation where this level of challenge is automatically optimized using…

Systems and Control · Electrical Eng. & Systems 2021-06-08 Sandra-Carina Noble , Tomas Ward , John V. Ringwood

Prompt-based learning has been demonstrated as a compelling paradigm contributing to large language models' tremendous success (LLMs). Inspired by their success in language tasks, existing research has leveraged LLMs in embodied instruction…

As machine learning permeates more industries and models become more expensive and time consuming to train, the need for efficient automated hyperparameter optimization (HPO) has never been more pressing. Multi-step planning based…

Machine Learning · Computer Science 2022-11-18 Lucio M. Dery , Abram L. Friesen , Nando De Freitas , Marc'Aurelio Ranzato , Yutian Chen

Understanding human perceptions presents a formidable multimodal challenge for computers, encompassing aspects such as sentiment tendencies and sense of humor. While various methods have recently been introduced to extract…

Multimedia · Computer Science 2023-11-21 Hao Sun , Ziwei Niu , Xinyao Yu , Jiaqing Liu , Yen-Wei Chen , Lanfen Lin

When deploying autonomous agents in the real world, we need effective ways of communicating objectives to them. Traditional skill learning has revolved around reinforcement and imitation learning, each with rigid constraints on the format…

Artificial Intelligence · Computer Science 2019-11-21 Mark Woodward , Chelsea Finn , Karol Hausman

Loco-manipulation planning skills are pivotal for expanding the utility of robots in everyday environments. These skills can be assessed based on a system's ability to coordinate complex holistic movements and multiple contact interactions…

Robotics · Computer Science 2023-08-21 Jean-Pierre Sleiman , Farbod Farshidian , Marco Hutter

Instruction tuning has emerged as a critical paradigm for improving the capabilities and alignment of large language models (LLMs). However, existing iterative model-aware data selection methods incur significant computational overhead, as…

Machine Learning · Computer Science 2025-05-13 Xiaotian Lin , Yanlin Qi , Yizhang Zhu , Themis Palpanas , Chengliang Chai , Nan Tang , Yuyu Luo

Trajectory prediction is an essential step in the pipeline of an autonomous vehicle. Inaccurate or inconsistent predictions regarding the movement of agents in its surroundings lead to poorly planned maneuvers and potentially dangerous…

Machine Learning · Computer Science 2025-07-04 Caio Azevedo , Lina Achaji , Stefano Sabatini , Nicola Poerio , Grzegorz Bartyzel , Sascha Hornauer , Fabien Moutarde

Smart assistants increasingly act proactively, yet mistimed or intrusive behavior often causes users to lose trust and disable these features. Learning user preferences for proactive assistance is difficult because real-world studies are…

Human-Computer Interaction · Computer Science 2026-02-05 Ziyi Xuan , Yiwen Wu , Zhaoyang Yan , Vinod Namboodiri , Yu Yang