English
Related papers

Related papers: Investigate-Consolidate-Exploit: A General Strateg…

200 papers

Reinforcement learning (RL) is a promising approach for robotic navigation, allowing robots to learn through trial and error. However, real-world robotic tasks often suffer from sparse rewards, leading to inefficient exploration and…

Existing multi-strategy adaptive differential evolution (DE) commonly involves trials of multiple strategies and then rewards better-performing ones with more resources. However, the trials of an exploitative or explorative strategy may…

Neural and Evolutionary Computing · Computer Science 2021-12-03 Sheng Xin Zhang , Wing Shing Chan , Kit Sang Tang , Shao Yong Zheng

The automation of scientific discovery represents a critical milestone in Artificial Intelligence (AI) research. However, existing agentic systems for science suffer from two fundamental limitations: rigid, pre-programmed workflows that…

Artificial Intelligence · Computer Science 2025-10-20 Ed Li , Junyu Ren , Xintian Pan , Cat Yan , Chuanhao Li , Dirk Bergemann , Zhuoran Yang

Current AI agents can flexibly invoke tools and execute complex tasks, yet their long-term advancement is hindered by the lack of systematic accumulation and transfer of skills. Without a unified mechanism for skill consolidation, agents…

The integration of Artificial Intelligence (AI) into Integrated Development Environments (IDEs) is reshaping software development, fundamentally altering how developers interact with their tools. This shift marks the emergence of Human-AI…

Software Engineering · Computer Science 2026-01-16 Agnia Sergeyuk , Ilya Zakharov , Ekaterina Koshchenko , Maliheh Izadi

This paper presents novel Gaussian process decentralized data fusion algorithms exploiting the notion of agent-centric support sets for distributed cooperative perception of large-scale environmental phenomena. To overcome the limitations…

Machine Learning · Statistics 2017-11-17 Ruofei Ouyang , Kian Hsiang Low

Existing value-based online reinforcement learning (RL) algorithms suffer from slow policy exploitation due to ineffective exploration and delayed policy updates. To address these challenges, we propose an algorithm called Instant…

Machine Learning · Computer Science 2026-02-18 Gong Gao , Weidong Zhao , Xianhui Liu , Ning Jia

We introduce Terra Nova, a new comprehensive challenge environment (CCE) for reinforcement learning (RL) research inspired by Civilization V. A CCE is a single environment in which multiple canonical RL challenges (e.g., partial…

Artificial Intelligence · Computer Science 2025-11-20 Trevor McInroe

There are many applications where users seek to explore the impact of the settings of several categorical variables with respect to one dependent numerical variable. For example, a computer systems analyst might want to study how the type…

Graphics · Computer Science 2020-03-03 Anjul Tyagi , Zhen Cao , Tyler Estro , Erez Zadok , Klaus Mueller

We argue that a key challenge in enabling usable and useful interactive task learning for intelligent agents is to facilitate effective Human-AI collaboration. We reflect on our past 5 years of efforts on designing, developing and studying…

Human-Computer Interaction · Computer Science 2020-03-06 Toby Jia-Jun Li , Jingya Chen , Tom M. Mitchell , Brad A. Myers

The development of Multimodal Virtual Agents has made significant progress through the integration of Multimodal Large Language Models. However, mainstream training paradigms face key challenges: Behavior Cloning is simple and effective…

Machine Learning · Computer Science 2026-01-06 Keyu Wang , Bingchen Miao , Wendong Bu , Yu Wu , Juncheng Li , Shengyu Zhang , Wenqiao Zhang , Siliang Tang , Jun Xiao , Yueting Zhuang

LLM-empowered multi-agent systems offer new potential to accelerate scientific discovery by generating novel research ideas. However, existing methods typically coordinate agents through temporary texts, such as drafts or chat logs; it is…

Multiagent Systems · Computer Science 2026-05-07 Jiangwen Dong , Bo Li , Wanyu Lin

Common approaches for task-agnostic exploration learn tabula-rasa --the agent assumes isolated environments and no prior knowledge or experience. However, in the real world, agents learn in many environments and always come with prior…

Machine Learning · Computer Science 2021-11-29 Simone Parisi , Victoria Dean , Deepak Pathak , Abhinav Gupta

In this paper, we examine cloud-edge-terminal IoT networks, where edges undertake a range of typical dynamic scheduling tasks. In these IoT networks, a central policy for each task can be constructed at a cloud server. The central policy…

Machine Learning · Computer Science 2023-07-04 Do-Yup Kim , Da-Eun Lee , Ji-Wan Kim , Hyun-Suk Lee

External knowledge has played a crucial role in the recent development of computer use agents. We identify a critical knowledge-execution gap: retrieved knowledge often fails to translate into effective real-world task execution. Our…

Human-Computer Interaction · Computer Science 2025-11-04 Ziyun Zhang , Xinyi Liu , Xiaoyi Zhang , Jun Wang , Gang Chen , Yan Lu

Tool-using agents that act in the world need to be both useful and safe. Well-calibrated model confidences can be used to weigh the risk versus reward of potential actions, but prior work shows that many models are poorly calibrated.…

Computation and Language · Computer Science 2025-04-30 Nishant Subramani , Jason Eisner , Justin Svegliato , Benjamin Van Durme , Yu Su , Sam Thomson

We consider the development of adaptive, instance-dependent algorithms for interactive decision making (bandits, reinforcement learning, and beyond) that, rather than only performing well in the worst case, adapt to favorable properties of…

Machine Learning · Computer Science 2023-04-26 Andrew Wagenmaker , Dylan J. Foster

One effective approach for equipping artificial agents with sensorimotor skills is to use self-exploration. To do this efficiently is critical, as time and data collection are costly. In this study, we propose an exploration mechanism that…

Robotics · Computer Science 2021-02-18 Melisa Sener , Yukie Nagai , Erhan Oztop , Emre Ugur

Information extraction (IE) has been studied extensively. The existing methods always follow a fixed extraction order for complex IE tasks with multiple elements to be extracted in one instance such as event extraction. However, we conduct…

Computation and Language · Computer Science 2024-03-26 Wenhao Huang , Jiaqing Liang , Zhixu Li , Yanghua Xiao , Chuanjun Ji

While robot learning has demonstrated promising results for enabling robots to automatically acquire new skills, a critical challenge in deploying learning-based systems is scale: acquiring enough data for the robot to effectively…