English
Related papers

Related papers: Meta-World Conditional Neural Processes

200 papers

Designing an effective communication mechanism among agents in reinforcement learning has been a challenging task, especially for real-world applications. The number of agents can grow or an environment sometimes needs to interact with a…

Machine Learning · Computer Science 2022-02-01 Wei-Cheng Tseng , Wei Wei , Da-Cheng Juan , Min Sun

While conventional reinforcement learning focuses on designing agents that can perform one task, meta-learning aims, instead, to solve the problem of designing agents that can generalize to different tasks (e.g., environments, obstacles,…

Machine Learning · Computer Science 2021-09-06 Xiaowu Sun , Wael Fatnassi , Ulices Santa Cruz , Yasser Shoukry

The advances in unsupervised object-centric representation learning have significantly improved its application to downstream tasks. Recent works highlight that disentangled object representations can aid policy learning in image-based,…

Artificial Intelligence · Computer Science 2025-03-21 Leonid Ugadiarov , Vitaliy Vorobyov , Aleksandr I. Panov

Reinforcement Learning (RL) environments can produce training data with spurious correlations between features due to the amount of training data or its limited feature coverage. This can lead to RL agents encoding these misleading…

Machine Learning · Computer Science 2023-10-13 Mhairi Dunion , Trevor McInroe , Kevin Sebastian Luck , Josiah P. Hanna , Stefano V. Albrecht

Conditional Neural Processes~(CNPs) formulate distributions over functions and generate function observations with exact conditional likelihoods. CNPs, however, have limited expressivity for high-dimensional observations, since their…

Machine Learning · Computer Science 2023-03-24 Zesheng Ye , Jing Du , Lina Yao

Meta-reinforcement learning (meta-RL) is a promising framework for tackling challenging domains requiring efficient exploration. Existing meta-RL algorithms are characterized by low sample efficiency, and mostly focus on low-dimensional…

Machine Learning · Computer Science 2024-03-18 Zohar Rimon , Tom Jurgenson , Orr Krupnik , Gilad Adler , Aviv Tamar

With the rapid advancement of autonomous driving technology, a lack of data has become a major obstacle to enhancing perception model accuracy. Researchers are now exploring controllable data generation using world models to diversify…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Xinqing Li , Ruiqi Song , Qingyu Xie , Ye Wu , Nanxin Zeng , Yunfeng Ai

Meta-Reinforcement Learning (Meta-RL) aims to acquire meta-knowledge for quick adaptation to diverse tasks. However, applying these policies in real-world environments presents a significant challenge in balancing rapid adaptability with…

Machine Learning · Computer Science 2024-06-21 Karam Daaboul , Florian Kuhm , Tim Joseph , J. Marius Zoellner

Neural Processes (NPs) are popular methods in meta-learning that can estimate predictive uncertainty on target datapoints by conditioning on a context dataset. Previous state-of-the-art method Transformer Neural Processes (TNPs) achieve…

Machine Learning · Computer Science 2023-03-03 Leo Feng , Hossein Hajimirsadeghi , Yoshua Bengio , Mohamed Osama Ahmed

Web agents based on large language models have demonstrated promising capability in automating web tasks. However, current web agents struggle to reason out sensible actions due to the limitations of predicting environment changes, and…

Artificial Intelligence · Computer Science 2026-02-18 Zhouzhou Shen , Xueyu Hu , Xiyun Li , Tianqing Fang , Juncheng Li , Shengyu Zhang

Open-world novelty--a sudden change in the mechanics or properties of an environment--is a common occurrence in the real world. Novelty adaptation is an agent's ability to improve its policy performance post-novelty. Most reinforcement…

Artificial Intelligence · Computer Science 2023-01-18 Jonathan Balloch , Zhiyu Lin , Robert Wright , Xiangyu Peng , Mustafa Hussain , Aarun Srinivas , Julia Kim , Mark O. Riedl

The consequences of complex disturbed environments in the vicinity of a supermassive black hole are not well represented by standard statistical models of optical variability in active galactic nuclei (AGN). Thus, developing new…

We present the group equivariant conditional neural process (EquivCNP), a meta-learning method with permutation invariance in a data set as in conventional conditional neural processes (CNPs), and it also has transformation equivariance in…

Machine Learning · Computer Science 2021-02-18 Makoto Kawano , Wataru Kumagai , Akiyoshi Sannai , Yusuke Iwasawa , Yutaka Matsuo

Generative world models (WMs) can now simulate worlds with striking visual realism, which naturally raises the question of whether they can endow embodied agents with predictive perception for decision making. Progress on this question has…

Although reinforcement learning methods can achieve impressive results in simulation, the real world presents two major challenges: generating samples is exceedingly expensive, and unexpected perturbations or unseen situations cause…

Machine Learning · Computer Science 2019-03-01 Anusha Nagabandi , Ignasi Clavera , Simin Liu , Ronald S. Fearing , Pieter Abbeel , Sergey Levine , Chelsea Finn

The goal of meta-learning is to generalize to new tasks and goals as quickly as possible. Ideally, we would like approaches that generalize to new goals and tasks on the first attempt. Toward that end, we introduce contextual planning…

Robotics · Computer Science 2021-11-22 Corban G. Rivera , David A Handelman

The scarcity of labeled action data poses a considerable challenge for developing machine learning algorithms for robotic object manipulation. It is expensive and often infeasible for a robot to interact with many objects. Conversely,…

Robotics · Computer Science 2024-12-03 Emily Liu , Michael Noseworthy , Nicholas Roy

Learning cooperative multi-agent policies directly from high-dimensional, multimodal sensory inputs like pixels and audio (from pixels) is notoriously sample-inefficient. Model-free Multi-Agent Reinforcement Learning (MARL) algorithms…

Multiagent Systems · Computer Science 2025-11-12 Sureyya Akin , Kavita Srivastava , Prateek B. Kapoor , Pradeep G. Sethi , Sunita Q. Patel , Rahu Srivastava

Real-world time series often exhibit complex interdependencies that cannot be captured in isolation. Global models that model past data from multiple related time series globally while producing series-specific forecasts locally are now…

Machine Learning · Computer Science 2024-05-14 Abishek Sriramulu , Christoph Bergmeir , Slawek Smyl

World modelling, i.e. building a representation of the rules that govern the world so as to predict its evolution, is an essential ability for any agent interacting with the physical world. Despite their impressive performance, many…

Machine Learning · Computer Science 2025-05-06 Francesco Petri , Luigi Asprino , Aldo Gangemi