English
Related papers

Related papers: An Adaptive Deep RL Method for Non-Stationary Envi…

200 papers

The deployment of machine learning models in safety-critical applications comes with the expectation that such models will perform well over a range of contexts (e.g., a vision model for classifying street signs should work in rural, city,…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Nathan Drenkow , Alvin Tan , Chace Ashcraft , Kiran Karra

We consider the problem of learning from training data obtained in different contexts, where the underlying context distribution is unknown and is estimated empirically. We develop a robust method that takes into account the uncertainty of…

Machine Learning · Statistics 2022-02-18 Muhammad Osama , Dave Zachariah , Petre Stoica

Context, the embedding of previous collected trajectories, is a powerful construct for Meta-Reinforcement Learning (Meta-RL) algorithms. By conditioning on an effective context, Meta-RL policies can easily generalize to new tasks within a…

Machine Learning · Computer Science 2020-12-16 Haotian Fu , Hongyao Tang , Jianye Hao , Chen Chen , Xidong Feng , Dong Li , Wulong Liu

Reinforcement Learning (RL) is an area of growing interest in the field of artificial intelligence due to its many notable applications in diverse fields. Particularly within the context of intelligent vehicle control, RL has made…

Machine Learning · Computer Science 2023-11-07 Rafael Pina , Corentin Artaud , Xiaolan Liu , Varuna De Silva

As Large Language Models (LLMs) are increasingly deployed in real-world settings, correctness alone is insufficient. Reliable deployment requires maintaining truthful beliefs under contextual perturbations. Existing evaluations largely rely…

Computation and Language · Computer Science 2026-04-08 Haoming Xu , Ningyuan Zhao , Yunzhi Yao , Weihong Xu , Hongru Wang , Xinle Deng , Shumin Deng , Jeff Z. Pan , Huajun Chen , Ningyu Zhang

Safe deployment of autonomous robots in diverse scenarios requires agents that are capable of efficiently adapting to new environments while satisfying constraints. In this work, we propose a practical and theoretically-justified approach…

Robotics · Computer Science 2022-02-17 Thomas Lew , Apoorva Sharma , James Harrison , Andrew Bylard , Marco Pavone

Most reinforcement learning (RL) methods only focus on learning a single task from scratch and are not able to use prior knowledge to learn other tasks more effectively. Context-based meta RL techniques are recently proposed as a possible…

Machine Learning · Computer Science 2022-08-01 Xu Han , Feng Wu

Application for semantic segmentation models in areas such as autonomous vehicles and human computer interaction require real-time predictive capabilities. The challenges of addressing real-time application is amplified by the need to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Ethan Goan , Clinton Fookes

The ability to reason about changes in the environment is crucial for robots operating over extended periods of time. Agents are expected to capture changes during operation so that actions can be followed to ensure a smooth progression of…

Robotics · Computer Science 2022-08-02 Jiahui Fu , Yilun Du , Kurran Singh , Joshua B. Tenenbaum , John J. Leonard

In meta-learning and its downstream tasks, many methods rely on implicit adaptation to task variations, where multiple factors are mixed together in a single entangled representation. This makes it difficult to interpret which factors drive…

Robotics · Computer Science 2025-09-03 Seonsoo Kim , Jun-Gill Kang , Taehong Kim , Seongil Hong

Modeling car-following behavior is fundamental to microscopic traffic simulation, yet traditional deterministic models often fail to capture the full extent of variability and unpredictability in human driving. While many modern approaches…

Applications · Statistics 2026-01-30 Chengyuan Zhang , Zhengbing He , Cathy Wu , Lijun Sun

Neural processes (NPs) aim to stochastically complete unseen data points based on a given context dataset. NPs essentially leverage a given dataset as a context representation to derive a suitable identifier for a novel task. To improve the…

Machine Learning · Computer Science 2022-04-13 Mingyu Kim , Kyeongryeol Go , Se-Young Yun

We propose a principle for exploring context in machine learning models. Starting with a simple assumption that each observation may or may not depend on its context, a conditional probability distribution is decomposed into two parts:…

Machine Learning · Computer Science 2019-01-23 Yun Zeng

Large language models (LLMs) have achieved remarkable success in text-based tasks but often struggle to provide actionable guidance in real-world physical environments. This is because of their inability to recognize their limited…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Muhammad Saif Ullah Khan , Muhammad Zeshan Afzal , Didier Stricker

Graph-based convolutional model such as non-local block has shown to be effective for strengthening the context modeling ability in convolutional neural networks (CNNs). However, its pixel-wise computational overhead is prohibitive which…

Computer Vision and Pattern Recognition · Computer Science 2021-09-01 Xiangtai Li , Xia Li , Ansheng You , Li Zhang , Guangliang Cheng , Kuiyuan Yang , Yunhai Tong , Zhouchen Lin

Semantic segmentation networks are usually pre-trained once and not updated during deployment. As a consequence, misclassifications commonly occur if the distribution of the training data deviates from the one encountered during the robot's…

Robotics · Computer Science 2023-02-15 Jonas Frey , Hermann Blum , Francesco Milano , Roland Siegwart , Cesar Cadena

Deep reinforcement learning (DRL) has achieved remarkable success across multiple domains, including competitive games, natural language processing, and robotics. Despite these advancements, policies trained via DRL often struggle to…

Machine Learning · Computer Science 2025-12-30 James Chapman , Kedar Karhadkar , Guido Montufar

In this work we present a novel end-to-end framework for tracking and classifying a robot's surroundings in complex, dynamic and only partially observable real-world environments. The approach deploys a recurrent neural network to filter an…

Machine Learning · Computer Science 2016-04-20 Peter Ondruska , Julie Dequaire , Dominic Zeng Wang , Ingmar Posner

Understanding environment dynamics is necessary for robots to act safely and optimally in the world. In realistic scenarios, dynamics are non-stationary and the causal variables such as environment parameters cannot necessarily be precisely…

Robotics · Computer Science 2022-03-11 Ben Evans , Abitha Thankaraj , Lerrel Pinto

Humans can perform complex tasks with long-term objectives by planning, reasoning, and forecasting outcomes of actions. For embodied agents to achieve similar capabilities, they must gain knowledge of the environment transferable to novel…

Machine Learning · Computer Science 2024-10-01 Shu Ishida