English
Related papers

Related papers: An Adaptive Deep RL Method for Non-Stationary Envi…

200 papers

Real-world applications of contextual bandits often exhibit non-stationarity due to seasonality, serendipity, and evolving social trends. While a number of non-stationary contextual bandit learning algorithms have been proposed in the…

Machine Learning · Computer Science 2023-10-17 Zheqing Zhu , Yueyang Liu , Xu Kuang , Benjamin Van Roy

Contextual bandit algorithms are extremely popular and widely used in recommendation systems to provide online personalised recommendations. A recurrent assumption is the stationarity of the reward function, which is rather unrealistic in…

Machine Learning · Statistics 2020-04-29 Giuseppe Di Benedetto , Vito Bellini , Giovanni Zappella

We introduce DynaMITE-RL, a meta-reinforcement learning (meta-RL) approach to approximate inference in environments where the latent state evolves at varying rates. We model episode sessions - parts of the episode where the latent state is…

Machine Learning · Computer Science 2024-12-05 Anthony Liang , Guy Tennenholtz , Chih-wei Hsu , Yinlam Chow , Erdem Bıyık , Craig Boutilier

A hallmark of intelligence is the ability to adapt in non-stationary environments, yet deep Reinforcement Learning (RL) agents often struggle in such settings. Prior studies introduce non-stationarity through abrupt shifts in features or…

Machine Learning · Computer Science 2026-05-28 Raymond Chua , Doina Precup , Blake Richards

The widespread adoption of artificial intelligence (AI) in next-generation communication systems is challenged by the heterogeneity of traffic and network conditions, which call for the use of highly contextual, site-specific, data. A…

Signal Processing · Electrical Eng. & Systems 2025-06-27 Clement Ruah , Houssem Sifaou , Osvaldo Simeone , Bashir Al-Hashimi

Modern deep reinforcement learning (DRL) methods have made significant advances in handling continuous action spaces. However, real-world control systems, especially those requiring precise and reliable performance, often demand…

Machine Learning · Computer Science 2026-04-10 Xuyang Li , Romit Maulik

Reinforcement learning (RL) policies trained in simulation often suffer from severe performance degradation when deployed in real-world environments due to non-stationary dynamics. While Domain Randomization (DR) and meta-RL have been…

Machine Learning · Computer Science 2026-02-09 Aoi Yoshimura , Gouhei Tanaka

Action recognition and anticipation are key to the success of many computer vision applications. Existing methods can roughly be grouped into those that extract global, context-aware representations of the entire image or sequence, and…

Computer Vision and Pattern Recognition · Computer Science 2016-11-21 Mohammad Sadegh Aliakbarian , Fatemehsadat Saleh , Basura Fernando , Mathieu Salzmann , Lars Petersson , Lars Andersson

Contextual bandit algorithms are increasingly replacing non-adaptive A/B tests in e-commerce, healthcare, and policymaking because they can both improve outcomes for study participants and increase the chance of identifying good or even…

Machine Learning · Statistics 2021-06-02 Aurélien Bibaut , Antoine Chambaz , Maria Dimakopoulou , Nathan Kallus , Mark van der Laan

Dynamical systems theory has long provided a foundation for understanding evolving phenomena across scientific domains. Yet, the application of this theory to complex real-world systems remains challenging due to issues in mathematical…

Machine Learning · Computer Science 2024-11-05 Samuel A. Moore , Brian P. Mann , Boyuan Chen

Reinforcement learning (RL) is a technique to learn the control policy for an agent that interacts with a stochastic environment. In any given state, the agent takes some action, and the environment determines the probability distribution…

Machine Learning · Computer Science 2021-07-30 Gaurav Gupta , Chenzhong Yin , Jyotirmoy V. Deshmukh , Paul Bogdan

Efficient RGB-D semantic segmentation has received considerable attention in mobile robots, which plays a vital role in analyzing and recognizing environmental information. According to previous studies, depth information can provide…

Computer Vision and Pattern Recognition · Computer Science 2023-08-14 Yang Zhang , Chenyun Xiong , Junjie Liu , Xuhui Ye , Guodong Sun

6D object pose estimation has been a research topic in the field of computer vision and robotics. Many modern world applications like robot grasping, manipulation, autonomous navigation etc, require the correct pose of objects present in a…

Computer Vision and Pattern Recognition · Computer Science 2022-12-13 Ankit Kumar , Priya Shukla , Vandana Kushwaha , G. C. Nandi

Meta-gradient methods (Xu et al., 2018; Zahavy et al., 2020) offer a promising solution to the problem of hyperparameter selection and adaptation in non-stationary reinforcement learning problems. However, the properties of meta-gradients…

Machine Learning · Computer Science 2022-09-14 Jelena Luketina , Sebastian Flennerhag , Yannick Schroecker , David Abel , Tom Zahavy , Satinder Singh

Evolving data streams induce joint nonstationarity in continual semantic segmentation, where semantic classes, input distributions, and supervision availability change simultaneously over time. This setting reflects practical structured…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Prashant Pandey , Himanshu Kumar , Devineni Sri Venkatraya Chowdary , Brejesh Lall

The robust interpretation of 3D environments is crucial for human-robot collaboration (HRC) applications, where safety and operational efficiency are paramount. Semantic segmentation plays a key role in this context by enabling a precise…

Robotics · Computer Science 2025-06-12 Fatemeh Mohammadi Amin , Darwin G. Caldwell , Hans Wernher van de Venn

Domain adaptation methods aim to bridge the gap between datasets by enabling knowledge transfer across domains, reducing the need for additional expert annotations. However, many approaches struggle with reliability in the target domain, an…

Image and Video Processing · Electrical Eng. & Systems 2026-05-14 Arnaud Judge , Nicolas Duchateau , Thierry Judge , Roman A. Sandler , Joseph Z. Sokol , Christian Desrosiers , Olivier Bernard , Pierre-Marc Jodoin

We consider the finite-horizon offline reinforcement learning (RL) setting, and are motivated by the challenge of learning the policy at any step h in dynamic programming (DP) algorithms. To learn this, it is sufficient to evaluate the…

Machine Learning · Computer Science 2025-01-22 Sanath Kumar Krishnamurthy , Tanmay Gangwani , Sumeet Katariya , Branislav Kveton , Shrey Modi , Anshuka Rangi

We aim for domestic robots to perform long-term indoor service. Under the object-level scene dynamics induced by daily human activities, a robot needs to robustly localize itself in the environment subject to scene uncertainties. Previous…

Robotics · Computer Science 2022-09-13 Xiao Li , Yidong Du , Zhen Zeng , Odest Chadwicke Jenkins

This paper presents a fully unsupervised deep change detection approach for mobile robots with 3D LiDAR. In unstructured environments, it is infeasible to define a closed set of semantic classes. Instead, semantic segmentation is…

Robotics · Computer Science 2024-05-01 Alexander Krawciw , Jordy Sehn , Timothy D. Barfoot
‹ Prev 1 3 4 5 6 7 10 Next ›