English
Related papers

Related papers: An Adaptive Deep RL Method for Non-Stationary Envi…

200 papers

Real-world time series often exhibit complex interdependencies that cannot be captured in isolation. Global models that model past data from multiple related time series globally while producing series-specific forecasts locally are now…

Machine Learning · Computer Science 2024-05-14 Abishek Sriramulu , Christoph Bergmeir , Slawek Smyl

Object-centric world models provide structured representation of the scene and can be an important backbone in reinforcement learning and planning. However, existing approaches suffer in partially-observable environments due to the lack of…

Machine Learning · Computer Science 2021-07-20 Gautam Singh , Skand Peri , Junghyun Kim , Hyunseok Kim , Sungjin Ahn

Learning to reliably perceive and understand the scene is an integral enabler for robots to operate in the real-world. This problem is inherently challenging due to the multitude of object types as well as appearance changes caused by…

Computer Vision and Pattern Recognition · Computer Science 2021-11-05 Abhinav Valada , Rohit Mohan , Wolfram Burgard

As Large Language Models (LLMs) can now process extremely long contexts, efficient inference over these extended inputs has become increasingly important, especially for emerging applications like LLM agents that highly depend on this…

Computation and Language · Computer Science 2026-04-09 Penghui Yang , Cunxiao Du , Fengzhuo Zhang , Haonan Wang , Tianyu Pang , Chao Du , Bo An

Unsupervised representation learning has succeeded with excellent results in many applications. It is an especially powerful tool to learn a good representation of environments with partial or noisy observations. In partially observable…

Machine Learning · Computer Science 2019-08-20 Zhaohan Daniel Guo , Mohammad Gheshlaghi Azar , Bilal Piot , Bernardo A. Pires , Rémi Munos

Retrieval-augmented generation (RAG) over long documents typically involves splitting the text into smaller chunks, which serve as the basic units for retrieval. However, due to dependencies across the original document, contextual…

Computation and Language · Computer Science 2026-04-22 Junjie Wu , Jiangnan Li , Yuqing Li , Lemao Liu , Liyan Xu , Jiwei Li , Dit-Yan Yeung , Jie Zhou , Mo Yu

Although legged robots demonstrate impressive mobility on rough terrain, using them safely in cluttered environments remains a challenge. A key issue is their inability to avoid stepping on low-lying objects, such as high-cost small devices…

Robotics · Computer Science 2026-04-07 Denan Liang , Yuan Zhu , Ruimeng Liu , Thien-Minh Nguyen , Shenghai Yuan , Lihua Xie

There has been growing interests in recent years from both practical and research perspectives for session-based recommendation tasks as long-term user profiles do not often exist in many real-life recommendation applications. In this case,…

Information Retrieval · Computer Science 2018-06-12 Fei Mi , Boi Faltings

Adaptation of semantic segmentation networks to different visual conditions is vital for robust perception in autonomous cars and robots. However, previous work has shown that most feature-level adaptation methods, which employ adversarial…

Computer Vision and Pattern Recognition · Computer Science 2025-01-23 Christos Sakaridis , David Bruggemann , Fisher Yu , Luc Van Gool

Long-horizon reinforcement learning (RL) for large language models faces critical scalability challenges from unbounded context growth, leading to context folding methods that compress interaction history during task execution. However,…

Machine Learning · Computer Science 2025-12-30 Jiaqi Shao , Yufeng Miao , Wei Zhang , Bing Luo

Building general-purpose reasoning models with reinforcement learning (RL) entails substantial cross-domain heterogeneity, including large variation in inference-time response lengths and verification latency. Such variability complicates…

Autonomous Vehicle (AV) decision making in urban environments is inherently challenging due to the dynamic interactions with surrounding vehicles. For safe planning, AV must understand the weightage of various spatiotemporal interactions in…

Artificial Intelligence · Computer Science 2024-10-01 Jayabrata Chowdhury , Venkataramanan Shivaraman , Sumit Dangi , Suresh Sundaram , P. B. Sujit

Effectively controlling systems governed by Partial Differential Equations (PDEs) is crucial in several fields of Applied Sciences and Engineering. These systems usually yield significant challenges to conventional control schemes due to…

Machine Learning · Computer Science 2024-11-07 Florian Wolf , Nicolò Botteghi , Urban Fasel , Andrea Manzoni

Dealing with non-stationarity in environments (e.g., in the transition dynamics) and objectives (e.g., in the reward functions) is a challenging problem that is crucial in real-world applications of reinforcement learning (RL). While most…

Machine Learning · Computer Science 2022-10-19 Fan Feng , Biwei Huang , Kun Zhang , Sara Magliacane

Safely exploring an unknown dynamical system is critical to the deployment of reinforcement learning (RL) in physical systems where failures may have catastrophic consequences. In scenarios where one knows little about the dynamics, diverse…

Machine Learning · Computer Science 2017-12-01 Tyler Lu , Martin Zinkevich , Craig Boutilier , Binz Roy , Dale Schuurmans

Localization is an essential task for mobile autonomous robotic systems that want to use pre-existing maps or create new ones in the context of SLAM. Today, many robotic platforms are equipped with high-accuracy 3D LiDAR sensors, which…

Deep reinforcement learning is used in various domains, but usually under the assumption that the environment has stationary conditions like transitions and state distributions. When this assumption is not met, performance suffers. For this…

Machine Learning · Computer Science 2024-05-24 Zihe Liu , Jie Lu , Guangquan Zhang , Junyu Xuan

We describe a contextual parser for the Robot Commands Treebank, a new crowdsourced resource. In contrast to previous semantic parsers that select the most-probable parse, we consider the different problem of parsing using additional…

Computation and Language · Computer Science 2014-05-02 Kais Dukes

State-of-the-art models for semantic segmentation are based on adaptations of convolutional networks that had originally been designed for image classification. However, dense prediction and image classification are structurally different.…

Computer Vision and Pattern Recognition · Computer Science 2016-05-03 Fisher Yu , Vladlen Koltun

Generating context-adaptive manipulation and grasping actions is a challenging problem in robotics. Classical planning and control algorithms tend to be inflexible with regard to parameterization by external variables such as object shapes.…

Robotics · Computer Science 2024-11-01 Tim R. Winter , Ashok M. Sundaram , Werner Friedl , Maximo A. Roa , Freek Stulp , João Silvério