English
Related papers

Related papers: A Loss Landscape Visualization Framework for Inter…

200 papers

Deploying reinforcement learning policies in the real world requires adapting to time-varying environments. We study this problem in the contextual Markov Decision Process (cMDP) framework, where a family of environments is indexed by a…

Machine Learning · Computer Science 2026-05-04 Param Budhraja , Aditya Gangrade , Alex Olshevsky , Venkatesh Saligrama

This paper addresses the challenge of active perception within autonomous navigation in complex, unknown environments. Revisiting the foundational principles of active perception, we introduce an end-to-end reinforcement learning framework…

Robotics · Computer Science 2026-02-03 Grzegorz Malczyk , Mihir Kulkarni , Kostas Alexis

The symmetry of dynamical systems can be exploited for state-transition prediction and to facilitate control policy optimization. This paper leverages system symmetry to develop sample-efficient offline reinforcement learning (RL)…

Machine Learning · Computer Science 2026-05-06 Yifei Li , Erik-Jan van Kampen

We consider offline Reinforcement Learning (RL), where the agent does not interact with the environment and must rely on offline data collected using a behavior policy. Previous works provide policy evaluation guarantees when the target…

Machine Learning · Computer Science 2023-05-26 Xumei Xi , Christina Lee Yu , Yudong Chen

We describe an approximate dynamic programming (ADP) approach to compute approximations of the optimal strategies and of the minimal losses that can be guaranteed in discounted repeated games with vector-valued losses. Such games…

Computer Science and Game Theory · Computer Science 2020-10-27 Vijay Kamble , Patrick Loiseau , Jean Walrand

We present dGrasp, an implicit grasp policy with an enhanced optimization landscape. This landscape is defined by a NeRF-informed grasp value function. The neural network representing this function is trained on simulated grasp…

Robotics · Computer Science 2024-10-25 Gergely Sóti , Xi Huang , Christian Wurll , Björn Hein

Humanoid locomotion is a challenging task due to its inherent complexity and high-dimensional dynamics, as well as the need to adapt to diverse and unpredictable environments. In this work, we introduce a novel learning framework for…

Robotics · Computer Science 2025-10-16 Hyunyoung Jung , Zhaoyuan Gu , Ye Zhao , Hae-Won Park , Sehoon Ha

The emergence of truck-drone collaborative systems in last-mile logistics has positioned the Traveling Salesman Problem with Drones (TSP-D) as a pivotal extension of classical routing optimization, where synchronized vehicle coordination…

Machine Learning · Computer Science 2025-11-10 Taihelong Zeng , Yun Lin , Yuhe Shi , Yan Li , Zhiqing Wei , Xuanru Ji

In order to successfully perform tasks specified by natural language instructions, an artificial agent operating in a visual world needs to map words, concepts, and actions from the instruction to visual elements in its environment. This…

Computer Vision and Pattern Recognition · Computer Science 2019-10-15 Soumik Dasgupta , Badri N. Patro , Vinay P. Namboodiri

In this paper, we propose actor-director-critic, a new framework for deep reinforcement learning. Compared with the actor-critic framework, the director role is added, and action classification and action evaluation are applied…

Machine Learning · Computer Science 2023-01-11 Zongwei Liu , Yonghong Song , Yuanlin Zhang

In this paper, a novel mechanism-driven reinforcement learning framework is proposed for airfoil shape optimization. To validate the framework, a reward function is designed and analyzed, from which the equivalence between the maximizing…

Numerical Analysis · Mathematics 2024-05-28 Jingfeng Wang , Guanghui Hu

Recent analyses of certain gradient descent optimization methods have shown that performance can degrade in some settings - such as with stochasticity or implicit momentum. In deep reinforcement learning (Deep RL), such optimization methods…

Machine Learning · Computer Science 2018-10-08 Peter Henderson , Joshua Romoff , Joelle Pineau

Creating an intelligent conversational system that understands vision and language is one of the ultimate goals in Artificial Intelligence (AI)~\cite{winograd1972understanding}. Extensive research has focused on vision-to-language…

Computation and Language · Computer Science 2018-05-10 Jiaping Zhang , Tiancheng Zhao , Zhou Yu

In reinforcement learning algorithms, leveraging multiple views of the environment can improve the learning of complicated policies. In multi-view environments, due to the fact that the views may frequently suffer from partial…

Machine Learning · Computer Science 2019-07-24 Elaheh Barati , Xuewen Chen

Understanding the interactions of agents trained with deep reinforcement learning is crucial for deploying agents in games or the real world. In the former, unreasonable actions confuse players. In the latter, that effect is even more…

Artificial Intelligence · Computer Science 2023-09-08 Manuel Eberhardinger , Johannes Maucher , Setareh Maghsudi

Reinforcement learning (RL) policies deployed in safety-critical systems, such as unmanned aerial vehicle (UAV) navigation in dynamic airspace, are vulnerable to out-ofdistribution (OOD) adversarial attacks in the observation space. These…

Machine Learning · Computer Science 2025-06-27 Deepak Kumar Panda , Adolfo Perrusquia , Weisi Guo

Motion planning is an essential component in most of today's robotic applications. In this work, we consider the learning setting, where a set of solved motion planning problems is used to improve the efficiency of motion planning on…

Robotics · Computer Science 2019-06-04 Tom Jurgenson , Aviv Tamar

Entropy regularization is commonly used to improve policy optimization in reinforcement learning. It is believed to help with \emph{exploration} by encouraging the selection of more stochastic policies. In this work, we analyze this claim…

Machine Learning · Computer Science 2019-06-11 Zafarali Ahmed , Nicolas Le Roux , Mohammad Norouzi , Dale Schuurmans

Optimization of non-convex loss surfaces containing many local minima remains a critical problem in a variety of domains, including operations research, informatics, and material design. Yet, current techniques either require extremely high…

Machine Learning · Computer Science 2021-07-21 Amil Merchant , Luke Metz , Sam Schoenholz , Ekin Dogus Cubuk

Unmanned Combat Aerial Vehicle (UCAV) Within-Visual-Range (WVR) engagement, referring to a fight between two or more UCAVs at close quarters, plays a decisive role on the aerial battlefields. With the development of artificial intelligence,…

Machine Learning · Computer Science 2025-10-13 Siyuan Li , Rongchang Zuo , Bofei Liu , Yaoyu He , Peng Liu , Yingnan Zhao