中文
相关论文

相关论文: Visualizing Critic Match Loss Landscapes for Inter…

200 篇论文

Recent advances in deep reinforcement learning (deep RL) enable researchers to solve challenging control problems, from simulated environments to real-world robotic tasks. However, deep RL algorithms are known to be sensitive to the problem…

机器人学 · 计算机科学 2023-02-01 Joanne Taery Kim , Sehoon Ha

This paper explores the mechanistic interpretability of reinforcement learning (RL) agents through an analysis of a neural network trained on procedural maze environments. By dissecting the network's inner workings, we identified…

机器学习 · 计算机科学 2024-11-05 Tristan Trim , Triston Grayston

Modern vision-based reinforcement learning techniques often use convolutional neural networks (CNN) as universal function approximators to choose which action to take for a given visual input. Until recently, CNNs have been treated like…

机器学习 · 计算机科学 2018-09-28 Jieliang Luo , Sam Green , Peter Feghali , George Legrady , Çetin Kaya Koç

Convolutional neural networks (CNNs) have achieved state-of-the-art performance on various tasks in computer vision. However, recent studies demonstrate that these models are vulnerable to carefully crafted adversarial samples and suffer…

机器学习 · 计算机科学 2020-12-15 Xin Li , Xiangrui Li , Deng Pan , Dongxiao Zhu

Hierarchical reinforcement learning (RL) can accelerate long-horizon decision-making by temporally abstracting a policy into multiple levels. Promising results in sparse reward environments have been seen with skills, i.e. sequences of…

机器学习 · 计算机科学 2024-07-15 Ce Hao , Catherine Weaver , Chen Tang , Kenta Kawamoto , Masayoshi Tomizuka , Wei Zhan

Reinforcement learning has been explored for many problems, from video games with deterministic environments to portfolio and operations management in which scenarios are stochastic; however, there have been few attempts to test these…

Control contraction metrics (CCMs) provide a framework to co-synthesize a controller and a corresponding contraction metric -- a positive-definite Riemannian metric under which a closed-loop system is guaranteed to be incrementally…

机器学习 · 计算机科学 2025-06-23 Minjae Cho , Hiroyasu Tsukamoto , Huy Trong Tran

This work focuses on the setting of dynamic regret in the context of online learning with full information. In particular, we analyze regret bounds with respect to the temporal variability of the loss functions. By assuming that the…

机器学习 · 计算机科学 2021-02-16 Nicolò Campolongo , Francesco Orabona

Recently, safe reinforcement learning (RL) with the actor-critic structure for continuous control tasks has received increasing attention. It is still challenging to learn a near-optimal control policy with safety and convergence…

机器学习 · 计算机科学 2024-02-06 Xinglong Zhang , Yaoqian Peng , Biao Luo , Wei Pan , Xin Xu , Haibin Xie

Harnessing the local topography of the loss landscape is a central challenge in advanced optimization tasks. By accounting for the effect of potential parameter changes, we can alter the model more efficiently. Contrary to standard…

机器学习 · 计算机科学 2024-11-27 Jed A. Duersch , Tommie A. Catanach , Alexander Safonov , Jeremy Wendt

In many real-world applications, reinforcement learning (RL) agents might have to solve multiple tasks, each one typically modeled via a reward function. If reward functions are expressed linearly, and the agent has previously learned a set…

机器学习 · 计算机科学 2022-06-24 Lucas N. Alegre , Ana L. C. Bazzan , Bruno C. da Silva

In this paper, we propose a method to perform empirical analysis of the loss landscape of machine learning (ML) models. The method is applied to two ML models for scientific sensing, which necessitates quantization to be deployed and are…

机器学习 · 计算机科学 2025-02-17 Tommaso Baldi , Javier Campos , Olivia Weng , Caleb Geniesse , Nhan Tran , Ryan Kastner , Alessandro Biondi

Recent advances at the intersection of reinforcement learning (RL) and visual intelligence have enabled agents that not only perceive complex visual scenes but also reason, generate, and act within them. This survey offers a critical and…

计算机视觉与模式识别 · 计算机科学 2025-12-24 Weijia Wu , Chen Gao , Joya Chen , Kevin Qinghong Lin , Qingwei Meng , Yiming Zhang , Yuke Qiu , Hong Zhou , Mike Zheng Shou

Reinforcement learning (RL) is a fundamental framework for sequential decision-making, in which an agent learns an optimal policy through interactions with an unknown environment. In settings with function approximation, many existing RL…

机器学习 · 计算机科学 2026-05-05 Ruiquan Huang , Donghao Li , Yingbin Liang , Jing Yang

The success of Reinforcement Learning (RL) heavily relies on the ability to learn robust representations from the observations of the environment. In most cases, the representations learned purely by the reinforcement learning loss can…

机器学习 · 计算机科学 2024-02-12 Somjit Nath , Rushiv Arora , Samira Ebrahimi Kahou

This study addresses the challenges of dynamics and complexity in intelligent human-computer interaction and proposes a reinforcement learning-based optimization framework to improve long-term returns and overall experience. Human-computer…

人机交互 · 计算机科学 2025-11-03 Rui Liu , Yifan Zhuang , Runsheng Zhang

Deep-learning-based methods for different applications have been shown vulnerable to adversarial examples. These examples make deployment of such models in safety-critical tasks questionable. Use of deep neural networks as inverse problem…

机器学习 · 计算机科学 2020-02-28 Ankit Raj , Yoram Bresler , Bo Li

In today's rapidly evolving technological landscape, organizations face the challenge of integrating external insights into their decision-making processes to stay competitive. To address this issue, this study proposes a method that…

机器学习 · 计算机科学 2025-02-14 Ali Nazari , Michael Weiss

Efficient solving of an unseen optimization problem is related to appropriate selection of an optimization algorithm and its hyper-parameters. For this purpose, automated algorithm performance prediction should be performed that in most…

神经与进化计算 · 计算机科学 2021-10-25 Risto Trajanov , Stefan Dimeski , Martin Popovski , Peter Korošec , Tome Eftimov

Incorporating encoding-decoding nets with adversarial nets has been widely adopted in image generation tasks. We observe that the state-of-the-art achievements were obtained by carefully balancing the reconstruction loss and adversarial…

计算机视觉与模式识别 · 计算机科学 2018-01-23 Zhifei Zhang , Yang Song , Hairong Qi