English
Related papers

Related papers: Stable Deep Reinforcement Learning via Isotropic G…

200 papers

Inference in Gaussian process (GP) models is computationally challenging for large data, and often difficult to approximate with a small number of inducing points. We explore an alternative approximation that employs stochastic inference…

Machine Learning · Statistics 2019-05-28 Jiaxin Shi , Mohammad Emtiyaz Khan , Jun Zhu

Implicit neural representation has paved the way for new approaches to dynamic scene reconstruction and rendering. Nonetheless, cutting-edge dynamic neural rendering methods rely heavily on these implicit representations, which frequently…

Computer Vision and Pattern Recognition · Computer Science 2023-11-22 Ziyi Yang , Xinyu Gao , Wen Zhou , Shaohui Jiao , Yuqing Zhang , Xiaogang Jin

Continual learning of deep neural networks is a key requirement for scaling them up to more complex applicative scenarios and for achieving real lifelong learning of these architectures. Previous approaches to the problem have considered…

Machine Learning · Computer Science 2020-06-25 Jary Pomponi , Simone Scardapane , Vincenzo Lomonaco , Aurelio Uncini

Stochastic Gradient Descent (SGD) has proven to be remarkably effective in optimizing deep neural networks that employ ever-larger numbers of parameters. Yet, improving the efficiency of large-scale optimization remains a vital and highly…

Machine Learning · Computer Science 2020-11-11 Frithjof Gressmann , Zach Eaton-Rosen , Carlo Luschi

Generalization analyses of deep learning typically assume that the training converges to a fixed point. But, recent results indicate that in practice, the weights of deep neural networks optimized with stochastic gradient descent often…

Machine Learning · Computer Science 2022-08-22 Nisha Chandramoorthy , Andreas Loukas , Khashayar Gatmiry , Stefanie Jegelka

Motivation: Quickly obtaining high-quality MRI from accelerated acquisitions is important to mitigate motion artifacts, maintain patient comfort, and improve clinical efficiency. Goals: To obtain high-quality dynamic MRI using efficient,…

Medical Physics · Physics 2026-03-24 M. L. Terpstra , C. A. T. van den Berg

Latent scene representation plays a significant role in training reinforcement learning (RL) agents. To obtain good latent vectors describing the scenes, recent works incorporate the 3D-aware latent-conditioned NeRF pipeline into scene…

Robotics · Computer Science 2024-09-30 Jiaxu Wang , Ziyi Zhang , Qiang Zhang , Jia Li , Jingkai Sun , Mingyuan Sun , Junhao He , Renjing Xu

Spiking neural networks (SNNs) are gaining popularity in deep learning due to their low energy budget on neuromorphic hardware. However, they still face challenges in lacking sufficient robustness to guard safety-critical applications such…

Neural and Evolutionary Computing · Computer Science 2024-06-03 Jianhao Ding , Zhiyu Pan , Yujia Liu , Zhaofei Yu , Tiejun Huang

Reinforcement learning with function approximation can be unstable and even divergent, especially when combined with off-policy learning and Bellman updates. In deep reinforcement learning, these issues have been dealt with empirically by…

Machine Learning · Computer Science 2020-10-06 Dibya Ghosh , Marc G. Bellemare

We propose a simple method that combines neural networks and Gaussian processes. The proposed method can estimate the uncertainty of outputs and flexibly adjust target functions where training data exist, which are advantages of Gaussian…

Machine Learning · Statistics 2017-07-20 Tomoharu Iwata , Zoubin Ghahramani

Understanding the training dynamics of deep neural networks remains a major open problem, with physics-inspired approaches offering promising insights. Building on this perspective, we develop a thermodynamic framework to describe the…

Machine Learning · Computer Science 2026-05-15 Ildus Sadrtdinov , Ekaterina Lobacheva , Ivan Klimov , Mikhail Burtsev , Mikhail I. Katsnelson , Dmitry Vetrov

Arguably the biggest challenge in applying neural networks is tuning the hyperparameters, in particular the learning rate. The sensitivity to the learning rate is due to the reliance on backpropagation to train the network. In this paper we…

Machine Learning · Statistics 2018-08-08 Francois Fagan , Garud Iyengar

Efficient neural representations for dynamic video scenes are critical for applications ranging from video compression to interactive simulations. Yet, existing methods often face challenges related to high memory usage, lengthy training…

Computer Vision and Pattern Recognition · Computer Science 2025-01-10 Andrew Bond , Jui-Hsien Wang , Long Mai , Erkut Erdem , Aykut Erdem

Contrastive learning has become a cornerstone of modern representation learning, allowing training with massive unlabeled data for both task-specific and general (foundation) models. A prototypical loss in contrastive training is InfoNCE…

Machine Learning · Computer Science 2026-03-02 Roy Betser , Eyal Gofer , Meir Yossef Levi , Guy Gilboa

Accurate quantification of uncertainty in neural network predictions remains a central challenge for scientific applications involving high-dimensional, correlated data. While existing methods capture either aleatoric or epistemic…

Machine Learning · Computer Science 2025-08-26 Harrison J. Goldwyn , Mitchell Krock , Johann Rudi , Daniel Getter , Julie Bessac

Deep generative models based on Generative Adversarial Networks (GANs) have demonstrated impressive sample quality but in order to work they require a careful choice of architecture, parameter initialization, and selection of…

Machine Learning · Computer Science 2017-11-08 Kevin Roth , Aurelien Lucchi , Sebastian Nowozin , Thomas Hofmann

In recent years, a variety of tasks have been accomplished by deep reinforcement learning (DRL). However, when applying DRL to tasks in a real-world environment, designing an appropriate reward is difficult. Rewards obtained via actual…

Machine Learning · Computer Science 2023-10-04 Kanata Suzuki , Tetsuya Ogata

We propose a new approach to inverse reinforcement learning (IRL) based on the deep Gaussian process (deep GP) model, which is capable of learning complicated reward structures with few demonstrations. Our model stacks multiple latent GP…

Machine Learning · Computer Science 2017-05-08 Ming Jin , Andreas Damianou , Pieter Abbeel , Costas Spanos

3D Gaussian splatting (3DGS) has recently emerged as an alternative representation that leverages a 3D Gaussian-based representation and introduces an approximated volumetric rendering, achieving very fast rendering speed and promising…

Computer Vision and Pattern Recognition · Computer Science 2024-08-08 Joo Chan Lee , Daniel Rho , Xiangyu Sun , Jong Hwan Ko , Eunbyung Park

Sparse representations have been shown to be useful in deep reinforcement learning for mitigating catastrophic interference and improving the performance of agents in terms of cumulative reward. Previous results were based on a two step…

Machine Learning · Computer Science 2019-12-10 J. Fernando Hernandez-Garcia , Richard S. Sutton