English
Related papers

Related papers: Variational Optimization Based Reinforcement Learn…

200 papers

In this paper, we investigate the following question: Can we obtain adversarially-trained models without training on adversarial examples? Our intuition is that training a model with inherent stochasticity, i.e., optimizing the parameters…

Machine Learning · Computer Science 2023-12-15 Ayoub Arous , Andres F Lopez-Lopera , Nael Abu-Ghazaleh , Ihsen Alouani

This paper presents a novel numerical optimisation method for infinite dimensional optimisation. The functional optimisation makes minimal assumptions about the functional and without any specific knowledge on the derivative of the…

Optimization and Control · Mathematics 2016-11-18 Muhammad F. Kasim , Peter A. Norreys

We focus on the control of unknown Partial Differential Equations (PDEs). The system dynamics is unknown, but we assume we are able to observe its evolution for a given control input, as typical in a Reinforcement Learning framework. We…

Optimization and Control · Mathematics 2023-08-09 Alessandro Alla , Agnese Pacifico , Michele Palladino , Andrea Pesare

In this paper, we propose a stochastic method for solving equality constrained optimization problems that utilizes predictive variance reduction. Specifically, we develop a method based on the sequential quadratic programming paradigm that…

Optimization and Control · Mathematics 2023-03-28 Albert S. Berahas , Jiahao Shi , Zihong Yi , Baoyu Zhou

Reinforcement learning is about learning agent models that make the best sequential decisions in unknown environments. In an unknown environment, the agent needs to explore the environment while exploiting the collected information, which…

Machine Learning · Computer Science 2021-02-12 Hong Qian , Yang Yu

Learning-based methods have improved locomotion skills of quadruped robots through deep reinforcement learning. However, the sim-to-real gap and low sample efficiency still limit the skill transfer. To address this issue, we propose an…

Robotics · Computer Science 2024-03-19 Haojie Shi , Tingguang Li , Qingxu Zhu , Jiapeng Sheng , Lei Han , Max Q. -H. Meng

We develop a mesh-free, derivative-free, matrix-free, and highly parallel localized stochastic method for high-dimensional semilinear parabolic PDEs. The efficiency of the proposed method is built upon four essential components: (i) a…

Numerical Analysis · Mathematics 2025-10-14 Shuixin Fang , Changtao Sheng , Bihao Su , Tao Zhou

Deep reinforcement learning has over the past few years shown great potential in learning near-optimal control in complex simulated environments with little visible information. Rainbow (Q-Learning) and PPO (Policy Optimisation) have shown…

Artificial Intelligence · Computer Science 2019-07-30 Per-Arne Andersen , Morten Goodwin , Ole-Christoffer Granmo

Integrating physics models within machine learning models holds considerable promise toward learning robust models with improved interpretability and abilities to extrapolate. In this work, we focus on the integration of incomplete physics…

Machine Learning · Computer Science 2021-10-28 Naoya Takeishi , Alexandros Kalousis

We explore training deep neural network models in conjunction with physics simulations via partial differential equations (PDEs), using the simulated degrees of freedom as latent space for a neural network. In contrast to previous work,…

Machine Learning · Computer Science 2023-10-04 Chloe Paliard , Nils Thuerey , Kiwon Um

We introduce a statistical physics inspired supervised machine learning algorithm for classification and regression problems. The method is based on the invariances or stability of predicted results when known data is represented as…

Machine Learning · Statistics 2018-11-19 Patrick Chao , Tahereh Mazaheri , Bo Sun , Nicholas B. Weingartner , Zohar Nussinov

Derivative-free optimization has become an important technique used in machine learning for optimizing black-box models. To conduct updates without explicitly computing gradient, most current approaches iteratively sample a random search…

Machine Learning · Statistics 2018-08-03 Liu Liu , Minhao Cheng , Cho-Jui Hsieh , Dacheng Tao

In this paper, we study a class of stochastic partial differential equations (SPDEs) driven by space-time fractional noises. Our method consists in studying first the nonlocal SPDEs and showing then the convergence of the family of these…

Probability · Mathematics 2014-09-17 Ying Hu , Yiming Jiang , Zhongmin Qian

Reinforcement Learning has been able to solve many complicated robotics tasks without any need for feature engineering in an end-to-end fashion. However, learning the optimal policy directly from the sensory inputs, i.e the observations,…

Ordinary and stochastic differential equations (ODEs and SDEs) are widely used to model continuous-time processes across various scientific fields. While ODEs offer interpretability and simplicity, SDEs incorporate randomness, providing…

Methodology · Statistics 2025-05-20 Qingchuan Sun , Susanne Ditlevsen

Unlike many deterministic PDEs, stochastic equations are not amenable to the classical variational theory of Euler-Lagrange. In this paper, we show how self-dual variational calculus leads to solutions of various stochastic partial…

Analysis of PDEs · Mathematics 2018-02-08 Shirin Boroushaki , Nassif Ghoussoub

The data-driven discovery of partial differential equations (PDEs) consistent with spatiotemporal data is experiencing a rebirth in machine learning research. Training deep neural networks to learn such data-driven partial differential…

Numerical Analysis · Mathematics 2020-11-10 Hassan Arbabi , Judith E. Bunder , Giovanni Samaey , Anthony J. Roberts , Ioannis G. Kevrekidis

This paper provides a unifying theoretical framework for stochastic optimization algorithms by means of a latent stochastic variational problem. Using techniques from stochastic control, the solution to the variational problem is shown to…

Machine Learning · Computer Science 2019-10-29 Philippe Casgrain

Reliable predictions of critical phenomena, such as weather, wildfires and epidemics often rely on models described by Partial Differential Equations (PDEs). However, simulations that capture the full range of spatio-temporal scales…

Machine Learning · Computer Science 2025-02-13 Jan-Philipp von Bassewitz , Sebastian Kaltenbach , Petros Koumoutsakos

Bayesian approach, as a useful tool for quantifying uncertainties, has been widely used for solving inverse problems of partial differential equations (PDEs). One of the key difficulties for employing Bayesian approach for the issue is how…

Numerical Analysis · Mathematics 2026-02-09 Junxiong Jia , Qian Zhao , Zongben Xu , Deyu Meng , Yee Leung