English
Related papers

Related papers: Neural Control Variates with Automatic Integration

200 papers

We introduce a methodology for seeking conservation laws within a Hamiltonian dynamical system, which we term ``neural deflation''. Inspired by deflation methods for steady states of dynamical systems, we propose to {iteratively} train a…

Pattern Formation and Solitons · Physics 2023-03-29 Wei Zhu , Hong-Kun Zhang , P. G. Kevrekidis

Achieving high efficiency in modern photorealistic rendering hinges on using Monte Carlo sampling distributions that closely approximate the illumination integral estimated for every pixel. Samples are typically generated from a set of…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Joey Litalien , Miloš Hašan , Fujun Luan , Krishna Mullia , Iliyan Georgiev

In this paper, we propose a novel control architecture, inspired from neuroscience, for adaptive control of continuous-time systems. The proposed architecture, in the setting of standard Neural Network (NN) based adaptive control, augments…

Systems and Control · Computer Science 2021-10-11 Deepan Muthirayan , Pramod P. Khargonekar

Monte Carlo (MC) sampling algorithms are an extremely widely-used technique to estimate expectations of functions f(x), especially in high dimensions. Control variates are a very powerful technique to reduce the error of such estimates, but…

Machine Learning · Statistics 2016-06-08 Brendan D. Tracey , David H. Wolpert

Humans and animals developed a sophisticated motor control apparatus and there is much evidence that it has a modular structure. The modularity offers a range of benefits, e.g. ability to learn dissociable motion styles without interference…

Robotics · Computer Science 2016-05-20 Kirill Makukhin

We propose a function-learning methodology with a control-theoretical foundation. We parametrise the approximating function as the solution to a control system on a reproducing-kernel Hilbert space, and propose several methods to find the…

Optimization and Control · Mathematics 2024-06-18 Paolo Colusso , Damir Filipović

Autonomous driving presents a complex challenge, which is usually addressed with artificial intelligence models that are end-to-end or modular in nature. Within the landscape of modular approaches, a bio-inspired neural circuit policy model…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Anass Bairouk , Mirjana Maras , Simon Herlin , Alexander Amini , Marc Blanchon , Ramin Hasani , Patrick Chareyre , Daniela Rus

Black-box variational inference performance is sometimes hindered by the use of gradient estimators with high variance. This variance comes from two sources of randomness: Data subsampling and Monte Carlo sampling. While existing control…

Machine Learning · Computer Science 2024-03-11 Xi Wang , Tomas Geffner , Justin Domke

While conventional reinforcement learning focuses on designing agents that can perform one task, meta-learning aims, instead, to solve the problem of designing agents that can generalize to different tasks (e.g., environments, obstacles,…

Machine Learning · Computer Science 2021-09-06 Xiaowu Sun , Wael Fatnassi , Ulices Santa Cruz , Yasser Shoukry

Many applications require the robustness, or ideally the invariance, of a neural network to certain transformations of input data. Most commonly, this requirement is addressed by either augmenting the training data, using adversarial…

Computer Vision and Pattern Recognition · Computer Science 2021-06-21 Kanchana Vaishnavi Gandikota , Jonas Geiping , Zorah Lähner , Adam Czapliński , Michael Moeller

With the increasing use of nonlinear devices in both generation and consumption of power, it is essential that we develop accurate and quick control for active filters to suppress harmonics. Time delays between input and output are…

Systems and Control · Electrical Eng. & Systems 2024-10-04 Dixant Bikal Sapkota , Puskar Neupane , Kajal Pokharel , Shahabuddin Khan

Neural networks are lately more and more often being used in the context of data-driven control, as an approximate model of the true system dynamics. Model Predictive Control (MPC) adopts this practise leading to neural MPC strategies. This…

Systems and Control · Electrical Eng. & Systems 2024-06-05 Spyridon Syntakas , Kostas Vlachos

We propose $\textit{iterative inversion}$ -- an algorithm for learning an inverse function without input-output pairs, but only with samples from the desired output distribution and access to the forward function. The key challenge is a…

Machine Learning · Computer Science 2023-05-31 Gal Leibovich , Guy Jacob , Or Avner , Gal Novik , Aviv Tamar

This paper proposes an active learning (AL) algorithm to solve regression problems based on inverse-distance weighting functions for selecting the feature vectors to query. The algorithm has the following features: (i) supports both…

Machine Learning · Computer Science 2022-12-15 Alberto Bemporad

This paper presents a novel approach for the safe control design of systems with parametric uncertainties in both drift terms and control-input matrices. The method combines control barrier functions and adaptive laws to generate a safe…

Systems and Control · Electrical Eng. & Systems 2024-04-16 Yujie Wang , Xiangru Xu

In recent years, deep learning has been connected with optimal control as a way to define a notion of a continuous underlying learning problem. In this view, neural networks can be interpreted as a discretization of a parametric Ordinary…

Optimization and Control · Mathematics 2020-07-07 Joubine Aghili , Olga Mula

A long tradition in theoretical neuroscience casts sensory processing in the brain as the process of inferring the maximally consistent interpretations of imperfect sensory input. Recently it has been shown that Gamma-band inhibition can…

Neurons and Cognition · Quantitative Biology 2017-09-04 Lorenz K. Muller , Giacomo Indiveri

This paper presents a novel approach to Autonomous Vehicle (AV) control through the application of active inference, a theory derived from neuroscience that conceptualizes the brain as a predictive machine. Traditional autonomous driving…

Robotics · Computer Science 2025-03-17 Elahe Delavari , John Moore , Junho Hong , Jaerock Kwon

Leveraging prior knowledge on intraclass variance due to transformations is a powerful method to improve the sample complexity of deep neural networks. This makes them applicable to practically important use-cases where training data is…

Machine Learning · Computer Science 2022-02-09 Matthias Rath , Alexandru Paul Condurache

We propose a variance reduction framework for variational inference using the Multilevel Monte Carlo (MLMC) method. Our framework is built on reparameterized gradient estimators and "recycles" parameters obtained from past update history in…

Machine Learning · Statistics 2021-12-03 Masahiro Fujisawa , Issei Sato