English
Related papers

Related papers: Learning Equations for Extrapolation and Control

200 papers

During the last few years, significant attention has been paid to the stochastic training of artificial neural networks, which is known as an effective regularization approach that helps improve the generalization capability of trained…

Machine Learning · Computer Science 2018-12-04 Qi Sun , Yunzhe Tao , Qiang Du

Given observations of a physical system, identifying the underlying non-linear governing equation is a fundamental task, necessary both for gaining understanding and generating deterministic future predictions. Of most practical relevance…

Numerical Analysis · Mathematics 2020-03-02 A. Goeßmann , M. Götte , I. Roth , R. Sweke , G. Kutyniok , J. Eisert

The prediction of salient areas in images has been traditionally addressed with hand-crafted features based on neuroscience principles. This paper, however, addresses the problem with a completely data-driven approach by training a…

Computer Vision and Pattern Recognition · Computer Science 2016-03-03 Junting Pan , Kevin McGuinness , Elisa Sayrol , Noel O'Connor , Xavier Giro-i-Nieto

In this article, we propose a data-enabled economic predictive control method for a class of nonlinear systems, which aims to optimize the economic operational performance while handling hard constraints on the system outputs. Two lifting…

Systems and Control · Electrical Eng. & Systems 2025-12-30 Mingxue Yan , Xuewen Zhang , Kaixiang Zhang , Zhaojian Li , Xunyuan Yin

Extrapolation -- the ability to make inferences that go beyond the scope of one's experiences -- is a hallmark of human intelligence. By contrast, the generalization exhibited by contemporary neural network algorithms is largely limited to…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Taylor W. Webb , Zachary Dulberg , Steven M. Frankland , Alexander A. Petrov , Randall C. O'Reilly , Jonathan D. Cohen

Deep neural networks tend to underestimate uncertainty and produce overly confident predictions. Recently proposed solutions, such as MC Dropout and SDENet, require complex training and/or auxiliary out-of-distribution data. We propose a…

Machine Learning · Computer Science 2021-10-14 Akib Mashrur , Wei Luo , Nayyar A. Zaidi , Antonio Robles-Kelly

In many machine learning applications, labeled data is scarce and obtaining more labels is expensive. We introduce a new approach to supervising neural networks by specifying constraints that should hold over the output space, rather than…

Artificial Intelligence · Computer Science 2016-09-20 Russell Stewart , Stefano Ermon

The significance of learning constraints from data is underscored by its potential applications in real-world problem-solving. While constraints are popular for modeling and solving, the approaches to learning constraints from data remain…

Machine Learning · Computer Science 2024-03-05 Eduardo Vyhmeister , Rocio Paez , Gabriel Gonzalez

Classical numerical methods for solving partial differential equations suffer from the curse dimensionality mainly due to their reliance on meticulously generated spatio-temporal grids. Inspired by modern deep learning based techniques for…

Machine Learning · Statistics 2018-04-20 Maziar Raissi

We address a three-tier data-driven approach to solve the inverse problem in complex systems modelling from spatio-temporal data produced by microscopic simulators using machine learning. In the first step, we exploit manifold learning and…

Dynamical Systems · Mathematics 2023-03-16 Evangelos Galaris , Gianluca Fabiani , Ioannis Gallos , Ioannis Kevrekidis , Constantinos Siettos

We extend the learning from demonstration paradigm by providing a method for learning unknown constraints shared across tasks, using demonstrations of the tasks, their cost functions, and knowledge of the system dynamics and control…

Robotics · Computer Science 2019-02-22 Glen Chou , Dmitry Berenson , Necmiye Ozay

To improve the physical understanding and the predictions of complex dynamic systems, such as ocean dynamics and weather predictions, it is of paramount interest to identify interpretable models from coarsely and off-grid sampled…

Computational Physics · Physics 2021-05-04 Gert-Jan Both , Georges Tod , Remy Kusters

We present a neural network-based method for learning scalar hyperbolic conservation laws. Our method replaces the traditional numerical flux in finite volume schemes with a trainable neural network while preserving the conservative…

Reasoning about the physical world requires models that are endowed with the right inductive biases to learn the underlying dynamics. Recent works improve generalization for predicting trajectories by learning the Hamiltonian or Lagrangian…

Machine Learning · Computer Science 2020-10-27 Marc Finzi , Ke Alexander Wang , Andrew Gordon Wilson

We develop a control algorithm that ensures the safety, in terms of confinement in a set, of a system with unknown, 2nd-order nonlinear dynamics. The algorithm establishes novel connections between data-driven and robust, nonlinear control.…

Systems and Control · Electrical Eng. & Systems 2021-05-17 Christos K. Verginis , Franck Djeumou , Ufuk Topcu

Learning to make decisions from observed data in dynamic environments remains a problem of fundamental importance in a number of fields, from artificial intelligence and robotics, to medicine and finance. This paper concerns the problem of…

Machine Learning · Statistics 2018-06-04 Jack Umenberger , Thomas B. Schön

Current deep neural networks (DNNs) can easily overfit to biased training data with corrupted labels or class imbalance. Sample re-weighting strategy is commonly used to alleviate this issue by designing a weighting function mapping from…

Machine Learning · Computer Science 2019-09-30 Jun Shu , Qi Xie , Lixuan Yi , Qian Zhao , Sanping Zhou , Zongben Xu , Deyu Meng

Artificial neural networks have been successfully applied to a variety of business application problems involving classification and regression. Although backpropagation neural networks generally predict better than decision trees do for…

Neural and Evolutionary Computing · Computer Science 2010-09-28 S. M. Kamruzzaman , Ahmed Ryadh Hasan

We present a method for learning dynamics of complex physical processes described by time-dependent nonlinear partial differential equations (PDEs). Our particular interest lies in extrapolating solutions in time beyond the range of…

Machine Learning · Computer Science 2020-12-07 Jungeun Kim , Kookjin Lee , Dongeun Lee , Sheo Yon Jin , Noseong Park

In this paper, we introduce an efficient backpropagation scheme for non-constrained implicit functions. These functions are parametrized by a set of learnable weights and may optionally depend on some input; making them perfectly suitable…

Machine Learning · Computer Science 2020-11-17 Andreas Look , Simona Doneva , Melih Kandemir , Rainer Gemulla , Jan Peters