English
Related papers

Related papers: Unifying Model-Based and Neural Network Feedforwar…

200 papers

Feedforward neural networks (FNNs) can be viewed as non-linear regression models, where covariates enter the model through a combination of weighted summations and non-linear functions. Although these models have some similarities to the…

Methodology · Statistics 2024-05-02 Andrew McInerney , Kevin Burke

We propose a hierarchical training algorithm for standard feed-forward neural networks that adaptively extends the network architecture as soon as the optimization reaches a stationary point. By solving small (low-dimensional) optimization…

Numerical Analysis · Mathematics 2024-10-31 Michael Feischl , Alexander Rieder , Fabian Zehetgruber

This paper studies the data-driven control of unknown linear-threshold network dynamics to stabilize the state to a reference value. We consider two types of controllers: (i) a state feedback controller with feed-forward reference input and…

Systems and Control · Electrical Eng. & Systems 2025-10-03 Xuan Wang , Duy Duong-Tran , Jorge Cortés

Estimating the parameters of a model describing a set of observations using a neural network is in general solved in a supervised way. In cases when we do not have access to the model's true parameters this approach can not be applied.…

Astrophysics of Galaxies · Physics 2020-09-30 Miguel A. Aragon-Calvo

We show that an interesting class of feed-forward neural networks can be understood as quantitative argumentation frameworks. This connection creates a bridge between research in Formal Argumentation and Machine Learning. We generalize the…

Neural and Evolutionary Computing · Computer Science 2020-12-11 Nico Potyka

We seek to impose linear, equality constraints in feedforward neural networks. As top layer predictors are usually nonlinear, this is a difficult task if we seek to deploy standard convex optimization methods and strong duality. To overcome…

Machine Learning · Computer Science 2023-01-10 Anand Rangarajan , Pan He , Jaemoon Lee , Tania Banerjee , Sanjay Ranka

We propose a new family of neural networks to predict the behaviors of physical systems by learning their underpinning constraints. A neural projection operator lies at the heart of our approach, composed of a lightweight network with an…

Neural and Evolutionary Computing · Computer Science 2020-12-15 Shuqi Yang , Xingzhe He , Bo Zhu

Modelling of contact-rich tasks is challenging and cannot be entirely solved using classical control approaches due to the difficulty of constructing an analytic description of the contact dynamics. Additionally, in a manipulation task like…

Robotics · Computer Science 2019-09-27 Ioanna Mitsioni , Yiannis Karayiannidis , Johannes A. Stork , Danica Kragic

This work presents a novel resolution-invariant model order reduction strategy for multifidelity applications. We base our architecture on a novel neural network layer developed in this work, the graph feedforward network, which extends the…

Numerical Analysis · Mathematics 2024-06-07 Oisín M. Morrison , Federico Pichi , Jan S. Hesthaven

Neural networks are a convenient way to automatically fit functions that are too complex to be described by hand. The downside of this approach is that it leads to build a black-box without understanding what happened inside. Finding the…

Machine Learning · Computer Science 2022-08-29 Théo Nancy , Vassili Maillet , Johann Barbier

Neural networks are powerful function estimators, leading to their status as a paradigm of choice for modeling structured data. However, unlike other structured representations that emphasize the modularity of the problem -- e.g., factor…

Machine Learning · Computer Science 2022-06-20 Tsvetomila Mihaylova , Vlad Niculae , André F. T. Martins

Accurate models are essential for design, performance prediction, control, and diagnostics in complex engineering systems. Physics-based models excel during the design phase but often become outdated during system deployment due to changing…

Machine Learning · Computer Science 2025-01-22 Zihan Liu , Prashant N. Kambali , C. Nataraj

Neural networks have proven practical for a synergistic combination of advanced control techniques. This work analyzes the implementation of rectified linear unit neural networks to achieve constrained control in differentially flat…

Systems and Control · Electrical Eng. & Systems 2026-04-06 Huu-Thinh Do , Ionela Prodan , Florin Stoican

In this work, we consider the problem of learning a feed-forward neural network controller to safely steer an arbitrarily shaped planar robot in a compact and obstacle-occluded workspace. Unlike existing methods that depend strongly on the…

Systems and Control · Electrical Eng. & Systems 2022-12-14 Panagiotis Vlantis , Leila J. Bridgeman , Michael M. Zavlanos

Estimating accurate forward and inverse dynamics models is a crucial component of model-based control for sophisticated robots such as robots driven by hydraulics, artificial muscles, or robots dealing with different contact situations.…

Two of the most popular modelling paradigms in computer vision are feed-forward neural networks (FFNs) and probabilistic graphical models (GMs). Various connections between the two have been studied in recent works, such as e.g. expressing…

Machine Learning · Statistics 2017-10-31 Dmitrij Schlesinger

Forecasting based on financial time-series is a challenging task since most real-world data exhibits nonstationary property and nonlinear dependencies. In addition, different data modalities often embed different nonlinear relationships…

Machine Learning · Computer Science 2019-03-19 Dat Thanh Tran , Juho Kanniainen , Moncef Gabbouj , Alexandros Iosifidis

This paper investigates options to complement a diesel engine airpath feedback controller with a feedforward. The control objective is to track the intake manifold pressure and exhaust gas recirculation (EGR) rate targets by manipulating…

Systems and Control · Electrical Eng. & Systems 2022-05-12 Jiadi Zhang , Mohammad Reza Amini , Ilya Kolmanovsky , Munechika Tsutsumi , Hayato Nakada

Backpropagation has long been criticized for being biologically implausible due to its reliance on concepts that are not viable in natural learning processes. Two core issues are the weight transport and update locking problems caused by…

Machine Learning · Computer Science 2026-01-14 Katharina Flügel , Daniel Coquelin , Marie Weiel , Charlotte Debus , Achim Streit , Markus Götz

This paper investigates reinforcement learning with constraints, which are indispensable in safety-critical environments. To drive the constraint violation monotonically decrease, we take the constraints as Lyapunov functions and impose new…

Machine Learning · Computer Science 2021-05-07 Chuangchuang Sun , Dong-Ki Kim , Jonathan P. How