English
Related papers

Related papers: An Efficient and Effective Second-Order Training A…

200 papers

State-of-the-art ensemble Kalman filtering (EnKF) algorithms require incorporating localization techniques to cope with the rank deficiency and the inherited spurious correlations in their error covariance matrices. Localization techniques…

Atmospheric and Oceanic Physics · Physics 2026-03-05 Boujemaa Ait-El-Fquih , Ibrahim Hoteit

In this paper we address the problem of estimating the posterior distribution of the static parameters of a continuous time state space model with discrete time observations by an algorithm that combines the Kalman filter and a particle…

Computation · Statistics 2019-05-22 Jian He , Asma Khedher , Peter Spreij

This paper considers the problem of data-driven robust control design for nonlinear systems, for instance, obtained when discretizing nonlinear partial differential equations (PDEs). A robust learning control approach is developed for…

Optimization and Control · Mathematics 2025-09-01 Anant A. Joshi , Saviz Mowlavi , Mouhacine Benosman

Nonlinear models are known to provide excellent performance in real-world applications that often operate in non-ideal conditions. However, such applications often require online processing to be performed with limited computational…

Machine Learning · Computer Science 2024-10-28 Danilo Comminiello , Alireza Nezamdoust , Simone Scardapane , Michele Scarpiniti , Amir Hussain , Aurelio Uncini

This paper derives a contact-aided inertial navigation observer for a 3D bipedal robot using the theory of invariant observer design. Aided inertial navigation is fundamentally a nonlinear observer design problem; thus, current solutions…

Robotics · Computer Science 2019-05-22 Ross Hartley , Maani Ghaffari Jadidi , Jessy W. Grizzle , Ryan M. Eustice

This paper illustrates the way for estimating position and orientation of a vehicle with an Extended Kalman Filter (EKF). For this purpose a non-linear model is designed and an adaptive calculation of measurement noise covariance matrix is…

Systems and Control · Electrical Eng. & Systems 2021-08-26 Reiner Marchthaler

Extreme learning machine (ELM), proposed by Huang et al., has been shown a promising learning algorithm for single-hidden layer feedforward neural networks (SLFNs). Nevertheless, because of the random choice of input weights and biases, the…

Neural and Evolutionary Computing · Computer Science 2014-09-16 Yuguang Wang , Feilong Cao , Yubo Yuan

Energy efficiency and reliability have long been crucial factors for ensuring cost-effective and safe missions in autonomous systems computers. With the rapid evolution of industries such as space robotics and advanced air mobility, the…

Machine Learning · Computer Science 2023-07-18 Reza Ahmadvand , Sarah Safura Sharif , Yaser Mike Banad

A second-order-based latent factor (SLF) analysis model demonstrates superior performance in graph representation learning, particularly for high-dimensional and incomplete (HDI) interaction data, by incorporating the curvature information…

Machine Learning · Computer Science 2024-09-05 Jialiang Wang , Yan Xia , Ye Yuan

In this paper, a position and velocity estimation method for robotic manipulators which are affected by constant bounded disturbances is considered. The tracking control problem is formulated as a disturbance rejection problem, with all the…

Systems and Control · Electrical Eng. & Systems 2020-08-25 AR Ghiasi , AA Ghavifekr , Y Shabbouei Hagh , H SeyedGholami

This paper develops a new nonlinear filter, called Moment-based Kalman Filter (MKF), using the exact moment propagation method. Existing state estimation methods use linearization techniques or sampling points to compute approximate values…

Robotics · Computer Science 2023-01-24 Yutaka Shimizu , Ashkan Jasour , Maani Ghaffari , Shinpei Kato

Long Short-Term Memory networks trained with gradient descent and back-propagation have received great success in various applications. However, point estimation of the weights of the networks is prone to over-fitting problems and lacks…

Machine Learning · Computer Science 2019-06-05 Chao Chen , Xiao Lin , Gabriel Terejanu

Supervised fine-tuning (SFT) is a standard approach to adapting large language models (LLMs) to new domains. In this work, we improve the statistical efficiency of SFT by selecting an informative subset of training examples. Specifically,…

Machine Learning · Computer Science 2025-05-22 Rohan Deb , Kiran Thekumparampil , Kousha Kalantari , Gaurush Hiranandani , Shoham Sabach , Branislav Kveton

In this paper, we provide two new stable online algorithms for the problem of prediction in reinforcement learning, \emph{i.e.}, estimating the value function of a model-free Markov reward process using the linear function approximation…

Machine Learning · Computer Science 2018-06-19 Ajin George Joseph , Shalabh Bhatnagar

The paper proposes a new recursive filter for non-linear systems that inherently computes a valid bound on the mean square estimation error. The proposed filter, bound based extended Kalman, (BEKF) is in the form of an extended Kalman…

Optimization and Control · Mathematics 2014-10-02 Gyorgy Hexner , Haim Weiss

A Data Assimilation (DA) strategy based on an ensemble Kalman filter (EnKF) is used to enhance the predictive capabilities of scale resolving numerical tools for the analysis of flows exhibiting cyclic behaviour. More precisely, an ensemble…

Fluid Dynamics · Physics 2025-03-20 Lucas Villanueva , Karine Truffin , Jacques Borée , Marcello Meldi

Application of two new UKF based estimation techniques with reduced processing time in re-entry vehicle position and velocity estimation problem using ground-based range and elevation measurements is presented. The first method is called…

Systems and Control · Computer Science 2016-11-30 Sanat Biswas , Li Qiao , Andrew Dempster

In a recent methodological paper, we showed how to learn chaotic dynamics along with the state trajectory from sequentially acquired observations, using local ensemble Kalman filters. Here, we more systematically investigate the possibility…

Machine Learning · Statistics 2022-10-19 Quentin Malartic , Alban Farchi , Marc Bocquet

Second-order optimization algorithms exhibit excellent convergence properties for training deep learning models, but often incur significant computation and memory overheads. This can result in lower training efficiency than the first-order…

Machine Learning · Computer Science 2023-08-07 Lin Zhang , Shaohuai Shi , Bo Li

This paper develops an online inverse reinforcement learning algorithm aimed at efficiently recovering a reward function from ongoing observations of an agent's actions. To reduce the computation time and storage space in reward estimation,…

Robotics · Computer Science 2017-08-01 Kun Li , Joel W. Burdick