English
Related papers

Related papers: An Efficient and Effective Second-Order Training A…

200 papers

The traditional GNSS-aided inertial navigation system (INS) usually exploits the extended Kalman filter (EKF) for state estimation, and the initial attitude accuracy is key to the filtering performance. To spare the reliance on the initial…

Systems and Control · Electrical Eng. & Systems 2023-11-16 Wei Ouyang , Yutian Wang , Yuanxin Wu

A dynamic weighted directed graph (DWDG) is commonly encountered in various application scenarios. It involves extensive dynamic interactions among numerous nodes. Most existing approaches explore the intricate temporal patterns hidden in a…

Artificial Intelligence · Computer Science 2024-08-01 Hongxun Zhou , Xiangyu Chen , Ye Yuan

In this paper, we consider both first- and second-order techniques to address continuous optimization problems arising in machine learning. In the first-order case, we propose a framework of transition from deterministic or…

Machine Learning · Computer Science 2021-11-30 Sanae Lotfi , Tiphaine Bonniot de Ruisselet , Dominique Orban , Andrea Lodi

We investigate the applicability of the data assimilation (DA) to large eddy simulations (LESs) based on the lattice Boltzmann method (LBM). We carry out the observing system simulation experiment of a two-dimensional (2D) forced isotropic…

This paper contains a concise comparison of a number of nonlinear attitude filtering methods that have attracted attention in the robotics and aviation literature. With the help of previously published surveys and comparison studies, the…

Systems and Control · Computer Science 2015-02-16 M. Zamani , J. Trumpf , R. Mahony

We propose a simple yet effective alternative to reward normalization in policy gradient reinforcement learning by integrating a 1D Kalman filter for online reward estimation. Instead of relying on fixed heuristics, our method recursively…

Machine Learning · Computer Science 2026-04-28 Zixuan Xia , Quanxi Li

Extended Kalman Filtering (EKF) can be used to propagate and quantify input uncertainty through a Deep Neural Network (DNN) assuming mild hypotheses on the input distribution. This methodology yields results comparable to existing methods…

Machine Learning · Computer Science 2018-09-18 Jessica S. Titensky , Hayden Jananthan , Jeremy Kepner

Performing Data Assimilation (DA) at a low cost is of prime concern in Earth system modeling, particularly at the time of big data where huge quantities of observations are available. Capitalizing on the ability of Neural Networks…

Machine Learning · Computer Science 2021-11-24 Mathis Peyron , Anthony Fillion , Selime Gürol , Victor Marchais , Serge Gratton , Pierre Boudier , Gael Goret

Kalman Filters (KF) are fundamental to real-time state estimation applications, including radar-based tracking systems used in modern driver assistance and safety technologies. In a linear dynamical system with Gaussian noise distributions…

Robotics · Computer Science 2024-11-27 Arian Mehrfard , Bharanidhar Duraisamy , Stefan Haag , Florian Geiss

Accurate data assimilation (DA) for systems with piecewise-smooth or discontinuous state variables remains a significant challenge, as conventional covariance-based ensemble Kalman filter approaches often fail to effectively balance…

Numerical Analysis · Mathematics 2025-10-09 Tongtong Li , Anne Gelb , Yoonsang Lee

In Online Continual Learning (OCL) a learning system receives a stream of data and sequentially performs prediction and training steps. Important challenges in OCL are concerned with automatic adaptation to the particular non-stationary…

Machine Learning · Computer Science 2024-11-11 Michalis K. Titsias , Alexandre Galashov , Amal Rannen-Triki , Razvan Pascanu , Yee Whye Teh , Jorg Bornschein

LiDAR odometry is a pivotal technology in the fields of autonomous driving and autonomous mobile robotics. However, most of the current works focus on nonlinear optimization methods, and still existing many challenges in using the…

Robotics · Computer Science 2024-07-03 Wenlu Yu , Jie Xu , Chengwei Zhao , Lijun Zhao , Thien-Minh Nguyen , Shenghai Yuan , Mingming Bai , Lihua Xie

Extreme Learning Machines (ELM) provide a fast alternative to traditional gradient-based learning in neural networks, offering rapid training and robust generalization capabilities. Its theoretical basis shows its universal approximation…

Machine Learning · Computer Science 2024-06-27 Ergun Biçici

A critical factor in adopting machine learning for time-sensitive financial tasks is computational speed, including model training and inference. This paper demonstrates that a broad class of such problems, especially those previously…

Computational Finance · Quantitative Finance 2025-05-27 Liexin Cheng , Xue Cheng , Shuaiqiang Liu

We use statistical learning methods to construct an adaptive state estimator for nonlinear stochastic systems. Optimal state estimation, in the form of a Kalman filter, requires knowledge of the system's process and measurement uncertainty.…

Machine Learning · Statistics 2014-11-05 Michael Busch , Jeff Moehlis

The ensemble Kalman filter (EnKF) is widely used for data assimilation in high-dimensional systems, but its performance often deteriorates for strongly nonlinear dynamics due to the structural mismatch between the Kalman update and the…

Machine Learning · Computer Science 2026-04-30 Xin T. Tong , Yanyan Wang , Liang Yan

In this paper, we first review the theory of symmetry-preserving observers and we mention some recent results. Then, we apply the theory to Extended Kalman Filter-based Simultaneous Localization and Mapping (EKF SLAM). It allows to derive a…

Optimization and Control · Mathematics 2011-05-12 Silvere Bonnabel

Kalman filter-based algorithms are fundamental for mobile robots, as they provide a computationally efficient solution to the challenging problem of state estimation. However, they rely on two main assumptions that are difficult to satisfy…

With the rapid development of natural language processing technology, large-scale language models (LLM) have achieved remarkable results in a variety of tasks. However, how to effectively train these huge models and improve their…

Artificial Intelligence · Computer Science 2024-12-09 Jiajing Chen , Bingying Liu , Xiaoxuan Liao , Jia Gao , Hongye Zheng , Yue Li

The popularity of algorithms based on Extreme Learning Machine (ELM), which can be used to train Single Layer Feedforward Neural Networks (SLFN), has increased in the past years. They have been successfully applied to a wide range of…