English
Related papers

Related papers: Bayesian Knowledge Transfer for a Kalman Fixed-Lag…

200 papers

We consider Bayesian optimization of an expensive-to-evaluate black-box objective function, where we also have access to cheaper approximations of the objective. In general, such approximations arise in applications such as reinforcement…

Machine Learning · Statistics 2016-11-16 Matthias Poloczek , Jialei Wang , Peter I. Frazier

Active learning seeks to reduce the amount of data required to fit the parameters of a model, thus forming an important class of techniques in modern machine learning. However, past work on active learning has largely overlooked latent…

Machine Learning · Computer Science 2024-02-20 Aditi Jha , Zoe C. Ashwood , Jonathan W. Pillow

Existing Bayesian models, especially nonparametric Bayesian methods, rely on specially conceived priors to incorporate domain knowledge for discovering improved latent representations. While priors can affect posterior distributions through…

Machine Learning · Computer Science 2014-02-13 Jun Zhu , Ning Chen , Eric P. Xing

Balancing exploration and exploitation is a fundamental part of reinforcement learning, yet most state-of-the-art algorithms use a naive exploration protocol like $\epsilon$-greedy. This contributes to the problem of high sample complexity,…

Machine Learning · Computer Science 2019-11-21 Tom Blau , Lionel Ott , Fabio Ramos

In this paper, we study the design of an optimal transmission policy for remote state estimation over packet-dropping wireless channels with imperfect channel state information. A smart sensor uses a Kalman filter to estimate the system…

Systems and Control · Electrical Eng. & Systems 2025-05-05 Ioannis Tzortzis , Evagoras Makridis , Charalambos D. Charalambous , Themistoklis Charalambous

Interleaved learning in machine learning algorithms is a biologically inspired training method with promising results. In this short note, we illustrate the interleaving mechanism via a simple statistical and optimization framework based on…

Signal Processing · Electrical Eng. & Systems 2023-11-14 Majnu John , Yihren Wu

The development of a wall model using machine learning methods for the large-eddy simulation (LES) of separated flows is still an unsolved problem. Our approach is to leverage the significance of separated flow data, for which existing…

Fluid Dynamics · Physics 2024-12-25 Zhideng Zhou , Xin-lei Zhang , Guo-wei He , Xiaolei Yang

State estimation in heavy-tailed process and measurement noise is an important challenge that must be addressed in, e.g., tracking scenarios with agile targets and outlier-corrupted measurements. The performance of the Kalman filter (KF)…

Methodology · Statistics 2017-03-08 Michael Roth , Tohid Ardeshiri , Emre Özkan , Fredrik Gustafsson

Multi-fidelity machine learning methods address the accuracy-efficiency trade-off by integrating scarce, resource-intensive high-fidelity data with abundant but less accurate low-fidelity data. We propose a practical multi-fidelity strategy…

Machine Learning · Computer Science 2025-03-26 Jiaxiang Yi , Ji Cheng , Miguel A. Bessa

The Bayesian learning rule is a natural-gradient variational inference method, which not only contains many existing learning algorithms as special cases but also enables the design of new algorithms. Unfortunately, when variational…

Machine Learning · Statistics 2020-10-27 Wu Lin , Mark Schmidt , Mohammad Emtiyaz Khan

This paper considers the distributed filtering problem for a class of stochastic uncertain systems under quantized data flowing over switching sensor networks. Employing the biased noisy observations of the local sensor and…

Signal Processing · Electrical Eng. & Systems 2019-10-08 Xingkang He , Wenchao Xue , Xiaocheng Zhang , Haitao Fang

We introduce a new method for learning Bayesian neural networks, treating them as a stack of multivariate Bayesian linear regression models. The main idea is to infer the layerwise posterior exactly if we know the target outputs of each…

Machine Learning · Computer Science 2024-11-20 Richard Kurle , Alexej Klushyn , Ralf Herbrich

The paper proposes a new recursive filter for non-linear systems that inherently computes a valid bound on the mean square estimation error. The proposed filter, bound based extended Kalman, (BEKF) is in the form of an extended Kalman…

Optimization and Control · Mathematics 2014-10-02 Gyorgy Hexner , Haim Weiss

Modern autonomous systems are purposed for many challenging scenarios, where agents will face unexpected events and complicated tasks. The presence of disturbance noise with control command and unknown inputs can negatively impact robot…

Robotics · Computer Science 2023-09-22 Zida Wu , Zhaoliang Zheng , Ankur Mehta

Federated learning involves training machine learning models over devices or data silos, such as edge processors or data warehouses, while keeping the data local. Training in heterogeneous and potentially massive networks introduces bias…

Machine Learning · Computer Science 2021-06-18 Zichen Ma , Yu Lu , Zihan Lu , Wenye Li , Jinfeng Yi , Shuguang Cui

We present LINS, a lightweight lidar-inertial state estimator, for real-time ego-motion estimation. The proposed method enables robust and efficient navigation for ground vehicles in challenging environments, such as feature-less scenes,…

Robotics · Computer Science 2020-05-07 Chao Qin , Haoyang Ye , Christian E. Pranata , Jun Han , Shuyang Zhang , Ming Liu

State estimation of dynamical systems in real-time is a fundamental task in signal processing. For systems that are well-represented by a fully known linear Gaussian state space (SS) model, the celebrated Kalman filter (KF) is a low…

Signal Processing · Electrical Eng. & Systems 2022-04-13 Guy Revach , Nir Shlezinger , Xiaoyong Ni , Adria Lopez Escoriza , Ruud J. G. van Sloun , Yonina C. Eldar

When hyperparameter optimization of a machine learning algorithm is repeated for multiple datasets it is possible to transfer knowledge to an optimization run on a new dataset. We develop a new hyperparameter-free ensemble model for…

Machine Learning · Statistics 2022-10-25 Matthias Feurer , Benjamin Letham , Frank Hutter , Eytan Bakshy

Autonomous mobile robots operating in novel environments depend critically on accurate state estimation, often utilizing visual and inertial measurements. Recent work has shown that an invariant formulation of the extended Kalman filter…

Robotics · Computer Science 2025-10-06 Abdullah Altawaitan , Jason Stanley , Sambaran Ghosal , Thai Duong , Nikolay Atanasov

Scientific computer simulations cannot represent all scales in realistic applications. To bridge this model-data gap, parameters are injected into models and constrained with noisy data using Bayesian inversion. To reduce the number of…

Computation · Statistics 2026-05-22 Arne Bouillon , Oliver R. A. Dunbar