English
Related papers

Related papers: Unified Estimation--Guidance Framework Based on Ba…

200 papers

Gaussian processes allow for flexible specification of prior assumptions of unknown dynamics in state space models. We present a procedure for efficient Bayesian learning in Gaussian process state space models, where the representation is…

Computation · Statistics 2016-04-18 Andreas Svensson , Arno Solin , Simo Särkkä , Thomas B. Schön

Bayesian optimization has been successful at global optimization of expensive-to-evaluate multimodal objective functions. However, unlike most optimization methods, Bayesian optimization typically does not use derivative information. In…

Machine Learning · Statistics 2018-02-08 Jian Wu , Matthias Poloczek , Andrew Gordon Wilson , Peter I. Frazier

We show that model-based Bayesian clustering, the probabilistically most systematic approach to the partitioning of data, can be mapped into a statistical physics problem for a gas of particles, and as a result becomes amenable to a…

Disordered Systems and Neural Networks · Physics 2018-10-24 Alexander Mozeika , Anthony CC Coolen

Moment-based estimation filters have successfully aided spacecraft navigation for decades. However, future missions plan to venture into deep-space regimes with significant round-trip light-time telecommunication delays, operate in…

Earth and Planetary Astrophysics · Physics 2025-08-13 Benjamin L. Hanson , Todd A. Ely , Thomas R. Bewley , Aaron J. Rosengren

The design of an experiment can be always be considered at least implicitly Bayesian, with prior knowledge used informally to aid decisions such as the variables to be studied and the choice of a plausible relationship between the…

Methodology · Statistics 2017-01-03 David C. Woods , Antony M. Overstall , Maria Adamou , Timothy W. Waite

We give a new consistent scoring function for structure learning of Bayesian networks. In contrast to traditional approaches to scorebased structure learning, such as BDeu or MDL, the complexity penalty that we propose is data-dependent and…

Machine Learning · Computer Science 2013-09-27 Eliot Brenner , David Sontag

Many real-world decisions are made under uncertainty by solving optimization problems using predicted quantities. This predict-then-optimize paradigm has motivated decision-focused learning, which trains models with awareness of how the…

Machine Learning · Computer Science 2025-11-10 Paula Rodriguez-Diaz , Kirk Bansak Elisabeth Paulson

This paper considers the noncooperative maximization of mutual information in the Gaussian interference channel in a fully distributed fashion via game theory. This problem has been studied in a number of papers during the past decade for…

Information Theory · Computer Science 2016-11-17 Gesualdo Scutari , Daniel P. Palomar , Sergio Barbarossa

Gathering labeled data to train well-performing machine learning models is one of the critical challenges in many applications. Active learning aims at reducing the labeling costs by an efficient and effective allocation of costly labeling…

Machine Learning · Computer Science 2020-06-03 Daniel Kottke , Marek Herde , Christoph Sandrock , Denis Huseljic , Georg Krempl , Bernhard Sick

Particle filtering is a Bayesian inference method and a fundamental tool in state estimation for dynamic systems, but its effectiveness is often limited by the constraints of the initial prior distribution, a phenomenon we define as the…

Machine Learning · Statistics 2025-01-31 Yiwei Shi , Jingyu Hu , Yu Zhang , Mengyue Yang , Weinan Zhang , Cunjia Liu , Weiru Liu

Learning rules -- prescriptions for updating model parameters to improve performance -- are typically assumed rather than derived. Why do some learning rules work better than others, and under what assumptions can a given rule be considered…

Machine Learning · Computer Science 2025-11-03 John J. Vastola , Samuel J. Gershman , Kanaka Rajan

Continuum-scale material deformation models, such as crystal plasticity, can significantly enhance their predictive accuracy by incorporating input from lower-scale (i.e., mesoscale) models. The procedure to generate and extract the…

Materials Science · Physics 2026-01-06 Nicholas Huebner Julian , Giacomo Po , Enrique Martinez , Nithin Mathew , Danny Perez

Bayesian filtering serves as the mainstream framework of state estimation in dynamic systems. Its standard version utilizes total probability rule and Bayes' law alternatively, where how to define and compute conditional probability is…

Machine Learning · Statistics 2024-04-02 Wenhan Cao , Shiqi Liu , Chang Liu , Zeyu He , Stephen S. -T. Yau , Shengbo Eben Li

This paper considers a distributed adaptive optimization problem, where all agents only have access to their local cost functions with a common unknown parameter, whereas they mean to collaboratively estimate the true parameter and find the…

Optimization and Control · Mathematics 2025-09-03 Yaqun Yang , Jinlong Lei , Guanghui Wen , Yiguang Hong

In machine learning and computer vision, optimal transport has had significant success in learning generative models and defining metric distances between structured and stochastic data objects, that can be cast as probability measures. The…

Machine Learning · Computer Science 2020-10-20 Anton Mallasto , Markus Heinonen , Samuel Kaski

Computer simulations of differential equations require a time discretization, which inhibits to identify the exact solution with certainty. Probabilistic simulations take this into account via uncertainty quantification. The construction of…

Numerical Analysis · Mathematics 2020-10-15 Philipp Frank , Torsten A. Enßlin

Gaussian graphical models are widely used to infer dependence structures. Bayesian methods are appealing to quantify uncertainty associated with structural learning, i.e., the plausibility of conditional independence statements given the…

Methodology · Statistics 2025-11-05 Deborah Sulem , Jack Jewson , David Rossell

We derive a new Bayesian Information Criterion (BIC) by formulating the problem of estimating the number of clusters in an observed data set as maximization of the posterior probability of the candidate models. Given that some mild…

Statistics Theory · Mathematics 2018-08-28 Freweyni K. Teklehaymanot , Michael Muma , Abdelhak M. Zoubir

The ability of Gaussian processes (GPs) to predict the behavior of dynamical systems as a more sample-efficient alternative to parametric models seems promising for real-world robotics research. However, the computational complexity of GPs…

Robotics · Computer Science 2022-03-01 Abdolreza Taheri , Joni Pajarinen , Reza Ghabcheloo

Distance metric learning is an important component for many tasks, such as statistical classification and content-based image retrieval. Existing approaches for learning distance metrics from pairwise constraints typically suffer from two…

Machine Learning · Computer Science 2012-06-26 Liu Yang , Rong Jin , Rahul Sukthankar