English
Related papers

Related papers: Asymptotically Tight Bayesian Cram\'{e}r-Rao Bound

200 papers

Sensor selection is a useful method to help reduce data throughput, as well as computational, power, and hardware requirements, while still maintaining acceptable performance. Although minimizing the Cram\'er-Rao bound has been adopted…

Signal Processing · Electrical Eng. & Systems 2023-08-01 Costas A. Kokke , Mario Coutiño , Laura Anitori , Richard Heusdens , Geert Leus

Univariate and multivariate general linear regression models, subject to linear inequality constraints, arise in many scientific applications. The linear inequality restrictions on model parameters are often available from phenomenological…

Methodology · Statistics 2021-12-07 Solmaz Seifollahi , Kaniav Kamary , Hossein Bevrani

We study stochastic nonconvex optimization under heavy-tailed noise. In this setting, the stochastic gradients only have bounded $p$-th central moment ($p$-BCM) for some $p \in (1,2]$. Building on the foundational work of Arjevani et al.…

Optimization and Control · Mathematics 2026-04-01 Adrien Fradin , Abdurakhmon Sadiev , Laurent Condat , Peter Richtárik

We derive new and improved non-asymptotic deviation inequalities for the sample average approximation (SAA) of an optimization problem. Our results give strong error probability bounds that are "sub-Gaussian"~even when the randomness of the…

Optimization and Control · Mathematics 2022-03-28 Roberto I. Oliveira , Philip Thompson

This paper investigates the potential of near-field localization using widely-spaced multi-subarrays (WSMSs) and analyzing the corresponding angle and range Cram\'er-Rao bounds (CRBs). By employing the Riemann sum, closed-form CRB…

Signal Processing · Electrical Eng. & Systems 2025-04-01 Songjie Yang , Xinyi Chen , Yue Xiu , Wanting Lyu , Zhongpei Zhang , Chau Yuen

Bayesian optimization (BO) has become popular for sequential optimization of black-box functions. When BO is used to optimize a target function, we often have access to previous evaluations of potentially related functions. This begs the…

Machine Learning · Computer Science 2022-06-17 Zhongxiang Dai , Yizhou Chen , Haibin Yu , Bryan Kian Hsiang Low , Patrick Jaillet

This paper introduces a model-free real-time optimization (RTO) framework based on unconstrained Bayesian optimization with embedded constraint control. The main contribution lies in demonstrating how this approach simplifies the black-box…

Optimization and Control · Mathematics 2024-02-29 Dinesh Krishnamoorthy

We consider covariance parameter estimation for a Gaussian process under inequality constraints (boundedness, monotonicity or convexity) in fixed-domain asymptotics. We address the estimation of the variance parameter and the estimation of…

Statistics Theory · Mathematics 2021-11-04 François Bachoc , Agnès Lagnoux , Andrés F. López-Lopera

Bayesian Additive Regression Trees (BART) is a popular Bayesian non-parametric regression model that is commonly used in causal inference and beyond. Its strong predictive performance is supported by well-developed estimation theory,…

Machine Learning · Statistics 2026-02-10 Yan Shuo Tan , Omer Ronen , Theo Saarinen , Bin Yu

In Causal Bayesian Optimization (CBO), an agent intervenes on an unknown structural causal model to maximize a downstream reward variable. In this paper, we consider the generalization where other agents or external events also intervene on…

Machine Learning · Computer Science 2023-08-02 Scott Sussex , Pier Giuseppe Sessa , Anastasiia Makarova , Andreas Krause

Near-field sensing with extremely large-scale antenna arrays (ELAAs) in practical 6G systems is expected to operate over broad bandwidths, where delay, Doppler, and spatial effects become tightly coupled across frequency. The purpose of…

Signal Processing · Electrical Eng. & Systems 2026-01-01 Tong Wei , Kumar Vijay Mishra , Bhavani Shankar M. R. , Björn Ottersten

The ultimate bound to the accuracy of phase estimates is often assumed to be given by the Heisenberg limit. Recent work seemed to indicate that this bound can be violated, yielding measurements with much higher accuracy than was previously…

Quantum Physics · Physics 2012-11-20 Dominic W. Berry , Michael J. W. Hall , Marcin Zwierz , Howard M. Wiseman

The adoption of large-scale antenna arrays at high-frequency bands is widely envisioned in the beyond 5G wireless networks. This leads to the near-field regime where the wavefront is no longer planar but spherical, bringing new…

Signal Processing · Electrical Eng. & Systems 2023-06-28 Ang Chen , Li Chen , Yunfei Chen , Changsheng You , Guo Wei , F. Richard Yu

We propose a distributionally robust approach to risk-sensitive estimation of an unknown signal x from an observed signal y. The unknown signal and observation are modeled as random vectors whose joint probability distribution is unknown,…

Machine Learning · Computer Science 2026-04-21 Feras Al Taha , Eilyan Bitar

Gaussian conditional random fields (GCRF) are a well-known used structured model for continuous outputs that uses multiple unstructured predictors to form its features and at the same time exploits dependence structure among outputs, which…

Machine Learning · Computer Science 2019-02-04 Andrija Petrović , Mladen Nikolić , Miloš Jovanović , Boris Delibašić

Gaussian process regression (GPR) is a popular nonparametric Bayesian method that provides predictive uncertainty estimates and is widely used in safety-critical applications. While prior research has introduced various uncertainty bounds,…

Machine Learning · Computer Science 2025-12-05 Junyi Liu , Stanley Kok

In extreme value theory and other related risk analysis fields, probability weighted moments (PWM) have been frequently used to estimate the parameters of classical extreme value distributions. This method-of-moment technique can be applied…

Statistics Theory · Mathematics 2023-06-21 Anna Ben-Hamou , Philippe Naveau , Maud Thomas

Learning classifiers that are robust to adversarial examples has received a great deal of recent attention. A major drawback of the standard robust learning framework is there is an artificial robustness radius $r$ that applies to all…

Machine Learning · Computer Science 2023-01-19 Robi Bhattacharjee , Kamalika Chaudhuri

In many real-world optimization problems, we have prior information about what objective function values are achievable. In this paper, we study the scenario that we have either exact knowledge of the minimum value or a, possibly inexact,…

Machine Learning · Computer Science 2025-09-26 Hanyang Wang , Juergen Branke , Matthias Poloczek

Bayesian optimization (BO) with Gaussian process (GP) surrogate models is a powerful black-box optimization method. Acquisition functions are a critical part of a BO algorithm as they determine how the new samples are selected. Some of the…

Machine Learning · Computer Science 2024-12-30 Jingyi Wang , Haowei Wang , Cosmin G. Petra , Nai-Yuan Chiang