中文
相关论文

相关论文: Differentiability and overlap concentration in opt…

200 篇论文

We study full Bayesian procedures for high-dimensional linear regression under sparsity constraints. The prior is a mixture of point masses at zero and continuous distributions. Under compatibility conditions on the design matrix, the…

统计理论 · 数学 2015-10-15 Ismaël Castillo , Johannes Schmidt-Hieber , Aad van der Vaart

We derive upper bounds for random design linear regression with dependent ($\beta$-mixing) data absent any realizability assumptions. In contrast to the strictly realizable martingale noise regime, no sharp instance-optimal non-asymptotics…

机器学习 · 计算机科学 2023-10-30 Ingvar Ziemann , Stephen Tu , George J. Pappas , Nikolai Matni

We study the rate of Bayesian consistency for hierarchical priors consisting of prior weights on a model index set and a prior on a density model for each choice of model index. Ghosal, Lember and Van der Vaart [2] have obtained general…

统计理论 · 数学 2008-09-23 Yang Xing

This paper is concerned with Bayesian inferential methods for data from controlled branching processes that account for model robustness through the use of disparities. Under regularity conditions, we establish that estimators built on…

统计方法学 · 统计学 2018-02-19 M. González , C. Minuesa , I. del Puerto , A. N. Vidyashankar

We consider the problem of optimizing signal transmission through multi-channel noisy devices. We investigate an array of bithreshold noisy devices which are connected in parallel and convergent on a summing center. Utilizing the concept of…

统计力学 · 物理学 2009-11-10 Aki-Hiro Sato , Michihito Ueda , Toyonori Munakata

Some statistical models are specified via a data generating process for which the likelihood function cannot be computed in closed form. Standard likelihood-based inference is then not feasible but the model parameters can be inferred by…

统计计算 · 统计学 2015-02-20 Michael U. Gutmann , Jukka Corander , Ritabrata Dutta , Samuel Kaski

This paper offers a qualitative insight into the convergence of Bayesian parameter inference in a setup which mimics the modeling of the spread of a disease with associated disease measurements. Specifically, we are interested in the…

统计理论 · 数学 2022-12-08 Samuel Bronstein , Stefan Engblom , Robin Marin

We consider a general statistical inference model of finite-rank tensor products. For any interaction structure and any order of tensor products, we identify the limit free energy of the model in terms of a variational formula. Our approach…

概率论 · 数学 2022-03-29 Hong-Bin Chen , Jean-Christophe Mourrat , Jiaming Xia

We study best-policy identification for finite-horizon risk-sensitive reinforcement learning under the entropic risk measure. Recent work established a constant gap in the exponential horizon dependence between lower and upper bounds on the…

机器学习 · 计算机科学 2026-05-14 Amer Essakine , Claire Vernade

We study the problem of learning classification functions from noiseless training samples, under the assumption that the decision boundary is of a certain regularity. We establish universal lower bounds for this estimation problem, for…

泛函分析 · 数学 2021-12-28 Philipp Petersen , Felix Voigtlaender

Perhaps the single most important use case for differential privacy is to privately answer numerical queries, which is usually achieved by adding noise to the answer vector. The central question, therefore, is to understand which noise…

机器学习 · 统计学 2021-03-17 Jinshuo Dong , Weijie J. Su , Linjun Zhang

We study optimal procedures for estimating a linear functional based on observational data. In many problems of this kind, a widely used assumption is strict overlap, i.e., uniform boundedness of the importance ratio, which measures how…

统计理论 · 数学 2023-01-18 Wenlong Mou , Peng Ding , Martin J. Wainwright , Peter L. Bartlett

Accurately solving PDEs with localised features requires refined meshes that adapt to the solution. Traditional numerical methods, such as finite elements, are linear in nature and often ineffective for such problems, as the mesh is not…

数值分析 · 数学 2025-08-27 Alexandre Magueresse , Santiago Badia

We analyse the matrix factorization problem. Given a noisy measurement of a product of two matrices, the problem is to estimate back the original matrices. It arises in many applications such as dictionary learning, blind matrix…

数值分析 · 计算机科学 2016-07-19 Yoshiyuki Kabashima , Florent Krzakala , Marc Mézard , Ayaka Sakata , Lenka Zdeborová

This paper presents a study of the large-sample behavior of the posterior distribution of a structural parameter which is partially identified by moment inequalities. The posterior density is derived based on the limited information…

统计理论 · 数学 2010-01-13 Yuan Liao , Wenxin Jiang

Unlike the classical linear model, nonlinear generative models have been addressed sparsely in the literature of statistical learning. This work aims to bringing attention to these models and their secrecy potential. To this end, we invoke…

信息论 · 计算机科学 2022-07-15 Ali Bereyhi , Bruno Loureiro , Florent Krzakala , Ralf R. Müller , Hermann Schulz-Baldes

A Bayesian network is a widely used probabilistic graphical model with applications in knowledge discovery and prediction. Learning a Bayesian network (BN) from data can be cast as an optimization problem using the well-known…

人工智能 · 计算机科学 2018-11-14 Zhenyu A. Liao , Charupriya Sharma , James Cussens , Peter van Beek

While post-training model compression can greatly reduce the inference cost of a deep neural network, uncompressed training still consumes a huge amount of hardware resources, run-time and energy. It is highly desirable to directly train a…

机器学习 · 计算机科学 2021-10-05 Cole Hawkins , Xing Liu , Zheng Zhang

Robustness and generalization ability of machine learning models are of utmost importance in various application domains. There is a wide interest in efficient ways to analyze those properties. One important direction is to analyze…

机器学习 · 计算机科学 2025-04-29 Khoat Than , Dat Phan , Giang Vu

Global discrete optimization is notoriously difficult due to the lack of gradient information and the curse of dimensionality, making exhaustive search infeasible. Tensor cross approximation is an efficient technique to approximate…

统计计算 · 统计学 2025-02-19 Sergey Dolgov , Dmitry Savostyanov