中文
相关论文

相关论文: Differentiability and overlap concentration in opt…

200 篇论文

We consider Bayesian optimization of an expensive-to-evaluate black-box objective function, where we also have access to cheaper approximations of the objective. In general, such approximations arise in applications such as reinforcement…

机器学习 · 统计学 2016-11-16 Matthias Poloczek , Jialei Wang , Peter I. Frazier

We develop a new computational approach for "focused" optimal Bayesian experimental design with nonlinear models, with the goal of maximizing expected information gain in targeted subsets of model parameters. Our approach considers…

统计计算 · 统计学 2019-03-28 Chi Feng , Youssef M. Marzouk

Tucker decomposition is the cornerstone of modern machine learning on tensorial data analysis, which have attracted considerable attention for multiway feature extraction, compressive sensing, and tensor completion. The most challenging…

机器学习 · 计算机科学 2015-05-12 Qibin Zhao , Liqing Zhang , Andrzej Cichocki

Information divergence that measures the difference between two nonnegative matrices or tensors has found its use in a variety of machine learning problems. Examples are Nonnegative Matrix/Tensor Factorization, Stochastic Neighbor…

机器学习 · 计算机科学 2014-06-06 Onur Dikmen , Zhirong Yang , Erkki Oja

Prior information often takes the form of parameter constraints. Bayesian methods include such information through prior distributions having constrained support. By using posterior sampling algorithms, one can quantify uncertainty without…

统计方法学 · 统计学 2018-09-25 Leo L Duan , Alexander L Young , Akihiko Nishimura , David B Dunson

Tensor models play an increasingly prominent role in many fields, notably in machine learning. In several applications, such as community detection, topic modeling and Gaussian mixture learning, one must estimate a low-rank signal from a…

机器学习 · 统计学 2022-06-16 José Henrique de Morais Goulart , Romain Couillet , Pierre Comon

We address the new problem of estimating a piece-wise constant signal with the purpose of detecting its change points and the levels of clusters. Our approach is to model it as a nonparametric penalized least square model selection on a…

机器学习 · 统计学 2019-12-04 Othmane Mazhar , Cristian R. Rojas , Carlo Fischione , Mohammad R. Hesamzadeh

We introduce an end-to-end optimization strategy for quantum machine learning that directly targets performance under finite measurement resources, where learning objectives are defined directly at the level of task performance. The method…

量子物理 · 物理学 2025-12-24 Theodoros Ilias , Fangjun Hu , Marti Vives , Hakan E. Türeci

How do statistical dependencies in measurement noise influence high-dimensional inference? To answer this, we study the paradigmatic spiked matrix model of principal components analysis (PCA), where a rank-one matrix is corrupted by…

信息论 · 计算机科学 2023-06-05 Jean Barbier , Francesco Camilli , Marco Mondelli , Manuel Saenz

We consider the problem of hypothesis testing for discrete distributions. In the standard model, where we have sample access to an underlying distribution $p$, extensive research has established optimal bounds for uniformity testing,…

机器学习 · 计算机科学 2024-12-03 Maryam Aliakbarpour , Piotr Indyk , Ronitt Rubinfeld , Sandeep Silwal

We address the problem of minimizing a class of energy functions consisting of data and smoothness terms that commonly occur in machine learning, computer vision, and pattern recognition. While discrete optimization methods are able to give…

计算机视觉与模式识别 · 计算机科学 2022-06-22 Zhakshylyk Nurlanov , Daniel Cremers , Florian Bernard

Bayesian coresets have emerged as a promising approach for implementing scalable Bayesian inference. The Bayesian coreset problem involves selecting a (weighted) subset of the data samples, such that the posterior inference using the…

机器学习 · 统计学 2021-03-01 Jacky Y. Zhang , Rajiv Khanna , Anastasios Kyrillidis , Oluwasanmi Koyejo

This work presents a novel and effective method for fitting multidimensional ellipsoids to scattered data in the contamination of noise and outliers. We approach the problem as a Bayesian parameter estimate process and maximize the…

统计方法学 · 统计学 2024-07-30 Zhao Mingyang , Jia Xiaohong , Ma Lei , Shi Yuke , Jiang Jingen , Li Qizhai , Yan Dong-Ming , Huang Tiejun

We consider nonparametric Bayesian inference in a multidimensional diffusion model with reflecting boundary conditions based on discrete high-frequency observations. We prove a general posterior contraction rate theorem in $L^2$-loss, which…

统计理论 · 数学 2025-08-12 Marc Hoffmann , Kolyan Ray

We rigorously analyse fully-trained neural networks of arbitrary depth in the Bayesian optimal setting in the so-called proportional scaling regime where the number of training samples and width of the input and all inner layers diverge…

统计理论 · 数学 2025-05-07 Francesco Camilli , Daria Tieplova , Eleonora Bergamin , Jean Barbier

In the setting of high-dimensional linear models with Gaussian noise, we investigate the possibility of confidence statements connected to model selection. Although there exist numerous procedures for adaptive point estimation, the…

统计理论 · 数学 2009-10-07 Angelika Rohde , Lutz Duembgen

We propose an algorithm for Bayesian functional optimisation - that is, finding the function to optimise a process - guided by experimenter beliefs and intuitions regarding the expected characteristics (length-scale, smoothness, cyclicity…

机器学习 · 计算机科学 2020-09-09 Alistair Shilton , Sunil Gupta , Santu Rana , Svetha Venkatesh

We assume the direct sum <A> o <B> for the signal subspace. As a result of post- measurement, a number of operational contexts presuppose the a priori knowledge of the LB -dimensional "interfering" subspace <B> and the goal is to estimate…

应用统计 · 统计学 2017-04-17 Guillaume Bouleux , Rémy Boyer

Streaming tensor factorization is a powerful tool for processing high-volume and multi-way temporal data in Internet networks, recommender systems and image/video data analysis. Existing streaming tensor factorization algorithms rely on…

机器学习 · 统计学 2019-01-01 Cole Hawkins , Zheng Zhang

Compressing word embeddings is important for deploying NLP models in memory-constrained settings. However, understanding what makes compressed embeddings perform well on downstream tasks is challenging---existing measures of compression…

机器学习 · 计算机科学 2020-01-16 Avner May , Jian Zhang , Tri Dao , Christopher Ré