中文
相关论文

相关论文: A Spectral Algorithm for List-Decodable Covariance…

200 篇论文

We study online inference and asymptotic covariance estimation for the stochastic gradient descent (SGD) algorithm. While classical methods (such as plug-in and batch-means estimators) are available, they either require inaccessible…

机器学习 · 统计学 2026-04-24 Ziyang Wei , Wanrong Zhu , Jingyang Lyu , Wei Biao Wu

Mixtures of Gaussian (or normal) distributions arise in a variety of application areas. Many heuristics have been proposed for the task of finding the component Gaussians given samples from the mixture, such as the EM algorithm, a…

概率论 · 数学 2007-05-23 Sanjeev Arora , Ravi Kannan

We revisit the problem of distribution learning within the framework of learning-augmented algorithms. In this setting, we explore the scenario where a probability distribution is provided as potentially inaccurate advice on the true,…

机器学习 · 计算机科学 2025-02-03 Arnab Bhattacharyya , Davin Choo , Philips George John , Themis Gouleakis

Given a graphical model (GM), computing its partition function is the most essential inference task, but it is computationally intractable in general. To address the issue, iterative approximation algorithms exploring certain local…

机器学习 · 计算机科学 2019-05-15 Sejun Park , Eunho Yang , Se-Young Yun , Jinwoo Shin

We study the problem of high-dimensional linear regression in a robust model where an $\epsilon$-fraction of the samples can be adversarially corrupted. We focus on the fundamental setting where the covariates of the uncorrupted samples are…

机器学习 · 计算机科学 2018-06-04 Ilias Diakonikolas , Weihao Kong , Alistair Stewart

We study the problem of detecting a change in the mean of one-dimensional Gaussian process data. This problem is investigated in the setting of increasing domain (customarily employed in time series analysis) and in the setting of fixed…

统计理论 · 数学 2017-04-11 Hossein Keshavarz , Clayton Scott , XuanLong Nguyen

In Gaussian graphical models, the likelihood equations must typically be solved iteratively. We investigate two algorithms: A version of iterative proportional scaling which avoids inversion of large matrices, and an algorithm based on…

统计计算 · 统计学 2023-12-12 Søren Højsgaard , Steffen Lauritzen

We study the fundamental problem of fixed design {\em multidimensional segmented regression}: Given noisy samples from a function $f$, promised to be piecewise linear on an unknown set of $k$ rectangles, we want to recover $f$ up to a…

数据结构与算法 · 计算机科学 2020-03-26 Ilias Diakonikolas , Jerry Li , Anastasia Voloshinov

Gaussian graphical models are widely utilized to infer and visualize networks of dependencies between continuous variables. However, inferring the graph is difficult when the sample size is small compared to the number of variables. To…

统计理论 · 数学 2016-09-30 Emilie Devijver , Mélina Gallopin

A novel Gaussian mixture model (GMM) aided sparse Bayesian learning (SBL) framework is proposed for channel state information (CSI) estimation in orthogonal time-frequency space (OTFS) modulated systems. The key attribute of the proposed…

信号处理 · 电气工程与系统科学 2026-03-31 Surbhi Gehlot , Suraj Srivastava , Sandeep Kumar Yadav , Lajos Hanzo

Semi-supervised learning is being extensively applied to estimate classifiers from training data in which not all the labels of the feature vectors are available. We present gmmsslm, an R package for estimating the Bayes' classifier from…

统计计算 · 统计学 2024-04-18 Ziyang Lyu , Daniel Ahfock , Ryan Thompson , Geoffrey J. McLachlan

We consider robust covariance estimation with group symmetry constraints. Non-Gaussian covariance estimation, e.g., Tyler scatter estimator and Multivariate Generalized Gaussian distribution methods, usually involve non-convex minimization…

机器学习 · 统计学 2013-06-19 Ilya Soloveychik , Ami Wiesel

We introduce an expander-sketching framework for list-decodable linear regression that achieves sample complexity $\tilde{O}((d+\log(1/\delta))/\alpha)$, list size $O(1/\alpha)$, and near input-sparsity running time…

机器学习 · 计算机科学 2025-12-01 Herbod Pourali , Sajjad Hashemian , Ebrahim Ardeshir-Larijani

We revisit the classical problem of estimating an unknown distribution from its samples by fitting a mixture model that minimizes cross-entropy loss. Framing the task as a stochastic convex optimization problem over the space of $ M…

机器学习 · 统计学 2026-05-26 Mohammadreza Ahmadypour , Tara Javidi , Farinaz Koushanfar

Motivated by a sampling problem basic to computational statistical inference, we develop a nearly optimal algorithm for a fundamental problem in spectral graph theory and numerical analysis. Given an $n\times n$ SDDM matrix ${\bf…

数据结构与算法 · 计算机科学 2014-10-21 Dehua Cheng , Yu Cheng , Yan Liu , Richard Peng , Shang-Hua Teng

We study Gaussian sparse estimation tasks in Huber's contamination model with a focus on mean estimation, PCA, and linear regression. For each of these tasks, we give the first sample and computationally efficient robust estimators with…

机器学习 · 计算机科学 2024-03-18 Ilias Diakonikolas , Daniel M. Kane , Sushrut Karmalkar , Ankit Pensia , Thanasis Pittas

We present a new framework to detect various types of variable objects within massive astronomical time-series data. Assuming that the dominant population of objects is non-variable, we find outliers from this population by using a…

天体物理仪器与方法 · 物理学 2010-01-17 Min-Su Shin , Michael Sekora , Yong-Ik Byun

We consider maximum likelihood estimation for Gaussian Mixture Models (Gmms). This task is almost invariably solved (in theory and practice) via the Expectation Maximization (EM) algorithm. EM owes its success to various factors, of which…

机器学习 · 统计学 2018-06-04 Reshad Hosseini , Suvrit Sra

We investigate a Gaussian mixture model (GMM) with component means constrained in a pre-selected subspace. Applications to classification and clustering are explored. An EM-type estimation algorithm is derived. We prove that the subspace…

机器学习 · 统计学 2015-08-27 Mu Qiao , Jia Li

Greedy Sampling Methods (GSMs) are widely used to construct approximate solutions of Configuration Optimization Problems (COPs), where a loss functional is minimized over finite configurations of points in a compact domain. While effective…

最优化与控制 · 数学 2026-01-09 Evie Nielen , Oliver Tse