English
Related papers

Related papers: MoDaH achieves rate optimal batch correction

200 papers

This paper investigates the computational and statistical limits in clustering matrix-valued observations. We propose a low-rank mixture model (LrMM), adapted from the classical Gaussian mixture model (GMM) to treat matrix-valued…

Statistics Theory · Mathematics 2023-06-08 Zhongyuan Lyu , Dong Xia

Bayesian methods for low-rank matrix completion with noise have been shown to be very efficient computationally. While the behaviour of penalized minimization methods is well understood both from the theoretical and computational points of…

Statistics Theory · Mathematics 2015-04-08 The Tien Mai , Pierre Alquier

Mixture models have attracted significant attention due to practical effectiveness and comprehensive theoretical foundations. A persisting challenge is model misspecification, which occurs when the model to be fitted has more mixture…

Machine Learning · Computer Science 2026-03-09 Zhankun Luo , Abolfazl Hashemi

Mixture of Experts (MoE) are successful models for modeling heterogeneous data in many statistical learning problems including regression, clustering and classification. Generally fitted by maximum likelihood estimation via the well-known…

Machine Learning · Statistics 2018-10-30 Faicel Chamroukhi , Bao-Tuyen Huynh

Maximum Likelihood (ML) algorithms, for the joint estimation of synchronization impairments and channel in Multiple Input Multiple Output-Orthogonal Frequency Division Multiplexing (MIMO-OFDM) system, are investigated in this work. A system…

Information Theory · Computer Science 2012-10-30 Renu Jose , K. V. S. Hari

Experimental design is central to science and engineering. A ubiquitous challenge is how to maximize the value of information obtained from expensive or constrained experimental settings. Bayesian optimal experimental design (OED) provides…

Methodology · Statistics 2026-02-13 Sofia Mäkinen , Andrew B. Duncan , Tapio Helin

We propose a batchwise monotone algorithm for dictionary learning. Unlike the state-of-the-art dictionary learning algorithms which impose sparsity constraints on a sample-by-sample basis, we instead treat the samples as a batch, and impose…

Machine Learning · Computer Science 2015-02-03 Huan Wang , John Wright , Daniel Spielman

In mass spectrometry based quantitative proteomics research, the emerging iTRAQ technique has been widely adopted for high throughput protein profiling, as it enables one to measure multiple samples simultaneously in one multiplex…

Applications · Statistics 2016-01-26 Lin S. Chen , Jiebiao Wang , Xianlong Wang , Pei Wang

State-of-the-art causal discovery methods usually assume that the observational data is complete. However, the missing data problem is pervasive in many practical scenarios such as clinical trials, economics, and biology. One…

Machine Learning · Computer Science 2023-01-18 Erdun Gao , Ignavier Ng , Mingming Gong , Li Shen , Wei Huang , Tongliang Liu , Kun Zhang , Howard Bondell

Large-scale nonsmooth optimization problems arise in many real-world applications, but obtaining exact function and subgradient values for these problems may be computationally expensive or even infeasible. In many practical settings, only…

Optimization and Control · Mathematics 2026-04-10 Jenni Lampainen , Kaisa Joki , Napsu Karmitsa , Marko M. Mäkelä

We consider fits to two or more datasets for which results from the sa me experiment share a common systematic uncertainty in addition to their individ ual statistical errors. This is important in extracting the maximum information from a…

Data Analysis, Statistics and Probability · Physics 2020-09-29 Roger John Barlow

Many physical systems evolve on matrix Lie groups and mixture filtering designed for such manifolds represent an inevitable tool for challenging estimation problems. However, mixture filtering faces the issue of a constantly growing number…

Systems and Control · Computer Science 2017-08-22 Josip Cesic , Ivan Markovic , Ivan Petrovic

The denoising diffusion model has recently emerged as a powerful generative technique, capable of transforming noise into meaningful data. While theoretical convergence guarantees for diffusion models are well established when the target…

Machine Learning · Computer Science 2025-03-28 Yuchen Liang , Peizhong Ju , Yingbin Liang , Ness Shroff

Score-based diffusion models, while achieving minimax optimality for sampling, are often hampered by slow sampling speeds due to the high computational burden of score function evaluations. Despite the recent remarkable empirical advances…

Machine Learning · Computer Science 2025-02-27 Gen Li , Changxiao Cai

Mixture of Experts (MoE) models constitute a widely utilized class of ensemble learning approaches in statistics and machine learning, known for their flexibility and computational efficiency. They have become integral components in…

Machine Learning · Statistics 2025-05-26 Tuan Thai , TrungTin Nguyen , Dat Do , Nhat Ho , Christopher Drovandi

We introduce new online and batch algorithms that are robust to data with missing features, a situation that arises in many practical applications. In the online setup, we allow for the comparison hypothesis to change as a function of the…

Machine Learning · Computer Science 2012-02-19 Afshin Rostamizadeh , Alekh Agarwal , Peter Bartlett

Machine learning models have traditionally been developed under the assumption that the training and test distributions match exactly. However, recent success in few-shot learning and related problems are encouraging signs that these models…

Machine Learning · Statistics 2020-10-15 James Lucas , Mengye Ren , Irene Kameni , Toniann Pitassi , Richard Zemel

Towards predicting patch correctness in APR, we propose a simple, but novel hypothesis on how the link between the patch behaviour and failing test specifications can be drawn: similar failing test cases should require similar patches. We…

Software Engineering · Computer Science 2022-03-17 Haoye Tian , Yinghua Li , Weiguo Pian , Abdoul Kader Kaboré , Kui Liu , Andrew Habib , Jacques Klein , Tegawendé F. Bissyande

In many scientific and engineering domains, physical experiments are often costly, non-replicable, or time-consuming. The Kennedy and O'Hagan (KOH) model framework has become a widely used approach for combining simulator runs with limited…

Computation · Statistics 2026-03-18 Hao Zhu , Markus Hainy

We present a general method for fitting finite mixture models (FMM). Learning in a mixture model consists of finding the most likely cluster assignment for each data-point, as well as finding the parameters of the clusters themselves. In…

Machine Learning · Statistics 2019-12-20 Mathias Edman , Neil Dhir