English
Related papers

Related papers: Optimally-Transported Generalized Method of Moment…

200 papers

Optimal Transport has received much attention in Machine Learning as it allows to compare probability distributions by exploiting the geometry of the underlying space. However, in its original formulation, solving this problem suffers from…

Machine Learning · Computer Science 2023-11-27 Clément Bonet

The Method of Moments [Pea94] is one of the most widely used methods in statistics for parameter estimation, by means of solving the system of equations that match the population and estimated moments. However, in practice and especially…

Statistics Theory · Mathematics 2019-04-16 Yihong Wu , Pengkun Yang

We propose a family of relaxations of the optimal transport problem which regularize the problem by introducing an additional minimization step over a small region around one of the underlying transporting measures. The type of…

Machine Learning · Statistics 2019-06-11 Saied Mahdian , Jose Blanchet , Peter Glynn

We develop a practical way of addressing the Errors-In-Variables (EIV) problem in the Generalized Method of Moments (GMM) framework. We focus on the settings in which the variability of the EIV is a fraction of that of the mismeasured…

Econometrics · Economics 2025-11-11 Kirill S. Evdokimov , Andrei Zeleneev

We study a parametric estimation problem related to moment condition models. As an alternative to the generalized empirical likelihood (GEL) and the generalized method of moments (GMM), a Bayesian approach to the problem can be adopted,…

Statistics Theory · Mathematics 2012-03-02 Paul Rochet

With recent advances in sequencing technologies, large amounts of epigenomic data have become available and computational methods are contributing significantly to the progress of epigenetic research. As an orthogonal approach to methods…

Genomics · Quantitative Biology 2019-11-05 Alexander Lück , Verena Wolf

Classifying the training data correctly without over-fitting is one of the goals in machine learning. In this paper, we propose a generalization-memorization mechanism, including a generalization-memorization decision and a memory modeling…

Machine Learning · Computer Science 2024-04-09 Zhen Wang , Yuan-Hai Shao

Optimal transport has gained significant attention in recent years due to its effectiveness in deep learning and computer vision. Its descendant metric, the Wasserstein distance, has been particularly successful in measuring distribution…

Optimization and Control · Mathematics 2025-02-18 Kaiwen Shi

Optimal transport is widely used to learn distributions, enforce distributional constraints, and model uncertainty. In applications, transport losses are often computed from samples through tractable representations, such as one-dimensional…

Optimization and Control · Mathematics 2026-05-28 Tam Le

The Optimal transport (OT) problem is rapidly finding its way into machine learning. Favoring its use are its metric properties. Many problems admit solutions with guarantees only for objects embedded in metric spaces, and the use of…

Machine Learning · Computer Science 2022-12-26 Liang Mi , Azadeh Sheikholeslami , José Bento

Contextual optimization enhances decision quality by leveraging side information to improve predictions of uncertain parameters. However, existing approaches face significant challenges when dealing with multimodal or mixtures of…

Optimization and Control · Mathematics 2025-09-19 YoungChul Yoon , Grani A. Hanasusanto , Yijie Wang

Optimal transport (OT) provides powerful tools for comparing probability measures in various types. The Wasserstein distance which arises naturally from the idea of OT is widely used in many machine learning applications. Unfortunately,…

Optimization and Control · Mathematics 2021-06-03 Shu Liu , Haodong Sun , Hongyuan Zha

A generalized method of moments (GMM) estimator is unreliable for a large number of moment conditions, that is, it is comparable, or larger than the sample size. While classical GMM literature proposes several provisions to this problem,…

Computation · Statistics 2021-03-11 Masahiro Tanaka

Many problems in machine learning involve calculating correspondences between sets of objects, such as point clouds or images. Discrete optimal transport provides a natural and successful approach to such tasks whenever the two sets of…

Machine Learning · Statistics 2019-02-28 David Alvarez-Melis , Stefanie Jegelka , Tommi S. Jaakkola

Optimal transportation theory and the related $p$-Wasserstein distance ($W_p$, $p\geq 1$) are widely-applied in statistics and machine learning. In spite of their popularity, inference based on these tools has some issues. For instance, it…

Statistics Theory · Mathematics 2024-03-01 Yiming Ma , Hang Liu , Davide La Vecchia , Metthieu Lerasle

By building upon the recent theory that established the connection between implicit generative modeling (IGM) and optimal transport, in this study, we propose a novel parameter-free algorithm for learning the underlying distributions of…

Machine Learning · Statistics 2019-06-12 Antoine Liutkus , Umut Şimşekli , Szymon Majewski , Alain Durmus , Fabian-Robert Stöter

We introduce the Gaussian transform (GT), an optimal transport inspired iterative method for denoising and enhancing latent structures in datasets. Under the hood, GT generates a new distance function (GT distance) on a given dataset by…

Machine Learning · Computer Science 2020-06-23 Kun Jin , Facundo Mémoli , Zhengchao Wan

We consider the problem of solving the optimal transport problem between two empirical distributions with missing values. Our main assumption is that the data is missing completely at random (MCAR), but we allow for heterogeneous…

Machine Learning · Statistics 2025-05-26 Linus Bleistein , Aurélien Bellet , Julie Josse

The Gromov-Wasserstein (GW) problem is an extension of the classical optimal transport problem to settings where the source and target distributions reside in incomparable spaces, and for which a cost function that attributes the price of…

Optimization and Control · Mathematics 2025-04-22 Hoang Anh Tran , Binh Tuan Nguyen , Yong Sheng Soh

Inference in models where the parameter is defined by moment inequalities is of interest in many areas of economics. This paper develops a new method for improving the performance of generalized moment selection (GMS) testing procedures in…

Econometrics · Economics 2020-08-26 Rami V. Tabri , Christopher D. Walker