English
Related papers

Related papers: Theoretical Analysis for Expectation-Maximization-…

200 papers

The Expectation-Maximization algorithm is perhaps the most broadly used algorithm for inference of latent variable problems. A theoretical understanding of its performance, however, largely remains lacking. Recent results established that…

Machine Learning · Statistics 2019-05-30 Jeongyeol Kwon , Wei Qian , Constantine Caramanis , Yudong Chen , Damek Davis

The Expectation Maximization (EM) algorithm is of key importance for inference in latent variable models including mixture of regressors and experts, missing observations. This paper introduces a novel EM algorithm, called…

Machine Learning · Computer Science 2020-12-04 Gersende Fort , Eric Moulines , Hoi-To Wai

We develop an unsupervised mixture model for non-negative, skewed and heavy-tailed data, such as losses in actuarial and risk management applications. The mixture has a lognormal component, which is usually appropriate for the body of the…

Methodology · Statistics 2025-05-29 Marco Bee , Flavio Santi

As machine learning applications grow increasingly ubiquitous and complex, they face an increasing set of requirements beyond accuracy. The prevalent approach to handle this challenge is to aggregate a weighted combination of requirement…

Machine Learning · Computer Science 2026-01-07 Aneesh Barthakur , Luiz F. O. Chamon

Over the last decade, researchers and engineers have developed a vast body of methodologies and technologies in requirements engineering for self-adaptive systems. Although existing studies have explored various aspects of this topic, few…

Software Engineering · Computer Science 2021-08-23 Zhuoqun Yang , Zhi Li , Zhi Jin

Standard regularized training procedures correspond to maximizing a posterior distribution over parameters, known as maximum a posteriori (MAP) estimation. However, model parameters are of interest only insomuch as they combine with the…

Machine Learning · Computer Science 2023-11-28 Shikai Qiu , Tim G. J. Rudner , Sanyam Kapoor , Andrew Gordon Wilson

We study the maximum of the random assignment process on rectangular matrices. We derive first-order asymptotics for the expected maximum, prove a law of large numbers under mild tail assumptions, and obtain exponential upper bounds for the…

Probability · Mathematics 2025-09-23 Timofey Moskalenko

We study an EM algorithm for estimating product-term regression models with missing data. The study of such problems in the likelihood tradition has thus far been restricted to an EM algorithm method using full numerical integration.…

Methodology · Statistics 2021-11-16 Dale S. Kim

Image registration has traditionally been done using two distinct approaches: learning based methods, relying on robust deep neural networks, and optimization-based methods, applying complex mathematical transformations to warp images…

Computer Vision and Pattern Recognition · Computer Science 2024-01-22 Gabriel De Araujo , Shanlin Sun , Xiaohui Xie

We discretize a risk-neutral optimal control problem governed by a linear elliptic partial differential equation with random inputs using a Monte Carlo sample-based approximation and a finite element discretization, yielding finite…

Optimization and Control · Mathematics 2023-11-10 Johannes Milz

The iterative nature of the expectation maximization (EM) algorithm presents a challenge for privacy-preserving estimation, as each iteration increases the amount of noise needed. We propose a practical private EM algorithm that overcomes…

Machine Learning · Computer Science 2016-11-01 Mijung Park , Jimmy Foulds , Kamalika Chaudhuri , Max Welling

Approximating solutions of ordinary and partial differential equations constitutes a significant challenge. Based on functional expressions that inherently depend on neural networks, neural forms are specifically designed to precisely…

Artificial Intelligence · Computer Science 2024-09-27 Adam D. Kypriadis , Isaac E. Lagaris , Aristidis Likas , Konstantinos E. Parsopoulos

In this paper, an Extreme Learning Machine (ELM) based technique for Multi-label classification problems is proposed and discussed. In multi-label classification, each of the input data samples belongs to one or more than one class labels.…

Machine Learning · Computer Science 2016-09-06 Rajasekar Venkatesan , Meng Joo Er

Neural network models and deep models are one of the leading and state of the art models in machine learning. Most successful deep neural models are the ones with many layers which highly increases their number of parameters. Training such…

Machine Learning · Computer Science 2018-07-17 Soufiane Belharbi

Lagrangian particle formulations of the large deformation diffeomorphic metric mapping algorithm (LDDMM) only allow for the study of a single shape. In this paper, we introduce and discuss both a theoretical and practical setting for the…

Optimization and Control · Mathematics 2015-03-04 Sylvain Arguillère , Emmanuel Trélat , Alain Trouvé , Laurent Younes

Recent advances in machine learning have spurred significant interest in learning-augmented algorithms, particularly for online optimization. A growing body of work has studied online bidding in this framework, aiming to characterize the…

Data Structures and Algorithms · Computer Science 2026-05-11 Changyeol Lee , Dahoon Lee , Jongseo Lee , Yongho Shin , Changki Yun

The map-matching is an essential preprocessing step for most of the trajectory-based applications. Although it has been an active topic for more than two decades and, driven by the emerging applications, is still under development. There is…

Databases · Computer Science 2019-10-30 Pingfu Chao , Yehong Xu , Wen Hua , Xiaofang Zhou

Hidden Markov models have successfully been applied as models of discrete time series in many fields. Often, when applied in practice, the parameters of these models have to be estimated. The currently predominating identification methods,…

Machine Learning · Statistics 2015-07-24 Robert Mattila , Cristian R. Rojas , Bo Wahlberg

Ellipsoid fitting is of general interest in machine vision, such as object detection and shape approximation. Most existing approaches rely on the least-squares fitting of quadrics, minimizing the algebraic or geometric distances, with…

Computer Vision and Pattern Recognition · Computer Science 2021-10-27 Zhao Mingyang , Jia Xiaohong , Ma Lei , Qiu Xinlin , Jiang Xin , Yan Dong-Ming

We propose a nonlinear registration-based model reduction procedure for rapid and reliable solution of parameterized two-dimensional steady conservation laws. This class of problems is challenging for model reduction techniques due to the…

Numerical Analysis · Mathematics 2022-03-14 Andrea Ferrero , Tommaso Taddei , Lei Zhang