English
Related papers

Related papers: Efficient Learning of Mixed Membership Models

200 papers

We propose a hierarchical architecture for efficiently computing high-quality solutions to structured mixed-integer programs (MIPs). To reduce computational effort, our approach decouples the original problem into a higher level problem and…

Optimization and Control · Mathematics 2025-12-04 Stefan Clarke , Bartolomeo Stellato

Process monitoring and control requires detection of structural changes in a data stream in real time. This article introduces an efficient sequential Monte Carlo algorithm designed for learning unknown changepoints in continuous time. The…

Applications · Statistics 2015-09-29 Melissa J. M. Turcotte , Nicholas A. Heard

We consider the problem of learning a non-negative linear classifier with a $1$-norm of at most $k$, and a fixed threshold, under the hinge-loss. This problem generalizes the problem of learning a $k$-monotone disjunction. We prove that we…

Machine Learning · Statistics 2016-04-19 Sivan Sabato , Shai Shalev-Shwartz , Nathan Srebro , Daniel Hsu , Tong Zhang

Multivariate polynomials arise in many different disciplines. Representing such a polynomial as a vector of univariate polynomials can offer useful insight, as well as more intuitive understanding. For this, techniques based on tensor…

Optimization and Control · Mathematics 2016-01-29 Gabriel Hollander , Philippe Dreesen , Mariya Ishteva , Johan Schoukens

We propose a probabilistic modeling framework for learning the dynamic patterns in the collective behaviors of social agents and developing profiles for different behavioral groups, using data collected from multiple information sources.…

Machine Learning · Statistics 2016-06-28 Lin Li , Ananthram Swami , Anna Scaglione

Accurate hardware performance models are critical to efficient code generation. They can be used by compilers to make heuristic decisions, by superoptimizers as a minimization objective, or by autotuners to find an optimal configuration for…

A common challenge faced in practical supervised learning, such as medical image processing and robotic interactions, is that there are plenty of tasks but each task cannot afford to collect enough labeled examples to be learned in…

Machine Learning · Computer Science 2020-06-22 Weihao Kong , Raghav Somani , Sham Kakade , Sewoong Oh

This paper establishes theoretical bonafides for implicit concurrent multivariate effect evaluation--implicit concurrency for short---a broad and versatile computational learning efficiency thought to underlie general-purpose, non-local,…

Neural and Evolutionary Computing · Computer Science 2013-07-16 Keki M. Burjorjee

In this paper we give an optimization for active learning algorithms, applicable to learning Moore machines where the output comprises several observables. These machines can be decomposed themselves by projecting on each observable,…

Software Engineering · Computer Science 2017-05-09 Joshua Moerman

Mixed-integer optimization problems arise in a wide range of control applications. Benders decomposition is a widely used algorithm for solving such problems by decomposing them into a mixed-integer master problem and a continuous…

Optimization and Control · Mathematics 2026-04-07 Bernard T. Agyeman , Zhe Li , Ilias Mitrai , Prodromos Daoutidis

Over recent years it has become well accepted that user interest is not static or immutable. There are a variety of contextual factors, such as time of day, the weather or the user's mood, that influence the current interests of the user.…

Information Retrieval · Computer Science 2025-04-15 Joey De Pauw , Bart Goethals

This paper presents two different efficiency-enhancement techniques for probabilistic model building genetic algorithms. The first technique proposes the use of a mutation operator which performs local search in the sub-solution…

Neural and Evolutionary Computing · Computer Science 2007-05-23 Kumara Sastry , David E. Goldberg , Martin Pelikan

Federated learning brings potential benefits of faster learning, better solutions, and a greater propensity to transfer when heterogeneous data from different parties increases diversity. However, because federated learning tasks tend to be…

Machine Learning · Computer Science 2021-01-18 Duc Thien Nguyen , Shiau Hoong Lim , Laura Wynter , Desmond Cai

We propose a machine learning approach for quickly solving Mixed Integer Programs (MIP) by learning to prioritize a set of decision variables, which we call pseudo-backdoors, for branching that results in faster solution times.…

Machine Learning · Computer Science 2021-06-10 Aaron Ferber , Jialin Song , Bistra Dilkina , Yisong Yue

We investigate the use of the Multiple Optimised Parameter Estimation and Data compression algorithm (MOPED) for data compression and faster evaluation of likelihood functions. Since MOPED only guarantees maintaining the Fisher matrix of…

Instrumentation and Methods for Astrophysics · Physics 2011-05-17 Philip Graff , Mike Hobson , Anthony Lasenby

Many convex optimization problems with important applications in machine learning are formulated as empirical risk minimization (ERM). There are several examples: linear and logistic regression, LASSO, kernel regression, quantile…

Machine Learning · Computer Science 2023-05-30 Song Bian , Zhao Song , Junze Yin

Although deep reinforcement learning has advanced significantly over the past several years, sample efficiency remains a major challenge. Careful choice of input representations can help improve efficiency depending on the structure present…

Machine Learning · Computer Science 2019-05-08 John Mern , Dorsa Sadigh , Mykel Kochenderfer

For several years, model-based clustering methods have successfully tackled many of the challenges presented by data-analysts. However, as the scope of data analysis has evolved, some problems may be beyond the standard mixture model…

Computation · Statistics 2018-08-31 Arthur White , Thomas Brendan Murphy

We study the problem of learning a distribution from samples, when the underlying distribution is a mixture of product distributions over discrete domains. This problem is motivated by several practical applications such as crowd-sourcing,…

Machine Learning · Statistics 2014-05-20 Prateek Jain , Sewoong Oh

We consider the problem of learning a mixture of linear regressions (MLRs). An MLR is specified by $k$ nonnegative mixing weights $p_1, \ldots, p_k$ summing to $1$, and $k$ unknown regressors $w_1,...,w_k\in\mathbb{R}^d$. A sample from the…

Data Structures and Algorithms · Computer Science 2019-12-18 Sitan Chen , Jerry Li , Zhao Song