English
Related papers

Related papers: Parameter Learning for Log-supermodular Distributi…

200 papers

Latent variable models are an elegant framework for capturing rich probabilistic dependencies in many applications. However, current approaches typically parametrize these models using conditional probability tables, and learning relies…

Machine Learning · Computer Science 2012-10-19 Ankur P. Parikh , Le Song , Mariya Ishteva , Gabi Teodoru , Eric P. Xing

In nonadaptive group testing, the main research objective is to design an efficient algorithm to identify a set of up to $t$ positive elements among $n$ samples with as few tests as possible. Disjunct matrices and separable matrices are two…

Combinatorics · Mathematics 2021-10-15 Bingchen Qian , Xin Wang , Gennian Ge

Algorithms typically come with tunable parameters that have a considerable impact on the computational resources they consume. Too often, practitioners must hand-tune the parameters, a tedious and error-prone task. A recent line of research…

Machine Learning · Computer Science 2020-11-24 Maria-Florina Balcan , Tuomas Sandholm , Ellen Vitercik

To better understand complexity in neural networks, we theoretically investigate the idealised phenomenon of lossless network compressibility, whereby an identical function can be implemented with fewer hidden units. In the setting of…

Machine Learning · Computer Science 2024-05-27 Matthew Farrugia-Roberts

This work explores the novel idea of learning a submodular scoring function to improve the specificity/selectivity of existing feature attribution methods. Submodular scores are natural for attribution as they are known to accurately model…

Machine Learning · Computer Science 2022-02-23 Piyushi Manupriya , Tarun Ram Menta , J. Saketha Nath , Vineeth N Balasubramanian

We propose a Bayesian approximate inference method for learning the dependence structure of a Gaussian graphical model. Using pseudo-likelihood, we derive an analytical expression to approximate the marginal likelihood for an arbitrary…

Machine Learning · Statistics 2017-04-13 Janne Leppä-aho , Johan Pensar , Teemu Roos , Jukka Corander

This paper introduces an iterative algorithm for training nonparametric additive models that enjoys favorable memory storage and computational requirements. The algorithm can be viewed as the functional counterpart of stochastic gradient…

Machine Learning · Statistics 2026-01-01 Xin Chen , Jason M. Klusowski

Recently, over-parameterized neural networks have been extensively analyzed in the literature. However, the previous studies cannot satisfactorily explain why fully trained neural networks are successful in practice. In this paper, we…

Machine Learning · Computer Science 2019-10-28 Cong Fang , Hanze Dong , Tong Zhang

Rule sets are highly interpretable logical models in which the predicates for decision are expressed in disjunctive normal form (DNF, OR-of-ANDs), or, equivalently, the overall model comprises an unordered collection of if-then decision…

Machine Learning · Computer Science 2022-06-09 Fan Yang , Kai He , Linxiao Yang , Hongxia Du , Jingbang Yang , Bo Yang , Liang Sun

We study two model selection settings in stochastic linear bandits (LB). In the first setting, which we refer to as feature selection, the expected reward of the LB problem is in the linear span of at least one of $M$ feature maps (models).…

Machine Learning · Computer Science 2022-06-20 Ahmadreza Moradipari , Berkay Turan , Yasin Abbasi-Yadkori , Mahnoosh Alizadeh , Mohammad Ghavamzadeh

Recently, it has become evident that submodularity naturally captures widely occurring concepts in machine learning, signal processing and computer vision. Consequently, there is need for efficient optimization procedures for submodular…

Machine Learning · Computer Science 2013-11-19 Stefanie Jegelka , Francis Bach , Suvrit Sra

We introduce several generalizations of classical computer science problems obtained by replacing simpler objective functions with general submodular functions. The new problems include submodular load balancing, which generalizes load…

Data Structures and Algorithms · Computer Science 2010-06-02 Zoya Svitkina , Lisa Fleischer

Submodularity is a discrete domain functional property that can be interpreted as mimicking the role of the well-known convexity/concavity properties in the continuous domain. Submodular functions exhibit strong structure that lead to…

Signal Processing · Electrical Eng. & Systems 2023-07-19 Ehsan Tohidi , Rouhollah Amiri , Mario Coutino , David Gesbert , Geert Leus , Amin Karbasi

We introduce a novel algorithm for estimating optimal parameters of linearized assignment flows for image labeling. An exact formula is derived for the parameter gradient of any loss function that is constrained by the linear system of ODEs…

Machine Learning · Computer Science 2022-04-07 Alexander Zeilmann , Stefania Petra , Christoph Schnörr

In this paper we present an end-to-end meta-learned system for image compression. Traditional machine learning based approaches to image compression train one or more neural network for generalization performance. However, at inference…

Image and Video Processing · Electrical Eng. & Systems 2021-05-04 Nannan Zou , Honglei Zhang , Francesco Cricri , Hamed R. Tavakoli , Jani Lainema , Miska Hannuksela , Emre Aksu , Esa Rahtu

The vast majority of work in self-supervised learning, both theoretical and empirical (though mostly the latter), have largely focused on recovering good features for downstream tasks, with the definition of "good" often being intricately…

Machine Learning · Computer Science 2022-02-21 Bingbin Liu , Daniel Hsu , Pradeep Ravikumar , Andrej Risteski

Eclipsing binaries provide one of the most direct mechanisms for measuring stellar properties such as mass and radius, but historically, determining these properties has been non-trivial and computationally prohibitive. As such, only a…

Probabilistic models help us encode latent structures that both model the data and are ideally also useful for specific downstream tasks. Among these, mixture models and their time-series counterparts, hidden Markov models, identify…

Machine Learning · Computer Science 2021-10-29 Abhishek Sharma , Catherine Zeng , Sanjana Narayanan , Sonali Parbhoo , Finale Doshi-Velez

Spectral risk objectives - also called $L$-risks - allow for learning systems to interpolate between optimizing average-case performance (as in empirical risk minimization) and worst-case performance on a task. We develop stochastic…

Machine Learning · Statistics 2022-12-13 Ronak Mehta , Vincent Roulet , Krishna Pillutla , Lang Liu , Zaid Harchaoui

Modeling the complex relationships between multiple categorical response variables as a function of predictors is a fundamental task in the analysis of categorical data. However, existing methods can be difficult to interpret and may lack…

Methodology · Statistics 2024-10-08 Hongru Zhao , Aaron J. Molstad , Adam J. Rothman