English
Related papers

Related papers: Probabilistic Segmentation via Total Variation Reg…

200 papers

Optimization problems over discrete or quantized variables are very challenging in general due to the combinatorial nature of their search space. Piecewise-affine regularization (PAR) provides a flexible modeling and computational framework…

Machine Learning · Computer Science 2025-08-18 Jianhao Ma , Lin Xiao

We derive an efficient stochastic algorithm for inverse problems that present an unknown linear forcing term and a set of nonlinear parameters to be recovered. It is assumed that the data is noisy and that the linear part of the problem is…

Numerical Analysis · Mathematics 2019-09-17 Darko Volkov

Well-calibrated probabilistic regression models are a crucial learning component in robotics applications as datasets grow rapidly and tasks become more complex. Unfortunately, classical regression models are usually either probabilistic…

Machine Learning · Computer Science 2023-09-12 Hany Abdulsamad , Peter Nickl , Pascal Klink , Jan Peters

The performance of penalized likelihood approaches depends profoundly on the selection of the tuning parameter; however, there is no commonly agreed-upon criterion for choosing the tuning parameter. Moreover, penalized likelihood estimation…

Methodology · Statistics 2018-05-09 Yang Liu , Peng Wang

Probabilistic convolutional neural networks, which predict distributions of predictions instead of point estimates, led to recent advances in many areas of computer vision, from image reconstruction to semantic segmentation. Besides state…

Computer Vision and Pattern Recognition · Computer Science 2021-01-19 Josef Lorenz Rumberger , Lisa Mais , Dagmar Kainmueller

Within the statistical and machine learning literature, regularization techniques are often used to construct sparse (predictive) models. Most regularization strategies only work for data where all predictors are treated identically, such…

Computation · Statistics 2020-12-16 Sander Devriendt , Katrien Antonio , Tom Reynkens , Roel Verbelen

We propose a distributionally robust formulation of the traditional risk parity portfolio optimization problem. Distributional robustness is introduced by targeting the discrete probabilities attached to each observation used during…

Optimization and Control · Mathematics 2021-10-14 Giorgio Costa , Roy H. Kwon

In this paper, we propose a novel class of Piecewise Deterministic Markov Processes (PDMPs) that are designed to sample from probability distributions $\pi$ supported on a convex set $\mathcal{M}$. This class of PDMPs adapts the concept of…

Computation · Statistics 2026-05-01 Joël Tatang Demano , Paul Dobson , Konstantinos Zygalakis

In this paper, we develop a parameterized proximal point algorithm (P-PPA) for solving a class of separable convex programming problems subject to linear and convex constraints. The proposed algorithm is provable to be globally convergent…

Optimization and Control · Mathematics 2018-12-11 Jianchao Bai , Hongchao Zhang , Jicheng Li

In recent years, mixup regularization has gained popularity as an effective way to improve the generalization performance of deep learning models by training on convex combinations of training data. While many mixup variants have been…

Machine Learning · Computer Science 2025-06-16 Yousef El-Laham , Niccolò Dalmasso , Svitlana Vyetrenko , Vamsi K. Potluru , Manuela Veloso

Convex regression is a promising area for bridging statistical estimation and deterministic convex optimization. New piecewise linear convex regression methods are fast and scalable, but can have instability when used to approximate…

Machine Learning · Computer Science 2012-06-22 Lauren Hannah , David Dunson

We develop an approach to risk minimization and stochastic optimization that provides a convex surrogate for variance, allowing near-optimal and computationally efficient trading between approximation and estimation error. Our approach…

Machine Learning · Statistics 2017-12-15 John Duchi , Hongseok Namkoong

We consider a new framework where a continuous, though bounded, random variable has unobserved bounds that vary over time. In the context of univariate time series, we look at the bounds as parameters of the distribution of the bounded…

Machine Learning · Statistics 2023-06-26 Amandine Pierrot , Pierre Pinson

Devising efficient algorithms that track the optimizers of continuously varying convex optimization problems is key in many applications. A possible strategy is to sample the time-varying problem at constant rate and solve the resulting…

Optimization and Control · Mathematics 2017-11-28 Andrea Simonetto

We develop a robust convex algorithm to select the regularization parameter in model selection. In practice this would be automated in order to save practitioners time from having to tune it manually. In particular, we implement and test…

Optimization and Control · Mathematics 2014-12-03 Dustin Tran

We consider a generic convex optimization problem associated with regularized empirical risk minimization of linear predictors. The problem structure allows us to reformulate it as a convex-concave saddle point problem. We propose a…

Optimization and Control · Mathematics 2015-09-10 Yuchen Zhang , Lin Xiao

The recently developed Distributed Block Proximal Method, for solving stochastic big-data convex optimization problems, is studied in this paper under the assumption of constant stepsizes and strongly convex (possibly non-smooth) local…

Optimization and Control · Mathematics 2020-03-06 Francesco Farina , Giuseppe Notarstefano

Traditional pairwise sequence alignment is based on matching individual samples from two sequences, under time monotonicity constraints. However, in many application settings matching subsequences (segments) instead of individual samples…

Databases · Computer Science 2016-09-28 Shahriar Shariat , Vladimir Pavlovic

Clustering, like covariate selection for classification, is an important step to compress and interpret the data. However, clustering of covariates is often performed independently of the classification step, which can lead to undesirable…

Computation · Statistics 2020-04-08 Daniel Andrade , Kenji Fukumizu , Yuzuru Okajima

We propose a novel and unified framework for change-point estimation in multivariate time series. The proposed method is fully nonparametric, enjoys effortless tuning and is robust to temporal dependence. One salient and distinct feature of…

Methodology · Statistics 2022-09-12 Zifeng Zhao , Feiyu Jiang , Xiaofeng Shao