English
Related papers

Related papers: An Objective Prior from a Scoring Rule

200 papers

This paper is concerned with objective value performance of the scenario approach for robust convex optimization. A novel method is proposed to derive probabilistic bounds for the objective value from scenario programs with a finite number…

Optimization and Control · Mathematics 2022-04-20 Zheming Wang , Raphaël M. Jungers

In this technical note, we deal with a spectrum approximation problem arising in THREE-like multivariate spectral estimation approaches. The solution to the problem minimizes a suitable divergence index with respect to an a priori spectral…

Optimization and Control · Mathematics 2014-06-27 Mattia Zorzi

Score-based diffusion models have emerged as powerful tools in generative modeling, yet their theoretical foundations remain underexplored. In this work, we focus on the Wasserstein convergence analysis of score-based diffusion models.…

Machine Learning · Statistics 2025-02-10 Yifeng Yu , Lu Yu

This paper presents and investigates an inexact proximal gradient method for solving composite convex optimization problems characterized by an objective function composed of a sum of a full-domain differentiable convex function and a…

Optimization and Control · Mathematics 2025-04-16 Yunier Bello-Cruz , Max L. N. Gonçalves , Jefferson G. Melo , Cassandra Mohr

We propose an extension of a special form of gradient descent -- in the literature known as linearised Bregman iteration -- to a larger class of non-convex functions. We replace the classical (squared) two norm metric in the gradient…

Optimization and Control · Mathematics 2021-05-26 Martin Benning , Marta M. Betcke , Matthias J. Ehrhardt , Carola-Bibiane Schönlieb

This paper introduces and develops a novel variable importance score function in the context of ensemble learning and demonstrates its appeal both theoretically and empirically. Our proposed score function is simple and more straightforward…

Machine Learning · Statistics 2015-01-27 Ernest Fokoué

Automated decision making systems are increasingly being used in real-world applications. In these systems for the most part, the decision rules are derived by minimizing the training error on the available historical data. Therefore, if…

Machine Learning · Computer Science 2018-07-31 AmirEmad Ghassami , Sajad Khodadadian , Negar Kiyavash

Diffusion models are typically trained using score matching, a learning objective agnostic to the underlying noising process that guides the model. This paper argues that Markov noising processes enjoy an advantage over alternatives, as the…

Machine Learning · Statistics 2025-05-27 Zheyang Shen , Huihui Wang , Marina Riabiz , Chris J. Oates

Propensity score weighting is widely used to improve the representativeness and correct the selection bias in the voluntary sample. The propensity score is often developed using a model for the sampling probability, which can be subject to…

Methodology · Statistics 2022-07-20 Hengfang Wang , Jae Kwang Kim

Algorithmic decision systems are increasingly used in areas such as hiring, school admission, or loan approval. Typically, these systems rely on labeled data for training a classification model. However, in many scenarios, ground-truth…

Machine Learning · Computer Science 2021-07-19 Jakob Schoeffer , Niklas Kuehl , Isabel Valera

The choice of the prior distribution is a key aspect of Bayesian analysis. For the spatial regression setting a subjective prior choice for the parameters may not be trivial, from this perspective, using the objective Bayesian analysis…

Statistics Theory · Mathematics 2020-04-10 Jose A. Ordoñez , Marcos O. Prates , Larissa A. Matos , Victor H. Lachos

Score-based diffusion models are a recently developed framework for posterior sampling in Bayesian inverse problems with a state-of-the-art performance for severely ill-posed problems by leveraging a powerful prior distribution learned from…

We present a computational analysis that establishes the $O(1/K)$ convergence of the distributed gradient tracking method when the objective function is smooth and convex but not strongly convex. The analysis is inspired by recent work on…

Optimization and Control · Mathematics 2019-03-27 Shuo Han

We consider a difference-of-convex formulation where one of the terms is allowed to be hypoconvex (or weakly convex). We first examine the precise behavior of a single iteration of the Difference-of-Convex algorithm (DCA), giving a tight…

Optimization and Control · Mathematics 2024-03-26 Teodor Rotaru , Panagiotis Patrinos , François Glineur

Multi-objective preference alignment in language models often encounters a challenging trade-off: optimizing for one human preference (e.g., helpfulness) frequently compromises others (e.g., harmlessness) due to the inherent conflicts…

Computation and Language · Computer Science 2025-04-16 Zhihao Xu , Yongqi Tong , Xin Zhang , Jun Zhou , Xiting Wang

Diffusion and flow models achieve high generative quality but remain computationally expensive due to slow multi-step sampling. Distillation methods accelerate them by training fast student generators, yet most existing objectives lack a…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Yuanzhi Zhu , Eleftherios Tsonis , Lucas Degeorge , Vicky Kalogeiton

Methods for Projection Pursuit aim to facilitate the visual exploration of high-dimensional data by identifying interesting low-dimensional projections. A major challenge is the design of a suitable quality metric of projections, commonly…

Machine Learning · Computer Science 2015-11-30 Tijl De Bie , Jefrey Lijffijt , Raul Santos-Rodriguez , Bo Kang

A new class of general exponential ranking models is introduced which we label angle-based models for ranking data. A consensus score vector is assumed, which assigns scores to a set of items, where the scores reflect a consensus view of…

Methodology · Statistics 2017-12-27 Hang Xu , Mayer Alvo , Philip L. H. Yu

Convex optimization models find interesting applications, especially in signal/image processing and compressive sensing. We study some augmented convex models, which are perturbed by strongly convex functions, and propose a dual gradient…

Optimization and Control · Mathematics 2013-08-30 Hui Zhang , Lizhi Cheng , Wotao Yin

Learning to make decisions from observed data in dynamic environments remains a problem of fundamental importance in a number of fields, from artificial intelligence and robotics, to medicine and finance. This paper concerns the problem of…

Machine Learning · Statistics 2018-06-04 Jack Umenberger , Thomas B. Schön