English
Related papers

Related papers: Non-Euclidean Conditional Expectation and Filterin…

200 papers

For some typical and widely used non-convex half-quadratic regularization models and the Ambrosio-Tortorelli approximate Mumford-Shah model, based on the Kurdyka-\L ojasiewicz analysis and the recent nonconvex proximal algorithms, we…

Optimization and Control · Mathematics 2021-07-30 Shengxiang Deng , Ismail Ben Ayed , Hongpeng Sun

Nonconvex optimization problems are widespread in modern machine learning and data science. We introduce an extrapolation strategy into a class of preconditioned second-order convex splitting algorithms for nonconvex optimization problems.…

Optimization and Control · Mathematics 2025-12-19 Xinhua Shen , Hongpeng Sun

The Euclidean scattering transform was introduced nearly a decade ago to improve the mathematical understanding of the success of convolutional neural networks (ConvNets) in image data analysis and other tasks. Inspired by recent interest…

Machine Learning · Statistics 2019-06-06 Michael Perlmutter , Guy Wolf , Matthew Hirn

We introduce a regression model for data on non-linear manifolds. The model describes the relation between a set of manifold valued observations, such as shapes of anatomical objects, and Euclidean explanatory variables. The approach is…

Other Computer Science · Computer Science 2017-03-02 Line Kühnel , Stefan Sommer

We present a new and compelling approach to the efficient solution of important computational problems that arise in the context of abstract argumentation. Our approach makes known algorithms defined for restricted fragments generally…

Artificial Intelligence · Computer Science 2011-04-18 Sebastian Ordyniak , Stefan Szeider

Most of the optimal guidance problems can be formulated as nonconvex optimization problems, which can be solved indirectly by relaxation, convexification, or linearization. Although these methods are guaranteed to converge to the global…

Optimization and Control · Mathematics 2024-03-19 Gyubin Park , Jiwoo Choi , Da Hoon Jeong , Jong-Han Kim

In this paper, we consider a modified projected Gauss-Newton method for solving constrained nonlinear least-squares problems. We assume that the functional constraints are smooth and the the other constraints are represented by a simple…

Optimization and Control · Mathematics 2025-04-02 Yassine Nabou , Lucian Toma , Ion Necoara

Gaussian processes (GPs) are very widely used for modeling of unknown functions or surfaces in applications ranging from regression to classification to spatial processes. Although there is an increasingly vast literature on applications,…

Methodology · Statistics 2017-06-28 Lizhen Lin , Mu Niu , Pokman Cheung , David Dunson

In this paper, we propose a catalog of iterative methods for solving the Split Feasibility Problem in the non-convex setting. We study four different optimization formulations of the problem, where each model has advantageous in different…

Optimization and Control · Mathematics 2020-10-12 Aviv Gibali , Shoham Sabach , Sergey Voldman

We present a theoretical framework and numerical methods for predicting the large-scale properties of solutions of partial differential equations that are too complex to be properly resolved. We assume that prior statistical information…

Numerical Analysis · Mathematics 2025-10-20 A. J. Chorin , A. Kast , R. Kupferman

The proximal gradient method is a generic technique introduced to tackle the non-smoothness in optimization problems, wherein the objective function is expressed as the sum of a differentiable convex part and a non-differentiable…

Numerical Analysis · Mathematics 2024-01-19 Abdeslem Hafid Bentbib , Khalide Jbilou , Ridwane Tahiri

We propose a novel, theoretically-grounded, acquisition function for Batch Bayesian optimization informed by insights from distributionally ambiguous optimization. Our acquisition function is a lower bound on the well-known Expected…

Machine Learning · Statistics 2018-04-17 Nikitas Rontsis , Michael A. Osborne , Paul J. Goulart

Motivated by variational models in continuum mechanics, we introduce a novel algorithm to perform nonsmooth and nonconvex minimizations with linear constraints in Euclidean spaces. We show how this algorithm is actually a natural…

Analysis of PDEs · Mathematics 2015-03-20 Marco Artina , Massimo Fornasier , Francesco Solombrino

We consider the fundamental task of optimising a real-valued function defined in a potentially high-dimensional Euclidean space, such as the loss function in many machine-learning tasks or the logarithm of the probability distribution in…

Machine Learning · Statistics 2024-03-20 Marcelo Hartmann , Bernardo Williams , Hanlin Yu , Mark Girolami , Alessandro Barp , Arto Klami

Conditional kernel mean embeddings form an attractive nonparametric framework for representing conditional means of functions, describing the observation processes for many complex models. However, the recovery of the original underlying…

Machine Learning · Statistics 2019-06-04 Kelvin Hsu , Fabio Ramos

Shape estimation and object reconstruction are common problems in image analysis. Mathematically, viewing objects in the image plane as random sets reduces the problem of shape estimation to inference about sets. Currently existing…

Methodology · Statistics 2009-03-12 Larissa I. Stanberry , Hanna K. Jankowski

Expectiles are statistical parameters which also provide a class of sublinear risk measures in finance. They are solutions of continuous optimization problems. The corresponding first order condition provides two different fixed point…

Statistics Theory · Mathematics 2025-09-03 Thi Khanh Linh Ha , Andreas Heinrich Hamel , Daniel Kostner

The binary Euclidean algorithm is a modification of the classical Euclidean algorithm for computation of greatest common divisors which avoids ordinary integer division in favour of division by powers of two only. The expectation of the…

Dynamical Systems · Mathematics 2014-09-03 Ian D. Morris

Bayesian quadrature is a probabilistic, model-based approach to numerical integration, the estimation of intractable integrals, or expectations. Although Bayesian quadrature was popularised already in the 1980s, no systematic and…

Machine Learning · Computer Science 2026-02-19 Maren Mahsereci , Toni Karvonen

Conditional gradients constitute a class of projection-free first-order algorithms for smooth convex optimization. As such, they are frequently used in solving smooth convex optimization problems over polytopes, for which the computational…

Optimization and Control · Mathematics 2019-10-14 Jelena Diakonikolas , Alejandro Carderera , Sebastian Pokutta