English
Related papers

Related papers: Optimal Prediction of Multivalued Functions from P…

200 papers

The goal of regression analysis is to predict the value of a numeric outcome variable y given a vector of joint values of other (predictor) variables x. Usually a particular x-vector does not specify a repeatable value for y, but rather a…

Machine Learning · Statistics 2020-01-29 Jerome H. Friedman

The recent developments of basis pursuit and compressed sensing seek to extract information from as few samples as possible. In such applications, since the number of samples is restricted, one should deploy the sampling points wisely. We…

Information Theory · Computer Science 2012-07-26 Rui Wang , Haizhang Zhang

In this paper, we investigate the problem of optimization multivariate performance measures, and propose a novel algorithm for it. Different from traditional machine learning methods which optimize simple loss functions to learn prediction…

Machine Learning · Computer Science 2015-08-03 Jiachen Yanga , Zhiyong Dinga , Fei Guoa , Huogen Wanga , Nick Hughesb

We study a functional linear regression model that deals with functional responses and allows for both functional covariates and high-dimensional vector covariates. The proposed model is flexible and nests several functional regression…

Statistics Theory · Mathematics 2022-08-24 Daren Wang , Zifeng Zhao , Yi Yu , Rebecca Willett

Recent years have seen a growing interest in accelerating optimization algorithms with machine-learned predictions. Sakaue and Oki (NeurIPS 2022) have developed a general framework that warm-starts the L-convex function minimization method…

Machine Learning · Computer Science 2023-06-12 Taihei Oki , Shinsaku Sakaue

Observations which are realizations from some continuous process are frequent in sciences, engineering, economics, and other fields. We consider linear models, with possible random effects, where the responses are random functions in a…

Statistics Theory · Mathematics 2016-11-30 Giacomo Aletti , Caterina May , Chiara Tommasi

We investigate the techniques and ideas used in the convergence analysis of two proximal ADMM algorithms for solving convex optimization problems involving compositions with linear operators. Besides this, we formulate a variant of the ADMM…

Optimization and Control · Mathematics 2019-12-20 Sebastian Banert , Radu Ioan Bot , Ernö Robert Csetnek

We propose a novel unsupervised object localization method that allows us to explain the predictions of the model by utilizing self-supervised pre-trained models without additional finetuning. Existing unsupervised and self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2023-09-11 Yeonghwan Song , Seokwoo Jang , Dina Katabi , Jeany Son

In this paper convex optimization techniques are employed for convex optimization problems in infinite dimensional Hilbert spaces. A first order optimality condition is given. Let $f : \mathbb{R}^{n}\rightarrow \mathbb{R}$ and let $x\in…

Functional Analysis · Mathematics 2019-03-26 Benard Okelo

We describe an active-set method for the minimization of an objective function $\phi$ that is the sum of a smooth convex function and an $\ell_1$-regularization term. A distinctive feature of the method is the way in which active-set…

Optimization and Control · Mathematics 2015-05-19 Nitish Shirish Keskar , Jorge Nocedal , Figen Oztoprak , Andreas Waechter

A new directional derivative and a new subdifferential for set-valued convex functions are constructed, and a set-valued version of the so-called 'max-formula' is proven. The new concepts are used to characterize solutions of convex…

Optimization and Control · Mathematics 2012-07-24 Andreas H. Hamel , Carola Schrage

A parametrized convex function depends on a variable and a parameter, and is convex in the variable for any valid value of the parameter. Such functions can be used to specify parametrized convex optimization problems, i.e., a convex…

Optimization and Control · Mathematics 2025-06-05 Maximilian Schaller , Alberto Bemporad , Stephen Boyd

One of the most important studies in finance is to find out whether stock returns could be predicted. This research aims to create a new multivariate model, which includes dividend yield, earnings-to-price ratio, book-to-market ratio as…

Econometrics · Economics 2021-10-06 Jianying Xie

Point forecasts can be interpreted as functionals (i.e., point summaries) of predictive distributions. We consider the situation where forecasters' directives are hidden and develop methodology for the identification of the unknown…

Methodology · Statistics 2019-02-19 Patrick Schmidt , Matthias Katzfuß , Tilmann Gneiting

Locating proximal points is a component of numerous minimization algorithms. This work focuses on developing a method to find the proximal point of a convex function at a point, given an inexact oracle. Our method assumes that exact…

Optimization and Control · Mathematics 2016-11-03 Warren Hare , Chayne Planiden

Fixpoints are ubiquitous in computer science and when dealing with quantitative semantics and verification one often considers least fixpoints of (higher-dimensional) functions over the non-negative reals. We show how to approximate the…

Logic in Computer Science · Computer Science 2025-06-16 Paolo Baldan , Sebastian Gurke , Barbara König , Tommaso Padoan , Florian Wittbold

We study nonparametric change-point estimation from indirect noisy observations. Focusing on the white noise convolution model, we consider two classes of functions that are smooth apart from the change-point. We establish lower bounds on…

Statistics Theory · Mathematics 2007-06-13 A. Goldenshluger , A. Tsybakov , A. Zeevi

Given a finite set, $X$, of points in projective space for which the Hilbert function is known, a standard result says that there exists a subset of this finite set whose Hilbert function is ``as big as possible'' inside $X$. Given a finite…

Algebraic Geometry · Mathematics 2007-05-23 Steven P. Diaz , Anthony V. Geramita , Juan C. Migliore

In this paper we propose a novel variable selection method for two-view settings, or for vector-valued supervised learning problems. Our framework is able to handle extremely large scale selection tasks, where number of data samples could…

Machine Learning · Computer Science 2023-07-06 Sandor Szedmak , Riikka Huusari , Tat Hong Duong Le , Juho Rousu

Motivated by applications, we consider here new operator theoretic approaches to Conditional mean embeddings (CME). Our present results combine a spectral analysis-based optimization scheme with the use of kernels, stochastic processes, and…

Machine Learning · Computer Science 2023-05-16 Palle E. T. Jorgensen , Myung-Sin Song , James Tian