English
Related papers

Related papers: A projection approach for multiple monotone regres…

200 papers

In this paper we introduce new estimators of the coefficient functions in the varying coefficient regression model. The proposed estimators are obtained by projecting the vector of the full-dimensional kernel-weighted local polynomial…

Statistics Theory · Mathematics 2012-03-05 Young K. Lee , Enno Mammen , Byeong U. Park

This paper focuses on convex constrained optimization problems, where the solution is subject to a convex inequality constraint. In particular, we aim at challenging problems for which both projection into the constrained domain and a…

Optimization and Control · Mathematics 2017-06-13 Tianbao Yang , Qihang Lin , Lijun Zhang

This paper discusses predictive inference and feature selection for generalized linear models with scarce but high-dimensional data. We argue that in many cases one can benefit from a decision theoretically justified two-stage approach:…

Machine Learning · Statistics 2020-11-09 Juho Piironen , Markus Paasiniemi , Aki Vehtari

For many applications in signal processing and machine learning, we are tasked with minimizing a large sum of convex functions subject to a large number of convex constraints. In this paper, we devise a new random projection method (RPM) to…

Optimization and Control · Mathematics 2024-04-08 Zhichun Yang , Fu-quan Xia , Kai Tu , Man-Chung Yue

A constrained multivariate linear model is a multivariate linear model with the columns of its coefficient matrix constrained to lie in a known subspace. This class of models includes those typically used to study growth curves and…

Methodology · Statistics 2021-01-05 Dennis Cook , Liliana Forzani , Lan Liu

This paper develops a uniformly valid and asymptotically nonconservative test based on projection for a class of shape restrictions. The key insight we exploit is that these restrictions form convex cones, a simple and yet elegant structure…

Econometrics · Economics 2021-09-21 Zheng Fang , Juwon Seo

Enforcing complex (e.g., nonconvex) operational constraints is a critical challenge in real-world learning and control systems. However, existing methods struggle to efficiently enforce general classes of constraints. To address this, we…

Machine Learning · Computer Science 2026-04-07 Maria Chzhen , Priya L. Donti

We consider the problem of projecting a convex set onto a subspace, or equivalently formulated, the problem of computing a set obtained by applying a linear mapping to a convex feasible set. This includes the problem of approximating convex…

Optimization and Control · Mathematics 2024-12-11 Gabriela Kováčová , Birgit Rudloff

Deep learning-based models have demonstrated remarkable success in solving illposed inverse problems; however, many fail to strictly adhere to the physical constraints imposed by the measurement process. In this work, we introduce a…

Machine Learning · Computer Science 2025-05-22 Jorge Bacca

We present a novel approach for constrained Bayesian inference. Unlike current methods, our approach does not require convexity of the constraint set. We reduce the constrained variational inference to a parametric optimization over the…

Machine Learning · Computer Science 2013-09-27 Oluwasanmi Koyejo , Joydeep Ghosh

Multi-view data provides complementary information on the same set of observations, with multi-omics and multimodal sensor data being common examples. Analyzing such data typically requires distinguishing between shared (joint) and unique…

Machine Learning · Statistics 2025-08-14 Renat Sergazinov , Armeen Taeb , Irina Gaynanova

Interesting data often concentrate on low dimensional smooth manifolds inside a high dimensional ambient space. Random projections are a simple, powerful tool for dimensionality reduction of such data. Previous works have studied bounds on…

Machine Learning · Statistics 2016-09-13 Subhaneil Lahiri , Peiran Gao , Surya Ganguli

Statistical inference based on optimal transport offers a different perspective from that of maximum likelihood, and has increasingly gained attention in recent years. In this paper, we study univariate nonparametric shape-constrained…

Statistics Theory · Mathematics 2026-04-13 Takeru Matsuda , Ting-Kam Leonard Wong

Shape restricted regressions, including isotonic regression and concave regression as special cases, are studied using priors on Bernstein polynomials and Markov chain Monte Carlo methods. These priors have large supports, select only…

Statistics Theory · Mathematics 2009-09-29 I-Shou Chang , Li-Chu Chien , Chao A. Hsiung , Chi-Chung Wen , Yuh-Jenn Wu

Classical extragradient schemes and their stochastic counterpart represent a cornerstone for resolving monotone variational inequality problems. Yet, such schemes have a per-iteration complexity of two projections onto a convex set and…

Optimization and Control · Mathematics 2020-12-22 Shisheng Cui , Uday V. Shanbhag

In this paper we consider a problem, called convex projection, of projecting a convex set onto a subspace. We will show that to a convex projection one can assign a particular multi-objective convex optimization problem, such that the…

Optimization and Control · Mathematics 2021-10-18 Gabriela Kováčová , Birgit Rudloff

In this study, we propose a projection estimation method for large-dimensional matrix factor models with cross-sectionally spiked eigenvalues. By projecting the observation matrix onto the row or column factor space, we simplify factor…

Methodology · Statistics 2020-12-04 Long Yu , Yong He , Xin-bing Kong , Xinsheng Zhang

This paper introduces a new way to calculate distance-based statistics, particularly when the data are multivariate. The main idea is to pre-calculate the optimal projection directions given the variable dimension, and to project…

Computation · Statistics 2019-11-11 Chuanping Yu , Xiaoming Huo

This paper investigates projection-free algorithms for stochastic constrained multi-level optimization. In this context, the objective function is a nested composition of several smooth functions, and the decision set is closed and convex.…

Optimization and Control · Mathematics 2024-06-07 Wei Jiang , Sifan Yang , Wenhao Yang , Yibo Wang , Yuanyu Wan , Lijun Zhang

This paper is concerned with some new projection methods for solving variational inequality problems with monotone and Lipschitz-continuous mapping in Hilbert space. First, we propose the projected reflected gradient algorithm with a…

Optimization and Control · Mathematics 2018-03-26 Yu. Malitsky