English
Related papers

Related papers: Efficient regularized isotonic regression with app…

200 papers

Synthesizing information from multiple data sources is crucial for constructing accurate individualized treatment rules (ITRs). However, privacy concerns often present significant barriers to the integrative analysis of such multi-source…

Methodology · Statistics 2025-11-11 Nan Qiao , Wangcheng Li , Jingxiao Zhang , Canyi Chen

Avoiding overfitting is a central challenge in machine learning, yet many large neural networks readily achieve zero training loss. This puzzling contradiction necessitates new approaches to the study of overfitting. Here we quantify…

Information Theory · Computer Science 2022-10-13 Vudtiwat Ngampruetikorn , David J. Schwab

Autoregressive (AR) modeling is invaluable in signal processing, in particular in speech and audio fields. Attempts in the literature can be found that regularize or constrain either the time-domain signal values or the AR coefficients,…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-06 Ondřej Mokrý , Pavel Rajmic

Current orthogonal matching pursuit (OMP) algorithms calculate the correlation between two vectors using the inner product operation and minimize the mean square error, which are both suboptimal when there are non-Gaussian noises or…

Computer Vision and Pattern Recognition · Computer Science 2020-05-12 Miaohua Zhang , Yongsheng Gao , Changming Sun , Michael Blumenstein

The rolling stock rotation problem with predictive maintenance (RSRP-PdM) involves the assignment of trips to a fleet of vehicles with integrated maintenance scheduling based on the predicted failure probability of the vehicles. These…

Optimization and Control · Mathematics 2024-04-15 Felix Prause , Ralf Borndörfer

Robotic systems must be able to quickly and robustly make decisions when operating in uncertain and dynamic environments. While Reinforcement Learning (RL) can be used to compute optimal policies with little prior knowledge about the…

Robotics · Computer Science 2016-09-13 Yunpeng Pan , Xinyan Yan , Evangelos Theodorou , Byron Boots

Restricted isometry property (RIP), essentially stating that the linear measurements are approximately norm-preserving, plays a crucial role in studying low-rank matrix recovery problem. However, RIP fails in the robust setting, when a…

Machine Learning · Computer Science 2021-09-29 Jianhao Ma , Salar Fattahi

In this paper, we present an extension to the recursive Gaussian Process (RGP) regression that enables the satisfaction of inequality constraints and is well suited for a real-time execution in control applications. The soft inequality…

Systems and Control · Electrical Eng. & Systems 2025-10-30 Ricus Husmann , Sven Weishaupt , Harald Aschemann

This paper proposes a polynomial-time algorithm to construct the monotone stepwise curve that minimizes the sum of squared errors with respect to a given cloud of data points. The fitted curve is also constrained on the maximum number of…

Optimization and Control · Mathematics 2021-07-01 Víctor Bucarey , Martine Labbé , Juan M. Morales , Salvador Pineda

Rank regression offers robustness to outliers and heavy-tailed response distributions, invariance to monotonic transformations, and improved efficiency under non-Gaussian errors, making it a versatile tool for analyzing complex data. This…

Methodology · Statistics 2026-05-25 Jiyuan Tu , Suqi Wu , Yichen Zhang , Wen-Xin Zhou

Many applications, including rank aggregation, crowd-labeling, and graphon estimation, can be modeled in terms of a bivariate isotonic matrix with unknown permutations acting on its rows and/or columns. We consider the problem of estimating…

Machine Learning · Statistics 2019-10-29 Cheng Mao , Ashwin Pananjady , Martin J. Wainwright

We propose a fast sequential algorithm for the fundamental problem of estimating frequencies and amplitudes of a noisy mixture of sinusoids. The algorithm is a natural generalization of Orthogonal Matching Pursuit (OMP) to the continuum…

Information Theory · Computer Science 2016-08-24 Babak Mamandipoor , Dinesh Ramasamy , Upamanyu Madhow

We study spherically symmetric spacetimes for matter distributions with isotropic pressures. We generate new exact solutions to the Einstein field equations which also contains isotropic pressures. We develop an algorithm that produces a…

General Relativity and Quantum Cosmology · Physics 2014-12-23 S. Ngubelanga , S. D. Maharaj

Inverse problems are paramount in Science and Engineering. In this paper, we consider the setup of Statistical Inverse Problem (SIP) and demonstrate how Stochastic Gradient Descent (SGD) algorithms can be used in the linear SIP setting. We…

Machine Learning · Statistics 2022-11-29 Yuri R. Fonseca , Yuri F. Saporito

This paper investigates iterative methods for solving bi-level optimization problems where both inner and outer functions have a composite structure. We establish novel theoretical results, including the first analysis that provides…

Optimization and Control · Mathematics 2025-10-07 Shimrit Shtern , Adeolu Taiwo

We study Newton type methods for inverse problems described by nonlinear operator equations $F(u)=g$ in Banach spaces where the Newton equations $F'(u_n;u_{n+1}-u_n) = g-F(u_n)$ are regularized variationally using a general data misfit…

Numerical Analysis · Mathematics 2015-04-01 Thorsten Hohage , Frank Werner

We propose two novel algorithms for constructing convex collision-free polytopes in robot configuration space. Finding these polytopes enables the application of stronger motion-planning frameworks such as trajectory optimization with…

Robotics · Computer Science 2024-11-15 Peter Werner , Thomas Cohn , Rebecca H. Jiang , Tim Seyde , Max Simchowitz , Russ Tedrake , Daniela Rus

Compared to frequent pattern mining, sequential pattern mining emphasizes the temporal aspect and finds broad applications across various fields. However, numerous studies treat temporal events as single time points, neglecting their…

Databases · Computer Science 2025-07-18 Shuang Liang , Lili Chen , Wensheng Gan , Philip S. Yu , Shengjie Zhao

Reduced Rank Regression (RRR) is a widely used method for multi-response regression. However, RRR assumes a linear relationship between features and responses. While linear models are useful and often provide a good approximation, many…

Machine Learning · Statistics 2025-03-11 Leia Greenberg , Haim Avron

Joint object matching, also known as multi-image matching, namely, the problem of finding consistent partial maps among all pairs of objects within a collection, is a crucial task in many areas of computer vision. This problem subsumes…

Optimization and Control · Mathematics 2022-11-29 Antonio De Rosa , Aida Khajavirad