English
Related papers

Related papers: Sparse Rank Regression for Restricted-Access Econo…

200 papers

Analysis of random censored life-time data along with some related stochastic covariables is of great importance in many applied sciences like medical research, population studies and planning etc. The parametric estimation technique…

Statistics Theory · Mathematics 2019-05-09 Abhik Ghosh , Ayanendranath Basu

Contrastive Representation Learning (CRL) has achieved strong empirical success in multiple machine learning disciplines, yet its theoretical sample complexity remains poorly understood. Existing analyses usually assume that input tuples…

Machine Learning · Statistics 2026-05-29 Nong Minh Hieu , Antoine Ledent

The paper introduces a penalized matrix estimation procedure aiming at solutions which are sparse and low-rank at the same time. Such structures arise in the context of social networks or protein interactions where underlying graphs have…

Data Structures and Algorithms · Computer Science 2012-07-03 Emile Richard , Pierre-Andre Savalle , Nicolas Vayatis

In domains such as finance, healthcare, and robotics, managing worst-case scenarios is critical, as failure to do so can lead to catastrophic outcomes. Distributional Reinforcement Learning (DRL) provides a natural framework to incorporate…

Machine Learning · Computer Science 2026-02-13 Mehrdad Moghimi , Hyejin Ku

We study sparse linear regression over a network of agents, modeled as an undirected graph and no server node. The estimation of the $s$-sparse parameter is formulated as a constrained LASSO problem wherein each agent owns a subset of the…

Machine Learning · Computer Science 2024-12-30 Marie Maros , Gesualdo Scutari , Ying Sun , Guang Cheng

In this paper, an issue of building the RRC model using probability distributions other than beta distribution is addressed. More precisely, in this paper, we propose to build the RRR model using the truncated normal distribution. Heuristic…

Machine Learning · Computer Science 2019-05-27 Pawel Trajdos , Marek Kurzynski

This paper considers the classical problem of sampling with Monte Carlo methods a target rare event distribution defined by a score function that is very expensive to compute. We assume we can build using evaluations of the true score, an…

Computation · Statistics 2024-10-25 Frédéric Cérou , Patrick Héas , Mathias Rousset

Sparse estimation methods are aimed at using or obtaining parsimonious representations of data or models. While naturally cast as a combinatorial optimization problem, variable or feature selection admits a convex relaxation through the…

Machine Learning · Computer Science 2012-04-23 Francis Bach , Rodolphe Jenatton , Julien Mairal , Guillaume Obozinski

High-dimensional settings, where the data dimension ($d$) far exceeds the number of observations ($n$), are common in many statistical and machine learning applications. Methods based on $\ell_1$-relaxation, such as Lasso, are very popular…

Machine Learning · Statistics 2018-02-20 Shiva Prasad Kasiviswanathan , Mark Rudelson

In this paper, we consider the problem of linear regression with heavy-tailed distributions. Different from previous studies that use the squared loss to measure the performance, we choose the absolute loss, which is capable of estimating…

Machine Learning · Computer Science 2018-10-26 Lijun Zhang , Zhi-Hua Zhou

While the SLIM approach obtained high ranking-accuracy in many experiments in the literature, it is also known for its high computational cost of learning its parameters from data. For this reason, we focus in this paper on variants of…

Information Retrieval · Computer Science 2019-05-01 Harald Steck

We study aleatoric and epistemic uncertainty estimation in a learned regressive system dynamics model. Disentangling aleatoric uncertainty (the inherent randomness of the system) from epistemic uncertainty (the lack of data) is crucial for…

Machine Learning · Computer Science 2025-03-21 Zhiyu An , Zhibo Hou , Wan Du

Distributionally robust reinforcement learning (DRRL) focuses on designing policies that achieve good performance under model uncertainties. The goal is to maximize the worst-case long-term discounted reward, where the data for RL comes…

Machine Learning · Computer Science 2026-03-17 Saptarshi Mandal , Yashaswini Murthy , R. Srikant

Reduced-Rank (RR) regression is a powerful dimensionality reduction technique but it overlooks any possible group configuration among the responses by assuming a low-rank structure on the entire coefficient matrix. Moreover, the temporal…

Methodology · Statistics 2025-12-22 Maria F. Pintado , Matteo Iacopini , Luca Rossini , Alexander Y. Shestopaloff

The deluge of networked data motivates the development of algorithms for computation- and communication-efficient information processing. In this context, three data-adaptive censoring strategies are introduced to considerably reduce the…

Systems and Control · Computer Science 2018-01-16 Zifeng Wang , Zheng Yu , Qing Ling , Dimitris Berberidis , Georgios B. Giannakis

Local polynomial regression of order one or higher often performs poorly in areas with sparse data. In contrast, local constant regression tends to be more robust in these regions, although it is generally the least accurate approach,…

Methodology · Statistics 2025-07-10 Chunlei Ge , W. John Braun

The covariate shift is a challenging problem in supervised learning that results from the discrepancy between the training and test distributions. An effective approach which recently drew a considerable attention in the research community…

Machine Learning · Computer Science 2013-11-27 Yun-Qian Miao , Ahmed K. Farahat , Mohamed S. Kamel

Evolutionary algorithms have been used to evolve a population of actors to generate diverse experiences for training reinforcement learning agents, which helps to tackle the temporal credit assignment problem and improves the exploration…

Neural and Evolutionary Computing · Computer Science 2023-04-21 Chengpeng Hu , Jiyuan Pei , Jialin Liu , Xin Yao

We examine the linear regression problem in a challenging high-dimensional setting with correlated predictors where the vector of coefficients can vary from sparse to dense. In this setting, we propose a combination of probabilistic…

Methodology · Statistics 2025-05-13 Roman Parzer , Peter Filzmoser , Laura Vana-Gür

Penalized quantile regression (QR) is widely used for studying the relationship between a response variable and a set of predictors under data heterogeneity in high-dimensional settings. Compared to penalized least squares, scalable…

Methodology · Statistics 2022-05-06 Rebeka Man , Xiaoou Pan , Kean Ming Tan , Wen-Xin Zhou