English
Related papers

Related papers: Distributed Convoluted Rank Regression for Non-Sha…

200 papers

Nowadays, massive datasets are typically dispersed across multiple locations, encountering dual challenges of high dimensionality and huge sample size. Therefore, it is necessary to explore sufficient dimension reduction (SDR) methods for…

Methodology · Statistics 2025-09-16 Hongying Li , Minyi Zhu , Yaqi Cao , Xinyi Xu

Reduced Rank Regression (RRR) is a widely used method for multi-response regression. However, RRR assumes a linear relationship between features and responses. While linear models are useful and often provide a good approximation, many…

Machine Learning · Statistics 2025-03-11 Leia Greenberg , Haim Avron

Distributional reinforcement learning (DRL) extends the value-based approach by approximating the full distribution over future returns instead of the mean only, providing a richer signal that leads to improved performances. Quantile…

Machine Learning · Statistics 2022-02-23 Alix Lhéritier , Nicolas Bondoux

Recently, distributed semi-supervised learning (DSSL) algorithms have shown their effectiveness in leveraging unlabeled samples over interconnected networks, where agents cannot share their original data with each other and can only…

Machine Learning · Computer Science 2022-09-21 Ye Shi , Leijie Zhang , Zehong Cao , M. Tanveer , Chin-Teng Lin

Multi-view data have been routinely collected in various fields of science and engineering. A general problem is to study the predictive association between multivariate responses and multi-view predictor sets, all of which can be of high…

Methodology · Statistics 2018-07-30 Gen Li , Xiaokang Liu , Kun Chen

In modern scientific research, massive datasets with huge numbers of observations are frequently encountered. To facilitate the computational process, a divide-and-conquer scheme is often used for the analysis of big data. In such a…

Machine Learning · Statistics 2015-05-06 Chen Xu , Yongquan Zhang , Runze Li

This work examines risk bounds for nonparametric distributional regression estimators. For convex-constrained distributional regression, general upper bounds are established for the continuous ranked probability score (CRPS) and the…

With the availability of extraordinarily huge data sets, solving the problems of distributed statistical methodology and computing for such data sets has become increasingly crucial in the big data area. In this paper, we focus on the…

Machine Learning · Statistics 2023-10-24 Yue Chao , Lei Huang , Xuejun Ma

Modern high-dimensional methods often adopt the "bet on sparsity" principle, while in supervised multivariate learning statisticians may face "dense" problems with a large number of nonzero coefficients. This paper proposes a novel…

Machine Learning · Statistics 2022-02-10 Yiyuan She , Jiahui Shen , Chao Zhang

This paper proposes a novel distributed reduced--rank scheme and an adaptive algorithm for distributed estimation in wireless sensor networks. The proposed distributed scheme is based on a transformation that performs dimensionality…

Information Theory · Computer Science 2014-11-06 S. Xu , R. C. de Lamare , H. V. Poor

Reduced-rank (RR) regression may be interpreted as a dimensionality reduction technique able to reveal complex relationships among the data parsimoniously. However, RR regression models typically overlook any potential group structure among…

Methodology · Statistics 2024-06-26 Maria F. Pintado , Matteo Iacopini , Luca Rossini , Alexander Y. Shestopaloff

We propose a framework for distributed robust statistical learning on {\em big contaminated data}. The Distributed Robust Learning (DRL) framework can reduce the computational time of traditional robust learning methods by several orders of…

Machine Learning · Statistics 2015-02-10 Jiashi Feng , Huan Xu , Shie Mannor

We study sparse linear regression over a network of agents, modeled as an undirected graph and no server node. The estimation of the $s$-sparse parameter is formulated as a constrained LASSO problem wherein each agent owns a subset of the…

Machine Learning · Computer Science 2024-12-30 Marie Maros , Gesualdo Scutari , Ying Sun , Guang Cheng

This paper studies distributed estimation and support recovery for high-dimensional linear regression model with heavy-tailed noise. To deal with heavy-tailed noise whose variance can be infinite, we adopt the quantile regression loss…

Methodology · Statistics 2020-09-21 Xi Chen , Weidong Liu , Xiaojun Mao , Zhuoyi Yang

In this paper, we introduce a novel decentralized surrogate gradient-based algorithm for quantile regression in a feature-distributed setting, where global features are dispersed across multiple machines within a decentralized network. The…

Computation · Statistics 2025-04-24 Peiwen Xiao , Xiaohui Liu , Guangming Pan , Wei Long

The method of constrained randomisation is applied to three-dimensional simulated galaxy distributions. With this technique we generate for a given data set surrogate data sets which have the same linear properties as the original data…

Astrophysics · Physics 2009-11-07 C. Raeth , W. Bunk , M. Huber , G. Morfill , J. Retzlaff , P. Schuecker

We consider distributed convex optimization problems originated from sample average approximation of stochastic optimization, or empirical risk minimization in machine learning. We assume that each machine in the distributed computing…

Optimization and Control · Mathematics 2015-01-05 Yuchen Zhang , Lin Xiao

In multiple domains, statistical tasks are performed in distributed settings, with data split among several end machines that are connected to a fusion center. In various applications, the end machines have limited bandwidth and power, and…

Machine Learning · Computer Science 2026-01-05 Rodney Fonseca , Boaz Nadler

When using stochastic gradient descent to solve large-scale machine learning problems, a common practice of data processing is to shuffle the training data, partition the data across multiple machines if needed, and then perform several…

Machine Learning · Statistics 2017-10-02 Qi Meng , Wei Chen , Yue Wang , Zhi-Ming Ma , Tie-Yan Liu

Causal representation learning seeks to uncover causal relationships among high-level latent variables from low-level, entangled, and noisy observations. Existing approaches often either rely on deep neural networks, which lack…

Methodology · Statistics 2026-03-27 Wenjin Zhang , Yixin Wang , Yuqi Gu