English
Related papers

Related papers: Split-and-Conquer: Distributed Factor Modeling for…

200 papers

Parr et al., 2025 examines how auto-regressive and deep temporal models differ in their treatment of non-Markovian sequence modelling. Building on this, we highlight the need for dissociating model architectures, i.e., how the predictive…

Neurons and Cognition · Quantitative Biology 2025-07-22 Noor Sajid , Johan Medrano

Using the matrix factorization technique in machine learning is very common mainly in areas like recommender systems. Despite its high prediction accuracy and its ability to avoid over-fitting of the data, the Bayesian Probabilistic Matrix…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-05-31 Tom Vander Aa , Imen Chakroun , Tom Haber

High-dimensional feature vectors are likely to contain sets of measurements that are approximate replicates of one another. In complex applications, or automated data collection, these feature sets are not known a priori, and need to be…

Methodology · Statistics 2020-10-07 Xin Bing , Florentina Bunea , Marten Wegkamp

We propose a novel conditional diffusion model for contextual portfolio optimization that learns the cross-sectional distribution of next-day stock returns conditioned on high-dimensional asset-specific factors. Our model leverages a…

Portfolio Management · Quantitative Finance 2026-04-17 Xuefeng Gao , Mengying He , Xuedong He

Network structure is growing popular for capturing the intrinsic relationship between large-scale variables. In the paper we propose to improve the estimation accuracy for large-dimensional factor model when a network structure between…

Methodology · Statistics 2020-01-30 Long Yu , Yong He , Xinsheng Zhang , Ji Zhu

This study addresses the challenge of accurately identifying multi-task contention types in high-dimensional system environments and proposes a unified contention classification framework that integrates representation transformation,…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-29 Xiao Yang , Yinan Ni , Yuqi Tang , Zhimin Qiu , Chen Wang , Tingzhou Yuan

Matrix-valued time series are ubiquitous in modern economics and finance, yet modeling them requires navigating a trade-off between flexibility and parsimony. We propose the Matrix Autoregressive model with Common Factors (MARCF), a unified…

Methodology · Statistics 2026-01-14 Zhiyun Fan , Xiaoyu Zhang , Di Wang

Data imputation and data generation have important applications for many domains, like healthcare and finance, where incomplete or missing data can hinder accurate analysis and decision-making. Diffusion models have emerged as powerful…

Machine Learning · Computer Science 2025-06-10 Mario Villaizán-Vallelado , Matteo Salvatori , Carlos Segura , Ioannis Arapakis

Functional magnetic resonance imaging (fMRI) data contain complex spatiotemporal dynamics, thus researchers have developed approaches that reduce the dimensionality of the signal while extracting relevant and interpretable dynamics. Models…

Computer Vision and Pattern Recognition · Computer Science 2022-05-30 Eloy Geenjaar , Amrit Kashyap , Noah Lewis , Robyn Miller , Vince Calhoun

As the size of datasets used in statistical learning continues to grow, distributed training of models has attracted increasing attention. These methods partition the data and exploit parallelism to reduce memory and runtime, but suffer…

Machine Learning · Computer Science 2024-07-10 Fred Lu , Ryan R. Curtin , Edward Raff , Francis Ferraro , James Holt

Sparse matrix factorization is a popular tool to obtain interpretable data decompositions, which are also effective to perform data completion or denoising. Its applicability to large datasets has been addressed with online and randomized…

Machine Learning · Statistics 2017-11-15 Arthur Mensch , Julien Mairal , Bertrand Thirion , Gaël Varoquaux

Factor models are a very efficient way to describe high dimensional vectors of data in terms of a small number of common relevant factors. This problem, which is of fundamental importance in many disciplines, is usually reformulated in…

Optimization and Control · Mathematics 2018-06-13 Valentina Ciccone , Augusto Ferrante , Mattia Zorzi

We propose a two-step procedure to model and predict high-dimensional functional time series, where the number of function-valued time series $p$ is large in relation to the length of time series $n$. Our first step performs an…

Methodology · Statistics 2024-06-04 Jinyuan Chang , Qin Fang , Xinghao Qiao , Qiwei Yao

The purpose of this article is to develop the dimension reduction techniques in panel data analysis when the number of individuals and indicators is large. We use Principal Component Analysis (PCA) method to represent large number of…

Methodology · Statistics 2017-01-10 Guobin Fang , Kani Chen , Bo Zhang

We propose a flexible nonparametric Bayesian modelling framework for multivariate time series of count data based on tensor factorisations. Our models can be viewed as infinite state space Markov chains of known maximal order with…

Methodology · Statistics 2023-11-13 Zhongzhen Wang , Petros Dellaportas , Ioannis Kosmidis

Due to the pervasive diffusion of personal mobile and IoT devices, many ``smart environments'' (e.g., smart cities and smart factories) will be, among others, generators of huge amounts of data. Currently, this is typically achieved through…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-28 Lorenzo Valerio , Andrea Passarella , Marco Conti

Dynamic network analysis has found an increasing interest in the literature because of the importance of different kinds of dynamic social networks, biological networks, and economic networks. Most available probability and statistical…

Methodology · Statistics 2017-10-18 Elynn Yi Chen , Rong Chen

In this paper, we propose a novel distributed data-driven optimization scheme. In detail, we focus on the so-called aggregative framework, a scenario in which a set of agents aim to cooperatively minimize the sum of local costs, each…

Optimization and Control · Mathematics 2026-01-27 Riccardo Brumali , Guido Carnevale , Giuseppe Notarstefano

The importance of interpretability of machine learning models has been increasing due to emerging enterprise predictive analytics, threat of data privacy, accountability of artificial intelligence in society, and so on. Piecewise linear…

Artificial Intelligence · Computer Science 2017-11-08 Masato Asahara , Ryohei Fujimaki

In multiple scientific and technological applications we face the problem of having low dimensional data to be justified by a linear model defined in a high dimensional parameter space. The difference in dimensionality makes the problem…

Other Computer Science · Computer Science 2016-08-04 Jorge Fernandez-de-Cossio-Diaz , Roberto Mulet