English
Related papers

Related papers: Distributed Methods for High-dimensional and Large…

200 papers

The exponential growth of artificial intelligence (AI) and machine learning (ML) applications has necessitated the development of efficient storage solutions for vector and tensor data. This paper presents a novel approach for tensor…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-14 Zhiwei Bao , Liu Liao-Liao , Zhiyu Wu , Yifan Zhou , Dan Fan , Michal Aibin , Yvonne Coady , Andrew Brownsword

We introduce a general tensor model suitable for data analytic tasks for {\em heterogeneous} datasets, wherein there are joint low-rank structures within groups of observations, but also discriminative structures across different groups. To…

Machine Learning · Statistics 2022-10-04 Davoud Ataee Tarzanagh , George Michailidis

Many applications in data science and scientific computing involve large-scale datasets that are expensive to store and compute with, but can be efficiently compressed and stored in an appropriate tensor format. In recent years, randomized…

Numerical Analysis · Mathematics 2019-05-20 Rachel Minster , Arvind K. Saibaba , Misha E. Kilmer

Factorization machines (FMs) are a powerful tool for regression and classification in the context of sparse observations, that has been successfully applied to collaborative filtering, especially when side information over users or items is…

Machine Learning · Computer Science 2022-12-21 Jill-Jênn Vie , Tomas Rigaux , Hisashi Kashima

Tensors are becoming increasingly common in data mining, and consequently, tensor factorizations are becoming more and more important tools for data miners. When the data is binary, it is natural to ask if we can factorize it into binary…

Data Structures and Algorithms · Computer Science 2013-10-21 Dóra Erdős , Pauli Miettinen

Tensor networks provide a powerful framework for compressing multi-dimensional data. The optimal tensor network structure for a given data tensor depends on both data characteristics and specific optimality criteria, making tensor network…

Computational Engineering, Finance, and Science · Computer Science 2026-03-23 Zheng Guo , Aditya Deshpande , Brian Kiedrowski , Xinyu Wang , Alex Gorodetsky

Numerous algorithms are used for nonnegative matrix factorization under the assumption that the matrix is nearly separable. In this paper, we show how to make these algorithms efficient for data matrices that have many more rows than…

Machine Learning · Computer Science 2018-01-08 Austin R. Benson , Jason D. Lee , Bartek Rajwa , David F. Gleich

There are several factorizations of multi-dimensional tensors into lower-dimensional components, known as `tensor networks'. We consider the popular `tensor-train' (TT) format and ask: How efficiently can we compute a low-rank approximation…

Numerical Analysis · Mathematics 2023-04-18 Melven Röhrig-Zöllner , Jonas Thies , Achim Basermann

Dynamic graph clustering aims to detect and track time-varying clusters in dynamic graphs, revealing the evolutionary mechanisms of complex real-world dynamic systems. Matrix factorization-based methods are promising approaches for this…

Machine Learning · Computer Science 2025-02-11 Dongyuan Li , Satoshi Kosugi , Ying Zhang , Manabu Okumura , Feng Xia , Renhe Jiang

We consider filtering for a continuous-time, or asynchronous, stochastic system where the full distribution over states is too large to be stored or calculated. We assume that the rate matrix of the system can be compactly represented and…

Systems and Control · Computer Science 2012-02-20 E. Busra Celikkaya , Christian R. Shelton , William Lam

We present a distributed-memory library for computations with dense structured matrices. A matrix is considered structured if its off-diagonal blocks can be approximated by a rank-deficient matrix with low numerical rank. Here, we use…

Mathematical Software · Computer Science 2015-06-29 François-Henry Rouet , Xiaoye S. Li , Pieter Ghysels , Artem Napov

Most currently used tensor regression models for high-dimensional data are based on Tucker decomposition, which has good properties but loses its efficiency in compressing tensors very quickly as the order of tensors increases, say greater…

Methodology · Statistics 2024-03-20 Yuefeng Si , Yingying Zhang , Yuxi Cai , Chunling Liu , Guodong Li

Nonnegative tensor factorization (NTF) has become an important tool for feature extraction and part-based representation with preserved intrinsic structure information from nonnegative high-order data. However, the original NTF methods…

Machine Learning · Computer Science 2024-01-04 Jianyu Wang , Linruize Tang

We show how to incorporate information from labeled examples into nonnegative matrix factorization (NMF), a popular unsupervised learning algorithm for dimensionality reduction. In addition to mapping the data into a space of lower…

Machine Learning · Computer Science 2011-12-19 Youngmin Cho , Lawrence K. Saul

This paper proposes a hierarchical approximate-factor approach to analyzing high-dimensional, large-scale heterogeneous time series data using distributed computing. The new method employs a multiple-fold dimension reduction procedure using…

Methodology · Statistics 2022-04-20 Zhaoxing Gao , Ruey S. Tsay

Latent factor models are the most popular backbones for today's recommender systems owing to their prominent performance. Latent factor models represent users and items as real-valued embedding vectors for pairwise similarity computation,…

Information Retrieval · Computer Science 2026-02-11 Yunke Qu , Tong Chen , Xiangyu Zhao , Lizhen Cui , Kai Zheng , Hongzhi Yin

In many signal processing and machine learning applications, datasets containing private information are held at different locations, requiring the development of distributed privacy-preserving algorithms. Tensor and matrix factorizations…

Machine Learning · Statistics 2019-04-23 Hafiz Imtiaz , Anand D. Sarwate

Two fundamental problems in unsupervised learning are efficient inference for latent-variable models and robust density estimation based on large amounts of unlabeled data. Algorithms for the two tasks, such as normalizing flows and…

Machine Learning · Statistics 2018-08-02 Changyou Chen , Chunyuan Li , Liqun Chen , Wenlin Wang , Yunchen Pu , Lawrence Carin

Function Secret Sharing (FSS) schemes enable sharing efficiently secret functions. Schemes dedicated to point functions, referred to as Distributed Point Functions (DPFs), are the center of FSS literature thanks to their numerous…

Cryptography and Security · Computer Science 2026-03-19 Marc Damie , Florian Hahn , Andreas Peter , Jan Ramon

Latent factor models are the driving forces of the state-of-the-art recommender systems, with an important insight of vectorizing raw input features into dense embeddings. The dimensions of different feature embeddings are often set to a…

Machine Learning · Computer Science 2020-09-11 Weiyu Cheng , Yanyan Shen , Linpeng Huang