中文
相关论文

相关论文: Preconditioned Data Sparsification for Big Data wi…

200 篇论文

Based on a generalized cosine measure between two symmetric matrices, we propose a general framework for one-sample and two-sample tests of covariance and correlation matrices. We also develop a set of associated permutation algorithms for…

统计方法学 · 统计学 2018-12-05 Longyang Wu , Chengguo Weng , Xu Wang , Kesheng Wang , Xuefeng Liu

Both PAC-Bayesian and Sample Compress learning frameworks are instrumental for deriving tight (non-vacuous) generalization bounds for neural networks. We leverage these results in a meta-learning scheme, relying on a hypernetwork that…

机器学习 · 计算机科学 2025-06-06 Benjamin Leblanc , Mathieu Bazinet , Nathaniel D'Amours , Alexandre Drouin , Pascal Germain

Over half a century old and showing no signs of aging, k-means remains one of the most popular data processing algorithms. As is well-known, a proper initialization of k-means is crucial for obtaining a good final solution. The recently…

数据库 · 计算机科学 2012-03-30 Bahman Bahmani , Benjamin Moseley , Andrea Vattani , Ravi Kumar , Sergei Vassilvitskii

This paper deals with the design of a sensing matrix along with a sparse recovery algorithm by utilizing the probability-based prior information for compressed sensing system. With the knowledge of the probability for each atom of the…

机器学习 · 计算机科学 2019-10-29 Q. Jiang , S. Li , Z. Zhu , H. Bai , X. He , R. C. de Lamare

In this paper, we consider the problem of partitioning a small data sample drawn from a mixture of $k$ product distributions. We are interested in the case that individual features are of low average quality $\gamma$, and we want to use as…

机器学习 · 统计学 2017-11-17 Avrim Blum , Amin Coja-Oghlan , Alan Frieze , Shuheng Zhou

In clinical and biomedical research, multiple high-dimensional datasets are nowadays routinely collected from omics and imaging devices. Multivariate methods, such as Canonical Correlation Analysis (CCA), integrate two (or more) datasets to…

统计方法学 · 统计学 2025-03-20 Nuria Senar , Mark van de Wiel , Aeilko Zwinderman , Michel Hof

Co-clustering simultaneously clusters rows and columns, revealing more fine-grained groups. However, existing co-clustering methods suffer from poor scalability and cannot handle large-scale data. This paper presents a novel and scalable…

分布式、并行与集群计算 · 计算机科学 2025-03-20 Zihan Wu , Zhaoke Huang , Hong Yan

We present and analyze a simple, two-step algorithm to approximate the optimal solution of the sparse PCA problem. Our approach first solves a L1 penalized version of the NP-hard sparse PCA optimization problem and then uses a randomized…

数据结构与算法 · 计算机科学 2016-11-24 Kimon Fountoulakis , Abhisek Kundu , Eugenia-Maria Kontopoulou , Petros Drineas

Sparse Principal Component Analysis (Sparse PCA) is a pivotal tool in data analysis and dimensionality reduction. However, Sparse PCA is a challenging problem in both theory and practice: it is known to be NP-hard and current exact methods…

机器学习 · 计算机科学 2025-03-06 Alberto Del Pia , Dekun Zhou , Yinglun Zhu

In datasets where the number of parameters is fixed and the number of samples is large, principal component analysis (PCA) is a powerful dimension reduction tool. However, in many contemporary datasets, when the number of parameters is…

概率论 · 数学 2019-02-14 Enrico Au-Yeung , Greg Zanotti

We generalise the results of Bhattacharya et al. (Journal of Computing Systems, 62(1):93-115, 2018) for the list-$k$-means problem defined as -- for a (unknown) partition $X_1, ..., X_k$ of the dataset $X \subseteq \mathbb{R}^d$, find a…

数据结构与算法 · 计算机科学 2020-02-20 Dishant Goyal , Ragesh Jaiswal , Amit Kumar

This work investigates the ``small-vs-large gap'', where repeating on fewer samples can lead to compute saving during training compared to using a larger dataset. This is observed across algorithmic tasks, architectures and optimizers and…

机器学习 · 计算机科学 2026-05-21 Jingwen Liu , Ezra Edelman , Surbhi Goel , Bingbin Liu

Background: High-throughput proteomics techniques, such as mass spectrometry (MS)-based approaches, produce very high-dimensional data-sets. In a clinical setting one is often interested in how mass spectra differ between patients of…

Compressed sensing is a signal processing technique whereby the limits imposed by the Shannon--Nyquist theorem can be exceeded provided certain conditions are imposed on the signal. Such conditions occur in many real-world scenarios, and…

信息论 · 计算机科学 2018-02-16 Fintan Hegarty , Padraig Ó Catháin , Yunbin Zhao

The volume of data and the velocity with which it is being generated by com- putational experiments on high performance computing (HPC) systems is quickly outpacing our ability to effectively store this information in its full fidelity.…

统计计算 · 统计学 2014-07-14 Henry Scharf , Ryan Elmore , Kenny Gruchalla

Cellular Automata are discrete dynamical systems that evolve following simple and local rules. Despite of its local simplicity, knowledge discovery in CA is a NP problem. This is the main motivation for using data mining techniques for CA…

离散数学 · 计算机科学 2007-05-23 Gilson A. Giraldi , Antonio A. F. Oliveira , Leonardo Carvalho

Generally, discretization of partial differential equations (PDEs) creates a sequence of linear systems $A_k x_k = b_k, k = 0, 1, 2, ..., N$ with well-known and structured sparsity patterns. Preconditioners are often necessary to achieve…

数值分析 · 数学 2024-06-26 Rishad Islam , Arielle Carr , Colin Jacobs

In this paper, we propose a scalable Bayesian method for sparse covariance matrix estimation by incorporating a continuous shrinkage prior with a screening procedure. In the first step of the procedure, the off-diagonal elements with small…

统计方法学 · 统计学 2023-11-22 Kyoungjae Lee , Seongil Jo , Kyeongwon Lee , Jaeyong Lee

Sparse matrix factorization is a popular tool to obtain interpretable data decompositions, which are also effective to perform data completion or denoising. Its applicability to large datasets has been addressed with online and randomized…

机器学习 · 统计学 2017-11-15 Arthur Mensch , Julien Mairal , Bertrand Thirion , Gaël Varoquaux

Machine-generated data is rapidly growing and poses challenges for data-intensive systems, especially as the growth of data outpaces the growth of storage space. To cope with the storage issue, compression plays a critical role in storage…

数据库 · 计算机科学 2023-11-27 Jiujing Zhang , Zhitao Shen , Shiyu Yang , Lingkai Meng , Chuan Xiao , Wei Jia , Yue Li , Qinhui Sun , Wenjie Zhang , Xuemin Lin