English
Related papers

Related papers: Hierarchical Lowrank Arithmetic with Binary Compre…

200 papers

Pooling second-order local feature statistics to form a high-dimensional bilinear feature has been shown to achieve state-of-the-art performance on a variety of fine-grained classification tasks. To address the computational demands of high…

Computer Vision and Pattern Recognition · Computer Science 2016-12-01 Shu Kong , Charless Fowlkes

When factorizing binary matrices, we often have to make a choice between using expensive combinatorial methods that retain the discrete nature of the data and using continuous methods that can be more efficient but destroy the discrete…

Discrete Mathematics · Computer Science 2016-10-07 Stefan Neumann , Rainer Gemulla , Pauli Miettinen

We propose geometric weighting as a novel method to combine multiple models in data compression. Our results reveal the rationale behind PAQ-weighting and generalize it to a non-binary alphabet. Based on a similar technique we present a…

Information Theory · Computer Science 2013-02-13 Christopher Mattern

The paper addresses the problem of low-rank trace norm minimization. We propose an algorithm that alternates between fixed-rank optimization and rank-one updates. The fixed-rank optimization is characterized by an efficient factorization…

Optimization and Control · Mathematics 2013-06-04 B. Mishra , G. Meyer , F. Bach , R. Sepulchre

The rapid growth of digital data has heightened the demand for efficient lossless compression methods. However, existing algorithms exhibit trade-offs: some achieve high compression ratios, others excel in encoding or decoding speed, and…

Information Theory · Computer Science 2025-10-01 Md. Atiqur Rahman , MM Fazle Rabbi

Directional interpolation is a fast and efficient compression technique for high-frequency Helmholtz boundary integral equations, but it requires a very large amount of storage in its original form. Algebraic recompression can significantly…

Numerical Analysis · Mathematics 2023-10-23 Steffen Börm , Janne Henningsen

The goal in thinning is to summarize a dataset using a small set of representative points. Remarkably, sub-Gaussian thinning algorithms like Kernel Halving and Compress can match the quality of uniform subsampling while substantially…

Machine Learning · Statistics 2026-03-03 Annabelle Michael Carrell , Albert Gong , Abhishek Shetty , Raaz Dwivedi , Lester Mackey

This paper is concerned with the development and analysis of an iterative solver for high-dimensional second-order elliptic problems based on subspace-based low-rank tensor formats. Both the subspaces giving rise to low-rank approximations…

Numerical Analysis · Mathematics 2014-07-21 Markus Bachmayr , Wolfgang Dahmen

Support for arithmetic in multiple precisions and number formats is becoming increasingly common in emerging high-performance architectures. From a computational scientist's perspective, our goal is to determine how and where we can safely…

Numerical Analysis · Mathematics 2026-02-05 Erin Claire Carson

We provide estimation methods for nonseparable panel models based on low-rank factor structure approximations. The factor structures are estimated by matrix-completion methods to deal with the computational challenges of principal component…

Econometrics · Economics 2021-03-05 Iván Fernández-Val , Hugo Freeman , Martin Weidner

In this paper, we introduce a method for multivariate function approximation using function evaluations, Chebyshev polynomials, and tensor-based compression techniques via the Tucker format. We develop novel randomized techniques to…

Numerical Analysis · Mathematics 2021-07-29 Arvind K. Saibaba , Rachel Minster , Misha E. Kilmer

The low-rank approximation is a complexity reduction technique to approximate a tensor or a matrix with a reduced rank, which has been applied to the simulation of high dimensional problems to reduce the memory required and computational…

Computational Physics · Physics 2020-08-26 Zhuogang Peng , Ryan McClarren , Martin Frank

Matrix valued data has become increasingly prevalent in many applications. Most of the existing clustering methods for this type of data are tailored to the mean model and do not account for the dependence structure of the features, which…

Machine Learning · Statistics 2023-12-07 Inbeom Lee , Siyi Deng , Yang Ning

Low-rank matrix completion concerns the problem of estimating unobserved entries in a matrix using a sparse set of observed entries. We consider the non-uniform setting where the observed entries are sampled with highly varying…

Machine Learning · Statistics 2024-03-04 Xumei Xi , Christina Lee Yu , Yudong Chen

As an alternative to variable selection or shrinkage in high dimensional regression, we propose to randomly compress the predictors prior to analysis. This dramatically reduces storage and computational bottlenecks, performing well when the…

Machine Learning · Statistics 2013-03-26 Rajarshi Guhaniyogi , David B. Dunson

Today's HPC applications are producing extremely large amounts of data, such that data storage and analysis are becoming more challenging for scientific research. In this work, we design a new error-controlled lossy compression algorithm…

Information Theory · Computer Science 2017-06-14 Dingwen Tao , Sheng Di , Zizhong Chen , Franck Cappello

Effective non-parametric density estimation is a key challenge in high-dimensional multivariate data analysis. In this paper,we propose a novel approach that builds upon tensor factorization tools. Any multivariate density can be…

Machine Learning · Statistics 2022-10-19 Magda Amiridi , Nikos Kargas , Nicholas D. Sidiropoulos

Probe-level microarray data are usually stored in matrices, where the row and column correspond to array and probe, respectively. Scientists routinely summarize each array by a single index as the expression level of each probe set (gene).…

Applications · Statistics 2010-09-30 Xingdong Feng , Xuming He

Low-rank matrix factorizations are a class of linear models widely used in various fields such as machine learning, signal processing, and data analysis. These models approximate a matrix as the product of two smaller matrices, where the…

Machine Learning · Computer Science 2024-12-10 Olivier Vu Thanh

Low-rank compression is an important model compression strategy for obtaining compact neural network models. In general, because the rank values directly determine the model complexity and model accuracy, proper selection of layer-wise rank…

Machine Learning · Computer Science 2024-01-15 Jinqi Xiao , Chengming Zhang , Yu Gong , Miao Yin , Yang Sui , Lizhi Xiang , Dingwen Tao , Bo Yuan