English
Related papers

Related papers: Zero-Cost NDV Estimation from Columnar File Metada…

200 papers

We introduce a novel cost aggregation network, dubbed Volumetric Aggregation with Transformers (VAT), to tackle the few-shot segmentation task by using both convolutions and transformers to efficiently handle high dimensional correlation…

Computer Vision and Pattern Recognition · Computer Science 2021-12-23 Sunghwan Hong , Seokju Cho , Jisu Nam , Seungryong Kim

Hashing methods aim to learn a set of hash functions which map the original features to compact binary codes with similarity preserving in the Hamming space. Hashing has proven a valuable tool for large-scale information retrieval. We…

Machine Learning · Computer Science 2016-02-23 Guosheng Lin , Fayao Liu , Chunhua Shen , Jianxin Wu , Heng Tao Shen

Low-rank decomposition, particularly Singular Value Decomposition (SVD), is a pivotal technique for mitigating the storage and computational demands of Large Language Models (LLMs). However, prevalent SVD-based approaches overlook the…

Machine Learning · Computer Science 2026-01-15 Lin Xv , Xian Gao , Ting Li , Yuzhuo Fu

In this paper we propose novel methods for compression and recovery of multilinear data under limited sampling. We exploit the recently proposed tensor- Singular Value Decomposition (t-SVD)[1], which is a group theoretic framework for…

Information Theory · Computer Science 2013-11-01 Zemin Zhang , Gregory Ely , Shuchin Aeron , Ning Hao , Misha Kilmer

In data analysis, there continues to be a need for interpretable dimensionality reduction methods whereby instrinic meaning associated with the data is retained in the reduced space. Standard approaches such as Principal Component Analysis…

Numerical Analysis · Mathematics 2024-02-13 Maria Emelianenko , Guy B. Oldaker

In this paper we propose new approaches to estimating large dimensional monotone index models. This class of models has been popular in the applied and theoretical econometrics literatures as it includes discrete choice, nonparametric…

Econometrics · Economics 2023-02-22 Shakeeb Khan , Xiaoying Lan , Elie Tamer , Qingsong Yao

In computational biology, numerous recent studies have been dedicated to the analysis of the chromatin structure within the cell by two-dimensional segmentation methods. Motivated by this application, we consider the problem of retrieving…

Statistics Theory · Mathematics 2016-03-14 V. Brault , M. Delattre , E. Lebarbier , T. Mary-Huard , C. Lévy-Leduc

Lightweight data compression is a key technique that allows column stores to exhibit superior performance for analytical queries. Despite a comprehensive study on dictionary-based encodings to approach Shannon's entropy, few prior works…

Databases · Computer Science 2023-11-27 Yihao Liu , Xinyu Zeng , Huanchen Zhang

Visual Document Retrieval (VDR) typically operates as text-to-image retrieval using specialized bi-encoders trained to directly embed document images. We revisit a zero-shot generate-and-encode pipeline: a vision-language model first…

Information Retrieval · Computer Science 2025-09-22 Thong Nguyen , Yibin Lei , Jia-Huei Ju , Andrew Yates

This paper presents a new method capable of reconstructing datasets with great precision and very low computational cost using a novel variant of the singular value decomposition (SVD) algorithm that has been named low-cost SVD (lcSVD).…

Computational Engineering, Finance, and Science · Computer Science 2023-11-20 Ashton Hetherington , Soledad Le Clainche

In this paper, we address the well-known challenge in the numerical solution of time-fractional partial differential equations (TFPDEs), namely, that the dependence on all previous time levels leads to storage requirements that grow…

Numerical Analysis · Mathematics 2026-04-23 Jichun Li , Yangpeng Zhang , Yangwen Zhang

Reliable density estimation is fundamental for numerous applications in statistics and machine learning. In many practical scenarios, data are best modeled as mixtures of component densities that capture complex and multimodal patterns.…

Machine Learning · Computer Science 2025-09-30 Mustafa Musab , Joseph K. Chege , Arie Yeredor , Martin Haardt

Variable length coding for Non-Volatile Memory (NVM) technologies is a promising method to improve memory capacity and system performance through compressing memory blocks. However, compression techniques used to improve capacity or…

Emerging Technologies · Computer Science 2017-10-26 Seyed Mohammad Seyedzadeh , Alex K. Jones , Rami Melhem

Learning a generative model from partial data (data with missingness) is a challenging area of machine learning research. We study a specific implementation of the Auto-Encoding Variational Bayes (AEVB) algorithm, named in this paper as a…

Machine Learning · Computer Science 2021-01-05 Amir Zadeh , Yao-Chong Lim , Paul Pu Liang , Louis-Philippe Morency

A novel orthogonalization-free method together with two specific algorithms are proposed to solve extreme eigenvalue problems. On top of gradient-based algorithms, the proposed algorithms modify the multi-column gradient such that earlier…

Numerical Analysis · Mathematics 2021-10-15 Weiguo Gao , Yingzhou Li , Bichen Lu

Various problems in data analysis and statistical genetics call for recovery of a column-sparse, low-rank matrix from noisy observations. We propose ReFACTor, a simple variation of the classical Truncated Singular Value Decomposition (TSVD)…

Machine Learning · Statistics 2017-05-23 Matan Gavish , Regev Schweiger , Elior Rahmani , Eran Halperin

A non-binary (2,v)-regular LDPC code is defined by a parity-check matrix with column weight 2 and row weight v. In this report, we give an ontology-based approach to the optimization for this class of codes. All possible inter-connected…

Information Theory · Computer Science 2014-09-09 Chao Chen

The growing interest in artificial intelligence has created workloads that require both sequential and random access. At the same time, NVMe-backed storage solutions have emerged, providing caching capability for large columnar datasets in…

Databases · Computer Science 2025-04-22 Weston Pace , Chang She , Lei Xu , Will Jones , Albert Lockett , Jun Wang , Raunak Shah

To reduce complexity and achieve scalable performance in high-dimensional black-box settings, we propose a distributed method for nonconvex derivative-free optimization of continuous variables with an additively separable objective, subject…

Optimization and Control · Mathematics 2025-11-03 Damilola Fasiku , Wentao Tang

We consider the task of classification in the high dimensional setting where the number of features of the given data is significantly greater than the number of observations. To accomplish this task, we propose a heuristic, called sparse…

Machine Learning · Statistics 2015-12-09 Brendan P. W. Ames , Mingyi Hong