English
Related papers

Related papers: oASIS: Adaptive Column Sampling for Kernel Matrix …

200 papers

Estimating rare events in complex systems is a key challenge in reliability analysis. The challenge grows in multimodal problems, where traditional methods often rely on a small set of design points and risk overlooking critical failure…

Computation · Statistics 2025-08-04 Sara Helal , Victor Elvira

This paper introduces ASCAI, a novel adaptive sampling methodology that can learn how to effectively compress Deep Neural Networks (DNNs) for accelerated inference on resource-constrained platforms. Modern DNN compression techniques…

Machine Learning · Computer Science 2019-11-18 Mojan Javaheripi , Mohammad Samragh , Tara Javidi , Farinaz Koushanfar

Efficient resource allocation and optical switching promise high key rates, network adaptability, and cost reduction in repeaterless quantum communication networks. However, identifying optimal switching configurations remains a significant…

This paper presents Orthogonal Subspace Clustering (OSC), an innovative method for high-dimensional data clustering. We first establish a theoretical theorem proving that high-dimensional data can be decomposed into orthogonal subspaces in…

Machine Learning · Computer Science 2026-03-17 Qing-Yuan Wen , Da-Qing Zhang

In today's information systems, the availability of massive amounts of data necessitates the development of fast and accurate algorithms to summarize these data and represent them in a succinct format. One crucial problem in big data…

Data Structures and Algorithms · Computer Science 2013-12-27 Ahmed K. Farahat , Ahmed Elgohary , Ali Ghodsi , Mohamed S. Kamel

This work aims to improve the sample efficiency of parallel large-scale ranking and selection (R&S) problems by leveraging correlation information. We modify the commonly used "divide and conquer" framework in parallel computing by adding a…

Methodology · Statistics 2026-02-16 Zishi Zhang , Yijie Peng

One of the longstanding open problems in spectral graph clustering (SGC) is the so-called model order selection problem: automated selection of the correct number of clusters. This is equivalent to the problem of finding the number of…

Social and Information Networks · Computer Science 2018-05-15 Pin-Yu Chen , Alfred O. Hero

We propose a continuous optimization algorithm for the Column Subset Selection Problem (CSSP) and Nystr\"om approximation. The CSSP and Nystr\"om method construct low-rank approximations of matrices based on a predetermined subset of…

Methodology · Statistics 2023-04-20 Anant Mathur , Sarat Moka , Zdravko Botev

In this paper, we propose a novel element-wise subset selection method for the alternating least squares (ALS) algorithm, focusing on low-rank matrix factorization involving matrices with missing values, as commonly encountered in…

Methodology · Statistics 2025-11-12 Dunyao Xue , Mengyu Li , Cheng Meng , Jingyi Zhang

This paper is concerned with the problem of low rank plus sparse matrix decomposition for big data. Conventional algorithms for matrix decomposition use the entire data to extract the low-rank and sparse components, and are based on…

Numerical Analysis · Computer Science 2017-03-17 Mostafa Rahmani , George Atia

We present a new algorithm for finding a near optimal low-rank approximation of a matrix $A$ in $O(nnz(A))$ time. Our method is based on a recursive sampling scheme for computing a representative subset of $A$'s columns, which is then used…

Data Structures and Algorithms · Computer Science 2016-10-10 Michael B. Cohen , Cameron Musco , Christopher Musco

Steerable networks, which process data with intrinsic symmetries, often use Fourier-based nonlinearities that require sampling from the entire group, leading to a need for discretization in continuous groups. As the number of samples…

Machine Learning · Computer Science 2024-09-16 Berfin Inal , Gabriele Cesa

Oversampled adaptive sensing (OAS) is a recently proposed Bayesian framework which sequentially adapts the sensing basis. In OAS, estimation quality is, in each step, measured by conditional mean squared errors (MSEs), and the basis for the…

Information Theory · Computer Science 2018-11-16 Ralf R. Müller , Ali Bereyhi , Christoph F. Mecklenbräuker

We propose an efficient novel path sampling-based framework designed to accelerate the investigation of rare events in complex molecular systems. A key innovation is the shift from sampling restricted path ensemble distributions, as in…

Chemical Physics · Physics 2025-03-28 Gianmarco Lazzeri , Peter G. Bolhuis , Roberto Covino

Recently, Sharma et al. suggested a method called Layer-SElective-Rank reduction (LASER) which demonstrated that pruning high-order components of carefully chosen LLM's weight matrices can boost downstream accuracy -- without any…

Machine Learning · Computer Science 2025-10-24 Shiva Sreeram , Alaa Maalouf , Pratyusha Sharma , Daniela Rus

In oversampled adaptive sensing (OAS), noisy measurements are collected in multiple subframes. The sensing basis in each subframe is adapted according to some posterior information exploited from previous measurements. The framework is…

Information Theory · Computer Science 2019-12-11 Ali Bereyhi , Ralf R. Müller

In this abstract paper, we introduce a new kernel learning method by a nonparametric density estimator. The estimator consists of a group of k-centroids clusterings. Each clustering randomly selects data points with randomly selected…

Machine Learning · Computer Science 2017-08-02 Xiao-Lei Zhang

Analysis of high-dimensional data has led to increased interest in both single index models (SIMs) and the best-subset selection. SIMs provide an interpretable and flexible modeling framework for high-dimensional data, while the best-subset…

Machine Learning · Statistics 2025-08-19 Borui Tang , Jin Zhu , Junxian Zhu , Xueqin Wang , Heping Zhang

We study the problem of instance segmentation in biological images with crowded and compact cells. We formulate this task as an integer program where variables correspond to cells and constraints enforce that cells do not overlap. To solve…

Computer Vision and Pattern Recognition · Computer Science 2017-09-22 Chong Zhang , Shaofei Wang , Miguel A. Gonzalez-Ballester , Julian Yarkony

Sparse Inverse Covariance Estimation (SICE) is useful in many practical data analyses. Recovering the connectivity, non-connectivity graph of covariates is classified amongst the most important data mining and learning problems. In this…

Machine Learning · Computer Science 2019-04-05 Ashkan Esmaeili , Farokh Marvasti