English
Related papers

Related papers: SPRISS: Approximating Frequent $k$-mers by Samplin…

200 papers

Purpose: A fast data-driven optimization approach, named bias-accelerated subset selection (BASS), is proposed for learning efficacious sampling patterns (SPs) with the purpose of reducing scan time in large-dimensional parallel MRI.…

Signal Processing · Electrical Eng. & Systems 2020-11-05 Marcelo V. W. Zibetti , Gabor T. Herman , Ravinder R. Regatte

Given the vast reservoirs of data stored worldwide, efficient mining of data from a large information store has emerged as a great challenge. Many databases like that of intrusion detection systems, web-click records, player statistics,…

Databases · Computer Science 2010-03-09 Sourav Dutta , Arnab Bhattacharya

$k$-means++ \cite{arthur2007k} is a widely used clustering algorithm that is easy to implement, has nice theoretical guarantees and strong empirical performance. Despite its wide adoption, $k$-means++ sometimes suffers from being slow on…

Machine Learning · Computer Science 2020-12-23 Vincent Cohen-Addad , Silvio Lattanzi , Ashkan Norouzi-Fard , Christian Sohler , Ola Svensson

Efficient Maximum Inner Product Search (MIPS) is an important task that has a wide applicability in recommendation systems and classification with a large number of classes. Solutions based on locality-sensitive hashing (LSH) as well as…

Machine Learning · Computer Science 2015-12-01 Alex Auvolat , Sarath Chandar , Pascal Vincent , Hugo Larochelle , Yoshua Bengio

Consistent sampling is a technique for specifying, in small space, a subset $S$ of a potentially large universe $U$ such that the elements in $S$ satisfy a suitably chosen sampling condition. Given a subset $\mathcal{I}\subseteq U$ it…

Data Structures and Algorithms · Computer Science 2014-04-21 Konstantin Kutzkov , Rasmus Pagh

Data selection is essential for training deep learning models. An effective data sampler assigns proper sampling probability for training data and helps the model converge to a good local minimum with high performance. Previous studies in…

Machine Learning · Computer Science 2024-10-10 Jiawei Yao , Chuming Li , Canran Xiao

$k$-subset sampling is ubiquitous in machine learning, enabling regularization and interpretability through sparsity. The challenge lies in rendering $k$-subset sampling amenable to end-to-end learning. This has typically involved relaxing…

Machine Learning · Computer Science 2024-06-10 Kareem Ahmed , Zhe Zeng , Mathias Niepert , Guy Van den Broeck

Pairwise alignment of DNA sequencing data is a ubiquitous task in bioinformatics and typically represents a heavy computational burden. State-of-the-art approaches to speed up this task use hashing to identify short segments (k-mers) that…

Machine Learning · Computer Science 2021-02-16 Govinda M. Kamath , Tavor Z. Baharav , Ilan Shomorony

Sub-sequence splitting (SSS) has been demonstrated as an effective approach to mitigate data sparsity in sequential recommendation (SR) by splitting a raw user interaction sequence into multiple sub-sequences. Previous studies have…

Information Retrieval · Computer Science 2026-04-08 Yizhou Dang , Yifan Wu , Minhan Huang , Chuang Zhao , Lianbo Ma , Guibing Guo , Xingwei Wang , Zhu Sun

Background: High-throughput proteomics techniques, such as mass spectrometry (MS)-based approaches, produce very high-dimensional data-sets. In a clinical setting one is often interested in how mass spectra differ between patients of…

This paper describes a new asynchronous algorithm and implementation for the problem of k-mer counting (KC), which concerns quantifying the frequency of length k substrings in a DNA sequence. This operation is common to many computational…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-08 Souvadra Hati , Akihiro Hayashi , Richard Vuduc

Frequent pattern mining is a flagship problem in data mining. In its most basic form, it asks for the set of substrings of a given string $S$ of length $n$ that occur at least $\tau$ times in $S$, for some integer $\tau\in[1,n]$. We…

Data Structures and Algorithms · Computer Science 2025-06-06 Pengxin Bian , Panagiotis Charalampopoulos , Lorraine A. K. Ayad , Manal Mohamed , Solon P. Pissis , Grigorios Loukides

Existing systems dealing with the increasing volume of data series cannot guarantee interactive response times, even for fundamental tasks such as similarity search. Therefore, it is necessary to develop analytic approaches that support…

Databases · Computer Science 2022-12-29 Karima Echihabi , Theophanis Tsandilas , Anna Gogolou , Anastasia Bezerianos , Themis Palpanas

Clustering, a fundamental activity in unsupervised learning, is notoriously difficult when the feature space is high-dimensional. Fortunately, in many realistic scenarios, only a handful of features are relevant in distinguishing clusters.…

Machine Learning · Statistics 2020-10-23 Zhiyue Zhang , Kenneth Lange , Jason Xu

We propose sequenced-replacement sampling (SRS) for training deep neural networks. The basic idea is to assign a fixed sequence index to each sample in the dataset. Once a mini-batch is randomly drawn in each training iteration, we refill…

Machine Learning · Computer Science 2018-10-22 Chiu Man Ho , Dae Hoon Park , Wei Yang , Yi Chang

Selecting a small set of representatives from a large database is important in many applications such as multi-criteria decision making, web search, and recommendation. The $k$-regret minimizing set ($k$-RMS) problem was recently proposed…

Databases · Computer Science 2021-06-30 Yanhao Wang , Yuchen Li , Raymond Chi-Wing Wong , Kian-Lee Tan

Motivation: Seed filtering is critical in DNA read mapping, a process where billions of DNA fragments (reads) sampled from a donor are mapped onto a reference genome to identify genomic variants of the donor. Read mappers 1) quickly…

For single-cell or metagenomic sequencing projects, it is necessary to sequence with a very high mean coverage in order to make sure that all parts of the sample DNA get covered by the reads produced. This leads to huge datasets with lots…

Sparse Subspace Clustering (SSC) has been used extensively for subspace identification tasks due to its theoretical guarantees and relative ease of implementation. However SSC has quadratic computation and memory requirements with respect…

Computer Vision and Pattern Recognition · Computer Science 2017-04-14 Stephen Tierney , Yi Guo , Junbin Gao

Most kernel-based methods, such as kernel or Gaussian process regression, kernel PCA, ICA, or $k$-means clustering, do not scale to large datasets, because constructing and storing the kernel matrix $\mathbf{K}_n$ requires at least…

Machine Learning · Statistics 2018-03-28 Daniele Calandriello , Alessandro Lazaric , Michal Valko