English
Related papers

Related papers: Distinct counting with a self-learning bitmap

200 papers

Traditional indexing techniques commonly employed in da\-ta\-ba\-se systems perform poorly on multidimensional array scientific data. Bitmap indices are widely used in commercial databases for processing complex queries, due to their…

Databases · Computer Science 2021-09-01 Luboš Krčál , Shen-Shyang Ho , Jan Holub

Machine learning and quantum computing are two technologies each with the potential for altering how computation is performed to address previously untenable problems. Kernel methods for machine learning are ubiquitous for pattern…

Classification of high dimensional data finds wide-ranging applications. In many of these applications equipping the resulting classification with a measure of uncertainty may be as important as the classification itself. In this paper we…

Machine Learning · Computer Science 2018-02-12 Andrea L. Bertozzi , Xiyang Luo , Andrew M. Stuart , Konstantinos C. Zygalakis

Conformal prediction has emerged as an effective strategy for uncertainty quantification by modifying a model to output sets of labels instead of a single label. These prediction sets come with the guarantee that they contain the true label…

Machine Learning · Computer Science 2025-05-28 Haosen Ge , Hamsa Bastani , Osbert Bastani

We consider increasingly complex models of matrix denoising and dictionary learning in the Bayes-optimal setting, in the challenging regime where the matrices to infer have a rank growing linearly with the system size. This is in contrast…

Information Theory · Computer Science 2022-09-14 Jean Barbier , Nicolas Macris

Drawing a sample from a discrete distribution is one of the building components for Monte Carlo methods. Like other sampling algorithms, discrete sampling suffers from the high computational burden in large-scale inference problems. We…

Machine Learning · Statistics 2016-04-29 Yutian Chen , Zoubin Ghahramani

Large scale online kernel learning aims to build an efficient and scalable kernel-based predictive model incrementally from a sequence of potentially infinite data points. A current key approach focuses on ways to produce an approximate…

Machine Learning · Computer Science 2019-09-25 Kai Ming Ting , Jonathan R. Wells , Takashi Washio

Species-sampling problems (SSPs) refer to a vast class of statistical problems calling for the estimation of (discrete) functionals of the unknown species composition of an unobservable population. A common feature of SSPs is their…

Methodology · Statistics 2024-02-13 Cecilia Balocchi , Federico Camerlenghi , Stefano Favaro

In this study, a novel machine learning algorithm, restricted Boltzmann machine (RBM), is introduced. The algorithm is applied for the spectral classification in astronomy. RBM is a bipartite generative graphical model with two separate…

Machine Learning · Computer Science 2013-10-15 Fuqiang Chen , Yan Wu , Yude Bu , Guodong Zhao

Several statistical approaches based on reproducing kernels have been proposed to detect abrupt changes arising in the full distribution of the observations and not only in the mean or variance. Some of these approaches enjoy good…

Statistics Theory · Mathematics 2017-10-13 Alain Celisse , Guillemette Marot , Morgane Pierre-Jean , Guillem Rigaill

Semi-supervised learning is attracting blooming attention, due to its success in combining unlabeled data. To mitigate potentially incorrect pseudo labels, recent frameworks mostly set a fixed confidence threshold to discard uncertain…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Lihe Yang , Zhen Zhao , Lei Qi , Yu Qiao , Yinghuan Shi , Hengshuang Zhao

Deep learning techniques have achieved great success in remote sensing image change detection. Most of them are supervised techniques, which usually require large amounts of training data and are limited to a particular application.…

Image and Video Processing · Electrical Eng. & Systems 2021-10-11 Yuxing Chen , Lorenzo Bruzzone

Learning a discriminative semantic space using unlabelled and noisy data remains unaddressed in a multi-label setting. We present a contrastive self-supervised learning method which is robust to data noise, grounded in the domain of…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Mehmet Can Yavuz , Berrin Yanikoglu

Discriminative pattern mining is an essential task of data mining. This task aims to discover patterns which occur more frequently in a class than other classes in a class-labeled dataset. This type of patterns is valuable in various…

Machine Learning · Computer Science 2019-06-05 Hoang Son Pham , Gwendal Virlet , Dominique Lavenier , Alexandre Termier

Privately counting distinct elements in a stream is a fundamental data analysis problem with many applications in machine learning. In the turnstile model, Jain et al. [NeurIPS2023] initiated the study of this problem parameterized by the…

Data Structures and Algorithms · Computer Science 2024-08-22 Monika Henzinger , A. R. Sricharan , Teresa Anna Steiner

High dimensional and heterogeneous count data are collected in various applied fields. In this paper, we look closely at high-resolution sequencing data on the microbiome, which have enabled researchers to study the genomes of entire…

Methodology · Statistics 2024-01-12 Veronica Vinciotti , Pariya Behrouzi , Reza Mohammadi

The success of machine learning has resulted from its structured representation of data. Similar data have close internal representations as compressed codes for classification or emerged labels for clustering. We observe that the frequency…

Machine Learning · Computer Science 2022-04-13 Sungyeop Lee , Junghyo Jo

Coordinate Descent (CD) methods have gained significant attention in machine learning due to their effectiveness in solving high-dimensional problems and their ability to decompose complex optimization tasks. However, classical CD methods…

Optimization and Control · Mathematics 2024-12-24 Artavazd Maranjyan , Abdurakhmon Sadiev , Peter Richtárik

Bayesian inference allows us to define a posterior distribution over the weights of a generic neural network (NN). Exact posteriors are usually intractable, in which case approximations can be employed. One such approximation - variational…

Machine Learning · Computer Science 2026-01-30 Andrew Millard , Joshua Murphy , Peter Green , Simon Maskell

We propose an extensible deep learning method that uses reinforcement learning to train neural networks for offline ranking in information retrieval (IR). We call our method BanditRank as it treats ranking as a contextual bandit problem. In…

Information Retrieval · Computer Science 2019-10-24 Phanideep Gampa , Sumio Fujita