English
Related papers

Related papers: Learning Group Importance using the Differentiable…

200 papers

Estimating and disentangling epistemic uncertainty, uncertainty that is reducible with more training data, and aleatoric uncertainty, uncertainty that is inherent to the task at hand, is critically important when applying machine learning…

Machine Learning · Computer Science 2024-11-08 Matthew A. Chan , Maria J. Molina , Christopher A. Metzler

This article proposes an active learning method for high dimensional data, based on intrinsic data geometries learned through diffusion processes on graphs. Diffusion distances are used to parametrize low-dimensional structures on the…

Machine Learning · Computer Science 2019-05-31 Mauro Maggioni , James M. Murphy

Unsupervised clustering is one of the most fundamental challenges in machine learning. A popular hypothesis is that data are generated from a union of low-dimensional nonlinear manifolds; thus an approach to clustering is identifying and…

Machine Learning · Computer Science 2017-12-27 Dejiao Zhang , Yifan Sun , Brian Eriksson , Laura Balzano

In this work we study the set size distribution estimation problem, where elements are randomly sampled from a collection of non-overlapping sets and we seek to recover the original set size distribution from the samples. This problem has…

Statistics Theory · Mathematics 2012-12-04 Fabricio Murai , Bruno Ribeiro , Don Towsley , Pinghui Wang

Understanding the macroscopic characteristics of biological complexes demands precision and specificity in statistical ensemble modeling. One of the primary challenges in this domain lies in sampling from particular subsets of the…

Machine Learning · Computer Science 2023-07-11 Justin Diamond , Markus Lill

Artificial intelligence has made remarkable progress in handling complex tasks, thanks to advances in hardware acceleration and machine learning algorithms. However, to acquire more accurate outcomes and solve more complex issues,…

Machine Learning · Computer Science 2023-09-12 Mohammad Dehghani , Zahra Yazdanparast

Decision Trees and Random Forests are among the most widely used machine learning models, and often achieve state-of-the-art performance in tabular, domain-agnostic datasets. Nonetheless, being primarily discriminative models they lack…

Machine Learning · Statistics 2020-07-14 Alvaro H. C. Correia , Robert Peharz , Cassio de Campos

Galaxy groups are essential for studying the distribution of matter on a large scale in redshift surveys and for deciphering the link between galaxy traits and their associated halos. In this work, we propose a widely applicable method for…

Cosmology and Nongalactic Astrophysics · Physics 2025-04-03 Juntao Ma , Jie Wang , Tianxiang Mao , Hongxiang Chen , Yuxi Meng , Xiaohu Yang , Qingyang Li

Despite the superior performance of Deep Learning (DL) on numerous segmentation tasks, the DL-based approaches are notoriously overconfident about their prediction with highly polarized label probability. This is often not desirable for…

Image and Video Processing · Electrical Eng. & Systems 2021-12-14 Sungmin Hong , Anna K. Bonkhoff , Andrew Hoopes , Martin Bretzner , Markus D. Schirmer , Anne-Katrin Giese , Adrian V. Dalca , Polina Golland , Natalia S. Rost

Quantitative analysis of large-scale data is often complicated by the presence of diverse subgroups, which reduce the accuracy of inferences they make on held-out data. To address the challenge of heterogeneous data analysis, we introduce…

Machine Learning · Computer Science 2021-09-01 Nazanin Alipourfard , Keith Burghardt , Kristina Lerman

In the group-testing literature, efficient algorithms have been developed to minimize the number of tests required to identify all minimal "defective" sub-groups embedded within a larger group, using deterministic group splitting with a…

Discrete Mathematics · Computer Science 2020-10-20 Laurence A. Clarfeld , Margaret J. Eppstein

In this paper, we address an issue of finding explainable clusters of class-uniform data in labelled datasets. The issue falls into the domain of interpretable supervised clustering. Unlike traditional clustering, supervised clustering aims…

Machine Learning · Computer Science 2023-07-18 Natallia Kokash , Leonid Makhnist

We consider the basic problem of learning an unknown partition of $n$ elements into at most $k$ sets using simple queries that reveal information about a small subset of elements. Our starting point is the well-studied pairwise same-set…

Data Structures and Algorithms · Computer Science 2025-06-24 Hadley Black , Arya Mazumdar , Barna Saha

The Riemannian geometry of covariance matrices has been essential to several successful applications, in computer vision, biomedical signal and image processing, and radar data processing. For these applications, an important ongoing…

Statistics Theory · Mathematics 2017-05-15 Salem Said , Hatem Hajri , Lionel Bombrun , Baba C. Vemuri

Modern datasets span billions of samples, making training on all available data infeasible. Selecting a high quality subset helps in reducing training costs and enhancing model quality. Submodularity, a discrete analogue of convexity, is…

Machine Learning · Computer Science 2025-04-04 Maximilian Böther , Abraham Sebastian , Pranjal Awasthi , Ana Klimovic , Srikumar Ramalingam

We present a novel unsupervised learning approach to automatically segment and label images in astronomical surveys. Automation of this procedure will be essential as next-generation surveys enter the petabyte scale: data volumes will…

Instrumentation and Methods for Astrophysics · Physics 2015-07-08 Alex Hocking , James E. Geach , Neil Davey , Yi Sun

Learning algorithms for implicit generative models can optimize a variety of criteria that measure how the data distribution differs from the implicit model distribution, including the Wasserstein distance, the Energy distance, and the…

Machine Learning · Statistics 2019-08-23 Leon Bottou , Martin Arjovsky , David Lopez-Paz , Maxime Oquab

Distributed learning provides an attractive framework for scaling the learning task by sharing the computational load over multiple nodes in a network. Here, we investigate the performance of distributed learning for large-scale linear…

Machine Learning · Statistics 2021-11-03 Martin Hellkvist , Ayça Özçelikkale , Anders Ahlén

A central problem in machine learning involves modeling complex data-sets using highly flexible families of probability distributions in which learning, sampling, inference, and evaluation are still analytically or computationally…

Machine Learning · Computer Science 2015-11-20 Jascha Sohl-Dickstein , Eric A. Weiss , Niru Maheswaranathan , Surya Ganguli

We consider the problem of clustering data points in high dimensions, i.e. when the number of data points may be much smaller than the number of dimensions. Specifically, we consider a Gaussian mixture model (GMM) with non-spherical…

Statistics Theory · Mathematics 2014-06-10 Martin Azizyan , Aarti Singh , Larry Wasserman