English
Related papers

Related papers: Fast clustering for scalable statistical analysis …

200 papers

Clustering can be defined as the process of assembling objects into a number of groups whose elements are similar to each other in some manner. As a technique that is used in many domains, such as face clustering, plant categorization,…

Machine Learning · Computer Science 2022-04-05 Mehmet F. Demirel , Enrico Au-Yeung

The problem of constrained clustering has attracted significant attention in the past decades. In this paper, we study the balanced $k$-center, $k$-median, and $k$-means clustering problems where the size of each cluster is constrained by…

Computational Geometry · Computer Science 2018-09-11 Hu Ding

The field of connectomics faces unprecedented "big data" challenges. To reconstruct neuronal connectivity, automated pixel-level segmentation is required for petabytes of streaming electron microscopy data. Existing algorithms provide…

While clustering is one of the most popular methods for data mining, analysts lack adequate tools for quick, iterative clustering analysis, which is essential for hypothesis generation and data reasoning. We introduce Clustrophile, an…

Human-Computer Interaction · Computer Science 2017-10-09 Çağatay Demiralp

Clustering algorithms remain valuable tools for grouping and summarizing the most important aspects of data. Example areas where this is the case include image segmentation, dimension reduction, signals analysis, model order reduction,…

Numerical Analysis · Mathematics 2024-12-24 Guy B. Oldaker , Maria Emelianenko

Purpose: Functional Magnetic Resonance Imaging (fMRI) data acquired through resting-state studies have been used to obtain information about the spontaneous activations inside the brain. One of the approaches for analysis and interpretation…

Image and Video Processing · Electrical Eng. & Systems 2022-02-24 Harshit Parmar , Brian Nutter , Rodney Long , Sameer Antani , Sunanda Mitra

Data structures for efficient sampling from a set of weighted items are an important building block of many applications. However, few parallel solutions are known. We close many of these gaps both for shared-memory and distributed-memory…

Data Structures and Algorithms · Computer Science 2021-07-20 Lorenz Hübschle-Schneider , Peter Sanders

Clustering high-dimensional data often requires some form of dimensionality reduction, where clustered variables are separated from "noise-looking" variables. We cast this problem as finding a low-dimensional projection of the data which is…

Machine Learning · Statistics 2016-08-30 Nicolas Flammarion , Balamurugan Palaniappan , Francis Bach

A method for dimension reduction with clustering, classification, or discriminant analysis is introduced. This mixture model-based approach is based on fitting generalized hyperbolic mixtures on a reduced subspace within the paradigm of…

Methodology · Statistics 2017-10-09 Katherine Morris , Paul D. McNicholas

With rapid advances in neuroimaging techniques, the research on brain disorder identification has become an emerging area in the data mining community. Brain disorder data poses many unique challenges for data mining research. For example,…

Machine Learning · Computer Science 2015-08-06 Bokai Cao , Xiangnan Kong , Philip S. Yu

Dimensionality reduction and clustering techniques are frequently used to analyze complex data sets, but their results are often not easy to interpret. We consider how to support users in interpreting apparent cluster structure on scatter…

Machine Learning · Computer Science 2021-11-08 Xander Vankwikelberge , Bo Kang , Edith Heiter , Jefrey Lijffijt

Large language models (LLMs) often rely on user-specific memories distilled from past interactions to enable personalized generation. A common practice is to concatenate these memories with the input prompt, but this approach quickly…

Computation and Language · Computer Science 2026-01-27 Ondrej Bohdal , Pramit Saha , Umberto Michieli , Mete Ozay , Taha Ceritli

Large-scale genomic workflows used in precision medicine can process datasets spanning tens to hundreds of gigabytes per sample, leading to high memory spikes, intensive disk I/O, and task failures due to out-of-memory errors. Simple static…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-21 Daniel Mas Montserrat , Ray Verma , Míriam Barrabés , Francisco M. de la Vega , Carlos D. Bustamante , Alexander G. Ioannidis

Many approaches to 3D image segmentation are based on hierarchical clustering of supervoxels into image regions. Here we describe a distributed algorithm capable of handling a tremendous number of supervoxels. The algorithm works…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Ran Lu , Aleksandar Zlateski , H. Sebastian Seung

Large models and enormous data are essential driving forces of the unprecedented successes achieved by modern algorithms, especially in scientific computing and machine learning. Nevertheless, the growing dimensionality and model…

Machine Learning · Computer Science 2023-10-04 Yijun Dong

Modeling the behavior of coupled networks is challenging due to their intricate dynamics. For example in neuroscience, it is of critical importance to understand the relationship between the functional neural processes and anatomical…

Machine Learning · Computer Science 2021-04-20 Hongyuan You , Sikun Lin , Ambuj K. Singh

The desire to train complex machine learning algorithms and to increase the statistical power in association studies drives neuroimaging research to use ever-larger datasets. The most obvious way to increase sample size is by pooling scans…

Computer Vision and Pattern Recognition · Computer Science 2020-10-29 Christian Wachinger , Anna Rieckmann , Sebastian Pölsterl

Time-series clustering serves as a powerful data mining technique for time-series data in the absence of prior knowledge about clusters. A large amount of time-series data with large size has been acquired and used in various research…

Signal Processing · Electrical Eng. & Systems 2024-05-21 Tomoki Inoue , Koyo Kubota , Tsubasa Ikami , Yasuhiro Egami , Hiroki Nagai , Takahiro Kashikawa , Koichi Kimura , Yu Matsuda

This paper introduces a novel K-means clustering algorithm, an advancement on the conventional Big-means methodology. The proposed method efficiently integrates parallel processing, stochastic sampling, and competitive optimization to…

Machine Learning · Computer Science 2024-03-28 Rustam Mussabayev , Ravil Mussabayev

Face clustering is a promising way to scale up face recognition systems using large-scale unlabeled face images. It remains challenging to identify small or sparse face image clusters that we call hard clusters, which is caused by the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Yingjie Chen , Huasong Zhong , Chong Chen , Chen Shen , Jianqiang Huang , Tao Wang , Yun Liang , Qianru Sun