Related papers: Quantitative Clustering in Mean-Field Transformer …
Transformers play a central role in the inner workings of large language models. We develop a mathematical framework for analyzing Transformers based on their interpretation as interacting particle systems, which reveals that clusters…
Modulation recognition is an important task in radio signal processing. Most of the current researches focus on supervised learning. However, in many real scenarios, it is difficult and cost to obtain the labels of signals. In this letter,…
Persistent homology is a methodology central to topological data analysis that extracts and summarizes the topological features within a dataset as a persistence diagram; it has recently gained much popularity from its myriad successful…
"Cluster" extensions of the dynamical mean field method to include longer range correlations are discussed. It is argued that the clusters arising in these methods are naturally interpreted not as actual subunits of a physical lattice but…
The degrees of freedom that confer to strongly correlated systems their many intriguing properties also render them fairly intractable through typical perturbative treatments. For this reason, the mechanisms responsible for these…
Computational studies show the generation of large coexisting metallic and insulating clusters with equal electronic density in models for manganites. The clusters are induced by disorder on exchange and hopping amplitudes near first-order…
Using high precision Monte Carlo simulations and a mean-field theory, we explore coarsening phenomena in a simple driven diffusive system. The model is reminiscent of vehicular traffic on a two-lane ring road. At sufficiently high density,…
In this paper, we will study the emergent behavior of Kuramoto model with frustration on a general digraph containing a spanning tree. We provide a sufficient condition for the emergence of asymptotical synchronization if the initial data…
The phase transition of a random mixed-bond Ising ferromagnet on a cubic lattice model is studied both numerically and analytically. In this work, we use the Cluster algorithms of Wolff and Glauber to simulate the dynamics of the system. We…
Dirichlet process mixtures are flexible non-parametric models, particularly suited to density estimation and probabilistic clustering. In this work we study the posterior distribution induced by Dirichlet process mixtures as the sample size…
We develop a real space cluster extension of the typical medium theory (cluster-TMT) to study Anderson localization. By construction, the cluster-TMT approach is formally equivalent to the real space cluster extension of the dynamical mean…
Clustering performs an essential role in many real world applications, such as market research, pattern recognition, data analysis, and image processing. However, due to the high dimensionality of the input feature values, the data being…
Clustering is a core task in machine learning with wide-ranging applications in data mining and pattern recognition. However, its unsupervised nature makes it inherently challenging. Many existing clustering algorithms suffer from critical…
Clustering samples according to an effective metric and/or vector space representation is a challenging unsupervised learning task with a wide spectrum of applications. Among several clustering algorithms, k-means and its kernelized version…
We present Agglomerative Token Clustering (ATC), a novel token merging method that consistently outperforms previous token merging and pruning methods across image classification, image synthesis, and object detection & segmentation tasks.…
We study the asymptotic scaling of the entanglement of a block of spins for the ground state of the one-dimensional quantum Ising model with transverse field. When the field is sufficiently strong, the entanglement grows at most…
The problem of inhomogeneous cluster densities has been a long-standing issue for distance-based and density-based algorithms in clustering and anomaly detection. These algorithms implicitly assume that all clusters have approximately the…
We discuss a generalized self-consistent mean field (MF) treatment, based on the selection of an arbitrary subset of operators for representing the system density matrix, and its application to the problem of entanglement evaluation in…
We analyse the collective behavior of a mean-field model of phase-oscillators of Kuramoto-Daido type coupled through pairwise interactions which depend on phase differences: the coupling function is composed of three harmonics. We provide…
Finding well-defined clusters in data represents a fundamental challenge for many data-driven applications, and largely depends on good data representation. Drawing on literature regarding representation learning, studies suggest that one…