English
Related papers

Related papers: Analytical and statistical properties of local dep…

200 papers

We study when low coordinate degree functions (LCDF) -- linear combinations of functions depending on small subsets of entries of a vector -- can hypothesis test between high-dimensional probability measures. These functions are a…

Statistics Theory · Mathematics 2024-03-13 Dmitriy Kunisky

It is important to identify the discriminative features for high dimensional clustering. However, due to the lack of cluster labels, the regularization methods developed for supervised feature selection can not be directly applied. To learn…

Machine Learning · Statistics 2025-07-16 Zhaoyu Xing , Yang Wan , Juan Wen , Wei Zhong

The Stochastic Gradient Langevin Dynamics (SGLD) are popularly used to approximate Bayesian posterior distributions in statistical learning procedures with large-scale data. As opposed to many usual Markov chain Monte Carlo (MCMC)…

Machine Learning · Statistics 2024-04-30 Kexin Jin , Chenguang Liu , Jonas Latz

Stochastic Gradient Descent (SGD) based methods have been widely used for training large-scale machine learning models that also generalize well in practice. Several explanations have been offered for this generalization performance, a…

Machine Learning · Computer Science 2021-02-11 Yikai Zhang , Wenjia Zhang , Sammy Bald , Vamsi Pingali , Chao Chen , Mayank Goswami

We analyze asynchronous-type algorithms for distributed SGD in the heterogeneous setting, where each worker has its own computation and communication speeds, as well as data distribution. In these algorithms, workers compute possibly stale…

Machine Learning · Computer Science 2023-11-01 Rustem Islamov , Mher Safaryan , Dan Alistarh

In this paper, we provide a generalization of the forward-backward splitting algorithm for minimizing the sum of a proper convex lower semicontinuous function and a differentiable convex function whose gradient satisfies a locally…

Optimization and Control · Mathematics 2023-06-29 Luis M. Briceno-Arias , Francisco José Silva , Xianjin Yang

We present a detailed description of the generalized geometric cluster algorithm for the efficient simulation of continuum fluids. The connection with well-known cluster algorithms for lattice spin models is discussed, and an explicit full…

Statistical Mechanics · Physics 2009-11-11 Jiwen Liu , Erik Luijten

The distributed subgradient method (DSG) is a widely discussed algorithm to cope with large-scale distributed optimization problems in the arising machine learning applications. Most exisiting works on DSG focus on ideal communication…

Signal Processing · Electrical Eng. & Systems 2022-08-24 Zhaoyue Xia , Jun Du , Yong Ren

In this paper we target the class of modal clustering methods where clusters are defined in terms of the local modes of the probability density function which generates the data. The most well-known modal clustering method is the k-means…

Machine Learning · Computer Science 2022-03-04 Gaël Beck , Tarn Duong , Mustapha Lebbah , Hanane Azzag , Christophe Cérin

In the context of texture segmentation in images, and provide some theoretical guarantees for the prototypical approach which consists in extracting local features in the neighborhood of a pixel and then applying a clustering algorithm for…

Statistics Theory · Mathematics 2020-11-25 Lin Zheng

Unsupervised clustering algorithm can effectively reduce the dimension of high-dimensional unlabeled data, thus reducing the time and space complexity of data processing. However, the traditional clustering algorithm needs to set the upper…

Machine Learning · Computer Science 2022-01-17 Zecang Gu , Xiaoqi Sun , Yuan Sun , Fuquan Zhang

Statistical properties of a local fluctuational fluxes measured at the plasma edge are investigated in the work. It's shown that the amplitudes increments of the local fluctuational fluxes decrease by power law. For approximation of…

Plasma Physics · Physics 2012-09-12 Viacheslav Saenko

Given a graph $G$ and a seed node $v_s$, the objective of local graph clustering (LGC) is to identify a subgraph $C_s \in G$ (a.k.a. local cluster) surrounding $v_s$ in time roughly linear with the size of $C_s$. This approach yields…

Social and Information Networks · Computer Science 2025-03-27 Haoran Zheng , Renchi Yang , Jianliang Xu

In this paper, we introduce a new approach to proving the convergence of the Stochastic Approximation (SA) and the Stochastic Gradient Descent (SGD) algorithms. The new approach is based on a concept called GSLLN (Generalized Strong Law of…

Optimization and Control · Mathematics 2025-11-11 Rajeeva Laxman Karandikar , Bhamidi Visweswara Rao , Mathukumalli Vidyasagar

The recovery of an unknown density matrix of large size requires huge computational resources. The recent Factored Gradient Descent (FGD) algorithm and its variants achieved state-of-the-art performance since they could mitigate the…

Quantum Physics · Physics 2022-10-11 Ming-Chien Hsu , En-Jui Kuo , Wei-Hsuan Yu , Jian-Feng Cai , Min-Hsiu Hsieh

We propose a bootstrap procedure for data that may exhibit clustering in two or more dimensions. We use insights from the theory of generalized U-statistics to analyze the large-sample properties of statistics that are sample averages from…

Methodology · Statistics 2017-12-06 Konrad Menzel

Human analysts that use anomaly detection systems in practice want to retain the use of simple and explainable global anomaly detectors. In this paper, we propose a novel human-in-the-loop learning algorithm called GLAD (GLocalized Anomaly…

Machine Learning · Computer Science 2020-07-17 Md Rakibul Islam , Shubhomoy Das , Janardhan Rao Doppa , Sriraam Natarajan

We consider a large class of random geometric graphs constructed from samples $\mathcal{X}_n = \{X_1,X_2,\ldots,X_n\}$ of independent, identically distributed observations of an underlying probability measure $\nu$ on a bounded domain…

Probability · Mathematics 2016-04-15 Erik Davis , Sunder Sethuraman

Finding the densest subgraph (DS) from a graph is a fundamental problem in graph databases. The DS obtained, which reveals closely related entities, has been found to be useful in various application domains such as e-commerce, social…

Databases · Computer Science 2025-04-16 Yi Yang , Chenhao Ma , Reynold Cheng , Laks V. S. Lakshmanan , Xiaolin Han

By using the quantum Ising chain as a test bed and treating the spin polarization along the external transverse field as the "generalized density", we examine the performance of different levels of density functional approximations parallel…

Computational Physics · Physics 2021-10-27 Jiahao Mao , Haifeng Tang , Wenhui Duan , Zheng Liu