English
Related papers

Related papers: On a phase transition in general order spline regr…

200 papers

We establish phase transitions for continuum Delaunay multi-type particle systems (continuum Potts or Widom-Rowlinson models) with a repulsive interaction between particles of different types. Our interaction potential depends solely on the…

Probability · Mathematics 2018-05-23 Stefan Adams , Michael Eyers

Network analysis is becoming one of the most active research areas in statistics. Significant advances have been made recently on developing theories, methodologies and algorithms for analyzing networks. However, there has been little…

Statistics Theory · Mathematics 2015-11-18 Chao Gao , Yu Lu , Harrison H. Zhou

This is a continuation of the previous work (Takata & Noguchi, J. Stat. Phys., 2018) that introduces the presumably simplest model of kinetic theory for phase transition. Here, main concern is to clarify the stability of uniform equilibrium…

Statistical Mechanics · Physics 2018-11-28 Shigeru Takata , Takuya Matsumoto , Anna Hirahara , Masanari Hattori

We study the problem of $(\epsilon,\delta)$-differentially private learning of linear predictors with convex losses. We provide results for two subclasses of loss functions. The first case is when the loss is smooth and non-negative but not…

Machine Learning · Computer Science 2024-03-07 Raman Arora , Raef Bassily , Cristóbal Guzmán , Michael Menart , Enayat Ullah

The 3d SU(2)-Higgs model is used to find the critical Higgs mass above which the first order phase transition ends. One method is focused on the disappearance of the two-state signal of the scalar condensate (vanishing of the latent heat).…

High Energy Physics - Lattice · Physics 2009-10-30 M. Gürtler , E. -M. Ilgenfritz , A. Schiller

We study dimerization transitions in a frustrated spin-3 chain with next-nearest neighbor and three-site interactions. We show that two independent coupling constants of the model are sufficient to fine-tune the system to the critical point…

Strongly Correlated Electrons · Physics 2024-06-04 Natalia Chepiga

We introduce a very general model of an inhomogenous random graph with independence between the edges, which scales so that the number of edges is linear in the number of vertices. This scaling corresponds to the p=c/n scaling for G(n,p)…

Probability · Mathematics 2011-11-10 Bela Bollobas , Svante Janson , Oliver Riordan

The typical training of neural networks using large stepsize gradient descent (GD) under the logistic loss often involves two distinct phases, where the empirical risk oscillates in the first phase but decreases monotonically in the second…

Machine Learning · Statistics 2024-06-28 Yuhang Cai , Jingfeng Wu , Song Mei , Michael Lindsey , Peter L. Bartlett

Given a large number of covariates $Z$, we consider the estimation of a high-dimensional parameter $\theta$ in an individualized linear threshold $\theta^T Z$ for a continuous variable $X$, which minimizes the disagreement between…

Statistics Theory · Mathematics 2019-05-28 Huijie Feng , Yang Ning , Jiwei Zhao

In high-dimensional learning, models remain stable until they collapse abruptly once the sample size falls below a critical level. This instability is not algorithm-specific but a geometric mechanism: when the weakest Fisher eigendirection…

Machine Learning · Statistics 2025-11-26 William Hao-Cheng Huang

In this paper we complete the analysis of a statistical mechanics model on Cayley trees of any degree, started in [EsHaRo12,EsRo10,BoEsRo13,JaKuBo14,Bo17]. The potential is of nearest-neighbor type and the local state space is compact but…

Probability · Mathematics 2018-03-09 Golibjon Botirov , Benedikt Jahnel

We study a random graph model which combines properties of the edge percolation model on Z^d and a classical random graph G(n,c/n). We show that this model, being a homogeneous random graph, has a natural relation to the so-called "rank 1…

Probability · Mathematics 2007-05-23 Tatyana S. Turova , Thomas Vallier

We demonstrate that, in the classical non-stochastic regret minimization problem with $d$ decisions, gains and losses to be respectively maximized or minimized are fundamentally different. Indeed, by considering the additional sparsity…

Machine Learning · Computer Science 2015-11-30 Joon Kwon , Vianney Perchet

We study the tradeoff between the statistical error and communication cost of distributed statistical estimation problems in high dimensions. In the distributed sparse Gaussian mean estimation problem, each of the $m$ machines receives $n$…

Machine Learning · Computer Science 2016-05-11 Mark Braverman , Ankit Garg , Tengyu Ma , Huy L. Nguyen , David P. Woodruff

The ability to understand and solve high-dimensional inference problems is essential for modern data science. This article examines high-dimensional inference problems through the lens of information theory and focuses on the standard…

Information Theory · Computer Science 2019-07-05 Galen Reeves , Henry Pfister

We study the out-of-sample performance of multi-pass stochastic gradient descent (SGD) in the fundamental stochastic convex optimization (SCO) model. While one-pass SGD is known to achieve an optimal $\Theta(1/\sqrt{n})$ excess population…

Machine Learning · Computer Science 2025-05-16 Shira Vansover-Hager , Tomer Koren , Roi Livni

We consider rank-one symmetric tensor estimation when the tensor is corrupted by Gaussian noise and the spike forming the tensor is a structured signal coming from a generalized linear model. The latter is a mathematically tractable model…

Information Theory · Computer Science 2020-06-29 Clément Luneau , Nicolas Macris

We study the random field Ising model in a two-dimensional box with side length $N$ where the external field is given by independent normal variables with mean $0$ and variance $\epsilon^2$. Our primary result is the following phase…

Probability · Mathematics 2024-03-05 Jian Ding , Fenglin Huang , Aoteng Xia

We continue numerical studies of the spectrum of the pure U(1) lattice gauge theory in the confinement phase, initiated in our previous work. Using the extended Wilson action $ S = -\sum_P [\beta \cos(\Theta_P) + \gamma \cos(2\Theta_P)] $…

High Energy Physics - Lattice · Physics 2009-10-31 J. Cox , J. Jersak , H. Pfeiffer , T. Neuhaus , P. W. Stephenson , A. Seyfried

We introduce a novel characterization of phase transitions based on hypothesis testing. In our formulation, a phase transition is defined as the breakdown of statistical indistinguishability under vanishing parameter perturbations in the…

Statistical Mechanics · Physics 2026-04-20 Taiyo Narita , Hideyuki Miyahara