English
Related papers

Related papers: On the Scaling Window of Model RB

200 papers

The distribution of overlaps of solutions of a random CSP is an indicator of the overall geometry of its solution space. For random $k$-SAT, nonrigorous methods from Statistical Physics support the validity of the ``one step replica…

Discrete Mathematics · Computer Science 2007-05-23 Gabriel Istrate

For high dimensional sparse linear regression problems, we propose a sequential convex relaxation algorithm (iSCRA-TL1) by solving inexactly a sequence of truncated $\ell_1$-norm regularized minimization problems, in which the working index…

Statistics Theory · Mathematics 2024-11-05 Shujun Bi , Yonghua Yang , Shaohua Pan

Let $P:\{0,1\}^k \to \{0,1\}$ be a nontrivial $k$-ary predicate. Consider a random instance of the constraint satisfaction problem $\mathrm{CSP}(P)$ on $n$ variables with $\Delta n$ constraints, each being $P$ applied to $k$ randomly chosen…

Computational Complexity · Computer Science 2017-01-18 Pravesh K. Kothari , Ryuhei Mori , Ryan O'Donnell , David Witmer

It can be difficult to interpret a coefficient of an uncertain model. A slope coefficient of a regression model may change as covariates are added or removed from the model. In the context of high-dimensional data, there are too many model…

Methodology · Statistics 2024-08-20 Brian Knaeble , R. Mitchell Hughes , George Rudolph , Mark A. Abramson , Daniel Razo

The Cram\'er-Rao bound (CRB), a well-known lower bound on the performance of any unbiased parameter estimator, has been used to study a wide variety of problems. However, to obtain the CRB, requires an analytical expression for the…

Machine Learning · Computer Science 2022-10-11 Hai Victor Habi , Hagit Messer , Yoram Bresler

For random samples of size n obtained from p-variate normal distributions, we consider the classical likelihood ratio tests (LRT) for their means and covariance matrices in the high-dimensional setting. These test statistics have been…

Statistics Theory · Mathematics 2013-06-04 Tiefeng Jiang , Fan Yang

In an early paper (Horowitz and Albano, Phys. Rev. E.,{\bf 73} 031111 (2006)) we studied growing models, generically called $X/RD$, such that a particle is attached to the aggregate with probability $p$ following the mechanisms of a generic…

Other Condensed Matter · Physics 2009-12-22 Claudio Horowitz , Ezequiel V. Albano

We study the systole of a random surface, where by a random surface we mean a surface constructed by randomly gluing together an even number of triangles. We study two types of metrics on these surfaces, the first one coming from using…

Differential Geometry · Mathematics 2017-05-17 Bram Petri

Distributionally Robust Optimization (DRO) is a worst-case approach to decision making when there is model uncertainty. It is also well known that for certain uncertainty sets, DRO is approximated by a regularized nominal problem. We show…

Optimization and Control · Mathematics 2026-05-08 Jun-ya Gotoh , Michael Jong Kim , Andrew E. B. Lim

Relation between problem hardness and solution space structure is an important research aspect. Model d-k-CSP generates very hard instances when $r=1$ and $r$ is near 1, where $r$ represents normalized constraint density. We find that when…

Disordered Systems and Neural Networks · Physics 2019-04-09 Wei Xu , Fuzhou Gong , Guangyan Zhou

We study the scaling of two-dimensional crack roughness using large scale beam lattice systems. Our results indicate that the crack roughness obtained using beam lattice systems does not exhibit anomalous scaling in sharp contrast to the…

Statistical Mechanics · Physics 2009-11-13 Phani K. V. V. Nukala , Stefano Zapperi , Mikko Alava , Srdjan Simunovic

We consider a class of real numbers, a subset of irrational numbers and certain mathematical constants, for which the elements in the simple continued fraction appears to be random. As an illustrative example, one can consider $\pi = \{x_0,…

Statistical Mechanics · Physics 2020-02-19 Avinash Chand Yadav

Let $X_{1}=(W_{1},Y_{1}),\ldots,X_{n}=(W_{n},Y_{n})$ be $n$ pairs of independent random variables. We assume that, for each $i\in\{1,\ldots,n\}$, the conditional distribution of $Y_{i}$ given $W_{i}$ belongs to a one-parameter exponential…

Statistics Theory · Mathematics 2022-03-15 Juntong Chen

Sample efficiency in Reinforcement Learning (RL) has traditionally been driven by algorithmic enhancements. In this work, we demonstrate that scaling can also lead to substantial improvements. We conduct a thorough investigation into the…

Machine Learning · Computer Science 2024-12-04 Michal Nauman , Mateusz Ostaszewski , Krzysztof Jankowski , Piotr Miłoś , Marek Cygan

Distributional regression aims at estimating the conditional distribution of a targetvariable given explanatory co-variates. It is a crucial tool for forecasting whena precise uncertainty quantification is required. A popular methodology…

Statistics Theory · Mathematics 2024-11-22 Clément Dombry , Ahmed Zaoui

The degree of a CSP instance is the maximum number of times that any variable appears in the scopes of constraints. We consider the approximate counting problem for Boolean CSP with bounded-degree instances, for constraint languages…

Computational Complexity · Computer Science 2011-09-19 Martin Dyer , Leslie Ann Goldberg , Markus Jalsenius , David Richerby

We initiate the study of numerical linear algebra in the sliding window model, where only the most recent $W$ updates in a stream form the underlying data set. We first introduce a unified row-sampling based framework that gives randomized…

Data Structures and Algorithms · Computer Science 2023-04-12 Vladimir Braverman , Petros Drineas , Cameron Musco , Christopher Musco , Jalaj Upadhyay , David P. Woodruff , Samson Zhou

We give a fast algorithm for sampling uniform solutions of general constraint satisfaction problems (CSPs) in a local lemma regime. Suppose that the CSP has $n$ variables with domain size at most q, each constraint contains at most k…

Data Structures and Algorithms · Computer Science 2023-03-10 Kun He , Chunyang Wang , Yitong Yin

This paper proposes a data-driven distributionally robust shortest path (DRSP) model where the distribution of the travel time in the transportation network can only be partially observed through a finite number of samples. Specifically, we…

Optimization and Control · Mathematics 2019-11-19 Zhuolin Wang , Keyou You , Shiji Song , Yuli Zhang

Classical probabilistic rounding error analysis is particularly well suited to stochastic rounding (SR), and it yields strong results when dealing with floating-point algorithms that rely heavily on summation. For many numerical linear…

Numerical Analysis · Mathematics 2025-02-26 El-Mehdi El Arar , Massimiliano Fasi , Silviu-Ioan Filip , Mantas Mikaitis