Related papers: Finite size scaling approach to dynamic storage al…
Rare trajectories of stochastic systems are important to understand -- because of their potential impact. However, their properties are by definition difficult to sample directly. Population dynamics provides a numerical tool allowing their…
{}From a finite-size scaling (FSS) theory of cumulants of the order parameter at phase coexistence points, we reconstruct the scaling of the moments. Assuming that the cumulants allow a reconstruction of the free energy density no better…
We study optimization algorithms for the finite sum problems frequently arising in machine learning applications. First, we propose novel variants of stochastic gradient descent with a variance reduction property that enables linear…
We investigate distributed memory parallel sorting algorithms that scale to the largest available machines and are robust with respect to input size and distribution of the input elements. The main outcome is that four sorting algorithms…
Single-time and two-time correlators are computed exactly in the $1D$ Glauber-Ising model after a quench to zero temperature and on a periodic chain of finite length $N$, using a simple analytical continuation technique. Besides the general…
Finite-size scaling (FSS) is a standard technique for measuring scaling exponents in spin glasses. Here we present a critique of this approach, emphasizing the need for all length scales to be large compared to microscopic scales. In…
The mathematical problem concerning intrinsic storage optimisation is formulated and solved by means of variational analysis. The solution, though obtained in implicit form, still sheds light on many important features of the optimal…
Using Finite-Size Scaling techniques we obtain accurate results for critical quantities of the Ising model and the site percolation, in three dimensions. We pay special attention in parameterizing the corrections-to-scaling, what is…
Large-scale unconstrained optimization is a fundamental and important class of, yet not well-solved problems in numerical optimization. The main challenge in designing an algorithm is to require a few storage locations or very inexpensive…
Finite size scaling is shown to work very well for the block variables used in intermittency studies on a 2-d Ising lattice. The intermittency exponents so derived exhibit the expected relations to the magnetic critical exponent of the…
We study the scaling properties of Higgs-Yukawa models. Using the technique of Finite-Size Scaling, we are able to derive scaling functions that describe the observables of the model in the vicinity of a Gaussian fixed point. A feasibility…
The mathematical problem of the static storage optimisation is formulated and solved by means of a variational analysis. The solution obtained in implicit form is shedding light on the most important features of the optimal exercise…
Data-driven algorithm selection is a powerful approach for choosing effective heuristics for computational problems. It operates by evaluating a set of candidate algorithms on a collection of representative training instances and selecting…
This paper considers the problem of designing a dynamical system to solve constrained optimization problems in a distributed way and in an anytime fashion (i.e., such that the feasible set is forward invariant). For problems with separable…
Fine-tuning pretrained models has become a standard approach to adapting pretrained knowledge to improve the accuracy on new sparse, imbalance datasets. However, issues arise when optimization falls into a collapsed state, where the model…
As the size of modern data sets exceeds the disk and memory capacities of a single computer, machine learning practitioners have resorted to parallel and distributed computing. Given that optimization is one of the pillars of machine…
In this paper we accomplish the development of the fast rank-adaptive solver for tensor-structured symmetric positive definite linear systems in higher dimensions. In [arXiv:1301.6068] this problem is approached by alternating minimization…
This note describes the full approximation storage (FAS) multigrid scheme for an easy one-dimensional nonlinear boundary value problem. The problem is discretized by a simple finite element (FE) scheme. We apply both FAS V-cycles and…
New algorithms are devised for finding the maxima of multidimensional point samples, one of the very first problems studied in computational geometry. The algorithms are very simple and easily coded and modified for practical needs. The…
For systems with infinite-order phase transitions, in which an order parameter smoothly becomes nonzero, a new observable for finite-size scaling analysis is suggested. By construction this new observable has the favourable property of…