English
Related papers

Related papers: Thimble regularization at work besides toy models:…

200 papers

This paper focuses on regularisation methods using models up to the third order to search for up to second-order critical points of a finite-sum minimisation problem. The variant presented belongs to the framework of [3]: it employs random…

Numerical Analysis · Mathematics 2021-04-05 Stefania Bellavia , Gianmarco Gurioli , Benedetta Morini , Philippe L. Toint

The aim of this paper is twofold. First, we introduce a new class of linearizations, based on the generalization of a construction used in polynomial algebra to find the zeros of a system of (scalar) polynomial equations. We show that one…

Numerical Analysis · Mathematics 2014-08-26 Federico Poloni

The study of lattice gauge theories with Monte Carlo simulations is hindered by the infamous sign problem that appears under certain circumstances, in particular at non-zero chemical potential. So far, there is no universal method to…

High Energy Physics - Lattice · Physics 2017-03-27 Mari Carmen Bañuls , Krzysztof Cichy , J. Ignacio Cirac , Karl Jansen , Stefan Kühn , Hana Saito

Convex relaxations are effective for training and certifying neural networks against norm-bounded adversarial attacks, but they leave a large gap between certifiable and empirical robustness. In principle, convex relaxation can provide…

Machine Learning · Computer Science 2020-02-25 Chen Zhu , Renkun Ni , Ping-yeh Chiang , Hengduo Li , Furong Huang , Tom Goldstein

Several applications of Reinforcement Learning suffer from instability due to high variance. This is especially prevalent in high dimensional domains. Regularization is a commonly used technique in machine learning to reduce variance, at…

Machine Learning · Computer Science 2019-04-12 Pierre Thodoroff , Audrey Durand , Joelle Pineau , Doina Precup

We consider the problem of minimising the number of states in a multiplicity tree automaton over the field of rational numbers. We give a minimisation algorithm that runs in polynomial time assuming unit-cost arithmetic. We also show that a…

Formal Languages and Automata Theory · Computer Science 2019-03-14 Stefan Kiefer , Ines Marusic , James Worrell

We study the problem of learning a tensor from a set of linear measurements. A prominent methodology for this problem is based on a generalization of trace norm regularization, which has been used extensively for learning low rank matrices,…

Machine Learning · Computer Science 2013-07-18 Bernardino Romera-Paredes , Massimiliano Pontil

Data augmentation is one of the most popular techniques for improving the robustness of neural networks. In addition to directly training the model with original samples and augmented samples, a torrent of methods regularizing the distance…

Machine Learning · Computer Science 2020-11-30 Haohan Wang , Zeyi Huang , Xindi Wu , Eric P. Xing

We consider training probabilistic classifiers in the case of a large number of classes. The number of classes is assumed too large to perform exact normalisation over all classes. To account for this we consider a simple approach that…

Machine Learning · Statistics 2016-07-08 David Barber , Aleksandar Botev

In this paper we investigate an adaptive discretization strategy for ill-posed linear prob- lems combined with a regularization from a class of semiiterative methods. We show that such a discretization approach in combination with a…

Numerical Analysis · Mathematics 2014-07-22 Wolfgang Erb , Evgeniya V. Semenova

We introduce an algorithm to solve linear inverse problems regularized with the total (gradient) variation in a gridless manner. Contrary to most existing methods, that produce an approximate solution which is piecewise constant on a fixed…

Signal Processing · Electrical Eng. & Systems 2025-07-08 Yohann de Castro , Vincent Duval , Romain Petit

We show that complex Langevin simulation converges to a wrong result, by relating it to the Lefschetz-thimble path integral, when the path-integral weight has different phases among dominant complex saddle points. Equilibrium solution of…

High Energy Physics - Lattice · Physics 2017-02-07 Tomoya Hayata , Yoshimasa Hidaka , Yuya Tanizaki

Graph matching is one of the most important problems in graph theory and combinatorial optimization, with many applications in various domains. Although meta-heuristic algorithms have had good performance on many NP-Hard and NP-Complete…

Neural and Evolutionary Computing · Computer Science 2019-04-01 Hashem Ezzati , Mahmood Amintoosi , Hashem Tabasi

We develop several efficient algorithms for the classical \emph{Matrix Scaling} problem, which is used in many diverse areas, from preconditioning linear systems to approximation of the permanent. On an input $n\times n$ matrix $A$, this…

Data Structures and Algorithms · Computer Science 2017-04-10 Zeyuan Allen-Zhu , Yuanzhi Li , Rafael Oliveira , Avi Wigderson

We consider the large-scale regularity of solutions to second-order linear elliptic equations with random coefficient fields. In contrast to previous works on regularity theory for random elliptic operators, our interest is in the…

Analysis of PDEs · Mathematics 2016-10-26 Julian Fischer , Claudia Raithel

We present a new method for regularizing chiral theories on the lattice. The arbitrariness in the regularization is used in order to decouple massless replica fermions. A continuum limit with only one fermion is obtained in perturbation…

High Energy Physics - Lattice · Physics 2009-10-22 J. L. Alonso , Ph. Boucaud , J. L. Cortes , F. Lesmes , E. Rivas

As recently pointed out, regularization schemes defined in four-dimensions may also face inconsistencies in the presence of chiral fermions. In this work, we extend this analysis to two-loop order. Adopting the implicit regularization as…

High Energy Physics - Phenomenology · Physics 2023-02-08 Adriano Cherchiglia

Transfer learning - i.e., further fine-tuning a pre-trained model on a downstream task - can confer significant advantages, including improved downstream performance, faster convergence, and better sample efficiency. These advantages have…

Machine Learning · Computer Science 2023-10-30 Prateek Yadav , Derek Tam , Leshem Choshen , Colin Raffel , Mohit Bansal

Mitigating shortcuts, where models exploit spurious correlations in training data, remains a significant challenge for improving generalization. Regularization methods have been proposed to address this issue by enhancing model…

Machine Learning · Computer Science 2025-03-24 Haoyang Hong , Ioanna Papanikolaou , Sonali Parbhoo

An algorithm is proposed for solving stochastic and finite sum minimization problems. Based on a trust region methodology, the algorithm employs normalized steps, at least as long as the norms of the stochastic gradient estimates are within…

Optimization and Control · Mathematics 2018-06-27 Frank E. Curtis , Katya Scheinberg , Rui Shi