English
Related papers

Related papers: Simplifying the minimax disparity model for determ…

200 papers

A weight normalization procedure, commonly called pushing, is introduced for weighted tree automata (wta) over commutative semifields. The normalization preserves the recognized weighted tree language even for nondeterministic wta, but it…

Formal Languages and Automata Theory · Computer Science 2023-06-22 Thomas Hanneforth , Andreas Maletti , Daniel Quernheim

Overparameterized models may have many interpolating solutions; implicit regularization refers to the hidden preference of a particular optimization method towards a certain interpolating solution among the many. A by now established line…

Machine Learning · Computer Science 2024-09-18 Hung-Hsu Chou , Holger Rauhut , Rachel Ward

We introduce a new nonparametric framework for classification problems in the presence of missing data. The key aspect of our framework is that the regression function decomposes into an anova-type sum of orthogonal functions, of which some…

Statistics Theory · Mathematics 2024-05-06 Torben Sell , Thomas B. Berrett , Timothy I. Cannings

We note that decoupled weight decay regularization is a particular case of weight norm control where the target norm of weights is set to 0. Any optimization method (e.g., Adam) which uses decoupled weight decay regularization…

Machine Learning · Computer Science 2023-11-22 Ilya Loshchilov

Finding high-quality parameters is a central obstacle to using the quantum approximate optimization algorithm (QAOA). Previous work partially addresses this issue for QAOA on unweighted MaxCut problems by leveraging similarities in the…

We present weight normalization: a reparameterization of the weight vectors in a neural network that decouples the length of those weight vectors from their direction. By reparameterizing the weights in this way we improve the conditioning…

Machine Learning · Computer Science 2016-06-07 Tim Salimans , Diederik P. Kingma

Mixed-integer convex quadratic programs with indicator variables (MIQP) encompass a wide range of applications, from statistical learning to energy, finance, and logistics. The outer approximation (OA) algorithm has been proven efficient in…

Optimization and Control · Mathematics 2023-12-11 Linchuan Wei , Simge Küçükyavuz

The Best-Worst Method (BWM) is a well-known distance based multi-criteria decision-making method used for computing the weights of decision criteria. This article examines a taxicab distance based model of the BWM, with the objective of…

Optimization and Control · Mathematics 2025-04-07 Harshit Ratandhara , Mohit Kumar

Let $G$ be an undirected bipartite graph with positive integer weights on the edges. We refine the existing decomposition theorem originally proposed by Kao et al., for computing maximum weight bipartite matching. We apply it to design an…

Discrete Mathematics · Computer Science 2019-12-11 Shibsankar Das

We consider the optimization problem of constructing a binary orthogonal array (OA) starting from a bigger one, by removing a specified amount of lines. In particular, we develop a genetic algorithm (GA) where the underlying chromosomes are…

Neural and Evolutionary Computing · Computer Science 2021-11-29 Luca Mariot

We propose an algorithm for the Wireless Sensor Network localization problem, which is based on the well-known algorithmic framework of Alternating Minimization. We start with a non-smooth and non-convex minimization, and transform it into…

Networking and Internet Architecture · Computer Science 2020-12-30 Eyal Gur , Shoham Sabach , Shimrit Shtern

Decomposing a total causal effect into natural direct and indirect effects is central to revealing causal mechanisms. Conventional methods achieve the decomposition by specifying an outcome model as a linear function of the treatment, the…

Methodology · Statistics 2025-06-05 Guanglei Hong

Biased stochastic estimators, such as finite-differences for noisy gradient estimation, often contain parameters that need to be properly chosen to balance impacts from the bias and the variance. While the optimal order of these parameters…

Methodology · Statistics 2019-02-14 Henry Lam , Xinyu Zhang , Xuhui Zhang

We provide new gradient-based methods for efficiently solving a broad class of ill-conditioned optimization problems. We consider the problem of minimizing a function $f : \mathbb{R}^d \rightarrow \mathbb{R}$ which is implicitly…

Optimization and Control · Mathematics 2021-11-08 Jonathan Kelner , Annie Marsden , Vatsal Sharan , Aaron Sidford , Gregory Valiant , Honglin Yuan

Herein, an atomic norm based method for accurately estimating the location and orientation of a target from millimeter-wave multi-input-multi-output (MIMO) orthogonal frequency-division multiplexing (OFDM) signals is presented. A novel…

Signal Processing · Electrical Eng. & Systems 2021-10-12 Jianxiu Li , Maxime Ferreira Da Costa , Urbashi Mitra

Imbalance in covariate distributions leads to biased estimates of causal effects. Weighting methods attempt to correct this imbalance but rely on specifying models for the treatment assignment mechanism, which is unknown in observational…

Methodology · Statistics 2022-05-13 Eric Dunipace

The Best-Worst Method (BWM) has emerged as a prominent multi-criteria decision-making method for determining the weights of the decision criteria. Among various BWM models, this research focuses on the linear model of the BWM. This model…

Optimization and Control · Mathematics 2025-06-24 Harshit M. Ratandhara , Mohit Kumar

In this work, we first consider distributed convex constrained optimization problems where the objective function is encoded by multiple local and possibly nonsmooth objectives privately held by a group of agents, and propose a distributed…

Optimization and Control · Mathematics 2020-02-20 Changxin Liu , Huiping Li , Yang Shi

While the inverse probability of treatment weighting (IPTW) is a commonly used approach for treatment comparisons in observational data, the resulting estimates may be subject to bias and excessively large variance when there is lack of…

Methodology · Statistics 2024-02-13 Zhiqiang Cao , Lama Ghazi , Claudia Mastrogiacomo , Laura Forastiere , F. Perry Wilson , Fan Li

During the past two decades, multi-agent optimization problems have drawn increased attention from the research community. When multiple objective functions are present among agents, many works optimize the sum of these objective functions.…

Multiagent Systems · Computer Science 2020-10-13 M. J. Blondin , M. T. Hale