English
Related papers

Related papers: From Majorization to Scaling: Advancing Convex Rel…

200 papers

In this work we present a new method of black-box optimization and constraint satisfaction. Existing algorithms that have attempted to solve this problem are unable to consider multiple modes, and are not able to adapt to changes in…

Machine Learning · Computer Science 2020-02-19 Kourosh Hakhamaneshi , Keertana Settaluri , Pieter Abbeel , Vladimir Stojanovic

To quantify the complexity of a system, entropy-based methods have received considerable critical attentions in real-world data analysis. Among numerous entropy algorithms, amplitude-based formulas, represented by Sample Entropy, suffer…

Signal Processing · Electrical Eng. & Systems 2022-01-12 Hongjian Xiao , Danilo P. Mandic

This paper considers a quadratically-constrained cardinality minimization problem with applications to digital filter design, subset selection for linear regression, and portfolio selection. Two relaxations are investigated: the continuous…

Optimization and Control · Mathematics 2012-10-19 Dennis Wei

We generalize the reduction mechanism for linear programming problems and semidefinite programming problems from [arXiv:1410.8816] in two ways 1) relaxing the requirement of affineness and 2) extending to fractional optimization problems.…

Computational Complexity · Computer Science 2018-10-23 Gábor Braun , Sebastian Pokutta , Aurko Roy

The most important ingredient for solving mixed-integer nonlinear programs (MINLPs) to global epsilon-optimality with spatial branch and bound is a tight, computationally tractable relaxation. Due to both theoretical and practical…

Optimization and Control · Mathematics 2019-12-03 Benjamin Müller , Gonzalo Muñoz , Maxime Gasse , Ambros Gleixner , Andrea Lodi , Felipe Serrano

The method of maximum entropy (ME) is extended to address the following problem: Once one accepts that the ME distribution is to be preferred over all others, the question is to what extent are distributions with lower entropy supposed to…

Mathematical Physics · Physics 2009-10-31 Ariel Caticha

We introduce a multi-species generalization of the symmetric simple exclusion process with open boundaries. This model possesses the property of being integrable and appears as physically relevant because the boundary conditions can be…

Statistical Mechanics · Physics 2017-02-01 Matthieu Vanicat

We consider a two-stage stochastic decision problem where the decision-maker has the opportunity to obtain information about the distribution of the random variables $\xi$ that appear in the problem through a set of discrete actions that we…

Optimization and Control · Mathematics 2024-07-16 Zhichao Ma , Youngdae Kim , Jeff Linderoth , James R. Luedtke , Logan R. Matthews

Spreading the information over all coefficients of a representation is a desirable property in many applications such as digital communication or machine learning. This so-called antisparse representation can be obtained by solving a convex…

Machine Learning · Computer Science 2020-07-15 Clément Elvira , Cédric Herzet

We introduce a learning-based algorithm to obtain a measurement matrix for compressive sensing related recovery problems. The focus lies on matrices with a constant modulus constraint which typically represent a network of analog phase…

Signal Processing · Electrical Eng. & Systems 2021-10-15 Michael Koller , Wolfgang Utschick

We investigate the lifted TASEP and its generalization, the GL-TASEP. We analyze the spectral properties of the transition matrix of the lifted TASEP using its Bethe ansatz solution, and use them to determine the scaling of the relaxation…

Statistical Mechanics · Physics 2025-10-08 Fabian H. L. Essler , Jeanne Gipouloux , Werner Krauth

This paper studies two fundamental problems in power systems: the economic dispatch problem (EDP) and load shedding. For the EDP, an extension of the problem considering the transmission losses is presented. Because the optimization problem…

Systems and Control · Electrical Eng. & Systems 2021-08-31 Ismi Rosyiana Fitri , Jung-Su Kim

We introduce the ``soft Deep MaxPain'' (softDMP) algorithm, which integrates the optimization of long-term policy entropy into reward-punishment reinforcement learning objectives. Our motivation is to facilitate a smoother variation of…

Machine Learning · Computer Science 2024-09-16 Jiexin Wang , Eiji Uchibe

In this work, the development and implementation of the effective stochastic potential (ESP) method is presented to perform efficient conformational sampling of molecules. The overarching goal of this work is to alleviate the computational…

Chemical Physics · Physics 2018-08-01 Jeremy A. Scher , Michael G. Bayne , Amogh Srihari , Shikha Nangia , Arindam Chakraborty

Mixup is a well-established data augmentation technique, which can extend the training distribution and regularize the neural networks by creating ''mixed'' samples based on the label-equivariance assumption, i.e., a proportional mixup of…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Zongbo Han , Tianchi Xie , Bingzhe Wu , Qinghua Hu , Changqing Zhang

Prior work has explored directly regularizing the output distributions of probabilistic models to alleviate peaky (i.e. over-confident) predictions, a common sign of overfitting. This class of techniques, of which label smoothing is one,…

Computation and Language · Computer Science 2020-05-13 Clara Meister , Elizabeth Salesky , Ryan Cotterell

This work concerns the minimization of the pseudospectral abscissa of a matrix-valued function dependent on parameters analytically. The problem is motivated by robust stability and transient behavior considerations for a linear control…

Numerical Analysis · Mathematics 2024-06-21 Nicat Aliyev , Emre Mengi

We perform a finite sample analysis of the detection levels for sparse principal components of a high-dimensional covariance matrix. Our minimax optimal test is based on a sparse eigenvalue statistic. Alas, computing this test is known to…

Statistics Theory · Mathematics 2014-01-30 Quentin Berthet , Philippe Rigollet

Model usage is the central challenge of model-based reinforcement learning. Although dynamics model based on deep neural networks provide good generalization for single step prediction, such ability is over exploited when it is used to…

Machine Learning · Computer Science 2020-06-30 Chi Zhang , Sanmukh Rao Kuppannagari , Viktor K Prasanna

We describe a generalization of the Sums-of-AM/GM Exponential (SAGE) relaxation methodology for obtaining bounds on constrained signomial and polynomial optimization problems. Our approach leverages the fact that relative entropy based SAGE…

Optimization and Control · Mathematics 2021-07-06 Riley Murray , Venkat Chandrasekaran , Adam Wierman