English
Related papers

Related papers: Sparse hierarchical interaction learning with epig…

200 papers

Stochastic optimisation problems minimise expectations of random cost functions. We use 'optimise then discretise' method to solve stochastic optimisation. In our approach, accurate quadrature methods are required to calculate the…

Numerical Analysis · Mathematics 2022-02-22 Yuancheng Zhou

In this paper, we investigate the possibility of improving the performance of multi-objective optimization solution approaches using machine learning techniques. Specifically, we focus on multi-objective binary linear programs and employ…

Machine Learning · Statistics 2019-01-31 Alvaro Sierra-Altamiranda , Hadi Charkhgard , Iman Dayarian , Ali Eshragh , Sorna Javadi

Overparameterization and overfitting are common concerns when designing and training deep neural networks, that are often counteracted by pruning and regularization strategies. However, these strategies remain secondary to most learning…

Machine Learning · Computer Science 2020-09-01 Malena Reiners , Kathrin Klamroth , Michael Stiglmayr

Iterative regularization exploits the implicit bias of an optimization algorithm to regularize ill-posed problems. Constructing algorithms with such built-in regularization mechanisms is a classic challenge in inverse problems but also in…

Optimization and Control · Mathematics 2022-02-02 Cesare Molinari , Mathurin Massias , Lorenzo Rosasco , Silvia Villa

In many practical applications of constrained optimization, scale and solving time limits make traditional optimization solvers prohibitively slow. Thus, the research question of how to design optimization proxies -- machine learning models…

Machine Learning · Computer Science 2025-02-14 Michael Klamkin , Mathieu Tanneau , Pascal Van Hentenryck

We study how to effectively leverage expert feedback to learn sequential decision-making policies. We focus on problems with sparse rewards and long time horizons, which typically pose significant challenges in reinforcement learning. We…

Machine Learning · Computer Science 2018-06-12 Hoang M. Le , Nan Jiang , Alekh Agarwal , Miroslav Dudík , Yisong Yue , Hal Daumé

In this paper, a projected primal-dual gradient flow of augmented Lagrangian is presented to solve convex optimization problems that are not necessarily strictly convex. The optimization variables are restricted by a convex set with…

Optimization and Control · Mathematics 2018-10-31 Han Zhang , Jieqiang Wei , Peng Yi , Xiaoming Hu

We investigate an existing distributed algorithm for learning sparse signals or data over networks. The algorithm is iterative and exchanges intermediate estimates of a sparse signal over a network. This learning strategy using exchange of…

Machine Learning · Statistics 2017-09-25 Ahmed Zaki , Partha P. Mitra , Lars K. Rasmussen , Saikat Chatterjee

In this paper we extend the hierarchical model reduction framework based on reduced basis techniques for the application to nonlinear partial differential equations. The major new ingredient to accomplish this goal is the introduction of…

Numerical Analysis · Mathematics 2017-02-27 Kathrin Smetana , Mario Ohlberger

We consider the problem of estimating the parameters of a Gaussian or binary distribution in such a way that the resulting undirected graphical model is sparse. Our approach is to solve a maximum likelihood problem with an added l_1-norm…

Artificial Intelligence · Computer Science 2007-07-06 Onureena Banerjee , Laurent El Ghaoui , Alexandre d'Aspremont

We present a framework to train a structured prediction model by performing smoothing on the inference algorithm it builds upon. Smoothing overcomes the non-smoothness inherent to the maximum margin structured prediction objective, and…

Machine Learning · Statistics 2019-02-11 Krishna Pillutla , Vincent Roulet , Sham M. Kakade , Zaid Harchaoui

Neural networks have seen limited use in prediction for high-dimensional data with small sample sizes, because they tend to overfit and require tuning many more hyperparameters than existing off-the-shelf machine learning methods. With…

Machine Learning · Statistics 2020-05-12 Jean Feng , Noah Simon

Unveiling meaningful geophysical information from seismic data requires to deal with both random and structured "noises". As their amplitude may be greater than signals of interest (primaries), additional prior information is especially…

Geophysics · Physics 2014-09-25 Mai Quyen Pham , Laurent Duval , Caroline Chaux , Jean-Christophe Pesquet

Based on a preconditioned version of the randomized block-coordinate forward-backward algorithm recently proposed in [Combettes,Pesquet,2014], several variants of block-coordinate primal-dual algorithms are designed in order to solve a wide…

Optimization and Control · Mathematics 2014-10-28 Jean-Christophe Pesquet , Audrey Repetti

This paper is concerned with the design of algorithms based on systems of interacting particles to represent, approximate, and learn the optimal control law for reinforcement learning (RL). The primary contribution is that convergence rates…

Systems and Control · Electrical Eng. & Systems 2025-10-21 Anant A Joshi , Heng-Sheng Chang , Amirhossein Taghvaei , Prashant G Mehta , Sean P. Meyn

In the literature, there are a few researches to design some parameters in the Proximal Point Algorithm (PPA), especially for the multi-objective convex optimizations. Introducing some parameters to PPA can make it more flexible and…

Optimization and Control · Mathematics 2018-12-11 Jianchao Bai , Jicheng Li , Pingfan Dai , Jiaofen Li

Architectures for sparse hierarchical representation learning have recently been proposed for graph-structured data, but so far assume the absence of edge features in the graph. We close this gap and propose a method to pool graphs with…

In this work, we propose an adaptive sparse learning algorithm that can be applied to learn the physical processes and obtain a sparse representation of the solution given a large snapshot space. Assume that there is a rich class of…

Machine Learning · Computer Science 2022-07-26 Yating Wang , Wing Tat Leung , Guang Lin

We study the problem of optimal traffic prediction and monitoring in large-scale networks. Our goal is to determine which subset of K links to monitor in order to "best" predict the traffic on the remaining links in the network. We consider…

Data Structures and Algorithms · Computer Science 2013-12-04 Michael Kallitsis , Stilian Stoev , George Michailidis

Recent advances in deep reinforcement learning (deep RL) enable researchers to solve challenging control problems, from simulated environments to real-world robotic tasks. However, deep RL algorithms are known to be sensitive to the problem…

Robotics · Computer Science 2023-02-01 Joanne Taery Kim , Sehoon Ha