English
Related papers

Related papers: Lagrangian Relaxation Applied to Sparse Global Net…

200 papers

Motivation: High-throughput experimental techniques have been producing more and more protein-protein interaction (PPI) data. PPI network alignment greatly benefits the understanding of evolutionary relationship among species, helps…

Data Structures and Algorithms · Computer Science 2016-04-13 Somaye Hashemifar , Qixing Huang , Jinbo XU

The sparse group Lasso is a widely used statistical model which encourages the sparsity both on a group and within the group level. In this paper, we develop an efficient augmented Lagrangian method for large-scale non-overlapping sparse…

Optimization and Control · Mathematics 2020-10-23 Yangjing Zhang , Ning Zhang , Defeng Sun , Kim-Chuan Toh

Network inference approaches are now widely used in biological applications to probe regulatory relationships between molecular components such as genes or proteins. Many methods have been proposed for this setting, but the connections and…

Applications · Statistics 2014-06-03 Chris. J. Oates , Sach Mukherjee

We develop a general framework for MAP estimation in discrete and Gaussian graphical models using Lagrangian relaxation techniques. The key idea is to reformulate an intractable estimation problem as one defined on a more tractable graph,…

Artificial Intelligence · Computer Science 2007-10-02 Jason K. Johnson , Dmitry M. Malioutov , Alan S. Willsky

Network pruning is a widely used technique to reduce computation cost and model size for deep neural networks. However, the typical three-stage pipeline, i.e., training, pruning and retraining (fine-tuning) significantly increases the…

Machine Learning · Computer Science 2021-03-26 Deniz Gurevin , Shanglin Zhou , Lynn Pepin , Bingbing Li , Mikhail Bragin , Caiwen Ding , Fei Miao

Network alignment is the problem of matching the nodes of two graphs, maximizing the similarity of the matched nodes and the edges between them. This problem is encountered in a wide array of applications-from biological networks to social…

Social and Information Networks · Computer Science 2017-09-07 Eric Malmi , Aristides Gionis , Evimaria Terzi

Biological systems are often modelled at different levels of abstraction depending on the particular aims/resources of a study. Such different models often provide qualitatively concordant predictions over specific parametrisations, but it…

Machine Learning · Statistics 2016-05-10 Giulio Caravagna , Luca Bortolussi , Guido Sanguinetti

Bayesian optimization is an effective methodology for the global optimization of functions with expensive evaluations. It relies on querying a distribution over functions defined by a relatively cheap surrogate model. An accurate model for…

We prove a general result demonstrating the power of Lagrangian relaxation in solving constrained maximization problems with arbitrary objective functions. This yields a unified approach for solving a wide class of {\em subset selection}…

Data Structures and Algorithms · Computer Science 2015-12-22 Ariel Kulik , Hadas Shachnai , Gal Tamir

Despite the recent success of Graph Neural Networks (GNNs), training GNNs on large graphs remains challenging. The limited resource capacities of the existing servers, the dependency between nodes in a graph, and the privacy concern due to…

Machine Learning · Computer Science 2022-03-15 Morteza Ramezani , Weilin Cong , Mehrdad Mahdavi , Mahmut T. Kandemir , Anand Sivasubramaniam

Within the framework of the augmented Lagrangian (AL), we propose a novel distributed optimization method, termed Distributed Augmented Lagrangian Decomposition (DALD), and provide a rigorous convergence proof for its standard version. To…

Optimization and Control · Mathematics 2025-10-07 Wenyou Guo , Ting Qu , Hainan Huang , Yafeng Wei

Social network alignment has been an important research problem for social network analysis in recent years. With the identified shared users across networks, it will provide researchers with the opportunity to achieve a more comprehensive…

Social and Information Networks · Computer Science 2020-07-07 Yuxiang Ren , Lin Meng , Jiawei Zhang

We analyze the convergence behaviour of a recently proposed algorithm for regularized estimation called Dual Augmented Lagrangian (DAL). Our analysis is based on a new interpretation of DAL as a proximal minimization algorithm. We…

Machine Learning · Statistics 2011-06-07 Ryota Tomioka , Taiji Suzuki , Masashi Sugiyama

Molecular profiling data (e.g., gene expression) has been used for clinical risk prediction and biomarker discovery. However, it is necessary to integrate other prior knowledge like biological pathways or gene interaction networks to…

Genomics · Quantitative Biology 2016-09-22 Wenwen Min , Juan Liu , Shihua Zhang

In this paper, we aim at unifying, simplifying and improving the convergence rate analysis of Lagrangian-based methods for convex optimization problems. We first introduce the notion of nice primal algorithmic map, which plays a central…

Optimization and Control · Mathematics 2023-06-07 Shoham Sabach , Marc Teboulle

In many real world applications, data are characterized by a complex structure, that can be naturally encoded as a graph. In the last years, the popularity of deep learning techniques has renewed the interest in neural models able to…

Machine Learning · Computer Science 2020-04-20 Matteo Tiezzi , Giuseppe Marra , Stefano Melacci , Marco Maggini , Marco Gori

The life of the modern world essentially depends on the work of the large artificial homogeneous networks, such as wired and wireless communication systems, networks of roads and pipelines. The support of their effective continuous…

Optimization and Control · Mathematics 2017-01-25 Dmitry Yu. Ignatov , Alexander N. Filippov , Andrey D. Ignatov , Xuecang Zhang

A useful approach to the mathematical analysis of large-scale biological networks is based upon their decompositions into monotone dynamical systems. This paper deals with two computational problems associated to finding decompositions…

Molecular Networks · Quantitative Biology 2007-05-23 Bhaskar DasGupta , German Andres Enciso , Eduardo Sontag , Yi Zhang

Sparsity-based methods are widely used in machine learning, statistics, and signal processing. There is now a rich class of structured sparsity approaches that expand the modeling power of the sparsity paradigm and incorporate constraints…

Data Structures and Algorithms · Computer Science 2017-12-22 Aleksander Mądry , Slobodan Mitrović , Ludwig Schmidt

A Bayesian network is a widely used probabilistic graphical model with applications in knowledge discovery and prediction. Learning a Bayesian network (BN) from data can be cast as an optimization problem using the well-known…

Artificial Intelligence · Computer Science 2018-11-14 Zhenyu A. Liao , Charupriya Sharma , James Cussens , Peter van Beek