English
Related papers

Related papers: A Dual Approach for Hierarchical Information-Theor…

200 papers

In this paper, we study a remote source coding scenario in which binary phase shift keying (BPSK) modulation sources are corrupted by additive white Gaussian noise (AWGN). An intermediate node, such as a relay, receives these observations…

Information Theory · Computer Science 2024-05-14 Yi Song , Kai Wan , Zhenyu Liao , Giuseppe Caire

The framework of Integral Quadratic Constraints (IQC) reduces the computation of upper bounds on the convergence rate of several optimization algorithms to a semi-definite program (SDP). In the case of over-relaxed Alternating Direction…

Machine Learning · Statistics 2018-03-06 Guilherme França , José Bento

We propose a new bundle-based augmented Lagrangian framework for solving constrained convex problems. Unlike the classical (inexact) augmented Lagrangian method (ALM) that has a nested double-loop structure, our framework features a…

Optimization and Control · Mathematics 2025-02-14 Feng-Yi Liao , Yang Zheng

This paper presents an algorithmic study of a class of covering mixed-integer linear programming problems which encompasses classic cover problems, including multidimensional knapsack, facility location and supplier selection problems. We…

Data Structures and Algorithms · Computer Science 2026-02-12 Kobe Grobben , Phablo F. S. Moura , Hande Yaman

Sentence compression is an important problem in natural language processing with wide applications in text summarization, search engine and human-AI interaction system etc. In this paper, we design a hybrid extractive sentence compression…

Artificial Intelligence · Computer Science 2021-02-16 Yi-Shuai Niu , Yu You , Wenxu Xu , Wentao Ding , Junpeng Hu , Songquan Yao

We present a learning-based approach to computing solutions for certain NP-hard problems. Our approach combines deep learning techniques with useful algorithmic elements from classic heuristics. The central component is a graph…

Machine Learning · Computer Science 2018-10-26 Zhuwen Li , Qifeng Chen , Vladlen Koltun

We propose an algorithm for solving bound-constrained mathematical programs with complementarity constraints on the variables. Each iteration of the algorithm involves solving a linear program with complementarity constraints in order to…

Optimization and Control · Mathematics 2022-01-14 Christian Kirches , Jeffrey Larson , Sven Leyffer , Paul Manns

In this paper, we propose an inexact perturbed path-following algorithm in the framework of Lagrangian dual decomposition for solving large-scale structured convex optimization problems. Unlike the exact versions considered in literature,…

Optimization and Control · Mathematics 2011-09-16 Quoc Tran Dinh , Ion Necoara , Carlo Savorgnan , Moritz Diehl

This paper introduces a series of methods for traversing binary decision trees using arithmetic operations. We present a suite of binary tree traversal algorithms that leverage novel representation matrices to flatten the full binary tree…

Machine Learning · Computer Science 2024-11-18 Jinxiong Zhang

In recent several years, the information bottleneck (IB) principle provides an information-theoretic framework for deep multi-view clustering (MVC) by compressing multi-view observations while preserving the relevant information of multiple…

Information Theory · Computer Science 2024-03-26 Xiaoqiang Yan , Zhixiang Jin , Fengshou Han , Yangdong Ye

Efficient communication requires balancing informativity and simplicity when encoding meanings. The Information Bottleneck (IB) framework captures this trade-off formally, predicting that natural language systems cluster near an optimal…

Computation and Language · Computer Science 2026-04-07 Antoine Taroni , Ludovic Moncla , Frederique Laforest

Numerous machine learning algorithms contain pairwise statistical problems at their core---that is, tasks that require computations over all pairs of input points if implemented naively. Often, tree structures are used to solve these…

Data Structures and Algorithms · Computer Science 2015-01-22 Ryan R. Curtin , Dongryeol Lee , William B. March , Parikshit Ram

We consider convex optimization problems formulated using dynamic programming equations. Such problems can be solved using the Dual Dynamic Programming algorithm combined with the Level 1 cut selection strategy or the Territory algorithm to…

Optimization and Control · Mathematics 2017-05-26 Vincent Guigues

In this thesis, we present two approaches to a rigorous mathematical and algorithmic foundation of quantitative and statistical inference in constraint-based natural language processing. The first approach, called quantitative constraint…

Computation and Language · Computer Science 2007-05-23 Stefan Riezler

Quantified Integer Programming (QIP) bridges multiple domains by extending Quantified Boolean Formulas (QBF) to incorporate general integer variables and linear constraints while also generalizing Integer Programming through variable…

Discrete Mathematics · Computer Science 2025-06-06 Michael Hartisch , Leroy Chew

We consider the neighborhood tree induced by alternating the use of different neighborhood structures within a local search descent. We investigate the issue of designing a search strategy operating at the neighborhood tree level by…

Other Computer Science · Computer Science 2013-01-01 Houda Derbel , Bilel Derbel

Recent advancements in quantum computing and quantum-inspired algorithms have sparked renewed interest in binary optimization. These hardware and software innovations promise to revolutionize solution times for complex problems. In this…

We present a technique for producing valid dual bounds for nonconvex quadratic optimization problems. The approach leverages an elegant piecewise linear approximation for univariate quadratic functions due to Yarotsky, formulating this…

Optimization and Control · Mathematics 2021-03-30 Ben Beach , Robert Hildebrand , Joey Huchette

We propose a general dual ascent framework for Lagrangean decomposition of combinatorial problems. Although methods of this type have shown their efficiency for a number of problems, so far there was no general algorithm applicable to…

Data Structures and Algorithms · Computer Science 2017-01-13 Paul Swoboda , Jan Kuske , Bogdan Savchynskyy

The goal of this paper is to survey the properties of the eigenvalue relaxation for least squares binary problems. This relaxation is a convex program which is obtained as the Lagrangian dual of the original problem with an implicit compact…

Methodology · Statistics 2009-02-10 Stephane Chretien , Franck Corset