English
Related papers

Related papers: A General Regularized Continuous Formulation for t…

200 papers

We study MinMax solution methods for a general class of optimization problems related to (and including) optimal transport. Theoretically, the focus is on fitting a large class of problems into a single MinMax framework and generalizing…

Optimization and Control · Mathematics 2020-10-23 Luca De Gennaro Aquino , Stephan Eckstein

In this paper, we present a local information theoretic approach to explicitly learn probabilistic clustering of a discrete random variable. Our formulation yields a convex maximization problem for which it is NP-hard to find the global…

Machine Learning · Computer Science 2018-10-12 David Qiu , Anuran Makur , Lizhong Zheng

Transformers have achieved state-of-the-art performance in numerous tasks. In this paper, we propose a continuous-time formulation of transformers. Specifically, we consider a dynamical system whose governing equation is parametrized by…

Machine Learning · Computer Science 2025-02-03 Kelvin Kan , Xingjian Li , Stanley Osher

A clique in an undirected graph G= (V, E) is a subset V' V of vertices, each pair of which is connected by an edge in E. The clique problem is an optimization problem of finding a clique of maximum size in graph. The clique problem is…

Discrete Mathematics · Computer Science 2007-10-04 Murali Krishna P , Sabu . M Thampi

The performance of spectral clustering can be considerably improved via regularization, as demonstrated empirically in Amini et. al (2012). Here, we provide an attempt at quantifying this improvement through theoretical analysis. Under the…

Machine Learning · Statistics 2014-07-22 Antony Joseph , Bin Yu

This paper develops a method to obtain the optimal value for the regularization coefficient in a general mixed-integer problem (MIP). This approach eliminates the cross-validation performed in the existing penalty techniques to obtain a…

Optimization and Control · Mathematics 2020-08-05 Behrad Soleimani , Behzad Khamidehi , Maryam Sabbaghian

A general class of singular abstract Cauchy problems is considered which naturally arises in applications to certain Free Boundary Problems. Existence of an associated evolution operator characterizing its solutions is established and is…

Analysis of PDEs · Mathematics 2018-08-14 Patrick Guidotti

In this work we consider the problem of finding optimal regularization parameters for general-form Tikhonov regularization using training data. We formulate the general-form Tikhonov solution as a spectral filtered solution using the…

Numerical Analysis · Mathematics 2014-07-09 Julianne Chung , Malena I. Español , Tuan Nguyen

We extend the convergence analysis of the Scholtes-type regularization method for cardinality-constrained optimization problems. Its behavior is clarified in the vicinity of saddle points, and not just of minimizers as it has been done in…

Optimization and Control · Mathematics 2023-01-02 Sebastian Lammel , Vladimir Shikhman

The maximal clique problem, to find the maximally sized clique in a given graph, is classically an NP-complete computational problem, which has potential applications ranging from electrical engineering, computational chemistry,…

Quantum Physics · Physics 2018-04-18 Weng-Long Chang , Qi Yu , Zhaokai Li , Jiahui Chen , Xinhua Peng , Mang Feng

This note further addresses the global optimization problem for max-plus linear systems considered in [Automatica 119 (2020) 109104]. Firstly, the operations between infinity elemens and real numbers involved in the formulas of solving…

Optimization and Control · Mathematics 2021-03-30 Cailu Wang , Yuegang Tao

We propose and analyze a regularization approach for structured prediction problems. We characterize a large class of loss functions that allows to naturally embed structured outputs in a linear space. We exploit this fact to design…

Machine Learning · Computer Science 2017-07-31 Carlo Ciliberto , Alessandro Rudi , Lorenzo Rosasco

Combinatorial optimization problems arise in a wide range of applications from diverse domains. Many of these problems are NP-hard and designing efficient heuristics for them requires considerable time and experimentation. On the other…

Data Structures and Algorithms · Computer Science 2020-01-07 Juho Lauri , Sourav Dutta , Marco Grassia , Deepak Ajwani

A novel approach to complex problems has been previously applied to graph classification and the graph equivalence problem. Here we apply it to the NP complete problem of finding the largest perfect clique within a graph $G$.

Condensed Matter · Physics 2007-05-23 Vladimir Gudkov , Shmuel Nussinov , Zohar Nussinov

In this work, we consider learning over multitask graphs, where each agent aims to estimate its own parameter vector. Although agents seek distinct objectives, collaboration among them can be beneficial in scenarios where relationships…

Machine Learning · Computer Science 2025-09-23 Yara Zgheib , Luca Calatroni , Marc Antonini , Roula Nassif

The main goal of this paper is to relate the topologically relevant stationary points of a cardinality-constrained optimization problem and its continuous reformulation up to their type. For that, we focus on the nondegenerate M- and…

Optimization and Control · Mathematics 2022-12-29 Sebastian Lämmel , Vladimir Shikhman

We introduce and study a mathematical framework for a broad class of regularization functionals for ill-posed inverse problems: Regularization Graphs. Regularization graphs allow to construct functionals using as building blocks linear…

Optimization and Control · Mathematics 2022-09-28 Kristian Bredies , Marcello Carioni , Martin Holler

Parameter identification problems typically consist of a model equation, e.g. a (system of) ordinary or partial differential equation(s), and the observation equation. In the conventional reduced setting, the model equation is eliminated…

Numerical Analysis · Mathematics 2016-03-18 Barbara Kaltenbacher

This paper formulates a necessary and sufficient condition for a generic graph matching problem to be equivalent to the maximum vertex and edge weight clique problem in a derived association graph. The consequences of this results are…

Artificial Intelligence · Computer Science 2009-12-24 Brijnesh Jain , Klaus Obermayer

The Clique Problem has a reduction to the Maximum Flow Network Interdiction Problem. We review the reduction to evolve a polynomial time algorithm for the Clique Problem. A computer program in C language has been written to validate the…

Data Structures and Algorithms · Computer Science 2020-01-01 Pawan Tamta , B. P. Pande , H. S. Dhami