English
Related papers

Related papers: Evolution is Still Good: Theoretical Analysis of E…

200 papers

Submodular function maximization has been studied extensively in recent years under various constraints and models. The problem plays a major role in various disciplines. We study a natural online variant of this problem in which elements…

Data Structures and Algorithms · Computer Science 2015-01-26 Niv Buchbinder , Moran Feldman , Roy Schwartz

Expectation-Maximization (EM) algorithm is a widely used iterative algorithm for computing maximum likelihood estimate when dealing with Gaussian Mixture Model (GMM). When the sample size is smaller than the data dimension, this could lead…

Machine Learning · Statistics 2023-07-06 Pierre Houdouin , Matthieu Jonkcheere , Frederic Pascal

We consider the problem of sparse atomic optimization, where the notion of "sparsity" is generalized to meaning some linear combination of few atoms. The definition of atomic set is very broad; popular examples include the standard basis,…

Optimization and Control · Mathematics 2019-12-30 Thomas Zhang

In the absence of prior knowledge, ordinal embedding methods obtain new representation for items in a low-dimensional Euclidean space via a set of quadruple-wise comparisons. These ordinal comparisons often come from human annotators, and…

Machine Learning · Computer Science 2018-12-06 Ke Ma , Qianqian Xu , Zhiyong Yang , Xiaochun Cao

Recently, there has been increasing interest and progress in improvising the approximation algorithm for well-known NP-Complete problems, particularly the approximation algorithm for the Vertex-Cover problem. Here we have proposed a…

Data Structures and Algorithms · Computer Science 2013-09-20 Deepak Puthal

Submodular functions are an important class of functions in combinatorial optimization which satisfy the natural properties of decreasing marginal costs. The study of these functions has led to strong structural properties with applications…

Multiagent Systems · Computer Science 2009-11-13 Gagan Goel , Pushkar Tripathi , Lei Wang

Evolutionary algorithms excel in solving complex optimization problems, especially those with multiple objectives. However, their stochastic nature can sometimes hinder rapid convergence to the global optima, particularly in scenarios…

Neural and Evolutionary Computing · Computer Science 2024-05-10 Zeyi Wang , Songbai Liu , Jianyong Chen , Kay Chen Tan

We investigate three related and important problems connected to machine learning: approximating a submodular function everywhere, learning a submodular function (in a PAC-like setting [53]), and constrained minimization of submodular…

Data Structures and Algorithms · Computer Science 2013-11-12 Rishabh Iyer , Stefanie Jegelka , Jeff Bilmes

Feature selection for predictive analytics is the problem of identifying a minimal-size subset of features that is maximally predictive of an outcome of interest. To apply to molecular data, feature selection algorithms need to be scalable…

Machine Learning · Statistics 2020-04-02 Michail Tsagris , Zacharias Papadovasilakis , Kleanthi Lakiotaki , Ioannis Tsamardinos

Diversity optimization is the class of optimization problems in which we aim to find a diverse set of good solutions. One of the frequently-used approaches to solve such problems is to use evolutionary algorithms that evolve a desired…

Neural and Evolutionary Computing · Computer Science 2025-12-17 Denis Antipov , Aneta Neumann , Frank Neumann , Andrew M. Sutton

In the submodular cover problem, we are given a non-negative monotone submodular function $f$ over a ground set $E$ of items, and the goal is to choose a smallest subset $S \subseteq E$ such that $f(S) = Q$ where $Q = f(E)$. In the…

Data Structures and Algorithms · Computer Science 2018-11-01 Arpit Agarwal , Sepehr Assadi , Sanjeev Khanna

The paper presents complexity results and performance guaranties for a family of approximation algorithms for an optimisation problem arising in software testing and manufacturing. The problem is formulated as a partitioning of a set where…

Data Structures and Algorithms · Computer Science 2022-12-13 Yakov Zinder , Bertrand M. T. Lin , Joanna Berlińska

Evolutionary algorithms offer great promise for the automatic design of robot bodies, tailoring them to specific environments or tasks. Most research is done on simplified models or virtual robots in physics simulators, which do not capture…

Robotics · Computer Science 2020-05-20 Tonnes F. Nygaard , David Howard , Kyrre Glette

Evolutionary Computation is a group of biologically inspired algorithms used to solve complex optimisation problems. It can be split into Evolutionary Algorithms, which take inspiration from genetic inheritance, and Swarm Intelligence…

Neural and Evolutionary Computing · Computer Science 2021-08-11 Sizhe Yuen , Thomas H. G. Ezard , Adam J. Sobey

Motivation: Gene selection has become a common task in most gene expression studies. The objective of such research is often to identify the smallest possible set of genes that can still achieve good predictive performance. The problem of…

We consider the problem of covering multiple submodular constraints. Given a finite ground set $N$, a cost function $c: N \rightarrow \mathbb{R}_+$, $r$ monotone submodular functions $f_1,f_2,\ldots,f_r$ over $N$ and requirements…

Data Structures and Algorithms · Computer Science 2025-09-04 Tanvi Bajpai , Chandra Chekuri , Pooja Kulkarni

The celebrated sparse representation model has led to remarkable results in various signal processing tasks in the last decade. However, despite its initial purpose of serving as a global prior for entire signals, it has been commonly used…

Information Theory · Computer Science 2017-10-11 Vardan Papyan , Jeremias Sulam , Michael Elad

Evolutionary computation methods have been successfully applied to neural networks since two decades ago, while those methods cannot scale well to the modern deep neural networks due to the complicated architectures and large quantities of…

Neural and Evolutionary Computing · Computer Science 2019-03-12 Yanan Sun , Bing Xue , Mengjie Zhang , Gary G. Yen

Submodular maximization subject to matroid constraints is a central problem with many applications in machine learning. As algorithms are increasingly used in decision-making over datapoints with sensitive attributes such as gender or race,…

Data Structures and Algorithms · Computer Science 2026-01-16 Sepideh Mahabadi , Sherry Sarkar , Jakub Tarnawski

The optimization of dynamic problems is both widespread and difficult. When conducting dynamic optimization, a balance between reinitialization and computational expense has to be found. There are multiple approaches to this. In parallel…

Neural and Evolutionary Computing · Computer Science 2014-01-21 Ronald Hochreiter , Christoph Waldhauser