English
Related papers

Related papers: TSSOS: a Julia library to exploit sparsity for lar…

200 papers

Spike sorting is a class of algorithms used in neuroscience to attribute the time occurences of particular electric signals, called action potential or spike, to neurons. We rephrase this problem as a particular optimization problem : Lasso…

Statistics Theory · Mathematics 2022-04-12 Laurent Dragoni , Rémi Flamary , Karim Lounici , Patricia Reynaud-Bouret

We consider a class of learning problems that involve a structured sparsity-inducing norm defined as the sum of $\ell_\infty$-norms over groups of variables. Whereas a lot of effort has been put in developing fast optimization methods when…

Machine Learning · Computer Science 2010-09-02 Julien Mairal , Rodolphe Jenatton , Guillaume Obozinski , Francis Bach

High-dimensional data has become ubiquitous across the sciences but presents computational and statistical challenges. A common approach to addressing these challenges is through sparsity. In this paper, we introduce a new concept of…

Statistics Theory · Mathematics 2025-09-03 Ali Mohades , Johannes Lederer

Multitask learning can be effective when features useful in one task are also useful for other tasks, and the group lasso is a standard method for selecting a common subset of features. In this paper, we are interested in a less restrictive…

Machine Learning · Computer Science 2013-11-25 Nikhil Rao , Christopher Cox , Robert Nowak , Timothy Rogers

Sum of squares (SOS) optimization is a powerful technique for solving problems where the positivity of a polynomials must be enforced. The common approach to solve an SOS problem is by relaxation to a Semidefinite Program (SDP). The main…

Optimization and Control · Mathematics 2024-10-29 Daniel Keren , Margarita Osadchy , Roi Poranne

We present MultiObjectiveAlgorithms.jl, an open-source Julia library for solving multi-objective optimization problems written in JuMP. MultiObjectiveAlgorithms.jl implements a number of different solution algorithms, which all rely on an…

Optimization and Control · Mathematics 2026-05-26 Oscar Dowson , Xavier Gandibleux , Gökhan Kof

Machine learning and artificial intelligence algorithms typically require large amount of data for training. This means that for nonlinear aeroelastic applications, where small training budgets are driven by the high computational burden…

We introduce DiffOpt.jl, a Julia library to differentiate through the solution of optimization problems with respect to arbitrary parameters present in the objective and/or constraints. The library builds upon MathOptInterface, thus…

Machine Learning · Computer Science 2023-08-01 Mathieu Besançon , Joaquim Dias Garcia , Benoît Legat , Akshay Sharma

A widely used method for solving SOS (Sum Of Squares) decomposition problem is to reduce it to the problem of semi-definite programs (SDPs) which can be efficiently solved in theory. In practice, although many SDP solvers can work out some…

Symbolic Computation · Computer Science 2018-01-31 Haokun Li , Bican Xia

Motivation: Estimating model parameters from experimental observations is one of the key challenges in systems biology and can be computationally very expensive. While the Julia programming language was recently developed as a high-level…

Quantitative Methods · Quantitative Biology 2020-11-06 Paul F. Lang , Sungho Shin , Victor M. Zavala

Task arithmetic has emerged as a promising approach for editing models by representing task-specific knowledge as composable task vectors. However, existing methods rely on network linearization to derive task vectors, leading to…

Machine Learning · Computer Science 2025-04-04 Leonardo Iurada , Marco Ciccone , Tatiana Tommasi

This paper studies the hierarchy of sparse matrix Moment-SOS relaxations for solving sparse polynomial optimization problems with matrix constraints. First, we prove a sufficient and necessary condition for the sparse hierarchy to be tight.…

Optimization and Control · Mathematics 2025-10-06 Jiawang Nie , Zheng Qu , Xindong Tang , Linghao Zhang

Stochastic computer simulations enable users to gain new insights into complex physical systems. Optimization is a common problem in this context: users seek to find model inputs that maximize the expected value of an objective function.…

Optimization and Control · Mathematics 2018-09-13 Atiye Alaeddini , Daniel J. Klein

While current time series research focuses on developing new models, crucial questions of selecting an optimal approach for training such models are underexplored. Tsururu, a Python library introduced in this paper, bridges SoTA research…

Machine Learning · Computer Science 2025-09-22 Alina Kostromina , Kseniia Kuvshinova , Aleksandr Yugay , Andrey Savchenko , Dmitry Simakov

A class of splitting alternating algorithms is proposed for finding the sparse solution of linear systems with concatenated orthogonal matrices. Depending on the number of matrices concatenated, the proposed algorithms are classified into…

Information Theory · Computer Science 2025-09-30 Yun-Bin Zhao , Zhong-Feng Sun

Simulation optimization (SO) is frequently challenged by noisy evaluations, high computational costs, and complex, multimodal search landscapes. This paper introduces Tabu-Enhanced Simulation Optimization (TESO), a novel metaheuristic…

Neural and Evolutionary Computing · Computer Science 2026-01-01 Bulent Soykan , Sean Mondesire , Ghaith Rabadi

Scorio.jl is a Julia package for evaluating and ranking systems from repeated responses to shared tasks. It provides a common tensor-based interface for direct score-based, pairwise, psychometric, voting, graph, and listwise methods, so the…

Mathematical Software · Computer Science 2026-03-17 Mohsen Hariri , Michael Hinczewski , Vipin Chaudhary

Global optimization has gained attraction over the past decades, thanks to the development of both theoretical foundations and efficient numerical routines. Among recent advances, Kernel Sum of Squares (KernelSOS) provides a powerful…

We present StochasticPrograms.jl, a user-friendly and powerful open-source framework for stochastic programming written in the Julia language. The framework includes both modeling tools and structure-exploiting optimization algorithms.…

Optimization and Control · Mathematics 2022-09-07 Martin Biel , Mikael Johansson

We study the problem of minimizing a multivariate polynomial function over the unit hypercube. By representing the polynomial through a hypergraph and exploiting its sparsity structure, we establish a new sufficient condition under which…

Optimization and Control · Mathematics 2026-04-29 Aida Khajavirad