English
Related papers

Related papers: Differentiable Knapsack and Top-k Operators via Dy…

200 papers

Feature selection identifies subsets of informative features and reduces dimensions in the original feature space, helping provide insights into data generation or a variety of domain problems. Existing methods mainly depend on feature…

Machine Learning · Computer Science 2021-06-07 Xinxing Wu , Qiang Cheng

Incorporating stochasticity into the training process of deep convolutional networks is a widely used technique to reduce overfitting and improve regularization. Existing techniques often require modifying the architecture of the network by…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Evgeny Hershkovitch Neiterman , Gil Ben-Artzi

We study a robust extensible bin packing problem with budgeted uncertainty, under a budgeted uncertainty model where item sizes are defined to lie in the intersection of a box with a one-norm ball. We propose a scenario generation algorithm…

Discrete Mathematics · Computer Science 2025-10-29 Noam Goldberg , Michael Poss , Yariv Marmor

Variance reduction methods such as SVRG and SpiderBoost use a mixture of large and small batch gradients to reduce the variance of stochastic gradients. Compared to SGD, these methods require at least double the number of operations per…

Machine Learning · Computer Science 2020-01-28 Melih Elibol , Lihua Lei , Michael I. Jordan

We consider the 0-1 Penalized Knapsack Problem (PKP). Each item has a profit, a weight and a penalty and the goal is to maximize the sum of the profits minus the greatest penalty value of the items included in a solution. We propose an…

Data Structures and Algorithms · Computer Science 2017-02-15 Federico Della Croce , Ulrich Pferschy , Rosario Scatamacchia

This work presents an empirical analysis of exact algorithms for the unbounded knapsack problem, which includes seven algorithms from the literature, two commercial solvers, and more than ten thousand instances. The terminating step-off, a…

Data Structures and Algorithms · Computer Science 2019-03-22 Henrique Becker , Luciana S. Buriol

The automaton constrained tree knapsack problem is a variant of the knapsack problem in which the items are associated with the vertices of the tree, and we can select a subset of items that is accepted by a top-down tree automaton. If the…

Data Structures and Algorithms · Computer Science 2018-09-18 Soh Kumabe , Takanori Maehara , Ryoma Sin'ya

The chance-constrained knapsack problem is a variant of the classical knapsack problem where each item has a weight distribution instead of a deterministic weight. The objective is to maximize the total profit of the selected items under…

Neural and Evolutionary Computing · Computer Science 2020-04-09 Yue Xie , Aneta Neumann , Frank Neumann

In this paper, we consider a multi-stage dynamic assortment optimization problem with multi-nomial choice modeling (MNL) under resource knapsack constraints. Given the current resource inventory levels, the retailer makes an assortment…

Optimization and Control · Mathematics 2025-11-05 Xi Chen , Mo Liu , Yining Wang , Yuan Zhou

Probabilistic language generators are theoretically modeled as discrete stochastic processes, yet standard decoding strategies (Top-k, Top-p) impose static truncation rules that fail to accommodate the dynamic information density of natural…

Computation and Language · Computer Science 2026-03-17 Deepon Halder , Raj Dabre

Dynamic sampling mechanisms in deep learning architectures have demonstrated utility across many computer vision models, though the theoretical analysis of these structures has not yet been unified. In this paper we connect the various…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Dario Morle , Reid Zaffino

Determinantal point processes (DPPs) are well known models for diverse subset selection problems, including recommendation tasks, document summarization and image search. In this paper, we discuss a greedy deterministic adaptation of k-DPP.…

Machine Learning · Computer Science 2021-05-31 Joachim Schreurs , Michaël Fanuel , Johan A. K. Suykens

We study the problem of maximizing a non-monotone submodular function under multiple knapsack constraints. We propose a simple discrete greedy algorithm to approach this problem, and prove that it yields strong approximation guarantees for…

Machine Learning · Computer Science 2020-02-19 Vanja Doskoč , Tobias Friedrich , Andreas Göbel , Frank Neumann , Aneta Neumann , Francesco Quinzan

The development of a satisfying and rigorous mathematical understanding of the performance of neural networks is a major challenge in artificial intelligence. Against this background, we study the expressive power of neural networks through…

Machine Learning · Computer Science 2024-07-12 Christoph Hertrich , Martin Skutella

This paper presents a new method for solving an orienteering problem (OP) by breaking it down into two parts: a knapsack problem (KP) and a traveling salesman problem (TSP). A KP solver is responsible for picking nodes, while a TSP solver…

Neural and Evolutionary Computing · Computer Science 2023-02-23 Wei Liu , Tao Zhang , Rui Wang , Kaiwen Li , Wenhua Li , Kang Yang

This work proposes an efficient parallel algorithm for non-monotone submodular maximization under a knapsack constraint problem over the ground set of size $n$. Our algorithm improves the best approximation factor of the existing parallel…

Artificial Intelligence · Computer Science 2024-09-09 Tan D. Tran , Canh V. Pham , Dung T. K. Ha , Phuong N. H. Pham

Neural algorithmic reasoning (NAR) is a growing field that aims to embed algorithmic logic into neural networks by imitating classical algorithms. In this extended abstract, we detail our attempt to build a neural algorithmic reasoner that…

Artificial Intelligence · Computer Science 2025-12-08 Stjepan Požgaj , Dobrik Georgiev , Marin Šilić , Petar Veličković

Sparse tensors are prevalent in many data-intensive applications, yet existing differentiable programming frameworks are tailored towards dense tensors. This presents a significant challenge for efficiently computing gradients through…

Programming Languages · Computer Science 2023-03-14 Amir Shaikhha , Mathieu Huot , Shideh Hashemian

Operator learning enables fast surrogate modeling of high-dimensional dynamical systems, but existing approaches face two fundamental limitations: quadratic inference complexity and unreliable uncertainty quantification in safety-critical…

Machine Learning · Computer Science 2026-05-04 Purav Matlia , Christian Moya , Guang Lin

Submodular maximization generalizes many fundamental problems in discrete optimization, including Max-Cut in directed/undirected graphs, maximum coverage, maximum facility location and marketing over social networks. In this paper we…

Data Structures and Algorithms · Computer Science 2011-01-18 Ariel Kulik , Hadas Shachnai , Tami Tamir