English
Related papers

Related papers: Analyzing and provably improving fixed budget rank…

200 papers

The existing randomized algorithms need an initial estimation of the tubal rank to compute a tensor singular value decomposition. This paper proposes a new randomized fixedprecision algorithm which for a given third-order tensor and a…

Numerical Analysis · Mathematics 2024-04-09 Salman Ahmadi-Asl

Post-training of Large Language Models often involves a pipeline of Supervised Finetuning (SFT) followed by Preference Finetuning (PFT) using methods like Direct Preference Optimization. Both stages require annotated data that are very…

Machine Learning · Computer Science 2025-02-18 Mohit Raghavendra , Junmo Kang , Alan Ritter

Feature selection and regularization are becoming increasingly prominent tools in the efforts of the reinforcement learning (RL) community to expand the reach and applicability of RL. One approach to the problem of feature selection is to…

Machine Learning · Computer Science 2012-07-03 Christopher Painter-Wakefield , Ronald Parr

Algorithms with predictions is a recent framework that has been used to overcome pessimistic worst-case bounds in incomplete information settings. In the context of scheduling, very recent work has leveraged machine-learned predictions to…

Data Structures and Algorithms · Computer Science 2022-12-08 Eric Balkanski , Tingting Ou , Clifford Stein , Hao-Ting Wei

In machine learning, Feature Selection (FS) is a major part of efficient algorithm. It fuels the algorithm and is the starting block for our prediction. In this paper, we present a new method, called Optimal Coordinate Ascent (OCA) that…

Machine Learning · Statistics 2018-12-04 David Saltiel , Eric Benhamou

(Partial) ranking loss is a commonly used evaluation measure for multi-label classification, which is usually optimized with convex surrogates for computational efficiency. Prior theoretical work on multi-label ranking mainly focuses on…

Machine Learning · Computer Science 2021-05-12 Guoqiang Wu , Chongxuan Li , Kun Xu , Jun Zhu

Current AI/ML methods for data-driven engineering use models that are mostly trained offline. Such models can be expensive to build in terms of communication and computing cost, and they rely on data that is collected over extended periods…

Machine Learning · Computer Science 2021-12-16 Xiaoxuan Wang , Rolf Stadler

The linearly constrained matrix rank minimization problem is widely applicable in many fields such as control, signal processing and system identification. The tightest convex relaxation of this problem is the linearly constrained nuclear…

Optimization and Control · Mathematics 2009-05-12 Shiqian Ma , Donald Goldfarb , Lifeng Chen

We study randomized algorithms for constrained optimization, in abstract frameworks that include, in strictly increasing generality: convex programming; LP-type problems; violator spaces; and a setting we introduce, consistent spaces. Such…

Computational Geometry · Computer Science 2019-06-04 Kenneth L. Clarkson , Bernd Gärtner , Johannes Lengler , May Szedlak

The ranking problem is to order a collection of units by some unobserved parameter, based on observations from the associated distribution. This problem arises naturally in a number of contexts, such as business, where we may want to rank…

Statistics Theory · Mathematics 2019-09-04 Toby Kenney

When randomized ensembles such as bagging or random forests are used for binary classification, the prediction error of the ensemble tends to decrease and stabilize as the number of classifiers increases. However, the precise relationship…

Probability · Mathematics 2019-05-01 Miles E. Lopes

We extend Robust Optimization to fractional programming, where both the objective and the constraints contain uncertain parameters. Earlier work did not consider uncertainty in both the objective and the constraints, or did not use Robust…

Optimization and Control · Mathematics 2015-08-21 Bram L. Gorissen

In classification problems when multiples algorithms are applied to different benchmarks a difficult issue arises, i.e., how can we rank the algorithms? In machine learning it is common run the algorithms several times and then a statistic…

Machine Learning · Computer Science 2016-10-25 Andre G. C. Pacheco , Renato A. Krohling

We study the arbitrary cost case of the unweighted Stochastic Score Classification (SSClass) problem. We show two constant approximation algorithms and both algorithms are 6-approximation non-adaptive algorithms with respect to the optimal…

Data Structures and Algorithms · Computer Science 2022-12-06 Naifeng Liu

We study optimal policy learning under combined budget and minimum coverage constraints. We show that the problem admits a knapsack-type structure and that the optimal policy can be characterized by an affine threshold rule involving both…

Machine Learning · Statistics 2026-05-13 Giovanni Cerulli

In natural perception, different items (objects) in a scene are rarely equally relevant to the observer. The brain improves performance by directing attention to the most relevant items, for example the ones most likely to be probed. For a…

Neurons and Cognition · Quantitative Biology 2018-02-20 Nuwan de Silva , Wei Ji Ma

In contrast to the fixed parameter analysis (FPA), in the variable parameter analysis (VPA) the value of the target problem parameter is not fixed, it rather depends on the structure of a given problem instance and tends to have a favorable…

Data Structures and Algorithms · Computer Science 2022-11-07 Nodari Vakhania

We study single-stage decision problems in which a subset of items with minimum total cost has to be selected at once from a given set of items, subject to two costs of each item -fixed and uncertain -and cardinality constraints for each…

Optimization and Control · Mathematics 2025-11-04 Antoine Lhomme , Nadia Brauner , Evgeny Gurevsky , Mikhail Kovalyov , Erwin Pesch

In this paper, we study the performance of affine policies for two-stage adjustable robust optimization problem with fixed recourse and uncertain right hand side belonging to a budgeted uncertainty set. This is an important class of…

Optimization and Control · Mathematics 2019-06-04 Omar El Housni , Vineet Goyal

Auto-bidding systems are widely used in advertising to automatically determine bid values under constraints such as total budget and Return-on-Spend (RoS) targets. Existing works often assume that the value of an ad impression, such as the…

Machine Learning · Computer Science 2026-02-03 Jiale Han , Chun Gan , Chengcheng Zhang , Jie He , Zhangang Lin , Ching Law , Xiaowu Dai