English
Related papers

Related papers: Parameter-free Online Linear Optimization with Sid…

200 papers

Adversarial training has been shown to be one of the most effective approaches to improve the robustness of deep neural networks. It is formalized as a min-max optimization over model weights and adversarial perturbations, where the weights…

Machine Learning · Computer Science 2022-03-14 Gaojie Jin , Xinping Yi , Wei Huang , Sven Schewe , Xiaowei Huang

Deep learning methods achieve state-of-the-art performance in many application scenarios. Yet, these methods require a significant amount of hyperparameters tuning in order to achieve the best results. In particular, tuning the learning…

Machine Learning · Computer Science 2017-11-07 Francesco Orabona , Tatiana Tommasi

In the online bin packing problem, a sequence of items is revealed one at a time, and each item must be packed into an available bin instantly upon its arrival. In this paper, we revisit the problem under a setting where the total number of…

Data Structures and Algorithms · Computer Science 2021-12-07 Shang Liu , Xiaocheng Li

The paper investigates a version of the resource allocation problem arising in the wireless networking, namely in the OVSF code reallocation process. In this setting a complete binary tree of a given height $n$ is considered, together with…

Recent works have developed new projection-free first-order methods based on utilizing linesearches and normal vector computations to maintain feasibility. These oracles can be cheaper than orthogonal projection or linear optimization…

Optimization and Control · Mathematics 2024-05-01 Thabo Samakhoana , Benjamin Grimmer

This paper introduces the Partition Tree Weighting technique, an efficient meta-algorithm for piecewise stationary sources. The technique works by performing Bayesian model averaging over a large class of possible partitions of the data…

Information Theory · Computer Science 2012-11-22 Joel Veness , Martha White , Michael Bowling , András György

In this paper we propose a model-based approach to the design of online optimization algorithms, with the goal of improving the tracking of the solution trajectory (trajectories) w.r.t. state-of-the-art methods. We focus first on quadratic…

Optimization and Control · Mathematics 2023-07-24 Nicola Bastianello , Ruggero Carli , Sandro Zampieri

We introduce OFTER, a time series forecasting pipeline tailored for mid-sized multivariate time series. OFTER utilizes the non-parametric models of k-nearest neighbors and Generalized Regression Neural Networks, integrated with a…

Machine Learning · Statistics 2023-04-11 Nikolas Michael , Mihai Cucuringu , Sam Howison

Local Optima Networks (LONs) have been recently proposed as an alternative model of combinatorial fitness landscapes. The model compresses the information given by the whole search space into a smaller mathematical object that is the graph…

Artificial Intelligence · Computer Science 2012-10-16 Fabio Daolio , Sébastien Verel , Gabriela Ochoa , Marco Tomassini

Online learning makes sequence of decisions with partial data arrival where next movement of data is unknown. In this paper, we have presented a new technique as multiple times weight updating that update the weight iteratively forsame…

Machine Learning · Computer Science 2019-01-09 Charanjeet , Anuj Sharma

Rebalancing schemes for dynamic binary search trees are numerous in the literature, where the goal is to maintain trees of low height, either in the worst-case or expected sense. In this paper we study randomized rebalancing schemes for…

Data Structures and Algorithms · Computer Science 2024-04-15 Gerth Stølting Brodal

Finding tight bounds on the optimal solution is a critical element of practical solution methods for discrete optimization problems. In the last decade, decision diagrams (DDs) have brought a new perspective on obtaining upper and lower…

Artificial Intelligence · Computer Science 2019-02-28 Quentin Cappart , Emmanuel Goutierre , David Bergman , Louis-Martin Rousseau

The problem of online matching with stochastic rewards is a generalization of the online bipartite matching problem where each edge has a probability of success. When a match is made it succeeds with the probability of the corresponding…

Data Structures and Algorithms · Computer Science 2022-05-12 Vineet Goyal , Rajan Udwani

Many payment platforms hold large-scale marketing campaigns, which allocate incentives to encourage users to pay through their applications. To maximize the return on investment, incentive allocations are commonly solved in a two-stage…

Machine Learning · Computer Science 2022-01-03 Xuanying Chen , Zhining Liu , Li Yu , Sen Li , Lihong Gu , Xiaodong Zeng , Yize Tan , Jinjie Gu

We study a generalized binary search problem on the line and general trees. On the line (e.g., a sorted array), binary search finds a target node in $O(\log n)$ queries in the worst case, where $n$ is the number of nodes. In situations with…

Data Structures and Algorithms · Computer Science 2024-06-19 Agustín Caracci , Christoph Dürr , José Verschae

In this work we are interested in the construction of numerical methods for high dimensional constrained nonlinear optimization problems by particle-based gradient-free techniques. A consensus-based optimization (CBO) approach combined with…

Optimization and Control · Mathematics 2021-11-23 Giacomo Borghi , Michael Herty , Lorenzo Pareschi

We describe an algorithm computing an optimal prefix free code from $N$ unsorted positive integer weights in time linear in the number of machine words holding those weights. This algorithm takes advantage of common non-algebraic…

Data Structures and Algorithms · Computer Science 2017-03-02 Jérémy Barbay

In this paper, we investigate the online allocation problem of maximizing the overall revenue subject to both lower and upper bound constraints. Compared to the extensively studied online problems with only resource upper bounds, the…

Machine Learning · Computer Science 2023-01-31 Qixin Zhang , Wenbing Ye , Zaiyi Chen , Haoyuan Hu , Enhong Chen , Yang Yu

When optimizing a nonlinear objective, one can employ a neural network as a surrogate for the nonlinear function. However, the resulting optimization model can be time-consuming to solve globally with exact methods. As a result, local…

Optimization and Control · Mathematics 2026-03-19 Jiatai Tong , Yilin Zhu , Thiago Serra , Samuel Burer

We propose a general method for converting online algorithms to local computation algorithms by selecting a random permutation of the input, and simulating running the online algorithm. We bound the number of steps of the algorithm using a…

Data Structures and Algorithms · Computer Science 2012-05-08 Yishay Mansour , Aviad Rubinstein , Shai Vardi , Ning Xie