English
Related papers

Related papers: Phoebe: A Learning-based Checkpoint Optimizer

200 papers

Bayesian optimisation (BO) has been a successful approach to optimise functions which are expensive to evaluate and whose observations are noisy. Classical BO algorithms, however, do not account for errors about the location where…

Machine Learning · Computer Science 2019-02-22 Rafael Oliveira , Lionel Ott , Fabio Ramos

To achieve peak predictive performance, hyperparameter optimization (HPO) is a crucial component of machine learning and its applications. Over the last years, the number of efficient algorithms and tools for HPO grew substantially. At the…

With the rapid evolution of Large Language Models (LLMs) and their large-scale experimentation in cloud-computing spaces, the challenge of guaranteeing their security and efficiency in a failure scenario has become a main issue. To ensure…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-18 Yihong Jin , Ze Yang , Xinhe Xu , Yihan Zhang , Shuyang Ji

Mixture-of-Experts (MoE) models facilitate edge deployment by decoupling model capacity from active computation, yet their large memory footprint drives the need for GPU systems with near-data processing (NDP) capabilities that offload…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-08 Qi Wu , Chao Fang , Jiayuan Chen , Ye Lin , Yueqi Zhang , Yichuan Bai , Yuan Du , Li Du

Progressive Hedging is a popular decomposition algorithm for solving multi-stage stochastic optimization problems. A computational bottleneck of this algorithm is that all scenario subproblems have to be solved at each iteration. In this…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-09-28 Gilles Bareilles , Yassine Laguel , Dmitry Grishchenko , Franck Iutzeler , Jérôme Malick

Deep learning is slowly, but steadily, hitting a memory bottleneck. While the tensor computation in top-of-the-line GPUs increased by 32x over the last five years, the total available memory only grew by 2.5x. This prevents researchers from…

Machine Learning · Computer Science 2021-04-06 Aashaka Shah , Chao-Yuan Wu , Jayashree Mohan , Vijay Chidambaram , Philipp Krähenbühl

In this paper, we propose a learning algorithm that speeds up the search in task and motion planning problems. Our algorithm proposes solutions to three different challenges that arise in learning to improve planning efficiency: what to…

Robotics · Computer Science 2018-07-27 Beomjoon Kim , Zi Wang , Leslie Pack Kaelbling , Tomas Lozano-Perez

The performance of constraint programming solvers is highly sensitive to the choice of their hyperparameters. Manually finding the best solver configuration is a difficult, time-consuming task that typically requires expert knowledge. In…

Artificial Intelligence · Computer Science 2026-01-19 Hedieh Haddad , Thibault Falque , Pierre Talbot , Pascal Bouvry

Training machine learning models requires feeding input data for models to ingest. Input pipelines for machine learning jobs are often challenging to implement efficiently as they require reading large volumes of data, applying complex…

Machine Learning · Computer Science 2021-02-25 Derek G. Murray , Jiri Simsa , Ana Klimovic , Ihor Indyk

In the field of evolutionary multi-objective optimization, the approximation of the Pareto front (PF) is achieved by utilizing a collection of representative candidate solutions that exhibit desirable convergence and diversity. Although…

Neural and Evolutionary Computing · Computer Science 2024-07-10 Peng Chen , Jing Liang , Kangjia Qiao , Ponnuthurai Nagaratnam Suganthan , Xuanxuan Ban

Speed-robust scheduling is the following two-stage problem of scheduling $n$ jobs on $m$ uniformly related machines. In the first stage, the algorithm receives the value of $m$ and the processing times of $n$ jobs; it has to partition the…

Data Structures and Algorithms · Computer Science 2024-07-17 Josef Minařík , Jiří Sgall

Predicting structured outputs can be computationally onerous due to the combinatorially large output spaces. In this paper, we focus on reducing the prediction time of a trained black-box structured classifier without losing accuracy. To do…

Machine Learning · Computer Science 2018-06-13 Xingyuan Pan , Vivek Srikumar

Short- and long-term outcomes of an algorithm often differ, with damaging downstream effects. A known example is a click-bait algorithm, which may increase short-term clicks but damage long-term user engagement. A possible solution to…

Machine Learning · Computer Science 2024-04-25 Yuta Saito , Himan Abdollahpouri , Jesse Anderton , Ben Carterette , Mounia Lalmas

Multi-stage decision-making under uncertainty, where decisions are taken under sequentially revealing uncertain problem parameters, is often essential to faithfully model managerial problems. Given the significant computational challenges…

Optimization and Control · Mathematics 2026-04-30 Simon Thomä , Maximilian Schiffer , Wolfram Wiesemann

This work introduces a novel blackbox optimization algorithm for computationally expensive constrained multi-fidelity problems. When applying a direct search method to such problems, the scarcity of feasible points may lead to numerous…

Optimization and Control · Mathematics 2025-04-09 Stéphane Alarie , Charles Audet , Miguel Diago , Sébastien Le Digabel , Xavier Lebeuf

Federated learning (FL) has emerged as a solution to deal with the risk of privacy leaks in machine learning training. This approach allows a variety of mobile devices to collaboratively train a machine learning model without sharing the…

Machine Learning · Computer Science 2022-12-01 Young Geun Kim , Carole-Jean Wu

The accuracy-speed-memory trade-off is always the priority to consider for several computer vision perception tasks. Previous methods mainly focus on a single or small couple of these tasks, such as creating effective data augmentation,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Xinhao Xiang , Simon Dräger , Jiawei Zhang

The knob tuning aims to optimize database performance by searching for the most effective knob configuration under a certain workload. Existing works suffer two significant problems. On the one hand, there exist multiple similar even…

Databases · Computer Science 2024-07-04 Yu Yan , Junfang Huang , Hongzhi Wang , Jian Geng , Kaixin Zhang , Tao Yu

Automatic Machine Learning (Auto-ML) systems tackle the problem of automating the design of prediction models or pipelines for data science. In this paper, we present Lifelong Bayesian Optimization (LBO), an online, multitask Bayesian…

Machine Learning · Statistics 2019-06-24 Yao Zhang , James Jordon , Ahmed M. Alaa , Mihaela van der Schaar

Numerical software depends on fast, accurate implementations of mathematical primitives like sin, exp, and log. Modern superoptimizers can optimize floating-point kernels against a given set of such primitives, but a more fundamental…

Programming Languages · Computer Science 2026-03-27 Jonas Regehr , Mitch Briles , Zachary Tatlock , Pavel Panchekha