English
Related papers

Related papers: Position: Zeroth-Order Optimization in Deep Learni…

200 papers

Bilevel optimization (BLO) is a popular approach with many applications including hyperparameter optimization, neural architecture search, adversarial robustness and model-agnostic meta-learning. However, the approach suffers from time and…

Machine Learning · Computer Science 2021-06-08 Valerii Likhosherstov , Xingyou Song , Krzysztof Choromanski , Jared Davis , Adrian Weller

Forward-mode automatic differentiation (FmAD) and zero-order (ZO) optimization have been proposed as memory-efficient alternatives to backpropagation (BP) for gradient computation, especially in low-resource settings. However, their…

Machine Learning · Computer Science 2025-06-30 Kunjal Panchal , Sunav Choudhary , Yuriy Brun , Hui Guan

As 6G and beyond networks grow increasingly complex and interconnected, federated learning (FL) emerges as an indispensable paradigm for securely and efficiently leveraging decentralized edge data for AI. By virtue of the superposition…

Machine Learning · Computer Science 2024-12-24 Jonggyu Jang , Hyeonsu Lyu , David J. Love , Hyun Jong Yang

Machine learning pipeline potentially consists of several stages of operations like data preprocessing, feature engineering and machine learning model training. Each operation has a set of hyper-parameters, which can become irrelevant for…

Machine Learning · Computer Science 2021-05-04 Xudong Sun , Jiali Lin , Bernd Bischl

Backpropagation provides a generalized configuration for overcoming catastrophic forgetting. Optimizers such as SGD and Adam are commonly used for weight updates in continual learning and continual pre-training. However, access to gradient…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Tao Feng , Wei Li , Didi Zhu , Hangjie Yuan , Wendi Zheng , Dan Zhang , Jie Tang

Bayesian optimization (BO) is a sample-efficient approach to optimizing costly-to-evaluate black-box functions. Most BO methods ignore how evaluation costs may vary over the optimization domain. However, these costs can be highly…

Machine Learning · Computer Science 2021-11-15 Raul Astudillo , Daniel R. Jiang , Maximilian Balandat , Eytan Bakshy , Peter I. Frazier

Machine learning pipelines often rely on optimization procedures to make discrete decisions (e.g., sorting, picking closest neighbors, or shortest paths). Although these discrete decisions are easily computed, they break the…

Machine Learning · Computer Science 2020-06-11 Quentin Berthet , Mathieu Blondel , Olivier Teboul , Marco Cuturi , Jean-Philippe Vert , Francis Bach

Bi-Level Optimization (BLO) is originated from the area of economic game theory and then introduced into the optimization community. BLO is able to handle problems with a hierarchical structure, involving two levels of optimization tasks,…

Machine Learning · Computer Science 2021-09-29 Risheng Liu , Jiaxin Gao , Jin Zhang , Deyu Meng , Zhouchen Lin

Motivated by the problem of tuning hyperparameters in machine learning, we present a new approach for gradually and adaptively optimizing an unknown function using estimated gradients. We validate the empirical performance of the proposed…

Machine Learning · Computer Science 2019-06-05 Weijia Shao , Christian Geißler , Fikret Sivrikaya

There has been an increasing interest in harnessing deep learning to tackle combinatorial optimization (CO) problems in recent years. Typical CO deep learning approaches leverage the problem structure in the model architecture.…

Artificial Intelligence · Computer Science 2021-02-08 Yiwei Bai , Wenting Zhao , Carla P. Gomes

The research area of evolutionary multiobjective optimization (EMO) is reaching better understandings of the properties and capabilities of EMO algorithms, and accumulating much evidence of their worth in practical scenarios. An urgent…

Neural and Evolutionary Computing · Computer Science 2009-08-24 David Corne , Joshua Knowles

We introduce an order-invariant reinforcement learning framework for black-box combinatorial optimization. Classical estimation-of-distribution algorithms (EDAs) often rely on learning explicit variable dependency graphs, which can be…

Machine Learning · Computer Science 2026-01-30 Olivier Goudet , Quentin Suire , Adrien Goëffon , Frédéric Saubion , Sylvain Lamprier

Zero-shot learning, which aims to recognize new categories that are not included in the training set, has gained popularity owing to its potential ability in the real-word applications. Zero-shot learning models rely on learning an…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Xinsheng Wang , Shanmin Pang , Jihua Zhu , Zhongyu Li , Zhiqiang Tian , Yaochen Li

Deep Learning optimization involves minimizing a high-dimensional loss function in the weight space which is often perceived as difficult due to its inherent difficulties such as saddle points, local minima, ill-conditioning of the Hessian…

Machine Learning · Computer Science 2023-09-28 Rohan Kashyap

Using deep learning (DL) to accelerate and/or improve scientific workflows can yield discoveries that are otherwise impossible. Unfortunately, DL models have yielded limited success in complex scientific domains due to large data…

While reinforcement learning (RL) holds great potential for decision making in the real world, it suffers from a number of unique difficulties which often need specific consideration. In particular: it is highly non-stationary; suffers from…

Machine Learning · Computer Science 2025-04-16 Alexander David Goldie , Chris Lu , Matthew Thomas Jackson , Shimon Whiteson , Jakob Nicolaus Foerster

The optimization of high-dimensional black-box functions is a challenging problem. When a low-dimensional linear embedding structure can be assumed, existing Bayesian optimization (BO) methods often transform the original problem into…

Machine Learning · Statistics 2022-11-03 Shuhei A. Horiguchi , Tomoharu Iwata , Taku Tsuzuki , Yosuke Ozawa

Bayesian optimization (BO) developed as an approach for the efficient optimization of expensive black-box functions without gradient information. A typical BO paper introduces a new approach and compares it to some alternatives on simulated…

Computation · Statistics 2023-10-17 Jiajie Kong , Tony Pourmohamad , Herbert K. H. Lee

Federated optimization, an emerging paradigm which finds wide real-world applications such as federated learning, enables multiple clients (e.g., edge devices) to collaboratively optimize a global function. The clients do not share their…

Machine Learning · Computer Science 2023-08-09 Yao Shu , Xiaoqiang Lin , Zhongxiang Dai , Bryan Kian Hsiang Low

Distributed optimization is fundamental to modern machine learning applications like federated learning, but existing methods often struggle with ill-conditioned problems and face stability-versus-speed tradeoffs. We introduce fractional…

Machine Learning · Computer Science 2024-12-04 Andrei Lixandru , Marcel van Gerven , Sergio Pequito