English
Related papers

Related papers: Hierarchical Zero-Order Optimization for Deep Neur…

200 papers

To solve unmodeled optimization problems with hard constraints, this paper proposes a novel zeroth-order approach called Safe Zeroth-order Optimization using Linear Programs (SZO-LP). The SZO-LP method solves a linear program in each…

Optimization and Control · Mathematics 2023-04-05 Baiwei Guo , Yang Wang , Yuning Jiang , Maryam Kamgarpour , Giancarlo Ferrari-Trecate

Cross-device federated learning (FL) is a growing machine learning setting whereby multiple edge devices collaborate to train a model without disclosing their raw data. With the great number of mobile devices participating in more FL…

Machine Learning · Computer Science 2025-02-14 Elissa Mhanna , Mohamad Assaad

On-device fine-tuning is a critical capability for edge AI systems, which must support adaptation to different agentic tasks under stringent memory constraints. Conventional backpropagation (BP)-based training requires storing layer…

Machine Learning · Computer Science 2026-05-06 Prabodh Katti , Houssem Sifaou , Sangwoo Park , Bipin Rajendran , Osvaldo Simeone

In this paper, we propose a high-order extension of the multiscale method introduced by the authors in [SIAM J. Numer. Anal., 63(4) (2025), pp. 1617--1641] for heterogeneous Stokes problems, while also providing several other improvements,…

Numerical Analysis · Mathematics 2025-12-01 Moritz Hauck , Alexei Lozinski

Federated optimization, an emerging paradigm which finds wide real-world applications such as federated learning, enables multiple clients (e.g., edge devices) to collaboratively optimize a global function. The clients do not share their…

Machine Learning · Computer Science 2023-08-09 Yao Shu , Xiaoqiang Lin , Zhongxiang Dai , Bryan Kian Hsiang Low

Robust and stochastic optimal control problem (OCP) formulations allow a systematic treatment of uncertainty, but are typically associated with a high computational cost. The recently proposed zero-order robust optimization (zoRO) algorithm…

Optimization and Control · Mathematics 2023-11-09 Jonathan Frey , Yunfan Gao , Florian Messerer , Amon Lahr , Melanie Zeilinger , Moritz Diehl

Fine-tuning vision language models (VLMs) has achieved remarkable performance across various downstream tasks; yet, it requires access to model gradients through backpropagation (BP), making them unsuitable for memory-constrained,…

Machine Learning · Computer Science 2025-10-27 Yifan Yang , Zhen Zhang , Rupak Vignesh Swaminathan , Jing Liu , Nathan Susanj , Zheng Zhang

Fine-tuning large language models (LLMs) with zeroth-order (ZO) optimization reduces memory by approximating gradients through function evaluations. However, existing methods essentially perform updates in a one-dimensional space, and…

Machine Learning · Computer Science 2026-01-19 Jian Feng , Zhihong Huang

Large language models (LLMs) have brought about significant transformations in human society. Among the crucial computations in LLMs, the softmax unit holds great importance. Its helps the model generating a probability distribution on…

Machine Learning · Computer Science 2023-07-18 Yichuan Deng , Zhihang Li , Sridhar Mahadevan , Zhao Song

Fine-tuning large language models (LLMs) using zeroth-order (ZO) optimization has emerged as a promising alternative to traditional gradient-based methods due to its reduced memory footprint requirement. However, existing ZO methods suffer…

Machine Learning · Computer Science 2025-10-22 Zhendong Mi , Qitao Tan , Grace Li Zhang , Zhaozhuo Xu , Geng Yuan , Shaoyi Huang

Hierarchical Reinforcement Learning (HRL) agents often struggle with long-horizon visual planning due to their reliance on error-prone distance metrics. We propose Discrete Hierarchical Planning (DHP), a method that replaces continuous…

Robotics · Computer Science 2025-12-22 Shashank Sharma , Janina Hoffmann , Vinay Namboodiri

The minimization of convex functions which are only available through partial and noisy information is a key methodological problem in many disciplines. In this paper we consider convex optimization with noisy zero-th order information,…

Machine Learning · Computer Science 2016-05-27 Francis Bach , Vianney Perchet

This chapter provides an introduction to Hybrid High-Order (HHO) methods. These are new generation numerical methods for PDEs with several advantageous features: the support of arbitrary approximation orders on general polyhedral meshes,…

Numerical Analysis · Mathematics 2017-04-21 Daniele A. Di Pietro , Roberta Tittarelli

Decycling and dismantling of complex networks are underlying many important applications in network science. Recently these two closely related problems were tackled by several heuristic algorithms, simple and considerably sub-optimal, on…

Physics and Society · Physics 2019-02-18 Lenka Zdeborová , Pan Zhang , Hai-Jun Zhou

Differentiable architecture search (DARTS) has been a popular one-shot paradigm for NAS due to its high efficiency. It introduces trainable architecture parameters to represent the importance of candidate operations and proposes…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Xiaoxing Wang , Wenxuan Guo , Junchi Yan , Jianlin Su , Xiaokang Yang

We propose a new framework for analyzing zeroth-order optimization (ZOO) from the perspective of \emph{oblivious randomized sketching}.In this framework, commonly used gradient estimators in ZOO-such as finite difference (FD) and random…

Optimization and Control · Mathematics 2025-10-14 Haishan Ye , Xiangyu Chang , Xi Chen

The hybrid-high order (HHO) scheme has many successful applications including linear elasticity as the first step towards computational solid mechanics. The striking advantage is the simplicity among other higher-order nonconforming schemes…

Numerical Analysis · Mathematics 2026-04-10 Carsten Carstensen , Ngoc Tien Tran

This paper studies the stochastic distributed nonconvex optimization problem over a network of agents, where agents only access stochastic zeroth-order information about their local cost functions and collaboratively optimize the global…

Optimization and Control · Mathematics 2025-09-01 Haonan Wang , Xinlei Yi , Yiguang Hong

Artificial neural networks have gone through a recent rise in popularity, achieving state-of-the-art results in various fields, including image classification, speech recognition, and automated control. Both the performance and…

Neural and Evolutionary Computing · Computer Science 2016-11-08 Sean C. Smithson , Guang Yang , Warren J. Gross , Brett H. Meyer

Distributed network optimization has been studied for well over a decade. However, we still do not have a good idea of how to design schemes that can simultaneously provide good performance across the dimensions of utility optimality,…

Networking and Internet Architecture · Computer Science 2017-07-19 Sinong Wang , Ness Shroff