English
Related papers

Related papers: Towards Constituting Mathematical Structures for L…

200 papers

Learning to optimize (L2O) is an emerging approach that leverages machine learning to develop optimization methods, aiming at reducing the laborious iterations of hand engineering. It automates the design of an optimization method based on…

Optimization and Control · Mathematics 2021-07-05 Tianlong Chen , Xiaohan Chen , Wuyang Chen , Howard Heaton , Jialin Liu , Zhangyang Wang , Wotao Yin

Learning to Optimize (L2O) stands at the intersection of traditional optimization and machine learning, utilizing the capabilities of machine learning to enhance conventional optimization techniques. As real-world optimization problems…

Optimization and Control · Mathematics 2024-05-27 Xiaohan Chen , Jialin Liu , Wotao Yin

Learning to Optimize (L2O) enhances optimization efficiency with integrated neural networks. L2O paradigms achieve great outcomes, e.g., refitting optimizer, generating unseen solutions iteratively or directly. However, conventional L2O…

Machine Learning · Computer Science 2025-03-17 Mingjia Shi , Ruihan Lin , Xuxi Chen , Yuhao Zhou , Zezhen Ding , Pingzhi Li , Tong Wang , Kai Wang , Zhangyang Wang , Jiheng Zhang , Tianlong Chen

Learning to optimize (L2O) is an emerging technique to solve mathematical optimization problems with learning-based methods. Although with great success in many real-world scenarios such as wireless communications, computer networks, and…

Machine Learning · Computer Science 2025-06-18 Qingyu Song , Wei Lin , Juncheng Wang , Hong Xu

Learning to Optimize (L2O) has drawn increasing attention as it often remarkably accelerates the optimization procedure of complex tasks by ``overfitting" specific task type, leading to enhanced performance compared to analytical…

Machine Learning · Computer Science 2023-03-02 Junjie Yang , Xuxi Chen , Tianlong Chen , Zhangyang Wang , Yingbin Liang

Recent studies on Learning to Optimize (L2O) suggest a promising path to automating and accelerating the optimization procedure for complicated tasks. Existing L2O models parameterize optimization rules by neural networks, and learn those…

Machine Learning · Computer Science 2022-05-10 Wenqing Zheng , Tianlong Chen , Ting-Kuei Hu , Zhangyang Wang

Learning to optimize (L2O) has gained increasing attention since classical optimizers require laborious problem-specific design and hyperparameter tuning. However, there is a gap between the practical demand and the achievable performance…

Machine Learning · Computer Science 2020-10-20 Tianlong Chen , Weiyi Zhang , Jingyang Zhou , Shiyu Chang , Sijia Liu , Lisa Amini , Zhangyang Wang

The increasing reliance on numerical methods for controlling dynamical systems and training machine learning models underscores the need to devise algorithms that dependably and efficiently navigate complex optimization landscapes.…

Systems and Control · Electrical Eng. & Systems 2024-06-04 Andrea Martin , Luca Furieri

Learning to optimize (L2O) has gained increasing popularity, which automates the design of optimizers by data-driven approaches. However, current L2O methods often suffer from poor generalization performance in at least two folds: (i)…

Machine Learning · Computer Science 2023-03-29 Junjie Yang , Tianlong Chen , Mingkang Zhu , Fengxiang He , Dacheng Tao , Yingbin Liang , Zhangyang Wang

Learning to Optimize (L2O) is a subfield of machine learning (ML) in which ML models are trained to solve parametric optimization problems. The general goal is to learn a fast approximator of solutions to constrained optimization problems,…

Optimization and Control · Mathematics 2025-12-04 James Kotary , Himanshu Sharma , Ethan King , Draguna Vrabie , Ferdinando Fioretto , Jan Drgona

In the learning to learn (L2L) framework, we cast the design of optimization algorithms as a machine learning problem and use deep neural networks to learn the update rules. In this paper, we extend the L2L framework to zeroth-order (ZO)…

Machine Learning · Computer Science 2020-02-10 Yangjun Ruan , Yuanhao Xiong , Sashank Reddi , Sanjiv Kumar , Cho-Jui Hsieh

Learn to Optimize (L2O) trains deep neural network-based solvers for optimization, achieving success in accelerating convex problems and improving non-convex solutions. However, L2O lacks rigorous theoretical backing for its own training…

Machine Learning · Computer Science 2025-12-24 Qingyu Song , Wei Lin , Hong Xu

Towards designing learned optimization algorithms that are usable beyond their training setting, we identify key principles that classical algorithms obey, but have up to now, not been used for Learning to Optimize (L2O). Following these…

Machine Learning · Computer Science 2025-09-19 Camille Castera , Peter Ochs

We analyze a learning-to-optimize (L2O) algorithm that exploits parameter space symmetry to enhance optimization efficiency. Prior work has shown that jointly learning symmetry transformations and local updates improves meta-optimizer…

Machine Learning · Computer Science 2025-04-23 Guy Zamir , Aryan Dokania , Bo Zhao , Rose Yu

The development of artificial intelligence (AI) for science has led to the emergence of learning-based research paradigms, necessitating a compelling reevaluation of the design of multi-objective optimization (MOO) methods. The new…

Machine Learning · Computer Science 2023-11-02 Linxi Yang , Xinmin Yang , Liping Tang

Applications abound in which optimization problems must be repeatedly solved, each time with new (but similar) data. Analytic optimization algorithms can be hand-designed to provably solve these problems in an iterative fashion. On one…

Optimization and Control · Mathematics 2022-09-28 Howard Heaton , Xiaohan Chen , Zhangyang Wang , Wotao Yin

Learning a graph topology to reveal the underlying relationship between data entities plays an important role in various machine learning and data analysis tasks. Under the assumption that structured data vary smoothly over a graph, the…

Machine Learning · Statistics 2023-08-23 Xingyue Pu , Tianyue Cao , Xiaoyun Zhang , Xiaowen Dong , Siheng Chen

Learning to optimize (L2O) has recently emerged as a promising approach to solving optimization problems by exploiting the strong prediction power of neural networks and offering lower runtime complexity than conventional solvers. While L2O…

Machine Learning · Computer Science 2021-12-21 Zhihui Shao , Jianyi Yang , Cong Shen , Shaolei Ren

Most decentralized optimization algorithms are handcrafted. While endowed with strong theoretical guarantees, these algorithms generally target a broad class of problems, thereby not being adaptive or customized to specific problem…

Optimization and Control · Mathematics 2024-10-03 Yutong He , Qiulin Shang , Xinmeng Huang , Jialin Liu , Kun Yuan

In this paper, we propose a learning-to-optimize (L2O) framework to accelerate solving parametric mixed-integer quadratic programming (MIQP) problems, with a particular focus on mixed-integer model predictive control (MI-MPC) applications.…

Systems and Control · Electrical Eng. & Systems 2026-05-14 Viet-Anh Le , Mu Xie , Rahul Mangharam
‹ Prev 1 2 3 10 Next ›