English
Related papers

Related papers: End-to-End Stochastic Optimization with Energy-Bas…

200 papers

Connected and Automated Hybrid Electric Vehicles have the potential to reduce fuel consumption and travel time in real-world driving conditions. The eco-driving problem seeks to design optimal speed and power usage profiles based upon…

Machine Learning · Computer Science 2022-02-01 Zhaoxuan Zhu , Nicola Pivaro , Shobhit Gupta , Abhishek Gupta , Marcello Canova

Federated learning (FL) is a useful tool in distributed machine learning that utilizes users' local datasets in a privacy-preserving manner. When deploying FL in a constrained wireless environment; however, training models in a…

Machine Learning · Computer Science 2022-05-06 Jake Perazzone , Shiqiang Wang , Mingyue Ji , Kevin Chan

We introduce a novel algorithm for gradient-based optimization of stochastic objective functions. The method may be seen as a variant of SGD with momentum equipped with an adaptive learning rate automatically adjusted by an 'energy'…

Optimization and Control · Mathematics 2022-03-24 Hailiang Liu , Xuping Tian

Structured Prediction Energy Networks (SPENs) are a simple, yet expressive family of structured prediction models (Belanger and McCallum, 2016). An energy function over candidate structured outputs is given by a deep network, and…

Machine Learning · Statistics 2017-07-18 David Belanger , Bishan Yang , Andrew McCallum

This paper proposes a data-driven approach for optimal power flow (OPF) based on the stacked extreme learning machine (SELM) framework. SELM has a fast training speed and does not require the time-consuming parameter tuning process compared…

Systems and Control · Electrical Eng. & Systems 2020-06-02 Xingyu Lei , Zhifang Yang , Juan Yu , Junbo Zhao , Qian Gao , Hongxin Yu

Decentralized federated learning (DFL) is an emerging paradigm to enable edge devices collaboratively training a learning model using a device-to-device (D2D) communication manner without the coordination of a parameter server (PS).…

Signal Processing · Electrical Eng. & Systems 2025-11-06 Zhiyuan Zhai , Xiaojun Yuan , Xin Wang , Geoffrey Ye Li

Discrete structures play an important role in applications like program language modeling and software engineering. Current approaches to predicting complex structures typically consider autoregressive models for their tractability, with…

Machine Learning · Computer Science 2020-11-12 Hanjun Dai , Rishabh Singh , Bo Dai , Charles Sutton , Dale Schuurmans

Model-based planning holds great promise for improving both sample efficiency and generalization in reinforcement learning (RL). We show that energy-based models (EBMs) are a promising class of models to use for model-based planning. EBMs…

Machine Learning · Computer Science 2021-03-09 Yilun Du , Toru Lin , Igor Mordatch

This paper introduces an innovative end-to-end model-based deep learning approach for efficient electromagnetic analysis of high-dimensional frequency selective surfaces (FSS). Unlike traditional data-driven methods that require large…

Machine Learning · Computer Science 2024-10-23 Cheima Hammami , Lucas Polo-López , Luc Le Magoarou

Decision-focused learning (DFL), which differentiates through the KKT conditions, has recently emerged as a powerful approach for predict-then-optimize problems. However, under probabilistic settings, DFL faces three major bottlenecks:…

Machine Learning · Computer Science 2025-06-25 Lingkai Kong , Wenhao Mu , Jiaming Cui , Yuchen Zhuang , B. Aditya Prakash , Bo Dai , Chao Zhang

Automating optimization modeling with LLMs is a promising path toward scalable decision intelligence, but existing approaches either rely on agentic pipelines built on closed-source LLMs with high inference latency, or fine-tune smaller…

Artificial Intelligence · Computer Science 2026-04-02 Runda Guan , Xiangqing Shen , Jiajun Zhang , Yifan Zhang , Jian Cheng , Rui Xia

In this paper, we propose an unmanned aerial vehicle (UAV)-assisted federated learning (FL) framework that jointly optimizes UAV trajectory, user participation, power allocation, and data volume control to minimize overall system energy…

Networking and Internet Architecture · Computer Science 2025-08-06 Chien-Wei Fu , Meng-Lin Ku

Energy-based models (EBMs) exhibit a variety of desirable properties in predictive tasks, such as generality, simplicity and compositionality. However, training EBMs on high-dimensional datasets remains unstable and expensive. In this…

Computer Vision and Pattern Recognition · Computer Science 2023-03-09 Xiulong Yang , Shihao Ji

The federated learning (FL) framework enables edge clients to collaboratively learn a shared inference model while keeping privacy of training data on clients. Recently, many heuristics efforts have been made to generalize centralized…

Machine Learning · Computer Science 2022-07-18 Jiayin Jin , Jiaxiang Ren , Yang Zhou , Lingjuan Lyu , Ji Liu , Dejing Dou

Latent space Energy-Based Models (EBMs), also known as energy-based priors, have drawn growing interests in generative modeling. Fueled by its flexibility in the formulation and strong modeling power of the latent space, recent works built…

Machine Learning · Computer Science 2023-10-06 Peiyu Yu , Sirui Xie , Xiaojian Ma , Baoxiong Jia , Bo Pang , Ruiqi Gao , Yixin Zhu , Song-Chun Zhu , Ying Nian Wu

Deep learning models undergo a significant increase in the number of parameters they possess, leading to the execution of a larger number of operations during inference. This expansion significantly contributes to higher energy consumption…

Machine Learning · Computer Science 2023-07-04 Dario Lazzaro , Antonio Emanuele Cinà , Maura Pintor , Ambra Demontis , Battista Biggio , Fabio Roli , Marcello Pelillo

This work proposes a unified control architecture that couples a Reinforcement Learning (RL)-driven controller with a disturbance-rejection Extended State Observer (ESO), complemented by an Event-Triggered Mechanism (ETM) to limit…

Optimization and Control · Mathematics 2026-01-01 Ningwei Bai , Chi Pui Chan , Qichen Yin , Tengyang Gong , Yunda Yan , Zezhi Tang

There are situations where data relevant to machine learning problems are distributed across multiple locations that cannot share the data due to regulatory, competitiveness, or privacy reasons. Machine learning approaches that require data…

Machine Learning · Computer Science 2022-06-28 Dimitris Stripelis , Jose Luis Ambite

Decentralized Federated Learning (DFL) enables collaborative, privacy-preserving model training without relying on a central server. This decentralized approach reduces bottlenecks and eliminates single points of failure, enhancing…

In this work we propose the use of adaptive stochastic search as a building block for general, non-convex optimization operations within deep neural network architectures. Specifically, for an objective function located at some layer in the…

Machine Learning · Computer Science 2021-04-05 Ioannis Exarchos , Marcus A. Pereira , Ziyi Wang , Evangelos A. Theodorou