English
Related papers

Related papers: Practical and Fast Momentum-Based Power Methods

200 papers

Determinantal Point Processes (DPPs) are a family of probabilistic models that have a repulsive behavior, and lend themselves naturally to many tasks in machine learning where returning a diverse set of objects is important. While there are…

Statistics Theory · Mathematics 2017-03-03 John Urschel , Victor-Emmanuel Brunel , Ankur Moitra , Philippe Rigollet

Electricity is a volatile power source that requires great planning and resource management for both short and long term. More specifically, in the short-term, accurate instant energy consumption forecasting contributes greatly to improve…

Artificial Intelligence · Computer Science 2022-07-05 Nuno Oliveira , Norberto Sousa , Isabel Praça

Deep neural networks (DNNs) have been successfully applied in various fields. A major challenge of deploying DNNs, especially on edge devices, is power consumption, due to the large number of multiply-and-accumulate (MAC) operations. To…

Neural and Evolutionary Computing · Computer Science 2023-11-28 Richard Petri , Grace Li Zhang , Yiran Chen , Ulf Schlichtmann , Bing Li

This paper proposes a data-driven approach for optimal power flow (OPF) based on the stacked extreme learning machine (SELM) framework. SELM has a fast training speed and does not require the time-consuming parameter tuning process compared…

Systems and Control · Electrical Eng. & Systems 2020-06-02 Xingyu Lei , Zhifang Yang , Juan Yu , Junbo Zhao , Qian Gao , Hongxin Yu

We propose a novel decentralized mixed algebraic and dynamic state observation method for multi-machine power systems with unknown inputs and equipped with Phasor Measurement Units (PMUs). More specifically, we prove that for the…

Systems and Control · Electrical Eng. & Systems 2020-11-11 M. Nicolai L. Lorenz-Meyer , Alexey A. Bobtsov , Romeo Ortega , Nikolay Nikolaev , Johannes Schiffer

Active distribution networks (ADNs) incorporating massive photovoltaic (PV) devices encounter challenges of rapid voltage fluctuations and potential violations. Due to the fluctuation and intermittency of PV generation, the state gap,…

Systems and Control · Electrical Eng. & Systems 2024-02-28 Hong Cheng , Huan Luo , Zhi Liu , Wei Sun , Weitao Li , Qiyue Li

The Wind Storage Integrated System with Power Smoothing Control (PSC) has emerged as a promising solution to ensure both efficient and reliable wind energy generation. However, existing PSC strategies overlook the intricate interplay and…

Systems and Control · Electrical Eng. & Systems 2024-12-25 Shuyi Wang , Huan Zhao , Yuji Cao , Zibin Pan , Guolong Liu , Gaoqi Liang , Junhua Zhao

This paper proposes an accelerated consensus-based distributed iterative algorithm for resource allocation and scheduling. The proposed gradient-tracking algorithm introduces an auxiliary variable to add momentum towards the optimal state.…

Systems and Control · Electrical Eng. & Systems 2025-03-11 Mohammadreza Doostmohammadian , Zulfiya R. Gabidullina , Hamid R. Rabiee

Stochastic gradient descent (\textsc{Sgd}) methods are the most powerful optimization tools in training machine learning and deep learning models. Moreover, acceleration (a.k.a. momentum) methods and diagonal scaling (a.k.a. adaptive…

Machine Learning · Statistics 2018-10-02 Qi Deng , Yi Cheng , Guanghui Lan

When applying Dynamic Power Management (DPM) technique to pervasively deployed embedded systems, the technique needs to be very efficient so that it is feasible to implement the technique on low end processor and tight-budget memory.…

Other Computer Science · Computer Science 2011-11-09 Min Li , Xiaobo Wu , Richard Yao , Xiaolang Yan

Consider a network of $N$ decentralized computing agents collaboratively solving a nonconvex stochastic composite problem. In this work, we propose a single-loop algorithm, called DEEPSTORM, that achieves optimal sample complexity for this…

Optimization and Control · Mathematics 2023-04-14 Gabriel Mancino-Ball , Shengnan Miao , Yangyang Xu , Jie Chen

This PhD thesis thoroughly examines the utilization of deep learning techniques as a means to advance the algorithms employed in the monitoring and optimization of electric power systems. The first major contribution of this thesis involves…

Machine Learning · Computer Science 2023-09-04 Ognjen Kundacina

We introduce a semistochastic implementation of the power method to compute, for very large matrices, the dominant eigenvalue and expectation values involving the corresponding eigenvector. The method is semistochastic in that the matrix…

Strongly Correlated Electrons · Physics 2013-10-24 F. R. Petruzielo , A. A. Holmes , Hitesh J. Changlani , M. P. Nightingale , C. J. Umrigar

The power method is a basic method for computing the dominant eigenpair of a matrix. In this paper, we propose a structure-preserving power-like method for computing the dominant conjugate pair of purely imaginary eigenvalues and the…

Numerical Analysis · Mathematics 2024-09-10 Qingqing Zheng

Multi-modal learning, which focuses on utilizing various modalities to improve the performance of a model, is widely used in video recognition. While traditional multi-modal learning offers excellent recognition results, its computational…

Computer Vision and Pattern Recognition · Computer Science 2021-05-13 Rameswar Panda , Chun-Fu Chen , Quanfu Fan , Ximeng Sun , Kate Saenko , Aude Oliva , Rogerio Feris

Deep learning is formulated as a discrete-time optimal control problem. This allows one to characterize necessary conditions for optimality and develop training algorithms that do not rely on gradients with respect to the trainable…

Machine Learning · Computer Science 2018-06-05 Qianxiao Li , Shuji Hao

Distributed and decentralized optimization are key for the control of networked systems. Application examples include distributed model predictive control and distributed sensing or estimation. Non-linear systems, however, lead to problems…

Optimization and Control · Mathematics 2023-07-06 Alexander Engelmann , Gösta Stomberg , Timm Faulwasser

Distributed optimization advances centralized machine learning methods by enabling parallel and decentralized learning processes over a network of computing nodes. This work provides an accelerated consensus-based distributed algorithm for…

Systems and Control · Electrical Eng. & Systems 2025-07-01 Mohammadreza Doostmohammadian , Hamid R. Rabiee

This paper investigates the application of a robust CPU-based power modelling methodology that performs an automatic search of explanatory events derived from performance counters to embedded GPUs. A 64-bit Tegra TX1 SoC is configured with…

Other Computer Science · Computer Science 2020-06-23 Jose Nunez-Yanez , Kris Nikov , Kerstin Eder , Mohammad Hosseinabady

Motivated by image recovery in magnetic resonance imaging (MRI), we propose a new approach to solving linear inverse problems based on iteratively calling a deep neural-network, sometimes referred to as plug-and-play recovery. Our approach…

Information Theory · Computer Science 2020-10-23 Subrata Sarkar , Rizwan Ahmad , Philip Schniter