English
Related papers

Related papers: Revisiting DNN Training for Intermittently-Powered…

200 papers

To raise awareness of the environmental impact of deep learning (DL), many studies estimate the energy use of DL systems. However, energy estimates during DL training often rely on unverified assumptions. This work addresses that gap by…

Machine Learning · Computer Science 2025-09-26 Santiago del Rey , Luís Cruz , Xavier Franch , Silverio Martínez-Fernández

Object detection using deep neural networks (DNNs) involves a huge amount of computation which impedes its implementation on resource/energy-limited user-end devices. The reason for the success of DNNs is due to having knowledge over all…

Computer Vision and Pattern Recognition · Computer Science 2020-06-09 Mohammad Farhadi Bajestani , Mehdi Ghasemi , Sarma Vrudhula , Yezhou Yang

This paper aims to understand and improve the utility of the dropout operation from the perspective of game-theoretic interactions. We prove that dropout can suppress the strength of interactions between input variables of deep neural…

Machine Learning · Computer Science 2021-03-17 Hao Zhang , Sen Li , Yinchao Ma , Mingjie Li , Yichen Xie , Quanshi Zhang

Model discovery based on existing data has been one of the major focuses of mathematical modelers for decades. Despite tremendous achievements of model identification from adequate data, how to unravel the models from limited data is less…

Numerical Analysis · Mathematics 2020-09-25 Jia Zhao , Jarrod Mau

Compute-in-memory accelerators built upon non-volatile memory devices excel in energy efficiency and latency when performing deep neural network (DNN) inference, thanks to their in-situ data processing capability. However, the stochastic…

Machine Learning · Computer Science 2025-08-19 Yifan Qin , Zheyu Yan , Dailin Gan , Jun Xia , Zixuan Pan , Wujie Wen , Xiaobo Sharon Hu , Yiyu Shi

Internet of Things (IoT) devices can apply mobile-edge computing (MEC) and energy harvesting (EH) to provide the satisfactory quality of experiences for computation intensive applications and prolong the battery lifetime. In this article,…

Networking and Internet Architecture · Computer Science 2017-12-27 Minghui Min , Dongjin Xu , Liang Xiao , Yuliang Tang , Di Wu

While the current trend is to increase the depth of neural networks to increase their performance, the size of their training database has to grow accordingly. We notice an emergence of tremendous databases, although providing labels to…

Machine Learning · Computer Science 2016-02-22 Melanie Ducoffe , Frederic Precioso

Over-parameterization of deep neural networks (DNNs) has shown high prediction accuracy for many applications. Although effective, the large number of parameters hinders its popularity on resource-limited devices and has an outsize…

Machine Learning · Computer Science 2023-04-25 Shaoyi Huang , Bowen Lei , Dongkuan Xu , Hongwu Peng , Yue Sun , Mimi Xie , Caiwen Ding

Modern buildings encompass complex dynamics of multiple electrical, mechanical, and control systems. One of the biggest hurdles in applying conventional model-based optimization and control methods to building energy management is the huge…

Optimization and Control · Mathematics 2017-11-08 Yize Chen , Yuanyuan Shi , Baosen Zhang

With the rapid advancement in the performance of deep neural networks (DNNs), there has been significant interest in deploying and incorporating artificial intelligence (AI) systems into real-world scenarios. However, many DNNs lack the…

Machine Learning · Computer Science 2024-07-18 Mijoo Kim , Junseok Kwon

Due to lack of data, overfitting ubiquitously exists in real-world applications of deep neural networks (DNNs). We propose advanced dropout, a model-free methodology, to mitigate overfitting and improve the performance of DNNs. The advanced…

Machine Learning · Computer Science 2021-08-11 Jiyang Xie , Zhanyu Ma , and Jianjun Lei , Guoqiang Zhang , Jing-Hao Xue , Zheng-Hua Tan , Jun Guo

Recent years have witnessed growing interest in the application of deep neural networks (DNNs) for receiver design, which can potentially be applied in complex environments without relying on knowledge of the channel model. However, the…

Information Theory · Computer Science 2023-02-14 Tomer Raviv , Sangwoo Park , Osvaldo Simeone , Yonina C. Eldar , Nir Shlezinger

Efficient network modeling is essential for resource optimization and network planning in next-generation large-scale complex networks. Traditional approaches, such as queuing theory-based modeling and packet-based simulators, can be…

Networking and Internet Architecture · Computer Science 2025-03-25 Chetna Singhal , Yassine Hadjadj-Aoul

Radio frequency (RF) wireless power transfer (WPT) is a promising technology for sustainable support of massive Internet of Things (IoT). However, RF-WPT systems are characterized by low efficiency due to channel attenuation, which can be…

Signal Processing · Electrical Eng. & Systems 2024-05-08 Amirhossein Azarbahram , Onel L. A. López , Petar Popovski , Shashi Raj Pandey , Matti Latva-aho

Today, deep learning optimization is primarily driven by research focused on achieving high inference accuracy and reducing latency. However, the energy efficiency aspect is often overlooked, possibly due to a lack of sustainability mindset…

Networking and Internet Architecture · Computer Science 2024-06-11 Xiaolong Tu , Anik Mallik , Dawei Chen , Kyungtae Han , Onur Altintas , Haoxin Wang , Jiang Xie

Unsupervised domain adaptation has recently emerged as an effective paradigm for generalizing deep neural networks to new target domains. However, there is still enormous potential to be tapped to reach the fully supervised performance. In…

Machine Learning · Computer Science 2022-03-10 Binhui Xie , Longhui Yuan , Shuang Li , Chi Harold Liu , Xinjing Cheng , Guoren Wang

Deep neural networks (DNNs) have demonstrated remarkable success in various fields. However, the large number of floating-point operations (FLOPs) in DNNs poses challenges for their deployment in resource-constrained applications, e.g.,…

Artificial Intelligence · Computer Science 2024-02-20 Mengnan Jiang , Jingcun Wang , Amro Eldebiky , Xunzhao Yin , Cheng Zhuo , Ing-Chao Lin , Grace Li Zhang

Probabilistic power flow (PPF) plays a critical role in power system analysis. However, the high computational burden makes it challenging for the practical implementation of PPF. This paper proposes a model-based deep learning approach to…

Signal Processing · Electrical Eng. & Systems 2019-09-17 Yan Yang , Zhifang Yang , Juan Yu , Baosen Zhang

The increasing penetration of distributed energy resources (DERs) brings opportunities and challenges to the operation of distribution systems. To ensure network integrity, dynamic operating envelopes (DOEs) are issued by utilities to DERs…

Systems and Control · Electrical Eng. & Systems 2026-02-20 Hongyi Li , Liming Liu , Yunyi Li , Zhaoyu Wang

We propose a new method to efficiently compute load-flows (the steady-state of the power-grid for given productions, consumptions and grid topology), substituting conventional simulators based on differential equation solvers. We use a deep…

Machine Learning · Statistics 2018-01-31 Benjamin Donnot , Isabelle Guyon , Marc Schoenauer , Antoine Marot , Patrick Panciatici