English
Related papers

Related papers: Towards Physical Plausibility in Neuroevolution Sy…

200 papers

We propose a simple, but efficient and accurate machine learning (ML) model for developing high-dimensional potential energy surface. This so-called embedded atom neural network (EANN) approach is inspired by the well-known empirical…

Chemical Physics · Physics 2019-10-23 Yaolong Zhang , Ce Hu , Bin Jiang

The expansion of artificial intelligence (AI) applications has driven substantial investment in computational infrastructure, especially by cloud computing providers. Quantifying the energy footprint of this infrastructure requires models…

Hardware Architecture · Computer Science 2025-03-25 Imran Latif , Alex C. Newkirk , Matthew R. Carbone , Arslan Munir , Yuewei Lin , Jonathan Koomey , Xi Yu , Zhiuha Dong

We propose a novel method for training a neural network for image classification to reduce input data dynamically, in order to reduce the costs of training a neural network model. As Deep Learning tasks become more popular, their…

Machine Learning · Computer Science 2025-10-10 Dominic Sanderson , Tatiana Kalgonova

Over the past decade, deep learning (DL) has led to significant advancements in various fields of artificial intelligence, including machine translation (MT). These advancements would not be possible without the ever-growing volumes of data…

Computation and Language · Computer Science 2022-11-17 Dimitar Shterionov , Eva Vanmassenhove

Probabilistic power flow (PPF) plays a critical role in power system analysis. However, the high computational burden makes it challenging for the practical implementation of PPF. This paper proposes a model-based deep learning approach to…

Signal Processing · Electrical Eng. & Systems 2019-09-17 Yan Yang , Zhifang Yang , Juan Yu , Baosen Zhang

As the technology industry is moving towards implementing tasks such as natural language processing, path planning, image classification, and more on smaller edge computing devices, the demand for more efficient implementations of…

Machine Learning · Computer Science 2022-11-24 Peyton Chandarana , Mohammadreza Mohammadi , James Seekings , Ramtin Zand

Deep learning models like Transformers and Convolutional Neural Networks (CNNs) have revolutionized various domains, but their parameter-intensive nature hampers deployment in resource-constrained settings. In this paper, we introduce a…

Machine Learning · Computer Science 2024-01-31 Onur Can Koyun , Behçet Uğur Töreyin

This work considers the trade-off between accuracy and test-time computational cost of deep neural networks (DNNs) via \emph{anytime} predictions from auxiliary predictions. Specifically, we optimize auxiliary losses jointly in an…

Machine Learning · Computer Science 2018-05-28 Hanzhang Hu , Debadeepta Dey , Martial Hebert , J. Andrew Bagnell

The training for deep neural networks (DNNs) demands immense energy consumption, which restricts the development of deep learning as well as increases carbon emissions. Thus, the study of energy-efficient training for DNNs is essential. In…

Machine Learning · Computer Science 2023-03-01 Chang Liu , Rui Zhang , Xishan Zhang , Yifan Hao , Zidong Du , Xing Hu , Ling Li , Qi Guo

The rapidly increasing computational demands for artificial intelligence (AI) have spurred the exploration of computing principles beyond conventional digital computers. Physical neural networks (PNNs) offer efficient neuromorphic…

Renewable sources of energy are the future due to the environmental problems caused by non-renewable sources to produce energy. The biggest issue with renewable energy sources is that the power produced by devices such as PV solar panels…

Signal Processing · Electrical Eng. & Systems 2022-10-24 Rohaib Bhatti , Ali John Naqvi , Abdullah Tauqeer

Faithful energy reconstruction is foundational for precision neutrino experiments like DUNE, but is hindered by uncertainties in our understanding of neutrino--nucleus interactions. Here, we demonstrate that dense neural networks are very…

High Energy Physics - Phenomenology · Physics 2025-04-22 Joachim Kopp , Pedro Machado , Margot MacMahon , Ivan Martinez-Soler

Achieving energy efficiency in learning is a key challenge for artificial intelligence (AI) computing platforms. Biological systems demonstrate remarkable abilities to learn complex skills quickly and efficiently. Inspired by this, we…

Artificial Intelligence · Computer Science 2024-05-27 Ingo Blakowski , Dmitrii Zendrikov , Cristiano Capone , Giacomo Indiveri

NeuroEvolution (NE) methods are known for applying Evolutionary Computation to the optimisation of Artificial Neural Networks(ANNs). Despite aiding non-expert users to design and train ANNs, the vast majority of NE approaches disregard the…

Neural and Evolutionary Computing · Computer Science 2020-04-02 Filipe Assunção , Nuno Lourenço , Bernardete Ribeiro , Penousal Machado

Automated design methods for convolutional neural networks (CNNs) have recently been developed in order to increase the design productivity. We propose a neuroevolution method capable of evolving and optimizing CNNs with respect to the…

Neural and Evolutionary Computing · Computer Science 2019-10-16 Filip Badan , Lukas Sekanina

Integrated photonic neural networks (PNNs) are at the forefront of AI computing, leveraging on light's unique properties, such as large bandwidth, low latency, and potentially low power consumption. Nevertheless, the integrated optical…

The energy requirements of current natural language processing models continue to grow at a rapid, unsustainable pace. Recent works highlighting this problem conclude there is an urgent need for methods that reduce the energy needs of NLP…

Computation and Language · Computer Science 2023-05-03 Joseph McDonald , Baolin Li , Nathan Frey , Devesh Tiwari , Vijay Gadepally , Siddharth Samsi

Deep Neural Networks (DNN) achieve human level performance in many image analytics tasks but DNNs are mostly deployed to GPU platforms that consume a considerable amount of power. New hardware platforms using lower precision arithmetic…

Neural and Evolutionary Computing · Computer Science 2017-05-23 Antonio Jimeno Yepes , Jianbin Tang , Benjamin Scott Mashford

Deep Neural Networks (DNNs) have achieved great success in a variety of machine learning (ML) applications, delivering high-quality inferencing solutions in computer vision, natural language processing, and virtual reality, etc. However,…

Machine Learning · Computer Science 2022-08-29 Xiaofan Zhang , Yao Chen , Cong Hao , Sitao Huang , Yuhong Li , Deming Chen

Spiking Neural Networks (SNNs), as bio-inspired energy-efficient neural networks, have attracted great attentions from researchers and industry. The most efficient way to train deep SNNs is through ANN-SNN conversion. However, the…

Neural and Evolutionary Computing · Computer Science 2021-05-26 Jianhao Ding , Zhaofei Yu , Yonghong Tian , Tiejun Huang