English
Related papers

Related papers: Should We Even Optimize for Execution Energy? Reth…

200 papers

Large Language Models (LLMs) are increasingly deployed in production, contributing towards shifting the burden in terms of computational resources and energy demands from training to inference. While prior work has examined the energy cost…

Machine Learning · Computer Science 2026-02-02 Julien Delavande , Regis Pierrard , Sasha Luccioni

Memristive associative learning has gained significant attention for its ability to mimic fundamental biological learning mechanisms while maintaining system simplicity. In this work, we introduce a high-order memristive associative…

Neural and Evolutionary Computing · Computer Science 2024-10-23 Shengbo Wang , Xuemeng Li , Jialin Ding , Weihao Ma , Ying Wang , Luigi Occhipinti , Arokia Nathan , Shuo Gao

The resurgence of near-memory processing (NMP) with the advent of big data has shifted the computation paradigm from processor-centric to memory-centric computing. To meet the bandwidth and capacity demands of memory-centric computing, 3D…

Hardware Architecture · Computer Science 2021-04-29 Pritam Majumder , Jiayi Huang , Sungkeun Kim , Abdullah Muzahid , Dylan Siegers , Chia-Che Tsai , Eun Jung Kim

Since performance improvements of computers are stagnating, new technologies and computer paradigms are hot research topics. Memristor-based In-Memory Computing is one of the promising candidates for the post-CMOS era, which comes in many…

Emerging Technologies · Computer Science 2024-10-22 Fabian Seiler , Nima TaheriNejad

Memristors provide a tempting solution for weighted synapse connections in neuromorphic computing due to their size and non-volatile nature. However, memristors are unreliable in the commonly used voltage-pulse-based programming approaches…

Neural and Evolutionary Computing · Computer Science 2023-09-08 Hritom Das , Rocco D. Febbo , SNB Tushar , Nishith N. Chakraborty , Maximilian Liehr , Nathaniel Cady , Garrett S. Rose

Reservoir computing is a machine learning paradigm that uses a high-dimensional dynamical system, or \emph{reservoir}, to approximate and predict time series data. The scale, speed and power usage of reservoir computers could be enhanced by…

Neural and Evolutionary Computing · Computer Science 2022-11-16 Forrest C. Sheldon , Artemy Kolchinsky , Francesco Caravelli

Designing efficient optimizers for large language models (LLMs) with low-memory requirements and fast convergence is an important and challenging problem. This paper makes a step towards the systematic design of such optimizers through the…

Machine Learning · Computer Science 2025-02-21 Wenbo Gong , Meyer Scetbon , Chao Ma , Edward Meeds

Spintronic-based brain-inspired neuromorphic computing has recently attracted significant attention due to the exceptional properties of magnetic microstructures, including nanoscale dimensions, high stability, and low energy consumption.…

Computational Physics · Physics 2025-12-05 Anmol Sharma , Ranjeet Kumar Brajpuriya , Vivek K. Malik , Vishakha Kaushik , Sachin Pathak

Main memory's rising energy consumption has emerged as a critical challenge in modern computing architectures, particularly in large-scale systems, driven by frequent access patterns, growing data volumes, and insufficient power management…

We study a simple scheduling game for the speed scaling model. Players want their job to complete early, which however generates a big energy consumption. We address the game from the mechanism design side, and by charging the energy usage…

Computer Science and Game Theory · Computer Science 2013-01-01 Oscar C. Vásquez

The so-called matrix-element method (MEM) has long been used successfully as a classification tool in particle physics searches. In the presence of invisible final state particles, the traditional MEM typically assigns probabilities to an…

High Energy Physics - Phenomenology · Physics 2019-08-26 Stefan von Buddenbrock , Olivier Mattelaer , Michael Spannowsky

The energy requirements of current natural language processing models continue to grow at a rapid, unsustainable pace. Recent works highlighting this problem conclude there is an urgent need for methods that reduce the energy needs of NLP…

Computation and Language · Computer Science 2023-05-03 Joseph McDonald , Baolin Li , Nathan Frey , Devesh Tiwari , Vijay Gadepally , Siddharth Samsi

Computing-in-Memory (CiM) is a promising paradigm to address the memory bottleneck constraining traditional systems. Most power-efficient CiM variants can directly perform Boolean operations in non-volatile memory arrays. Higher…

Emerging Technologies · Computer Science 2026-04-09 Patrick Miller , Hüsrev Cilasun , Sachin S. Sapatnekar , Ulya R. Karpuzcu

In this paper, it is presented a novel strategy to optimize the determination of magnetic couplings by using ab-initio calculations of the energy. This approach allows determining efficiently, in terms of a proposed effective magnetic spin…

Strongly Correlated Electrons · Physics 2020-09-04 J. M. Matera , C. A. Lamas , L. A. Errico , A. V. Gil Rebaza , V. I. Fernández

Convolutional neural network (CNN) achieves excellent performance on fascinating tasks such as image recognition and natural language processing at the cost of high power consumption. Stochastic computing (SC) is an attractive paradigm…

Signal Processing · Electrical Eng. & Systems 2019-04-24 Xinyue Zhang , Yuan Wang , Yawen Zhang , Jiahao Song , Zuodong Zhang , Kaili Cheng , Runsheng Wang , Ru Huang

Energy minimization methods are a classical tool in a multitude of computer vision applications. While they are interpretable and well-studied, their regularity assumptions are difficult to design by hand. Deep learning techniques on the…

Optimization and Control · Mathematics 2019-08-20 Jonas Geiping , Michael Moeller

The widespread integration of embedded systems across various industries has facilitated seamless connectivity among devices and bolstered computational capabilities. Despite their extensive applications, embedded systems encounter…

Cryptography and Security · Computer Science 2024-04-16 Sreenitha Kasarapu , Sathwika Bavikadi , Sai Manoj Pudukotai Dinakarrao

Memory load/store instructions consume an important part in execution time and energy consumption in domain-specific accelerators. For designing highly parallel systems, available parallelism at each granularity is extracted from the…

Hardware Architecture · Computer Science 2022-09-07 Khushal Sethi

Recent years have seen a rapid rise of artificial neural networks being employed in a number of cognitive tasks. The ever-increasing computing requirements of these structures have contributed to a desire for novel technologies and…

Emerging Technologies · Computer Science 2022-05-06 Dovydas Joksas , Erwei Wang , Nikolaos Barmpatsalos , Wing H. Ng , Anthony J. Kenyon , George A. Constantinides , Adnan Mehonic

The energy consumption and the compute performance of a fluid dynamic code have been investigated varying parallelization approach, arithmetic precision and clock speed. The code is based on a Lattice Boltzmann approximation, is written in…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-18 Matteo Turisini , Giorgio Amati , Andrea Acquaviva