English
Related papers

Related papers: NEMO5: Achieving High-end Internode Communication …

200 papers

We expect that many-core microprocessors will push performance per chip from the 10 gigaflop to the 10 teraflop range in the coming decade. To support this increased performance, memory and inter-core bandwidths will also have to scale by…

Emergent nanoscale non-volatile memory technologies with high integration density offer a promising solution to overcome the scalability limitations of CMOS-based neural networks architectures, by efficiently exhibiting the key principle of…

Hardware Architecture · Computer Science 2018-11-14 Saber Moradi , Rajit Manohar

Thermal engineering of quantum devices has attracted much attention since the discovery of quantized thermal conductance of phonons. Although easily submerged in numerous excitations in macro-systems, quantum behaviors of phonons manifest…

Materials Science · Physics 2020-10-02 Xiaobin Chen , Yizhou Liu , Wenhui Duan

Training LLMs in distributed environments presents significant challenges due to the complexity of model execution, deployment systems, and the vast space of configurable strategies. Although various optimization techniques exist, achieving…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-15 Mingyu Liang , Hiwot Tadese Kassa , Wenyin Fu , Brian Coutinho , Louis Feng , Christina Delimitrou

The fluctuations of electrical current provide information on the dynamics of electrons in quantum devices. Understanding the nature of these fluctuations in a quantum dot is thus a crucial step insofar as this system is the elementary…

Mesoscale and Nanoscale Physics · Physics 2018-10-08 A. Crépieux , S. Sahoo , T. Q. Duong , R. Zamoum , M. Lavagna

The nonlinear Shannon capacity limit has been identified as the fundamental barrier to the maximum rate of transmitted information in optical communications. In long-haul high-bandwidth optical networks, this limit is mainly attributed to…

Signal Processing · Electrical Eng. & Systems 2019-04-19 Elias Giacoumidis , Jinlong Wei , Ivan Aldaya , Liam P. Barry

Non-equilibrium electronic quantum transport is crucial for the operation of existing and envisioned electronic, optoelectronic, and spintronic devices. The ultimate goal of encompassing atomistic to mesoscopic length scales in the same…

Computational Physics · Physics 2024-10-08 Saurabh Sawant , François Léonard , Zhi Yao , Andrew Nonaka

Emerging non-volatile memory (NVM), or memristive, devices promise energy-efficient realization of deep learning, when efficiently integrated with mixed-signal integrated circuits on a CMOS substrate. Even though several algorithmic…

Neural and Evolutionary Computing · Computer Science 2018-04-23 Vishal Saxena , Xinyu Wu , Kehan Zhu

Today's experimental noisy quantum processors can compete with and surpass all known algorithms on state-of-the-art supercomputers for the computational benchmark task of Random Circuit Sampling [1-5]. Additionally, a circuit-based quantum…

Quantum Physics · Physics 2024-01-22 K. Kechedzhi , S. V. Isakov , S. Mandrà , B. Villalonga , X. Mi , S. Boixo , V. Smelyanskiy

Due to energy-efficiency requirements, computational systems are now being implemented using noisy nanoscale semiconductor devices whose reliability depends on energy consumed. We study circuit-level energy-reliability limits for deep…

Information Theory · Computer Science 2020-03-17 Avhishek Chatterjee , Lav R. Varshney

Ongoing climate change calls for fast and accurate weather and climate modeling. However, when solving large-scale weather prediction simulations, state-of-the-art CPU and GPU implementations suffer from limited performance and high energy…

We study the problem of efficient generative inference for Transformer models, in one of its most challenging settings: large deep models, with tight latency targets and long sequence lengths. Better understanding of the engineering…

Transport properties of 2D materials especially close to their boundary has received much attention after the successful fabrication of graphene and other fascinating materials afterwards. While most previous work is devoted to the…

Mesoscale and Nanoscale Physics · Physics 2016-12-15 Fanbing Xia , Jian Wang

With more scientific fields relying on neural networks (NNs) to process data incoming at extreme throughputs and latencies, it is crucial to develop NNs with all their parameters stored on-chip. In many of these applications, there is not…

Machine Learning · Computer Science 2024-03-15 Olivia Weng , Alexander Redding , Nhan Tran , Javier Mauricio Duarte , Ryan Kastner

The monolithic integration of electromechanical transduction at the nanoscale with advanced CMOS is among the most important challenges of semiconductor electronic systems to leverage the multi-domain sensing, actuation, and resonance…

Mesoscale and Nanoscale Physics · Physics 2019-10-11 Mayur Ghatge , Glen Walters , Toshikazu Nishida , Roozbeh Tabrizian

We present an efficient implemention of a non-equilibrium Green function (NEGF) method for self-consistent calculations of electron transport and forces in nanostructured materials. The electronic structure is described at the level of…

Mesoscale and Nanoscale Physics · Physics 2015-06-04 Jingzhe Chen , Kristian S. Thygesen , Karsten W. Jacobsen

The rapid scaling of deep neural networks comes at the cost of unsustainable power consumption. While optical neural networks offer an alternative, their capabilities remain constrained by the lack of efficient optical nonlinearities. To…

Optics · Physics 2026-01-06 Qingyi Zhou , Jungmin Kim , Yutian Tao , Guoming Huang , Ming Zhou , Zewei Shao , Zongfu Yu

Real-time solutions to the influence blocking maximization (IBM) problems are crucial for promptly containing the spread of misinformation. However, achieving this goal is non-trivial, mainly because assessing the blocked influence of an…

Neural and Evolutionary Computing · Computer Science 2025-05-23 Wenjie Chen , Shengcai Liu , Yew-Soon Ong , Zhuang Li , Ke Tang

As large language models (LLMs) continue to scale, the high power consumption of AI accelerators in datacenters presents significant challenges, substantially increasing the total cost of ownership (TCO) for cloud service providers (CSPs)…

Machine Learning · Computer Science 2025-08-26 Jiwoo Kim , Joonhyung Lee , Gunho Park , Byeongwook Kim , Se Jung Kwon , Dongsoo Lee , Youngjoo Lee

We theoretically investigate a thermoelectric heat engine based on a single-level quantum dot, calculating average quantities such as current, heat current, output power, and efficiency, as well as fluctuations (noise). Our theory is based…

Mesoscale and Nanoscale Physics · Physics 2025-02-21 Simon Wozny , Martin Leijnse