English
Related papers

Related papers: Can Asymmetric Tile Buffering Be Beneficial?

200 papers

This study reports grain boundary (GB) energy calculations for 46 symmetric-tilt GBs in alpha-iron using molecular mechanics based on an artificial neural network (ANN) potential and compares the results with calculations based on the…

The Branch Target Buffer (BTB) plays a critical role in efficient CPU branch prediction. Understanding the design and implementation of the BTB provides valuable insights for both compiler design and the mitigation of hardware attacks such…

Hardware Architecture · Computer Science 2024-12-10 Junpeng Wan

We introduce Stream-K, a work-centric parallelization of matrix multiplication (GEMM) and related computations in dense linear algebra. Whereas contemporary decompositions are primarily tile-based, our method operates by partitioning an…

Data Structures and Algorithms · Computer Science 2023-01-11 Muhammad Osama , Duane Merrill , Cris Cecka , Michael Garland , John D. Owens

Tile-based many-Processing Element (PE) accelerators can achieve competitive performance on General Matrix Multiplication (GEMM), but they are extremely hard to program, as their optimal software mapping is deeply coupled with hardware…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-16 Aofeng Shen , Chi Zhang , Yakup Budanaz , Alexandru Calotoiu , Torsten Hoefler , Luca Benini

In the abstract Tile Assembly Model (aTAM) square tiles self-assemble, autonomously binding via glues on their edges, to form structures. Algorithmic aTAM systems can be designed in which the patterns of tile attachments are forced to…

Emerging Technologies · Computer Science 2022-11-10 Andrew Alseth , Matthew J. Patitz

Alternating Direction Method of Multipliers (ADMM) has been used successfully in many conventional machine learning applications and is considered to be a useful alternative to Stochastic Gradient Descent (SGD) as a deep learning optimizer.…

Optimization and Control · Mathematics 2021-07-07 Junxiang Wang , Fuxun Yu , Xiang Chen , Liang Zhao

Sequence-directed assembly processes - such as protein folding - allow the assembly of a large number of structures with high accuracy from only a small handful of fundamental building blocks. We aim to explore how efficiently sequence…

Biological Physics · Physics 2025-03-14 Jeremy Guntoro , Thomas Ouldridge

Contrastive loss is a powerful approach for representation learning, where larger batch sizes enhance performance by providing more negative samples to better distinguish between similar and dissimilar data. However, scaling batch sizes is…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Zesen Cheng , Hang Zhang , Kehan Li , Sicong Leng , Zhiqiang Hu , Fei Wu , Deli Zhao , Xin Li , Lidong Bing

Mining and exploring databases should provide users with knowledge and new insights. Tiles of data strive to unveil true underlying structure and distinguish valuable information from various kinds of noise. We propose a novel Boolean…

Artificial Intelligence · Computer Science 2019-06-25 Sibylle Hess , Katharina Morik , Nico Piatkowski

GEneral Matrix Multiplications (GEMMs) are recurrent in high-performance computing and deep learning workloads. Typically, high-end CPUs accelerate GEMM workloads with Single-Instruction Multiple Data (SIMD) or vector Instruction Set…

Hardware Architecture · Computer Science 2025-07-08 Alexandre de Limas Santana , Adrià Armejach , Francesc Martinez , Erich Focht , Marc Casas

The alternating direction method of multipliers (ADMM) is a powerful operator splitting technique for solving structured convex optimization problems. Due to its relatively low per-iteration computational cost and ability to exploit…

Optimization and Control · Mathematics 2020-06-09 Michel Schubiger , Goran Banjac , John Lygeros

In this paper we introduce a block-structured adaptive mesh refinement (AMR) software framework that incorporates tiling, a well-known loop transformation. Because the multiscale, multiphysics codes built in BoxLib are designed to solve…

Mathematical Software · Computer Science 2016-04-14 Weiqun Zhang , Ann Almgren , Marcus Day , Tan Nguyen , John Shalf , Didem Unat

General matrix-matrix multiplication (GEMM) is a cornerstone of AI computations, making tensor processing engines (TPEs) increasingly critical in GPUs and domain-specific architectures. Existing architectures primarily optimize dataflow or…

Hardware Architecture · Computer Science 2025-03-11 Qizhe Wu , Huawen Liang , Yuchen Gui , Zhichen Zeng , Zerong He , Linfeng Tao , Xiaotian Wang , Letian Zhao , Zhaoxi Zeng , Wei Yuan , Wei Wu , Xi Jin

While transformer models have been highly successful, they are computationally inefficient. We observe that for each layer, the full width of the layer may be needed only for a small subset of tokens inside a batch and that the "effective"…

Machine Learning · Computer Science 2024-12-19 Bartosz Wójcik , Alessio Devoto , Karol Pustelnik , Pasquale Minervini , Simone Scardapane

Binary Neural Networks (BNNs) enable efficient deep learning by saving on storage and computational costs. However, as the size of neural networks continues to grow, meeting computational requirements remains a challenge. In this work, we…

Machine Learning · Computer Science 2024-07-18 Matt Gorbett , Hossein Shirazi , Indrakshi Ray

The generic matrix multiply (GEMM) function is the core element of high-performance linear algebra libraries used in many computationally-demanding digital signal processing (DSP) systems. We propose an acceleration technique for GEMM based…

Mathematical Software · Computer Science 2015-05-30 Davide Anastasia , Yiannis Andreopoulos

General Matrix Multiplication (GEMM) is a fundamental operation in many scientific workloads, signal processing, and particularly deep learning. It is often a bottleneck for performance and energy efficiency, especially in edge environments…

Hardware Architecture · Computer Science 2025-11-11 Ilias Papalamprou , Dimosthenis Masouros , Ioannis Loudaros , Francky Catthoor , Dimitrios Soudris

General matrix/matrix multiplication (GEMM) is crucial for scientific computing and machine learning. However, the increased scale of the computing platforms raises concerns about hardware and software reliability. In this poster, we…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-05-10 Shixun Wu , Yujia Zhai , Jiajun Huang , Zizhe Jian , Zizhong Chen

We present a new method, called Analysis-of-marginal-Tail-Means (ATM), for effective robust optimization of discrete black-box problems. ATM has important applications to many real-world engineering problems (e.g., manufacturing…

Methodology · Statistics 2018-10-23 Simon Mak , C. F. Jeff Wu

General matrix multiplication (GEMM) is a ubiquitous computing kernel/algorithm for data processing in diverse applications, including artificial intelligence (AI) and deep learning (DL). Recent shift towards edge computing has inspired…

Hardware Architecture · Computer Science 2024-12-25 Harideep Nair , Prabhu Vellaisamy , Albert Chen , Joseph Finn , Anna Li , Manav Trivedi , John Paul Shen