English
Related papers

Related papers: Architecture Specific Generation of Large Scale La…

200 papers

Linear recurrent neural networks enable powerful long-range sequence modeling with constant memory usage and time-per-token during inference. These architectures hold promise for streaming applications at the edge, but deployment in…

Machine Learning · Computer Science 2025-08-14 Alessandro Pierro , Steven Abreu , Jonathan Timcheck , Philipp Stratmann , Andreas Wild , Sumit Bam Shrestha

With the fast growth of parameter size, it becomes increasingly challenging to deploy large generative models as they typically require large GPU memory consumption and massive computation. Unstructured model pruning has been a common…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-09-20 Haojun Xia , Zhen Zheng , Yuchao Li , Donglin Zhuang , Zhongzhu Zhou , Xiafei Qiu , Yong Li , Wei Lin , Shuaiwen Leon Song

Efficient solutions of large-scale, ill-conditioned and indefinite algebraic equations are ubiquitously needed in numerous computational fields, including multiphysics simulations, machine learning, and data science. Because of their…

Mathematical Software · Computer Science 2026-05-25 Xiaoye Sherry Li , Yang Liu

Spatially-coupled (SC) codes, known for their threshold saturation phenomenon and low-latency windowed decoding algorithms, are ideal for streaming applications and data storage systems. SC codes are constructed by partitioning an…

Information Theory · Computer Science 2021-09-21 Siyi Yang , Ahmed Hareedy , Robert Calderbank , Lara Dolecek

Quantitative structure-property relationships are crucial for the understanding and prediction of the physical properties of complex materials. For fluid flow in porous materials, characterizing the geometry of the pore microstructure…

Soft Condensed Matter · Physics 2020-09-21 Magnus Röding , Zheng Ma , Salvatore Torquato

Modern large language models (LLMs) increasingly depends on efficient long-context processing and generation mechanisms, including sparse attention, retrieval-augmented generation (RAG), and compressed contextual memory, to support complex…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-12 Zifan He , Rui Ma , Yizhou Sun , Jason Cong

In this work, we present a memory-efficient, high-performance GPU framework for moment-based lattice Boltzmann methods (LBM) with fluid-solid coupling. We introduce a split-kernel scheme that decouples fluid updates from solid boundary…

Graphics · Computer Science 2026-02-06 Yixin Chen , Wei Li , David I. W. Levin , Kui Wu

Rooted from the gas kinetics, the lattice Boltzmann method is a powerful tool in modeling hydrodynamics. In the past decade, it has been extended to simulate the rarefied gas flow beyond the Navier-Stokes level, either by using the…

Fluid Dynamics · Physics 2017-08-30 Scott Lindsay , Wei Su , Haihu Liu , Lei Wu

In cryptanalysis, solving the discrete logarithm problem (DLP) is key to assessing the security of many public-key cryptosystems. The index-calculus methods, that attack the DLP in multiplicative subgroups of finite fields, require solving…

Cryptography and Security · Computer Science 2014-12-05 Hamza Jeljeli

Large language models (LLMs) have been widely applied but face challenges in efficient inference. While quantization methods reduce computational demands, ultra-low bit quantization with arbitrary precision is hindered by limited GPU Tensor…

Machine Learning · Computer Science 2025-03-14 Shaobo Ma , Chao Fang , Haikuo Shao , Zhongfeng Wang

Automatic code generation is frequently used to create implementations of algorithms specifically tuned to particular hardware and application parameters. The code generation process involves the selection of adequate code transformations,…

Performance · Computer Science 2024-08-08 Dominik Ernst , Georg Hager , Markus Holzer , Matthias Knorr , Gerhard Wellein

For multiscale gas flows, kinetic-continuum hybrid method is usually used to balance the computational accuracy and efficiency. However, the kinetic-continuum coupling is not straightforward since the coupled methods are based on different…

Fluid Dynamics · Physics 2015-05-19 Jianping Meng , Yonghao Zhang , Xiaowen Shan

We generalize to three dimensions (3D) a recently developed improved multi-component pseudopotential lattice Boltzmann method and analyze its applicability to simulate flows through realistic porous media. The model is validated and…

Fluid Dynamics · Physics 2022-10-04 M. Sedahmed , R. C. V. Coelho , N. A. M. Araújo , E. M. Wahba , H. A. Warda

With the growing maturity of additive manufacturing, the fabrication of architected or lattice-based metamaterials has become a reality for industrial applications. These materials combine lightweight design with tailored mechanical…

Numerical Analysis · Mathematics 2026-03-12 Clément Guillet , Thibaut Hirschler , Pierre Jolivet , Pablo Antolin , Robin Bouclier

We propose a novel algorithm for efficiently computing a sparse directed adjacency matrix from a group of time series following a causal graph process. Our solution is scalable for both dense and sparse graphs and automatically selects the…

Machine Learning · Statistics 2019-11-19 Théophile Griveau-Billion , Ben Calderhead

Acceleration of deep neural networks to meet a specific latency constraint is essential for their deployment on mobile devices. In this paper, we design an architecture aware latency constrained sparse (ALCS) framework to prune and…

Computer Vision and Pattern Recognition · Computer Science 2021-09-02 Tianli Zhao , Qinghao Hu , Xiangyu He , Weixiang Xu , Jiaxing Wang , Cong Leng , Jian Cheng

Several algorithmic meta-theorems on kernelization have appeared in the last years, starting with the result of Bodlaender et al. [FOCS 2009] on graphs of bounded genus, then generalized by Fomin et al. [SODA 2010] to graphs excluding a…

Data Structures and Algorithms · Computer Science 2014-11-21 Valentin Garnero , Christophe Paul , Ignasi Sau , Dimitrios M. Thilikos

We propose a set of benchmarks that specifically targets a major cause of performance degradation in high performance computing platforms: irregular access patterns. These benchmarks are meant to be used to asses the performance of…

Performance · Computer Science 2008-05-27 H. L. A. van der Spek , E. M. Bakker , H. A. G. Wijshoff

Graph algorithms and techniques are increasingly being used in scientific and commercial applications to express relations and explore large data sets. Although conventional or commodity computer architectures, like CPU or GPU, can compute…

Hardware Architecture · Computer Science 2017-07-03 Michel A. Kinsy , Rashmi S. Agrawal , Hien D. Nguyen

The use of reduced and mixed precision computing has gained increasing attention in high-performance computing (HPC) as a means to improve computational efficiency, particularly on modern hardware architectures like GPUs. In this work, we…

Computational Engineering, Finance, and Science · Computer Science 2025-05-28 Bálint Siklósi , Pushpender K. Sharma , David J. Lusher , István Z. Reguly , Neil D. Sandham