Related papers: XLB: A differentiable massively parallel lattice B…

Pipeline Parallelism (PP) serves as a crucial technique for training Large Language Models (LLMs), owing to its capability to alleviate memory pressure from model states with relatively low communication overhead. However, in long-context…

Recent advancements in large language models (LLMs) have shown very impressive capabilities in code generation across many programming languages. However, even state-of-the-art LLMs generate programs that contains syntactic errors and fail…

Deep learning software demands reliability and performance. However, many of the existing deep learning frameworks are software libraries that act as an unsafe DSL in Python and a computation graph interpreter. We present DLVM, a design and…

Lattice-Boltzmann (LB) simulations are a common tool to numerically estimate the permeability of porous media. For valuable results, the porous structure has to be well resolved resulting in a large computational effort as well as high…

In this paper, we first present a multiple-relaxation-time lattice Boltzmann (MRT-LB) model for one-dimensional diffusion equation where the D1Q3 (three discrete velocities in one-dimensional space) lattice structure is considered. Then…

The concept of linearity plays a central role in both mathematics and computer science, with distinct yet complementary meanings. In mathematics, linearity underpins functions and vector spaces, forming the foundation of linear algebra and…

We propose a quantum algorithm for solving physical problems represented by the lattice Boltzmann formulation. Specifically, we deal with the case of a single phase, incompressible fluid obeying the Bhatnagar-Gross-Krook model. We use the…

We develop a relativistic lattice Boltzmann (LB) model, providing a more accurate description of dissipative phenomena in relativistic hydrodynamics than previously available with existing LB schemes. The procedure applies to the…

NLP Workbench is a web-based platform for text mining that allows non-expert users to obtain semantic understanding of large-scale corpora using state-of-the-art text mining models. The platform is built upon latest pre-trained models and…

Large language models (LLMs) have been a disruptive innovation in recent years, and they play a crucial role in our daily lives due to their ability to understand and generate human-like text. Their capabilities include natural language…

We show that the asymptotic properties of the link-wise artificial compressibility method are not compatible with a correct approximation of fluid properties. We propose to adapt the previous method through a framework suggested by the…

The Lattice Boltzmann Method (LBM) is widely recognized as an efficient algorithm for simulating fluid flows in both single-phase and multi-phase scenarios. In this research, a quantum Carleman Linearization formulation of the Lattice…

Conventional lattice Boltzmann models for the simulation of fluid dynamics are restricted by an error in the stress tensor that is negligible only for vanishing flow velocity and at a singular value of the temperature. To that end, we…

Type inference for dynamic languages like Python is a persistent challenge in software engineering. While large language models (LLMs) have shown promise in code understanding, their type inference capabilities remain underexplored. We…

Distributed, large-scale quantum computing will need architectures that combine matter-based qubits with photonic links, but today's software stacks target either gate-based chips or linear-optical devices in isolation. We introduce Optyx,…

The rapid development of open-source large language models (LLMs) has been truly remarkable. However, the scaling law described in previous literature presents varying conclusions, which casts a dark cloud over scaling LLMs. We delve into…

In this series of studies, we establish homogenized lattice Boltzmann methods (HLBM) for simulating fluid flow through porous media. Our contributions in part I are twofold. First, we assemble the targeted partial differential equation…

Large Language Models (LLMs) deliver strong performance but are difficult to deploy under tight memory and compute constraints. Low-bit post-training quantization (PTQ) is a promising direction; however, it typically relies on calibration…

In the paper we extend the Multiple-Relaxation-Time (MRT) Lattice Boltzmann (LB) model proposed in [Europhys. Lett. \textbf{90}, 54003 (2010)] so that it is suitable also for incompressible flows. To decrease the artificial oscillations,…

Modern LLMs typically require multistage training pipelines to achieve strong downstream performance, with post-training serving as the main interface for adapting open-weight models. We introduce torchtune, a PyTorch-native library…