English
Related papers

Related papers: ADELIA: Automatic Differentiation for Efficient La…

200 papers

Transformer-based models have unlocked a plethora of powerful intelligent applications at the edge, such as voice assistant in smart home. Traditional deployment approaches offload the inference workloads to the remote cloud server, which…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-28 Shengyuan Ye , Jiangsu Du , Liekang Zeng , Wenzhong Ou , Xiaowen Chu , Yutong Lu , Xu Chen

We introduce latency-aware network acceleration (LANA) - an approach that builds on neural architecture search techniques and teacher-student distillation to accelerate neural networks. LANA consists of two phases: in the first phase, it…

Computer Vision and Pattern Recognition · Computer Science 2021-11-19 Pavlo Molchanov , Jimmy Hall , Hongxu Yin , Jan Kautz , Nicolo Fusi , Arash Vahdat

The goal of phylodynamics, an area on the intersection of phylogenetics and population genetics, is to reconstruct population size dynamics from genetic data. Recently, a series of nonparametric Bayesian methods have been proposed for such…

Applications · Statistics 2012-10-19 Julia A. Palacios , Vladimir N. Minin

Automatic differentiation (AD) is a set of techniques that systematically applies the chain rule to compute the gradients of functions without requiring human intervention. Although the fundamentals of this technology were established…

Machine Learning · Computer Science 2025-09-03 Afif Boudaoud , Alexandru Calotoiu , Marcin Copik , Torsten Hoefler

Inverse problems constrained by partial differential equations (PDEs) play a critical role in model development and calibration. In many applications, there are multiple uncertain parameters in a model that must be estimated. However, high…

Numerical Analysis · Mathematics 2022-10-27 Joseph Hart , Bart van Bloemen Waanders

Vision-Language-Action (VLA) models have recently demonstrated impressive capabilities across various embodied AI tasks. While deploying VLA models on real-world robots imposes strict real-time inference constraints, the inference…

Robotics · Computer Science 2026-02-23 Wenqi Jiang , Jason Clemons , Karu Sankaralingam , Christos Kozyrakis

The increasing scale and complexity of large language models (LLMs) pose significant inference latency challenges, primarily due to their autoregressive decoding paradigm characterized by the sequential nature of next-token prediction. By…

Computation and Language · Computer Science 2025-08-15 Keyu Chen , Zhifeng Shen , Daohai Yu , Haoqian Wu , Wei Wen , Jianfeng He , Ruizhi Qiao , Xing Sun

The inverse design of nonlocal metasurfaces requires the precise optimization of lattice geometry to engineer spatial dispersion and high-Q resonances. However, gradient-based optimization is frequently bottle-necked by the evaluation of…

Optics · Physics 2026-03-05 Mingcan Qin , Yifeng Qin

We present two approximate Bayesian inference methods for parameter estimation in partial differential equation (PDE) models with space-dependent and state-dependent parameters. We demonstrate that these methods provide accurate and…

Methodology · Statistics 2019-09-04 David A. Barajas-Solano , Alexandre M. Tartakovsky

This paper proposes a two-stage estimation approach for a spatial misalignment scenario that is motivated by the epidemiological problem of linking pollutant exposures and health outcomes. We use the integrated nested Laplace approximation…

Methodology · Statistics 2022-07-21 Stephen Jun Villejo , Janine B Illian , Ben Swallow

This paper presents a new method for anomaly detection in automated systems with time and compute sensitive requirements, such as autonomous driving, with unparalleled efficiency. As systems like autonomous driving become increasingly…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Andrew Gao , Jun Liu

Deep learning inference is increasingly run at the edge. As the programming and system stack support becomes mature, it enables acceleration opportunities within a mobile system, where the system performance envelope is scaled up with a…

Machine Learning · Computer Science 2020-05-07 Young Geun Kim , Carole-Jean Wu

Efficient Bayesian inference remains a computational challenge in hierarchical models. Simulation-based approaches such as Markov Chain Monte Carlo methods are still popular but have a large computational cost. When dealing with the large…

Computation · Statistics 2021-12-07 Cristian Chiuchiolo , Janet van Niekerk , Haavard Rue

The stochastic partial differential equation (SPDE) approach is widely used for modeling large spatial datasets. It is based on representing a Gaussian random field $u$ on $\mathbb{R}^d$ as the solution of an elliptic SPDE $L^\beta u =…

Methodology · Statistics 2023-07-31 David Bolin , Alexandre B. Simas , Zhen Xiong

Energy efficiency is an essential requirement for all contemporary computing systems. We thus need tools to measure the energy consumption of computing systems and to understand how workloads affect it. Significant recent research effort…

Performance · Computer Science 2016-11-16 Lev Mukhanov , Dimitrios S. Nikolopoulos , Bronis R. de Supinski

The escalating adoption of diffusion models for applications such as image generation demands efficient parallel inference techniques to manage their substantial computational cost. However, existing diffusion parallelism inference schemes…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-16 Han Liang , Jiahui Zhou , Zicheng Zhou , Xiaoxi Zhang , Xu Chen

Deploying LLM agents at scale typically requires choosing between quality and cost. Existing cost-reduction approaches fail to preserve agility: the ability to iterate rapidly without human time bottlenecks. Prompt engineering is brittle…

Machine Learning · Computer Science 2026-04-21 Vishnu Sarukkai , Asanshay Gupta , James Hong , Michaël Gharbi , Kayvon Fatahalian

Coming up with Bayesian models for spatial data is easy, but performing inference with them can be challenging. Writing fast inference code for a complex spatial model with realistically-sized datasets from scratch is time-consuming, and if…

Artificial intelligence (AI) has transformed digital pathology by enabling biomarker prediction from high-resolution whole-slide images (WSIs). However, current methods are computationally inefficient, processing thousands of redundant…

Logistic Gaussian process (LGP) priors provide a flexible alternative for modelling unknown densities. The smoothness properties of the density estimates can be controlled through the prior covariance structure of the LGP, but the challenge…

Computation · Statistics 2016-11-01 Jaakko Riihimäki , Aki Vehtari