English
Related papers

Related papers: SNAP-UQ: Self-supervised Next-Activation Predictio…

200 papers

The safety-critical nature of autonomous vehicle (AV) operation necessitates development of task-relevant algorithms that can reason about safety at the system level and not just at the component level. To reason about the impact of a…

Training deep neural networks using backpropagation is very memory and computationally intensive. This makes it difficult to run on-device learning or fine-tune neural networks on tiny, embedded devices such as low-power micro-controller…

Machine Learning · Computer Science 2023-08-21 Marcus Rüb , Daniel Maier , Daniel Mueller-Gritschneder , Axel Sikora

Uncertainty quantification (UQ) is crucial in computational fluid dynamics to assess the reliability and robustness of simulations, given the uncertainties in input parameters. OpenLB is an open-source lattice Boltzmann method library…

Stochasticity plays a significant role in the low-power operation of a biological neural network. In an artificial neural network (ANN), stochasticity also contributes to critical functions such as the uncertainty quantification (UQ) for…

Applied Physics · Physics 2023-10-17 Cen Wang , Guang Zeng , Xinyu Wen , Yuhui He , Wei Luo , Shiwei Chen , Shiheng Liang , Yue Zhang

We introduce a physics-informed Bayesian Neural Network (BNN) with flow approximated posteriors using multiplicative normalizing flows (MNF) for detailed uncertainty quantification (UQ) at the physics event-level. Our method is capable of…

Machine Learning · Computer Science 2023-10-05 Cristiano Fanelli , James Giroux

Multifidelity forward uncertainty quantification (UQ) problems often involve multiple quantities of interest and heterogeneous models (e.g., different grids, equations, dimensions, physics, surrogate and reduced-order models). While…

Numerical Analysis · Mathematics 2023-06-26 M. Croci , K. E. Willcox , S. J. Wright

A new algorithm for incremental learning in the context of Tiny Machine learning (TinyML) is presented, which is optimized for low-performance and energy efficient embedded devices. TinyML is an emerging field that deploys machine learning…

Machine Learning · Computer Science 2024-09-12 Marcus Rüb , Philipp Tuchel , Axel Sikora , Daniel Mueller-Gritschneder

Machine learning interatomic potentials (MLIPs) enable accurate atomistic modelling, but reliable uncertainty quantification (UQ) remains elusive. In this study, we investigate two UQ strategies, ensemble learning and D-optimality, within…

Materials Science · Physics 2025-08-06 Fei Shuang , Zixiong Wei , Kai Liu , Wei Gao , Poulumi Dey

Tiny deep learning on microcontroller units (MCUs) is challenging due to the limited memory size. We find that the memory bottleneck is due to the imbalanced memory distribution in convolutional neural network (CNN) designs: the first…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Ji Lin , Wei-Ming Chen , Han Cai , Chuang Gan , Song Han

Structural Health Monitoring (SHM) ensures the safety and longevity of infrastructure by enabling timely damage detection. Vision-based crack detection, combined with UAVs, addresses the limitations of traditional sensor-based SHM methods…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Yuxuan Zhang , Luciano Sebastian Martinez-Rau , Quynh Nguyen Phuong Vu , Bengt Oelmann , Sebastian Bader

Self-supervised monocular depth estimation methods aim to be used in critical applications such as autonomous vehicles for environment analysis. To circumvent the potential imperfections of these approaches, a quantification of the…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Rémi Marsal , Florian Chabot , Angelique Loesch , William Grolleau , Hichem Sahbi

A wide range of sustainability and grid-integration strategies depend on workload shifting, which aligns the timing of energy consumption with external signals such as grid curtailment events, carbon intensity, or time-of-use electricity…

Data Structures and Algorithms · Computer Science 2025-10-01 Ezra Johnson , Adam Lechowicz , Mohammad Hajiesmaili

Operator learning is a recently developed generalization of regression to mappings between functions. It promises to drastically reduce expensive numerical integration of PDEs to fast evaluations of mappings between functional states of a…

Machine Learning · Computer Science 2025-12-23 Tian Yu Yen , Reese E. Jones , Ravi G. Patel

Deploying high-performance object detectors on TinyML platforms poses significant challenges due to tight hardware constraints and the modular complexity of modern detection pipelines. Neural Architecture Search (NAS) offers a path toward…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Tony Tran , Qin Lin , Bin Hu

Deep spiking neural networks (SNNs) have emerged as a potential alternative to traditional deep learning frameworks, due to their promise to provide increased compute efficiency on event-driven neuromorphic hardware. However, to perform…

Neural and Evolutionary Computing · Computer Science 2021-07-28 Souvik Kundu , Gourav Datta , Massoud Pedram , Peter A. Beerel

Static IR drop analysis is a fundamental and critical task in chip design since the IR drop will significantly affect the design's functionality, performance, and reliability. However, the process of IR drop analysis can be time-consuming,…

Hardware Architecture · Computer Science 2024-11-19 Yilu Chen , Zhijie Cai , Min Wei , Zhifeng Lin , Jianli Chen

Single Flux Quantum (SFQ) technology represents a groundbreaking advancement in computational efficiency and ultra-high-speed neuromorphic processing. The key features of SFQ technology, particularly data representation, transmission, and…

Emerging Technologies · Computer Science 2024-03-06 Mustafa Altay Karamuftuoglu , Beyza Zeynep Ucpinar , Sasan Razmkhah , Mehdi Kamal , Massoud Pedram

Mixed-precision quantization (MPQ) is crucial for deploying deep neural networks on resource-constrained devices, but finding the optimal bit-width for each layer represents a complex combinatorial optimization problem. Current…

Machine Learning · Computer Science 2026-03-24 Mehmet Emre Akbulut , Hazem Hesham Yousef Shalby , Fabrizio Pittorino , Manuel Roveri

Tiny Machine Learning (TinyML) enables efficient, lowcost, and privacy preserving machine learning inference directly on microcontroller units (MCUs) connected to sensors. Optimizing models for these constrained environments is crucial.…

Machine Learning · Computer Science 2024-09-18 Riya Samanta , Bidyut Saha , Soumya K. Ghosh , Ram Babu Roy

How can we accurately quantize a pre-trained model without any data? Quantization algorithms are widely used for deploying neural networks on resource-constrained edge devices. Zero-shot Quantization (ZSQ) addresses the crucial and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Minjun Kim , Jongjin Kim , U Kang