English
Related papers

Related papers: Quant-Trim in Practice: Improved Cross-Platform Lo…

200 papers

Quantization-Aware Training (QAT), combined with Knowledge Distillation (KD), holds immense promise for compressing models for edge deployment. However, joint optimization for precision-sensitive image restoration (IR) to recover visual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 S. M. A. Sharif , Abdur Rehman , Seongwan Kim , Jaeho Lee

One of the major bottlenecks in high-resolution Earth Observation (EO) space systems is the downlink between the satellite and the ground. Due to hardware limitations, on-board power limitations or ground-station operation costs, there is a…

Machine Learning · Computer Science 2023-11-21 Cédric Gernigon , Silviu-Ioan Filip , Olivier Sentieys , Clément Coggiola , Mickaël Bruno

A lot of recent progress has been made in ultra low-bit quantization, promising significant improvements in latency, memory footprint and energy consumption on edge devices. Quantization methods such as Learned Step Size Quantization can…

In the complex domain of large language models (LLMs), striking a balance between computational efficiency and maintaining model quality is a formidable challenge. Navigating the inherent limitations of uniform quantization, particularly…

Machine Learning · Computer Science 2023-07-24 Xiaoxia Wu , Zhewei Yao , Yuxiong He

Variational quantum circuits for image classification suffer from barren plateaus, while quantum kernel methods scale quadratically with dataset size. We propose an iterative framework based on Quadratic Unconstrained Binary Optimization…

Quantum Physics · Physics 2026-03-04 Mostafa Atallah , Rebekah Herrman

In the present noisy intermediate scale quantum computing era, there is a critical need to devise methods for the efficient implementation of gate-based variational quantum circuits. This ensures that a range of proposed applications can be…

Quantum Physics · Physics 2024-08-27 Ankit Kulshrestha , Xiaoyuan Liu , Hayato Ushijima-Mwesigwa , Bao Bach , Ilya Safro

Current quantum programming is dominated by low-level, circuit-centric approaches that limit the potential for compiler optimization. This work presents how a high-level programming construct provides compilers with the semantic information…

Quantum Physics · Physics 2025-10-29 Evandro C. R. Rosa , Jerusa Marchi , Eduardo I. Duzzioni , Rafael de Santiago

We introduce a quantization-aware training algorithm that guarantees avoiding numerical overflow when reducing the precision of accumulators during inference. We leverage weight normalization as a means of constraining parameters during…

Machine Learning · Computer Science 2023-02-01 Ian Colbert , Alessandro Pappalardo , Jakoba Petri-Koenig

Quantization-aware training (QAT) has achieved remarkable success in low-bit ($\leq$4-bit) quantization for classification networks. However, when applied to more complex visual tasks such as object detection and image segmentation,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Zhaoyang Wang , Dong Wang

We demonstrate, for the first time, fully quantized training (FQT) of large language models (LLMs) using predominantly 4-bit floating-point (FP4) precision for weights, activations, and gradients on datasets up to 200 billion tokens. We…

Machine Learning · Computer Science 2025-08-12 Brian Chmiel , Maxim Fishman , Ron Banner , Daniel Soudry

The Segment Anything Model (SAM) is a popular vision foundation model; however, its high computational and memory demands make deployment on resource-constrained devices challenging. While Post-Training Quantization (PTQ) is a practical…

Computer Vision and Pattern Recognition · Computer Science 2025-05-09 Navin Ranjan , Andreas Savakis

Circuit cutting decomposes a large quantum circuit into smaller subcircuits whose outputs are classically reconstructed to recover original expectation values. While prior work characterises cutting overhead via subcircuit counts and…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-07 Prabhjot Singh , Adel N. Toosi , Rajkumar Buyya

Quantum bits have technological imperfections. Additionally, the capacity of a component that can be implemented feasibly is limited. Therefore, distributed quantum computation is required to scale up quantum computers. This dissertation…

Quantum Physics · Physics 2017-04-11 Shota Nagayama

Convolutional Neural Networks (CNNs) have proven to be a powerful state-of-the-art method for image classification tasks. One drawback however is the high computational complexity and high memory consumption of CNNs which makes them…

Computer Vision and Pattern Recognition · Computer Science 2021-02-04 Rishabh Goyal , Joaquin Vanschoren , Victor van Acht , Stephan Nijssen

As supervised fine-tuning (SFT) evolves from a lightweight post-training step into a compute-intensive phase rivaling mid-training in scale, data efficiency has become critical for aligning large language models (LLMs) under tight budgets.…

Computation and Language · Computer Science 2026-02-04 Shaobo Wang , Jiaming Wang , Jiajun Zhang , Cong Wang , Yue Min , Zichen Wen , Xingzhang Ren , Fei Huang , Huiqiang Jiang , Junyang Lin , Dayiheng Liu , Linfeng Zhang

Quantization is essential for reducing the computational cost and memory usage of deep neural networks, enabling efficient inference on low-precision hardware. Despite the growing adoption of uniform and floating-point quantization schemes,…

Machine Learning · Statistics 2026-05-19 Mehmet Aktukmak , Daniel Huang , Ke Ding

The deployment of deep neural networks on edge devices is a challenging task due to the increasing complexity of state-of-the-art models, requiring efforts to reduce model size and inference latency. Recent studies explore models operating…

Machine Learning · Computer Science 2025-06-16 Jinhee Kim , Seoyeon Yoon , Taeho Lee , Joo Chan Lee , Kang Eun Jeon , Jong Hwan Ko

Quantization is a popular technique that $transforms$ the parameter representation of a neural network from floating-point numbers into lower-precision ones ($e.g.$, 8-bit integers). It reduces the memory footprint and the computational…

Machine Learning · Computer Science 2021-11-12 Sanghyun Hong , Michael-Andrei Panaitescu-Liess , Yiğitcan Kaya , Tudor Dumitraş

A fault-tolerant quantum computation requires an efficient means to detect and correct errors that accumulate in encoded quantum information. In the context of machine learning, neural networks are a promising new approach to quantum error…

Quantum Physics · Physics 2018-02-01 P. Baireuther , T. E. O'Brien , B. Tarasinski , C. W. J. Beenakker

Designing quantum processors is a complex task that demands advanced verification methods to ensure their correct functionality. However, traditional methods of comprehensively verifying quantum devices, such as quantum process tomography,…

Quantum Physics · Physics 2025-08-04 Keren Li , Peng Yan , Hanru Jiang , Nengkun Yu