English
Related papers

Related papers: Sigma-Delta and Distributed Noise-Shaping Quantiza…

200 papers

Feature Transformation (FT) crafts new features from original ones via mathematical operations to enhance dataset expressiveness for downstream models. However, existing FT methods exhibit critical limitations: discrete search struggles…

Machine Learning · Computer Science 2025-05-22 Nanxu Gong , Zijun Li , Sixun Dong , Haoyue Bai , Wangyang Ying , Xinyuan Wang , Yanjie Fu

Diffusion models have demonstrated remarkable performance on vision generation tasks. However, the high computational complexity hinders its wide application on edge devices. Quantization has emerged as a promising technique for inference…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Weilun Feng , Chuanguang Yang , Haotong Qin , Yuqi Li , Xiangqi Li , Zhulin An , Libo Huang , Boyu Diao , Fuzhen Zhuang , Michele Magno , Yongjun Xu , Yingli Tian , Tingwen Huang

We present an extension of many-body downfolding methods to reduce the resources required in the quantum phase estimation (QPE) algorithm. In this paper, we focus on the Schrieffer--Wolff (SW) transformation of the electronic Hamiltonians…

Quantum Physics · Physics 2022-11-22 Karol Kowalski , Nicholas P. Bauman

Consider the following distributed optimization scenario. A worker has access to training data that it uses to compute the gradients while a server decides when to stop iterative computation based on its target accuracy or delay…

Machine Learning · Computer Science 2022-04-28 Chung-Yi Lin , Victoria Kostina , Babak Hassibi

The use of low-bit quantization has emerged as an indispensable technique for enabling the efficient training of large-scale models. Despite its widespread empirical success, a rigorous theoretical understanding of its impact on learning…

Machine Learning · Statistics 2026-02-17 Dechen Zhang , Junwei Su , Difan Zou

Diffusion models excel at generating high-likelihood samples but often require alignment with downstream objectives. Existing fine-tuning methods for diffusion models significantly suffer from reward over-optimization, resulting in…

Machine Learning · Computer Science 2026-03-09 Hyeongyu Kang , Jaewoo Lee , Woocheol Shin , Kiyoung Om , Jinkyoo Park

With a finite amount of measurement data acquired in variational quantum algorithms, the statistical benefits of several optimized numerical estimation schemes, including the scaled parameter-shift (SPS) rule and finite-difference (FD)…

Quantum Physics · Physics 2024-08-07 Yong Siah Teo

We extend the diffusion-map formalism to data sets that are induced by asymmetric kernels. Analytical convergence results of the resulting expansion are proved, and an algorithm is proposed to perform the dimensional reduction. In this work…

Machine Learning · Computer Science 2024-01-24 Alvaro Almeida Gomez , Antonio Silva Neto , Jorge zubelli

We propose using variational quantum algorithms (VQAs) to simulate established quantum algorithms under realistic noise conditions, aiming to surpass the fidelity of theoretical circuits in noisy environments. Focusing on the Quantum…

This study proposes a Quantum Fourier Transform (QFT)-enhanced quantum kernel for short-term time-series forecasting. Each signal is windowed, amplitude-encoded, transformed by a QFT, then passed through a protective rotation layer to avoid…

Machine Learning · Statistics 2025-11-25 Nawfel Mechiche-Alami , Eduardo Rodriguez , Jose M. Cardemil , Enrique Lopez Droguett

The problem of efficient approximation of a linear operator induced by the Gaussian or softmax kernel is often addressed using random features (RFs) which yield an unbiased approximation of the operator's result. Such operators emerge in…

Machine Learning · Computer Science 2023-02-03 Valerii Likhosherstov , Krzysztof Choromanski , Avinava Dubey , Frederick Liu , Tamas Sarlos , Adrian Weller

We introduce a regularization loss based on kernel mean embeddings with rotation-invariant kernels on the hypersphere (also known as dot-product kernels) for self-supervised learning of image representations. Besides being fully competitive…

Computer Vision and Pattern Recognition · Computer Science 2023-03-09 Léon Zheng , Gilles Puy , Elisa Riccietti , Patrick Pérez , Rémi Gribonval

Existing low-bit Microscaling (MX) formats, such as MXFP4, often suffer from substantial accuracy degradation due to the use of a shared scaling factor with the Power-of-Two format. In this work, we explore strategies that introduce minimal…

Hardware Architecture · Computer Science 2026-01-29 Weiming Hu , Zihan Zhang , Haoyan Zhang , Chen Zhang , Cong Guo , Yu Feng , Tianchi Hu , Guanglin Li , Guipeng Hu , Junsong Wang , Jingwen Leng

Quantum processors may enhance machine learning by mapping high-dimensional data onto quantum systems for processing. Conventional feature maps, for encoding data onto a quantum circuit are currently impractical, as the number of entangling…

Quantum Physics · Physics 2026-03-27 Utkarsh Singh , Jean-Frédéric Laprade , Aaron Z. Goldberg , Khabat Heshami

We introduce a novel run-time method for significantly reducing the accuracy loss associated with quantizing BERT-like models to 8-bit integers. Existing methods for quantizing models either modify the training procedure,or they require an…

Computation and Language · Computer Science 2022-11-18 Yousef El-Kurdi , Jerry Quinn , Avirup Sil

The growing demand for machine learning applications in the context of the Internet of Things calls for new approaches to optimize the use of limited compute and memory resources. Despite significant progress that has been made w.r.t.…

Machine Learning · Computer Science 2026-03-06 Karsten Schrödter , Jan Stenkamp , Nina Herrmann , Fabian Gieseke

We introduce a distributed quantum-classical framework that synergizes photonic quantum neural networks (QNNs) with matrix-product-state (MPS) mapping to achieve parameter-efficient training of classical neural networks. By leveraging…

Quantum Physics · Physics 2025-05-14 Kuan-Cheng Chen , Chen-Yu Liu , Yu Shang , Felix Burt , Kin K. Leung

A design flow for {\Delta}{\Sigma} modulators is illustrated, allowing quantization noise to be shaped according to an arbitrary weighting profile. Being based on FIR NTFs, possibly with high order, the flow is best suited for digital…

Information Theory · Computer Science 2013-09-25 Sergio Callegari , Federico Bizzarri

We prove achievability of the recently characterized quadratic Gaussian rate-distortion function (RDF) subject to the constraint that the distortion is uncorrelated to the source. This result is based on shaped dithered lattice quantization…

Information Theory · Computer Science 2008-07-24 Milan S. Derpich , Jan Ostergaard , Daniel E. Quevedo

Quantum neural networks are expected to be a promising application in near-term quantum computing, but face challenges such as vanishing gradients during optimization and limited expressibility by a limited number of qubits and shallow…

Quantum Physics · Physics 2026-04-06 Yoshiaki Kawase