English
Related papers

Related papers: Trade-off between Gradient Measurement Efficiency …

200 papers

Quantizing deep networks with adaptive bit-widths is a promising technique for efficient inference across many devices and resource constraints. In contrast to static methods that repeat the quantization process and train different models…

Computer Vision and Pattern Recognition · Computer Science 2021-09-20 Ximeng Sun , Rameswar Panda , Chun-Fu Chen , Naigang Wang , Bowen Pan , Kailash Gopalakrishnan , Aude Oliva , Rogerio Feris , Kate Saenko

Deep neural networks (NNs) encounter scalability limitations when confronted with a vast array of neurons, thereby constraining their achievable network depth. To address this challenge, we propose an integration of tensor networks (TN)…

Disordered Systems and Neural Networks · Physics 2024-08-20 Saeed S. Jahromi , Roman Orus

Spiking neural networks (SNNs) offer inherent energy efficiency due to their event-driven computation model, making them promising for edge AI deployment. However, their practical adoption is limited by the computational overhead of deep…

Machine Learning · Computer Science 2026-03-17 Parth Patne , Mahdi Taheri , Ali Mahani , Maksim Jenihhin , Reza Mahani , Christian Herglotz

Spiking neural networks (SNNs) represent a promising approach in machine learning, combining the hierarchical learning capabilities of deep neural networks with the energy efficiency of spike-based computations. Traditional end-to-end…

Neural and Evolutionary Computing · Computer Science 2024-11-12 Ruyin Wan , Qian Zhang , George Em Karniadakis

Deep learning algorithms achieve high classification accuracy at the expense of significant computation cost. In order to reduce this cost, several quantization schemes have gained attention recently with some focusing on weight…

Computer Vision and Pattern Recognition · Computer Science 2018-07-19 Jungwook Choi , Pierce I-Jen Chuang , Zhuo Wang , Swagath Venkataramani , Vijayalakshmi Srinivasan , Kailash Gopalakrishnan

Variational quantum algorithms (VQAs) face an inherent trade-off between expressivity and trainability: deeper circuits can represent richer states but suffer from noise accumulation and barren plateaus, while shallow circuits remain…

Quantum Physics · Physics 2025-10-31 Shaojun Wu , Shan Jin , Abolfazl Bayat , Xiaoting Wang

Privacy-preserving training on sensitive data commonly relies on differentially private stochastic optimization with gradient clipping and Gaussian noise. The clipping threshold is a critical control knob: if set too small, systematic…

Machine Learning · Computer Science 2026-02-12 Mohammad Partohaghighi , Roummel Marcia , Bruce J. West , YangQuan Chen

The deployment of deep neural networks on resource-constrained devices necessitates effective model com- pression strategies that judiciously balance the reduction of model size with the preservation of performance. This study introduces a…

Machine Learning · Computer Science 2025-05-02 Mohammad Zbeeb , Mariam Salman , Mohammad Bazzi , Ammar Mohanna

Deep neural network (DNN) deployment has been confined to larger hardware devices due to their expensive computational requirements. This challenge has recently reached another scale with the emergence of large language models (LLMs). In…

Machine Learning · Computer Science 2023-08-11 Edouard Yvinec , Arnaud Dapogny , Kevin Bailly

Deep learning methods have established a significant place in image classification. While prior research has focused on enhancing final outcomes, the opaque nature of the decision-making process in these models remains a concern for…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Elmira Mousa Rezabeyk , Salar Beigzad , Yasin Hamzavi , Mohsen Bagheritabar , Seyedeh Sogol Mirikhoozani

Variational quantum circuits (VQCs) hold promise for quantum machine learning but face challenges in expressivity, trainability, and noise resilience. We propose VQC-MLPNet, a hybrid architecture where a VQC generates the first-layer…

Quantum Physics · Physics 2025-11-06 Jun Qi , Chao-Han Yang , Pin-Yu Chen , Min-Hsiu Hsieh

Recent advancements in QML and SNNs have generated considerable excitement, promising exponential speedups and brain-like energy efficiency to revolutionize AI. However, this paper argues that they are unlikely to displace DNNs in the near…

Neural and Evolutionary Computing · Computer Science 2025-10-13 Takehiro Ishikawa

Quantum computing requires the optimization of control pulses to achieve high-fidelity quantum gates. We propose a machine learning-based protocol to address the challenges of evaluating gradients and modeling complex system dynamics. By…

Quantum Physics · Physics 2026-01-27 Paul Surrey , Julian D. Teske , Tobias Hangleiter , Hendrik Bluhm , Pascal Cerfontaine

With the rise of deep neural networks, the challenge of explaining the predictions of these networks has become increasingly recognized. While many methods for explaining the decisions of deep neural networks exist, there is currently no…

Machine Learning · Computer Science 2022-07-13 Ian E. Nielsen , Dimah Dera , Ghulam Rasool , Nidhal Bouaynaya , Ravi P. Ramachandran

Deep learning for distribution grid optimization can be advocated as a promising solution for near-optimal yet timely inverter dispatch. The principle is to train a deep neural network (DNN) to predict the solutions of an optimal power flow…

Optimization and Control · Mathematics 2020-07-09 Manish K. Singh , Sarthak Gupta , Vassilis Kekatos , Guido Cavraro , Andrey Bernstein

Deep neural networks (DNN) have shown superior performance in a variety of tasks. As they rapidly evolve, their escalating computation and memory demands make it challenging to deploy them on resource-constrained edge devices. Though…

Machine Learning · Computer Science 2021-09-07 Jiaqi Gu , Hanqing Zhu , Chenghao Feng , Mingjie Liu , Zixuan Jiang , Ray T. Chen , David Z. Pan

Modern neural networks are often quite wide, causing large memory and computation costs. It is thus of great interest to train a narrower network. However, training narrow neural nets remains a challenging task. We ask two theoretical…

Machine Learning · Computer Science 2022-10-24 Jiawei Zhang , Yushun Zhang , Mingyi Hong , Ruoyu Sun , Zhi-Quan Luo

Parallel implementations of stochastic gradient descent (SGD) have received significant research attention, thanks to excellent scalability properties of this algorithm, and to its efficiency in the context of training deep neural networks.…

Machine Learning · Computer Science 2017-12-07 Dan Alistarh , Demjan Grubic , Jerry Li , Ryota Tomioka , Milan Vojnovic

Achieving both high precision and large dynamic range remains a central challenge in quantum metrology, as improving local sensitivity typically reduces the unambiguous estimation range. Variational quantum interferometers enhance precision…

Quantum Physics · Physics 2026-05-26 Qingchuan Yang , Xianing Feng , Lianfu Wei

Quantum Machine Learning (QML) is considered to be one of the most promising applications of near term quantum devices. However, the optimization of quantum machine learning models presents numerous challenges arising from the imperfections…

Machine Learning · Computer Science 2022-05-17 Owen Lockwood