中文
相关论文

相关论文: JAQ: Joint Efficient Architecture Design and Low-B…

200 篇论文

Mixed-precision quantization, where a deep neural network's layers are quantized to different precisions, offers the opportunity to optimize the trade-offs between model size, latency, and statistical accuracy beyond what can be achieved…

机器学习 · 计算机科学 2023-07-07 Georg Rutishauser , Francesco Conti , Luca Benini

The increasing spread of artificial neural networks does not stop at ultralow-power edge devices. However, these very often have high computational demand and require specialized hardware accelerators to ensure the design meets power and…

Inference for state-of-the-art deep neural networks is computationally expensive, making them difficult to deploy on constrained hardware environments. An efficient way to reduce this complexity is to quantize the weight parameters and/or…

计算机视觉与模式识别 · 计算机科学 2018-07-03 Julian Faraone , Nicholas Fraser , Michaela Blott , Philip H. W. Leong

The resource requirements of deep neural networks (DNNs) pose significant challenges to their deployment on edge devices. Common approaches to address this issue are pruning and mixed-precision quantization, which lead to latency and memory…

Noisy, Intermediate Scale Quantum (NISQ) computers have reached the point where they can show the potential for quantum advantage over classical computing. Unfortunately, NISQ machines introduce sufficient noise that even for moderate size…

量子物理 · 物理学 2025-04-22 Evan McKinney , Mingkang Xia , Chao Zhou , Pinlei Lu , Michael Hatridge , Alex K. Jones

Noisy Intermediate-Scale Quantum Computing (NISQ) has dominated headlines in recent years, with the longer-term vision of Fault-Tolerant Quantum Computation (FTQC) offering significant potential albeit at currently intractable resource…

Post-Training Quantization (PTQ) and Quantization-Aware Training (QAT) represent two mainstream model quantization approaches. However, PTQ often leads to unacceptable performance degradation in quantized models, while QAT imposes…

计算机视觉与模式识别 · 计算机科学 2025-08-18 Xinhao Wang , Zhiwei Lin , Zhongyu Xia , Yongtao Wang

The development of edge computing places critical demands on energy-efficient model deployment for multiple-input multiple-output (MIMO) detection tasks. Deploying deep unfolding models such as PGD-Nets and ADMM-Nets into…

机器学习 · 计算机科学 2025-05-20 Zeyi Ren , Jingreng Lei , Yichen Jin , Ermo Hua , Qingfeng Lin , Chen Zhang , Bowen Zhou , Yik-Chung Wu

Large language models with billions of parameters are often over-provisioned: many layers contribute little unique information yet dominate the memory and energy footprint during inference. We present LieQ Layer-wise information…

机器学习 · 计算机科学 2025-12-30 He Xiao , Qingyao Yang , Dirui Xie , Wendong Xu , Zunhai Su , Runming yang , Wenyong Zhou , Haobo Liu , Zhengwu Liu , Ngai Wong

Model size and inference speed/power have become a major challenge in the deployment of Neural Networks for many applications. A promising approach to address these problems is quantization. However, uniformly quantizing a model to ultra…

计算机视觉与模式识别 · 计算机科学 2020-03-29 Zhen Dong , Zhewei Yao , Amir Gholami , Michael Mahoney , Kurt Keutzer

The exponentially large discrete search space in mixed-precision quantization (MPQ) makes it hard to determine the optimal bit-width for each layer. Previous works usually resort to iterative search methods on the training set, which…

机器学习 · 计算机科学 2023-03-07 Chen Tang , Kai Ouyang , Zhi Wang , Yifei Zhu , Yaowei Wang , Wen Ji , Wenwu Zhu

The development of quantum algorithms and their practical applications currently relies heavily on the efficient design, compilation, and optimization of quantum circuits. In particular, parametrized quantum circuits (PQCs), which serve as…

量子物理 · 物理学 2025-10-14 Darya Martyniuk , Johannes Jung , Daniel Barta , Adrian Paschke

The use of quantum processing units (QPUs) promises speed-ups for solving computational problems. Yet, current devices are limited by the number of qubits and suffer from significant imperfections, which prevents achieving quantum…

量子物理 · 物理学 2023-06-08 Hila Safi , Karen Wintersperger , Wolfgang Mauerer

Quality-Diversity (QD) optimization algorithms are a well-known approach to generate large collections of diverse and high-quality solutions. However, derived from evolutionary computation, QD algorithms are population-based methods which…

神经与进化计算 · 计算机科学 2022-10-11 Bryan Lim , Maxime Allard , Luca Grillotti , Antoine Cully

Quantum computing has made significant progress in recent years, attracting immense interest not only in research laboratories but also in various industries. However, the application of quantum computing to solve real-world problems is…

量子物理 · 物理学 2025-05-26 Darya Martyniuk , Johannes Jung , Adrian Paschke

A massive gap exists between current quantum computing (QC) prototypes, and the size and scale required for many proposed QC algorithms. Current QC implementations are prone to noise and variability which affect their reliability, and yet…

Current quantum neural networks suffer from extreme sensitivity to both adversarial perturbations and hardware noise, creating a significant barrier to real-world deployment. Existing robustness techniques typically sacrifice clean accuracy…

量子物理 · 物理学 2026-01-27 Mohamed Afane , Quanjiang Long , Haoting Shen , Ying Mao , Junaid Farooq , Ying Wang , Juntao Chen

As the machine learning and systems communities strive to achieve higher energy-efficiency through custom deep neural network (DNN) accelerators, varied bit precision or quantization levels, there is a need for design space exploration…

硬件体系结构 · 计算机科学 2022-05-27 Ahmet Inci , Siri Garudanagiri Virupaksha , Aman Jain , Venkata Vivek Thallam , Ruizhou Ding , Diana Marculescu

Utilising quantum computing technology to enhance artificial intelligence systems is expected to improve training and inference times, increase robustness against noise and adversarial attacks, and reduce the number of parameters without…

软件工程 · 计算机科学 2024-12-18 Mykhailo Klymenko , Thong Hoang , Xiwei Xu , Zhenchang Xing , Muhammad Usman , Qinghua Lu , Liming Zhu

The rapid scaling of Large Language Models (LLMs) elevates inference costs and compounds substantial deployment barriers. While quantization to 8 or 4 bits mitigates this, sub-3-bit methods face severe accuracy, scalability, and efficiency…