English
Related papers

Related papers: JAQ: Joint Efficient Architecture Design and Low-B…

200 papers

Neural architecture search (NAS) is a powerful approach for automating model design, but existing methods often optimize for accuracy alone or rely on proxy metrics such as bit operations (BOPs) that correlate poorly with hardware cost.…

Machine Learning · Computer Science 2026-05-18 Jason Weitz , Dmitri Demler , Benjamin Hawks , Aaron Wang , Nhan Tran , Javier Duarte

Low-bit post-training quantization (PTQ) is a practical route to deploy reasoning-capable LLMs under tight memory and latency budgets, yet it can markedly impair mathematical reasoning (drops up to 69.81% in our harder settings). We address…

Machine Learning · Computer Science 2026-01-21 Zhen Li , Yupeng Su , Songmiao Wang , Runming Yang , Congkai Xie , Aofan Liu , Ming Li , Jiannong Cao , Yuan Xie , Ngai Wong , Hongxia Yang

This paper introduces MARCO (Multi-Agent Reinforcement learning with Conformal Optimization), a novel hardware-aware framework for efficient neural architecture search (NAS) targeting resource-constrained edge devices. By significantly…

Machine Learning · Computer Science 2025-06-17 Arya Fayyazi , Mehdi Kamal , Massoud Pedram

Ternary weight quantization (e.g., BitNet b1.58) offers a promising path to mitigate the memory bandwidth bottleneck in Large Language Model (LLM) inference. However, conventional compute platforms lack native support for ternary-weight…

Hardware Architecture · Computer Science 2026-04-29 Robin Geens , Joran Heldens , Joren Dumoulin , Marian Verhelst

Quantum computing (QC) technologies have reached a second renaissance in the last decade. Some fully programmable QC devices have been built based on superconducting or ion trap technologies. Although different quantum technologies have…

Quantum Physics · Physics 2020-01-22 Yu Zhang , Haowei Deng , Quanxi Li

Most neural network quantization methods apply uniform bit precision across spatial regions, disregarding the heterogeneous complexity inherent in visual data. This paper introduces MCAQ-YOLO, a practical framework for tile-wise spatial…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Yoonjae Seo , Ermal Elbasani , Jaehong Lee

We develop an automated pipeline to streamline neural architecture codesign for fast, real-time Bragg peak analysis in high-energy diffraction microscopy. Traditional approaches, notably pseudo-Voigt fitting, demand significant…

Machine Learning · Computer Science 2023-12-13 Luke McDermott , Jason Weitz , Dmitri Demler , Daniel Cummings , Nhan Tran , Javier Duarte

Critical decision-making issues in science, engineering, and industry are based on combinatorial optimization; however, its application is inherently limited by the NP-hard nature of the problem. A specialized paradigm of analogue quantum…

Quantum Physics · Physics 2026-02-04 Rudraksh Sharma , Ravi Katukam , Arjun Nagulapally

Hardware and neural architecture co-search that automatically generates Artificial Intelligence (AI) solutions from a given dataset is promising to promote AI democratization; however, the amount of time that is required by current…

Machine Learning · Computer Science 2020-07-20 Weiwen Jiang , Lei Yang , Sakyasingha Dasgupta , Jingtong Hu , Yiyu Shi

The rapidly evolving field of Artificial Intelligence necessitates automated approaches to co-design neural network architecture and neural accelerators to maximize system efficiency and address productivity challenges. To enable joint…

Post-training quantization (PTQ) reduces a model's memory footprint by mapping full precision weights into low bit weights without costly retraining, but can degrade its downstream performance especially in low 2- to 3-bit settings. We…

Machine Learning · Computer Science 2025-07-18 Hanqi Xiao , Yi-Lin Sung , Elias Stengel-Eskin , Mohit Bansal

Recent progress on concatenated codes, especially many-hypercube codes, achieves unprecedented space efficiency. Yet two critical challenges persist in practice. First, these codes lack efficient implementations of addressable logical…

Hardware Architecture · Computer Science 2025-08-11 Pengyu Liu , Mingkuan Xu , Hengyun Zhou , Hanrui Wang , Umut A. Acar , Yunong Shi

Mixed-precision quantization (MPQ) is crucial for deploying deep neural networks on resource-constrained devices, but finding the optimal bit-width for each layer represents a complex combinatorial optimization problem. Current…

Machine Learning · Computer Science 2026-03-24 Mehmet Emre Akbulut , Hazem Hesham Yousef Shalby , Fabrizio Pittorino , Manuel Roveri

We present a differentiable joint pruning and quantization (DJPQ) scheme. We frame neural network compression as a joint gradient-based optimization problem, trading off between model pruning and quantization automatically for hardware…

Machine Learning · Computer Science 2021-04-06 Ying Wang , Yadong Lu , Tijmen Blankevoort

The rapid proliferation of computing domains relying on Internet of Things (IoT) devices has created a pressing need for efficient and accurate deep-learning (DL) models that can run on low-power devices. However, traditional DL models tend…

The Segment Anything Model (SAM) has revolutionized image and video segmentation with its powerful zero-shot capabilities. However, its massive parameter scale and high computational demands hinder efficient deployment on…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Wenlun Zhang , Yunshan Zhong , Weiqi Yan , Shengchuan Zhang , Shimpei Ando , Kentaro Yoshioka

Quantization-aware training (QAT) is an effective method to drastically reduce the memory footprint of LLMs while keeping performance degradation at an acceptable level. However, the optimal choice of quantization format and bit-width…

Machine Learning · Computer Science 2026-02-18 Sohir Maskey , Constantin Eichenberg , Johannes Messner , Douglas Orr

Variational quantum algorithms (VQAs) are expected to be a path to quantum advantages on noisy intermediate-scale quantum devices. However, both empirical and theoretical results exhibit that the deployed ansatz heavily affects the…

Quantum Physics · Physics 2022-05-31 Yuxuan Du , Tao Huang , Shan You , Min-Hsiu Hsieh , Dacheng Tao

Quantum algorithms require accurate representations of electronic states on a quantum device, yet the approximation of electronic wave functions for strongly correlated systems remains a profound theoretical challenge, with existing methods…

Quantum Physics · Physics 2025-04-29 Dipanjali Halder , Dibyendu Mondal , Rahul Maitra

Despite the success of Quantum Neural Networks (QNNs) in decision-making systems, their fairness remains unexplored, as the focus primarily lies on accuracy. This work conducts a design space exploration, unveiling QNN unfairness, and…

Quantum Physics · Physics 2024-03-19 Ruhan Wang , Fahiz Baba-Yara , Fan Chen