中文
相关论文

相关论文: KLiNQ: Knowledge Distillation-Assisted Lightweight…

200 篇论文

Implicit Neural Representations (INRs) have recently exhibited immense potential in the field of scientific visualization for both data generation and visualization tasks. However, these representations often consist of large multi-layer…

图形学 · 计算机科学 2023-04-11 Qi Wu , David Bauer , Yuyang Chen , Kwan-Liu Ma

There is a growing discrepancy in computer vision between large-scale models that achieve state-of-the-art performance and models that are affordable in practical applications. In this paper we address this issue and significantly bridge…

计算机视觉与模式识别 · 计算机科学 2022-06-22 Lucas Beyer , Xiaohua Zhai , Amélie Royer , Larisa Markeeva , Rohan Anil , Alexander Kolesnikov

With the rapid development of deep learning (DL) in recent years, automatic modulation recognition (AMR) with DL has achieved high accuracy. However, insufficient training signal data in complicated channel environments and large-scale DL…

机器学习 · 计算机科学 2024-01-01 Dongbin Hou , Lixin Li , Wensheng Lin , Junli Liang , Zhu Han

Quantum cloud platforms have scaled hardware capacity but not the abstraction exposed to users: small programs still monopolise entire processors, and existing Quantum Virtual Machine (QVM) designs often rely on fixed, topology-specific…

量子物理 · 物理学 2026-04-02 Shusen Liu , Pascal Jahan Elahi , Ugo Varetto

We present APQ for efficient deep learning inference on resource-constrained hardware. Unlike previous methods that separately search the neural architecture, pruning policy, and quantization policy, we optimize them in a joint manner. To…

机器学习 · 计算机科学 2020-06-16 Tianzhe Wang , Kuan Wang , Han Cai , Ji Lin , Zhijian Liu , Song Han

Despite that current reading comprehension systems have achieved significant advancements, their promising performances are often obtained at the cost of making an ensemble of numerous models. Besides, existing approaches are also…

计算与语言 · 计算机科学 2018-09-18 Minghao Hu , Yuxing Peng , Furu Wei , Zhen Huang , Dongsheng Li , Nan Yang , Ming Zhou

In this work, we propose Mutual Information Maximization Knowledge Distillation (MIMKD). Our method uses a contrastive objective to simultaneously estimate and maximize a lower bound on the mutual information of local and global feature…

计算机视觉与模式识别 · 计算机科学 2023-05-12 Aman Shrivastava , Yanjun Qi , Vicente Ordonez

The development of edge computing places critical demands on energy-efficient model deployment for multiple-input multiple-output (MIMO) detection tasks. Deploying deep unfolding models such as PGD-Nets and ADMM-Nets into…

机器学习 · 计算机科学 2025-05-20 Zeyi Ren , Jingreng Lei , Yichen Jin , Ermo Hua , Qingfeng Lin , Chen Zhang , Bowen Zhou , Yik-Chung Wu

We propose a resource-efficient framework for compressing large language models through knowledge distillation, combined with guided chain-of-thought reinforcement learning. Using Qwen 3B as the teacher and Qwen 0.5B as the student, we…

计算与语言 · 计算机科学 2026-03-17 Alejandro Paredes La Torre , Barbara Flores , Diego Rodriguez

Despite remarkable successes in solving various complex decision-making tasks, training an imitation learning (IL) algorithm with deep neural networks (DNNs) suffers from the high computation burden. In this work, we propose quantum…

量子物理 · 物理学 2023-04-06 Zhihao Cheng , Kaining Zhang , Li Shen , Dacheng Tao

Over the past decade, machine learning techniques have revolutionized how research is done, from designing new materials and predicting their properties to assisting drug discovery to advancing cybersecurity. Recently, we added to this list…

量子物理 · 物理学 2018-10-19 Justyna P. Zwolak , Sandesh S. Kalantre , Xingyao Wu , Stephen Ragole , Jacob M. Taylor

In recent years, Convolutional Neural Networks (CNNs) have enabled ubiquitous image processing applications. As such, CNNs require fast runtime (forward propagation) to process high-resolution visual streams in real time. This is still a…

计算机视觉与模式识别 · 计算机科学 2022-03-23 Jinlin Xiang , Shane Colburn , Arka Majumdar , Eli Shlizerman

Quantum computers are becoming increasingly accessible, and may soon outperform classical computers for useful tasks. However, qubit readout errors remain a significant hurdle to running quantum algorithms on current devices. We present a…

量子物理 · 物理学 2022-02-28 Alistair W. R. Smith , Kiran E. Khosla , Chris N. Self , M. S. Kim

Spiking Neural Networks (SNNs) have emerged as a promising approach for energy-efficient and biologically plausible computation. However, due to limitations in existing training methods and inherent model constraints, SNNs often exhibit a…

人工智能 · 计算机科学 2025-05-19 Tianqing Zhang , Zixin Zhu , Kairong Yu , Hongwei Wang

Deep learning networks have achieved state-of-the-art accuracies on computer vision workloads like image classification and object detection. The performant systems, however, typically involve big models with numerous parameters. Once…

机器学习 · 计算机科学 2017-11-17 Asit Mishra , Debbie Marr

In real applications, different computation-resource devices need different-depth networks (e.g., ResNet-18/34/50) with high-accuracy. Usually, existing methods either design multiple networks and train them independently, or construct…

计算机视觉与模式识别 · 计算机科学 2021-08-11 Qi Zhao , Shuchang Lyu , Zhiwei Zhang , Ting-Bing Xu , Guangliang Cheng

Quantization-aware training (QAT) and Knowledge Distillation (KD) are combined to achieve competitive performance in creating low-bit deep learning models. However, existing works applying KD to QAT require tedious hyper-parameter tuning to…

机器学习 · 计算机科学 2024-03-19 Kaiqi Zhao , Ming Zhao

As quantum computing advances toward fault-tolerance through quantum error correction, modular chiplet architectures have emerged to provide the massive qubit counts required while overcoming fabrication limits of monolithic chips. However,…

量子物理 · 物理学 2026-03-26 Peter Wegmann , Aleksandra Świerkowska , Emmanouil Giortamis , Pramod Bhatotia

Quantum compute is scaling fast, from cloud QPUs to high throughput GPU simulators, making it timely to prototype quantum NLP beyond toy tasks. However, devices remain qubit limited and depth limited, training can be unstable, and classical…

量子物理 · 物理学 2025-10-09 Junhao Chen , Yifan Zhou , Hanqi Jiang , Yi Pan , Yiwei Li , Huaqin Zhao , Wei Zhang , Yingfeng Wang , Tianming Liu

Quantum reservoir computing offers a promising route for time series learning by modelling sequential data via rich quantum dynamics while the only training required happens at the level of a lightweight classical readout. However, studies…

机器学习 · 计算机科学 2026-02-17 Abdallah Aaraba , Soumaya Cherkaoui , Ola Ahmad , Shengrui Wang