English
Related papers

Related papers: SA-DQAS: Self-attention Enhanced Differentiable Qu…

200 papers

Hardware-friendly network quantization (e.g., binary/uniform quantization) can efficiently accelerate the inference and meanwhile reduce memory consumption of the deep neural networks, which is crucial for model deployment on…

Computer Vision and Pattern Recognition · Computer Science 2019-08-15 Ruihao Gong , Xianglong Liu , Shenghu Jiang , Tianxiang Li , Peng Hu , Jiazhen Lin , Fengwei Yu , Junjie Yan

Deep learning has made remarkable progress recently, largely due to the availability of large, well-labeled datasets. However, the training on such datasets elevates costs and computational demands. To address this, various techniques like…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Zhenghao Zhao , Yuzhang Shang , Junyi Wu , Yan Yan

We introduce the reinforcement quantum annealing (RQA) scheme in which an intelligent agent interacts with a quantum annealer that plays the stochastic environment role of learning automata and tries to iteratively find better Ising…

Quantum Physics · Physics 2020-01-03 Ramin Ayanzadeh , Milton Halem , Tim Finin

Semiconductor quantum dot (QD) devices have become central to advancements in spin-based quantum computing. However, the increasing complexity of modern QD devices makes calibration and control -- particularly at elevated temperatures -- a…

While the self-attention mechanism has been widely used in a wide variety of tasks, it has the unfortunate property of a quadratic cost with respect to the input length, which makes it difficult to deal with long inputs. In this paper, we…

Computation and Language · Computer Science 2020-09-30 Xiaoya Li , Yuxian Meng , Mingxin Zhou , Qinghong Han , Fei Wu , Jiwei Li

Trying to solve hard optimisation problems with quantum techniques requires transformations of domain objectives and constraints into formats compatible with a chosen quantum algorithm. This often introduces inefficiencies and overheads…

Quantum Physics · Physics 2026-05-19 Simon Thelen , Wolfgang Mauerer

There is a constant need for high-performing and computationally efficient neural network models for image super-resolution: computationally efficient models can be used via low-capacity devices and reduce carbon footprints. One way to…

Computer Vision and Pattern Recognition · Computer Science 2024-01-11 Egor Shvetsov , Dmitry Osin , Alexey Zaytsev , Ivan Koryakovskiy , Valentin Buchnev , Ilya Trofimov , Evgeny Burnaev

At the core of the Transformer, the softmax normalizes the attention matrix to be right stochastic. Previous research has shown that this often de-stabilizes training and that enforcing the attention matrix to be doubly stochastic (through…

Machine Learning · Computer Science 2025-11-11 Jannis Born , Filip Skogh , Kahn Rhrissorrakrai , Filippo Utro , Nico Wagner , Aleksandros Sobczyk

Circuit cutting enables large quantum circuits to run on small NISQ devices, but it introduces an exponentially high sampling overhead. Here, we present CutVQA, a co-design framework that integrates circuit cutting with quantum architecture…

Quantum Physics · Physics 2026-03-17 Jun Wu , Jicun Li , Jiaqi Yang , Wei Xie , Xiang-Yang Li

While modern text-to-image models excel at prompt-based generation, they often lack the fine-grained control necessary for specific user requirements like spatial layouts or subject appearances. Multi-condition control addresses this, yet…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Chao Zhou , Tianyi Wei , Yiling Chen , Wenbo Zhou , Nenghai Yu

Are quantum advantages in discrete manufacturing achievable in the near term? As manufacturing-relevant NISQ algorithms, we identified Quantum Annealing (QA) and the Quantum Approximate Optimization Algorithm (QAOA) for combinatorial…

Quantum Physics · Physics 2022-09-21 Oxana Shaya

Self-attention mechanisms have achieved great success on a variety of NLP tasks due to its flexibility of capturing dependency between arbitrary positions in a sequence. For problems such as query-based summarization (Qsumm) and knowledge…

Computation and Language · Computer Science 2020-02-19 Yujia Xie , Tianyi Zhou , Yi Mao , Weizhu Chen

Designing effective quantum circuits remains a central challenge in quantum computing, as circuit structure strongly influences expressivity, trainability, and hardware feasibility. Current approaches, whether using manually designed…

Neural and Evolutionary Computing · Computer Science 2026-02-04 Devroop Kar , Daniel Krutz , Travis Desell

The imminent era of error-corrected quantum computing urgently demands robust methods to characterize complex quantum states, even from limited and noisy measurements. We introduce the Quantum Attention Network (QuAN), a versatile classical…

Attention mechanisms have been widely used in Visual Question Answering (VQA) solutions due to their capacity to model deep cross-domain interactions. Analyzing attention maps offers us a perspective to find out limitations of current VQA…

Computer Vision and Pattern Recognition · Computer Science 2018-10-10 Wei Li , Zehuan Yuan , Xiangzhong Fang , Changhu Wang

We present BenchRL-QAS, a unified benchmarking framework for reinforcement learning (RL) in quantum architecture search (QAS) across a spectrum of variational quantum algorithm tasks on 2- to 8-qubit systems. Our study systematically…

Quantum Physics · Physics 2025-09-30 Azhar Ikhtiarudin , Aditi Das , Param Thakkar , Akash Kundu

Existing multi-scale solutions lead to a risk of just increasing the receptive field sizes while neglecting small receptive fields. Thus, it is a challenging problem to effectively construct adaptive neural networks for recognizing various…

Computer Vision and Pattern Recognition · Computer Science 2022-09-22 Qingbei Guo , Xiao-Jun Wu , Zhiquan Feng , Tianyang Xu , Cong Hu

Distributed quantum computing (DQC) that allows a large quantum circuit to be executed simultaneously on multiple quantum processing units (QPUs) becomes a promising approach to increase the scalability of quantum computing. It is natural…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-30 Ruilin Zhou , Yuhang Gan , Yi Liu , Chen Qian

The Transformer architecture has become the foundation of modern deep learning, yet its core self-attention mechanism suffers from quadratic computational complexity and lacks grounding in biological neural computation. We propose Selective…

Machine Learning · Computer Science 2026-02-17 Hasi Hays

Channel and spatial attentions have respectively brought significant improvements in extracting feature dependencies and spatial structure relations for various downstream vision tasks. While their combination is more beneficial for…

Computer Vision and Pattern Recognition · Computer Science 2024-11-13 Yunzhong Si , Huiying Xu , Xinzhong Zhu , Wenhao Zhang , Yao Dong , Yuxing Chen , Hongbo Li