English
Related papers

Related papers: SA-DQAS: Self-attention Enhanced Differentiable Qu…

200 papers

Quantum computing has made substantial progress in recent years; however, its scalability remains constrained on a monolithic quantum processing unit (QPU). Distributed quantum computing (DQC) offers a pathway by coordinating multiple QPUs…

Emerging Technologies · Computer Science 2025-11-26 Sen Zhang , Lingjun Xiong , Yipie Liu , Brian L. Mark , Lei Yang , Zebo Yang , Weiwen Jiang

Quantization-aware training (QAT) and Knowledge Distillation (KD) are combined to achieve competitive performance in creating low-bit deep learning models. However, existing works applying KD to QAT require tedious hyper-parameter tuning to…

Machine Learning · Computer Science 2024-03-19 Kaiqi Zhao , Ming Zhao

Efficient ground state search is fundamental to advancing combinatorial optimization problems and quantum chemistry. While the Variational Imaginary Time Evolution (VITE) method offers a useful alternative to Variational Quantum Eigensolver…

Quantum Physics · Physics 2026-04-10 Ryo Suzuki , Shohei Watabe

Convolutional Neural Networks (CNN) have been regarded as a capable class of models for visual recognition problems. Nevertheless, it is not trivial to develop generic and powerful network architectures, which requires significant efforts…

Computer Vision and Pattern Recognition · Computer Science 2019-09-24 Zhaofan Qiu , Ting Yao , Yiheng Zhang , Yongdong Zhang , Tao Mei

Self-Attention Mechanism (SAM) is good at capturing the internal connections of features and greatly improves the performance of machine learning models, espeacially requiring efficient characterization and feature extraction of…

Quantum Physics · Physics 2023-08-08 Jinjing Shi , Ren-Xin Zhao , Wenxuan Wang , Shichao Zhang , Xuelong Li

The Transformer architecture has revolutionized deep learning through its Self-Attention mechanism, which effectively captures contextual information. However, the memory footprint of Self-Attention presents significant challenges for…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Zohaib Khan , Muhammad Khaquan , Omer Tafveez , Burhanuddin Samiwala , Agha Ali Raza

Edge computing aims to enable edge devices, such as IoT devices, to process data locally instead of relying on the cloud. However, deep learning techniques like computer vision and natural language processing can be computationally…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Oshin Dutta , Tanu Kanvar , Sumeet Agarwal

We introduce CL-QAS, a continual quantum architecture search framework that mitigates the challenges of costly amplitude encoding and catastrophic forgetting in variational quantum circuits. The method uses Tensor-Train encoding to…

Quantum Physics · Physics 2026-01-13 Jun Qi , Chao-Han Huck Yang , Pin-Yu Chen , Javier Tejedor , Ling Li , Min-Hsiu Hsieh

Transformers excel across a large variety of tasks but remain susceptible to corrupted inputs, since standard self-attention treats all query-key interactions uniformly. Inspired by lateral inhibition in biological neural circuits and…

Machine Learning · Computer Science 2025-09-26 Elpiniki Maria Lygizou , Mónika Farsang , Radu Grosu

Attention mechanisms have revolutionized natural language processing. Combining them with quantum computing aims to further advance this technology. This paper introduces a novel Quantum Mixed-State Self-Attention Network (QMSAN) for…

Quantum Physics · Physics 2024-12-03 Fu Chen , Qinglin Zhao , Li Feng , Chuangtao Chen , Yangbin Lin , Jianhong Lin

Variational Quantum Algorithms (VQAs) have emerged as a powerful class of algorithms that is highly suitable for noisy quantum devices. Therefore, investigating their design has become key in quantum computing research. Previous works have…

Autonomous driving in multi-agent dynamic traffic scenarios is challenging: the behaviors of road users are uncertain and are hard to model explicitly, and the ego-vehicle should apply complicated negotiation skills with them, such as…

Robotics · Computer Science 2022-06-22 Peide Cai , Hengli Wang , Yuxiang Sun , Ming Liu

Constructing quantum circuits for efficient state preparation belongs to the central topics in the field of quantum information and computation. As the number of qubits grows fast, methods to derive large-scale quantum circuits are strongly…

Quantum Physics · Physics 2021-10-04 Peng-Fei Zhou , Rui Hong , Shi-Ju Ran

We propose a variational quantum implementation of self-attention (QSA), the core operation in transformers and large language models, which predicts future elements of a sequence by forming overlap-weighted combinations of past data. At…

Quantum Physics · Physics 2026-02-09 Alessio Pecilli , Matteo Rosati

Variational Quantum Algorithms (VQAs) are a leading approach to exploiting near-term quantum hardware, leveraging parameterized quantum circuits and classical optimization to achieve advantage. Despite their promise, the practical…

Quantum Physics · Physics 2026-05-28 Tung Dao , Son Tran , Huynh Thi Thanh Binh

Variational quantum algorithms, inspired by neural networks, have become a novel approach in quantum computing. However, designing efficient parameterized quantum circuits remains a challenge. Quantum architecture search tackles this by…

Quantum Physics · Physics 2024-08-02 Haozhen Situ , Zhimin He , Shenggen Zheng , Lvzhou Li

In recent years, Variational Quantum Algorithms (VQAs) have emerged as a promising approach for solving optimization problems on quantum computers in the NISQ era. However, one limitation of VQAs is their reliance on fixed-structure…

Quantum Physics · Physics 2026-03-03 Gloria Turati , Maurizio Ferrari Dacrema , Paolo Cremonesi

Financial market prediction and optimal trading strategy development remain challenging due to market complexity and volatility. Our research in quantum finance and reinforcement learning for decision-making demonstrates the approach of…

Quantum Physics · Physics 2025-01-24 Siddhant Dutta , Nouhaila Innan , Alberto Marchisio , Sadok Ben Yahia , Muhammad Shafique

Deep reinforcement learning for high dimensional, hierarchical control tasks usually requires the use of complex neural networks as functional approximators, which can lead to inefficiency, instability and even divergence in the training…

Machine Learning · Computer Science 2019-11-26 Yuguang Yang

Variational quantum algorithms (VQAs) have attracted remarkable interest over the past few years because of their potential computational advantages on near-term quantum devices. They leverage a hybrid approach that integrates classical and…