English
Related papers

Related papers: QSAN: A Near-term Achievable Quantum Self-Attentio…

200 papers

Current end-to-end machine reading and question answering (Q\&A) models are primarily based on recurrent neural networks (RNNs) with attention. Despite their success, these models are often slow for both training and inference due to the…

Computation and Language · Computer Science 2018-04-26 Adams Wei Yu , David Dohan , Minh-Thang Luong , Rui Zhao , Kai Chen , Mohammad Norouzi , Quoc V. Le

Self-attention-based models have achieved remarkable progress in short-text mining. However, the quadratic computational complexities restrict their application in long text processing. Prior works have adopted the chunking strategy to…

Computation and Language · Computer Science 2023-06-13 Xianming Li , Zongxi Li , Xiaotian Luo , Haoran Xie , Xing Lee , Yingbin Zhao , Fu Lee Wang , Qing Li

Due to the success of the Standard Model~(SM), it is reasonable to anticipate that the signal of new physics~(NP) beyond the SM is small. Consequently, future searches for NP and precision tests of the SM will require high luminosity…

High Energy Physics - Phenomenology · Physics 2026-01-09 Ji-Chong Yang , Shuai Zhang , Chong-Xing Yue

A prominent technique for reducing the memory footprint of Spiking Neural Networks (SNNs) without decreasing the accuracy significantly is quantization. However, the state-of-the-art only focus on employing the weight quantization directly…

Neural and Evolutionary Computing · Computer Science 2023-03-06 Rachmad Vidya Wicaksana Putra , Muhammad Shafique

Weak measurements of a superconducting qubit produce noisy voltage signals that are weakly correlated with the qubit state. To recover individual quantum trajectories from these noisy signals, traditional methods require slow qubit dynamics…

Deep Convolutional Neural Networks (CNN) have drawn great attention in image super-resolution (SR). Recently, visual attention mechanism, which exploits both of the feature importance and contextual cues, has been introduced to image SR and…

Image and Video Processing · Electrical Eng. & Systems 2019-10-01 Huapeng Wu , Zhengxia Zou , Jie Gui , Wen-Jun Zeng , Jieping Ye , Jun Zhang , Hongyi Liu , Zhihui Wei

Compressive sensing is a signal processing technique that enables the reconstruction of sparse signals from a limited number of measurements, leveraging the signal's inherent sparsity to facilitate efficient recovery. Recent works on the…

Quantum Physics · Physics 2025-01-22 Naveed Naimipour , Collin Frink , Harry Shaw , Haleh Safavi , Mojtaba Soltanalian

We study supervised learning algorithms in which a quantum device is used to perform a computational subroutine - either for prediction via probability estimation, or to compute a kernel via estimation of quantum states overlap. We design…

Quantum Physics · Physics 2021-07-07 Ulysse Chabaud , Damian Markham , Adel Sohbi

Variational quantum algorithms hold the promise to address meaningful quantum problems already on noisy intermediate-scale quantum hardware. In spite of the promise, they face the challenge of designing quantum circuits that both solve the…

Quantum Physics · Physics 2025-10-01 Akash Kundu , Stefano Mangini

Classical machine learning often struggles with complex, high-dimensional data. Quantum machine learning offers a potential solution, promising more efficient processing. The quantum convolutional neural network (QCNN), a hybrid algorithm,…

Quantum Physics · Physics 2025-07-25 Hinako Asaoka , Kazue Kudo

The Multi-Head Attention mechanism is central to LLM operation, and multiple works target its compute and memory efficiency during training. While most works focus on approximating the scaled dot product, the memory consumption of the…

Machine Learning · Computer Science 2026-03-03 Malik Khalaf , Yara Shamshoum , Nitzan Hodos , Yuval Sieradzki , Assaf Schuster

Quantum architecture Search (QAS) is a promising direction for optimization and automated design of quantum circuits towards quantum advantage. Recent techniques in QAS emphasize Multi-Layer Perceptron (MLP)-based deep Q-networks. However,…

Quantum Physics · Physics 2024-12-13 Akash Kundu , Aritra Sarkar , Abhishek Sadhu

The versatility of self-attention mechanism earned transformers great success in almost all data modalities, with limitations on the quadratic complexity and difficulty of training. Efficient transformers, on the other hand, often rely on…

Machine Learning · Computer Science 2024-08-20 Minh Lenhat , Viet Anh Nguyen , Khoa Nguyen , Duong Duc Hieu , Dao Huu Hung , Truong Son Hy

Quantum error mitigation (QEM) has emerged as a powerful tool for the extraction of useful quantum information from quantum devices. Here, we introduce the Subspace Noise Tailoring (SNT) algorithm, which efficiently combines the cheap cost…

With the rapid development of quantum computers, quantum algorithms have been studied extensively. However, quantum algorithms tackling statistical problems are still lacking. In this paper, we propose a novel non-oracular quantum adaptive…

Methodology · Statistics 2021-07-20 Wenxuan Zhong , Yuan Ke , Ye Wang , Yongkai Chen , Jinyang Chen , Ping Ma

This article explores how to effectively incorporate curvature information generated using SIMD-parallel forward-mode Algorithmic Differentiation (AD) into unconstrained Quasi-Newton (QN) minimization of a smooth objective function, $f$.…

Optimization and Control · Mathematics 2022-01-10 Joy Azzam , Daniel Henderson , Benjamin Ong , Allan Struthers

We introduce Extreme Quantum Cognition Machines, a class of quantum learning architectures for deliberative decision making that is tolerant to noisy and contradictory training data. Inspired by the quantum cognition paradigm, Extreme…

Quantum Physics · Physics 2026-05-15 Francesco Romeo , Jacopo Settino

Segment Anything Model (SAM) has achieved impressive performance in many computer vision tasks. However, as a large-scale model, the immense memory and computation costs hinder its practical deployment. In this paper, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Chengtao Lv , Hong Chen , Jinyang Guo , Yifu Ding , Xianglong Liu

Combining quantum sensing with quantum computing can lead to quantum computational sensors that are able to more efficiently extract task-specific information from physical signals than is possible otherwise. Early examples of quantum…

Quantum Physics · Physics 2025-07-22 Saeed A. Khan , Sridhar Prabhu , Logan G. Wright , Peter L. McMahon

Giovannetti, Lloyd, and Maccone [Phys. Rev. Lett. 100, 160501] proposed a quantum random access memory (QRAM) architecture to retrieve arbitrary superpositions of $N$ (quantum) memory cells via $O(\log(N))$ quantum switches and $O(\log(N))$…

‹ Prev 1 8 9 10 Next ›