English
Related papers

Related papers: SA-DQAS: Self-attention Enhanced Differentiable Qu…

200 papers

Model quantization is challenging due to many tedious hyper-parameters such as precision (bitwidth), dynamic range (minimum and maximum discrete values) and stepsize (interval between discrete values). Unlike prior arts that carefully tune…

Machine Learning · Computer Science 2021-07-08 Zhang Zhaoyang , Shao Wenqi , Gu Jinwei , Wang Xiaogang , Luo Ping

Feature upsampling is an essential operation in constructing deep convolutional neural networks. However, existing upsamplers either lack specific feature guidance or necessitate the utilization of high-resolution feature maps, resulting in…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Zewen Du , Zhenjiang Hu , Guiyu Zhao , Ying Jin , Hongbin Ma

Noisy Intermediate-Scale Quantum (NISQ) devices lack error correction, limiting scalability for quantum algorithms. In this context, digital-analog quantum computing (DAQC) offers a more resilient alternative quantum computing paradigm that…

Quantum Physics · Physics 2024-10-11 Paula García-Molina , Ana Martin , Mikel Garcia de Andoin , Mikel Sanz

As the applications of deep learning models on edge devices increase at an accelerating pace, fast adaptation to various scenarios with varying resource constraints has become a crucial aspect of model deployment. As a result, model…

Computer Vision and Pattern Recognition · Computer Science 2021-05-20 Haoping Bai , Meng Cao , Ping Huang , Jiulong Shan

The scalability of long-context large language models is fundamentally limited by the quadratic memory cost of exact self-attention, which often leads to out-of-memory (OOM) failures on modern hardware. Existing methods improve memory…

Machine Learning · Computer Science 2026-04-23 Yiming Bian , Joshua M. Akey

Document Question Answering (DQA) involves generating answers from a document based on a user's query, representing a key task in document understanding. This task requires interpreting visual layouts, which has prompted recent studies to…

Computation and Language · Computer Science 2026-04-17 Yixin Xiang , Yunshan Ma , Xiaoyu Du , Yibing Chen , Yanxin Zhang , Jinhui Tang

This paper introduces a novel quantum embedding search algorithm (QES, pronounced as "quest"), enabling search for optimal quantum embedding design for a specific dataset of interest. First, we establish the connection between the…

Quantum Physics · Physics 2022-04-20 Nam Nguyen , Kwang-Chen Chen

Recently, self-attention mechanisms have shown impressive performance in various NLP and CV tasks, which can help capture sequential characteristics and derive global information. In this work, we explore how to extend self-attention…

Computer Vision and Pattern Recognition · Computer Science 2022-05-05 Haowei Zhu , Wenjing Ke , Dong Li , Ji Liu , Lu Tian , Yi Shan

Popular transformer detectors have achieved promising performance through query-based learning using attention mechanisms. However, the roles of existing decoder query types (e.g., content query and positional query) are still…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Guiping Cao , Xiangyuan Lan , Wenjian Huang , Jianguo Zhang , Dongmei Jiang , Yaowei Wang

Quantization is an effective way to reduce the memory cost of large-scale model training. However, most existing methods adopt fixed-precision policies, which ignore the fact that optimizer-state distributions vary significantly across…

Machine Learning · Computer Science 2026-04-10 Minglu Liu , Cunchen Hu , Liangliang Xu , Fengming Tang , Ruijia Wang , Fu Yu

Variational quantum circuits (VQCs) are a leading approach to quantum machine learning on near-term devices, yet it remains unclear which circuit architecture yields the best accuracy-parameter trade-off on classical tabular data. We…

Quantum Physics · Physics 2026-04-28 Chi-Sheng Chen , En-Jui Kuo

Optimization problems become fundamentally challenging as the number of variables increases. Because the volume of the search space grows exponentially, classical algorithms frequently fail to locate the global minimum of non-convex…

Quantum Physics · Physics 2026-04-23 Dominik Soós , Marc Paterno , John Stenger , Nikos Chrisochoides

In the community question answering (CQA) system, the answer selection task aims to identify the best answer for a specific question, and thus is playing a key role in enhancing the service quality through recommending appropriate answers…

Artificial Intelligence · Computer Science 2019-12-18 Fengshi Jing , Qingpeng Zhang

Transformer networks have achieved remarkable success across diverse domains, leveraging a variety of architectural innovations, including residual connections. However, traditional residual connections, which simply sum the outputs of…

Machine Learning · Computer Science 2025-07-25 Mike Heddes , Adel Javanmard , Kyriakos Axiotis , Gang Fu , MohammadHossein Bateni , Vahab Mirrokni

The automated segmentation of Intracranial Arteries (IA) in Digital Subtraction Angiography (DSA) plays a crucial role in the quantification of vascular morphology, significantly contributing to computer-assisted stroke research and…

Image and Video Processing · Electrical Eng. & Systems 2024-07-09 Wentao Liu , Tong Tian , Lemeng Wang , Weijin Xu , Lei Li , Haoyuan Li , Wenyi Zhao , Siyu Tian , Xipeng Pan , Huihua Yang , Feng Gao , Yiming Deng , Xin Yang , Ruisheng Su

We introduce hybrid sequential quantum computing (HSQC), a paradigm for combinatorial optimization that systematically integrates classical and quantum methods within a structured, stage-wise workflow. HSQC may involve an arbitrary sequence…

Variational Quantum Algorithms (VQAs) are a class of hybrid quantum-classical algorithms that leverage on classical optimization tools to find the optimal parameters for a parameterized quantum circuit. One relevant application of VQAs is…

Quantum Physics · Physics 2026-01-26 Mirko Legnini , Julian Berberich

Quantum machine learning -- and specifically Variational Quantum Algorithms (VQAs) -- offers a powerful, flexible paradigm for programming near-term quantum computers, with applications in chemistry, metrology, materials science, data…

Quantum Physics · Physics 2024-03-15 M. Bilkis , M. Cerezo , Guillaume Verdon , Patrick J. Coles , Lukasz Cincio

We propose SnCQA, a set of hardware-efficient variational circuits of equivariant quantum convolutional circuits respective to permutation symmetries and spatial lattice symmetries with the number of qubits $n$. By exploiting permutation…

Automated segmentation of structural defects from visual inspection imagery remains challenging due to the diversity of damage types, extreme class imbalance, and the need for precise boundary delineation. This paper presents DeltaSeg, a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Enrique Hernandez Noguera , Md Meftahul Ferdaus , Elias Ioup , Mahdi Abdelguerfi