English
Related papers

Related papers: QTP-Net: A Quantum Text Pre-training Network for N…

200 papers

Quantum Language Models (QLMs) in which words are modelled as quantum superposition of sememes have demonstrated a high level of model transparency and good post-hoc interpretability. Nevertheless, in the current literature word sequences…

Computation and Language · Computer Science 2021-12-21 Yiwei Chen , Yu Pan , Daoyi Dong

We propose a general framework for decoding quantum error-correcting codes with generative modeling. The model utilizes autoregressive neural networks, specifically Transformers, to learn the joint probability of logical operators and…

Quantum Physics · Physics 2023-07-19 Hanyan Cao , Feng Pan , Yijia Wang , Pan Zhang

Recent advances in Natural Language Processing have been predominantly driven by transformer-based architectures, which rely heavily on self-attention mechanisms to model relationships between tokens in a sequence. Similarly, the field of…

Computation and Language · Computer Science 2026-03-05 Nikita Kuznetsov , Niyaz Ismagilov , Ernesto Campos

Quantum computing and AI have found a fruitful intersection in the field of natural language processing. We focus on the recently proposed DisCoCirc framework for natural language, and propose a quantum adaptation, QDisCoCirc. This is…

Quantum Physics · Physics 2024-08-13 Tuomas Laakkonen , Konstantinos Meichanetzidis , Bob Coecke

An emerging direction of quantum computing is to establish meaningful quantum applications in various fields of artificial intelligence, including natural language processing (NLP). Although some efforts based on syntactic analysis have…

Quantum Physics · Physics 2023-09-29 Guangxi Li , Xuanqiang Zhao , Xin Wang

Recently, the development of pre-trained language models has brought natural language processing (NLP) tasks to the new state-of-the-art. In this paper we explore the efficiency of various pre-trained language models. We pre-train a list of…

Computation and Language · Computer Science 2023-07-27 Tong Guo

Recent breakthroughs of pretrained language models have shown the effectiveness of self-supervised learning for a wide range of natural language processing (NLP) tasks. In addition to standard syntactic and semantic NLP tasks, pretrained…

Computation and Language · Computer Science 2019-12-23 Wenhan Xiong , Jingfei Du , William Yang Wang , Veselin Stoyanov

The main approach to hybrid quantum-classical neural networks (QNN) is employing quantum computing to build a neural network (NN) that has quantum features, which is then optimized classically. Here, we propose a different strategy: to use…

Quantum Physics · Physics 2025-04-22 Stefan-Alexandru Jura , Mihai Udrescu

Natural Language Processing (NLP) has witnessed a transformative leap with the advent of transformer-based architectures, which have significantly enhanced the ability of machines to understand and generate human-like text. This paper…

Computation and Language · Computer Science 2025-03-27 Tianhao Wu , Yu Wang , Ngoc Quach

Attention mechanisms have revolutionized natural language processing. Combining them with quantum computing aims to further advance this technology. This paper introduces a novel Quantum Mixed-State Self-Attention Network (QMSAN) for…

Quantum Physics · Physics 2024-12-03 Fu Chen , Qinglin Zhao , Li Feng , Chuangtao Chen , Yangbin Lin , Jianhong Lin

This work proposes QNet, a novel sequence encoder model that entirely inferences on the quantum computer using a minimum number of qubits. Let $n$ and $d$ represent the length of the sequence and the embedding size, respectively. The…

Machine Learning · Computer Science 2023-08-29 Wei Day , Hao-Sheng Chen , Min-Te Sun

We show that protein sequences can be thought of as sentences in natural language processing and can be parsed using the existing Quantum Natural Language framework into parameterized quantum circuits of reasonable qubits, which can be…

Pre-trained language representation models (PLMs) cannot well capture factual knowledge from text. In contrast, knowledge embedding (KE) methods can effectively represent the relational facts in knowledge graphs (KGs) with informative…

Computation and Language · Computer Science 2020-11-24 Xiaozhi Wang , Tianyu Gao , Zhaocheng Zhu , Zhengyan Zhang , Zhiyuan Liu , Juanzi Li , Jian Tang

Sentiment classification is one the best use case of classical natural language processing (NLP) where we can witness its power in various daily life domains such as banking, business and marketing industry. We already know how classical AI…

Quantum Physics · Physics 2023-06-01 Srinjoy Ganguly , Sai Nandan Morapakula , Luis Miguel Pozo Coronado

The present study aims to explore the feasibility of language translation using quantum natural language processing algorithms on noisy intermediate-scale quantum (NISQ) devices. Classical methods in natural language processing (NLP)…

Computation and Language · Computer Science 2023-08-01 Mina Abbaszade , Mariam Zomorodi , Vahid Salari , Philip Kurian

The emergence of noisy medium-scale quantum devices has led to proof-of-concept applications for quantum computing in various domains. Examples include Natural Language Processing (NLP) where sentence classification experiments have been…

Quantum Physics · Physics 2022-11-03 Amin Karamlou , Marcel Pfaffhauser , James Wootton

In this paper, we discuss the initial attempts at boosting understanding human language based on deep-learning models with quantum computing. We successfully train a quantum-enhanced Long Short-Term Memory network to perform the…

Computation and Language · Computer Science 2021-10-15 Riccardo Di Sipio , Jia-Hong Huang , Samuel Yen-Chi Chen , Stefano Mangini , Marcel Worring

Natural language processing (NLP) is the field that attempts to make human language accessible to computers, and it relies on applying a mathematical model to express the meaning of symbolic language. One such model, DisCoCat, defines how…

Computation and Language · Computer Science 2022-05-16 Matt Wright

Knowledge Graph Embedding (KGE) methods have gained enormous attention from a wide range of AI communities including Natural Language Processing (NLP) for text generation, classification and context induction. Embedding a huge number of…

Artificial Intelligence · Computer Science 2022-09-19 Mojtaba Moattari , Sahar Vahdati , Farhana Zulkernine

In this work, we introduce the Qwen3 Embedding series, a significant advancement over its predecessor, the GTE-Qwen series, in text embedding and reranking capabilities, built upon the Qwen3 foundation models. Leveraging the Qwen3 LLMs'…

Computation and Language · Computer Science 2025-06-12 Yanzhao Zhang , Mingxin Li , Dingkun Long , Xin Zhang , Huan Lin , Baosong Yang , Pengjun Xie , An Yang , Dayiheng Liu , Junyang Lin , Fei Huang , Jingren Zhou