English
Related papers

Related papers: Adapting Pre-trained Language Models for Quantum N…

200 papers

Natural Language Processing (NLP) has witnessed a transformative leap with the advent of transformer-based architectures, which have significantly enhanced the ability of machines to understand and generate human-like text. This paper…

Computation and Language · Computer Science 2025-03-27 Tianhao Wu , Yu Wang , Ngoc Quach

Quantum Natural Language Processing (QNLP) deals with the design and implementation of NLP models intended to be run on quantum hardware. In this paper, we present results on the first NLP experiments conducted on Noisy Intermediate-Scale…

Computation and Language · Computer Science 2023-05-05 Robin Lorenz , Anna Pearson , Konstantinos Meichanetzidis , Dimitri Kartsaklis , Bob Coecke

Quantum communication has the potential to revolutionize information processing, providing unparalleled security and increased capacity compared to its classical counterpart by using the principles of quantum mechanics. However, the…

Quantum Physics · Physics 2025-04-30 Yuqi Li , Zhouhang Shi , Haitao Ma , Li Shen , Jinge Bao , Yunlong Xiao

Recent advances in quantum computing have opened new pathways for enhancing deep learning architectures, particularly in domains characterized by high-dimensional and context-rich data such as natural language processing (NLP). In this…

Computation and Language · Computer Science 2025-06-30 S. M. Yousuf Iqbal Tomal , Abdullah Al Shafin , Debojit Bhattacharjee , MD. Khairul Amin , Rafiad Sadat Shahir

The application of Natural Language Processing (NLP) has achieved a high level of relevance in several areas. In the field of software engineering (SE), NLP applications are based on the classification of similar texts (e.g. software…

Software Engineering · Computer Science 2021-12-02 Eliane Maria De Bortoli Fávero , Dalcimar Casanova

Language processing is at the heart of current developments in artificial intelligence, and quantum computers are becoming available at the same time. This has led to great interest in quantum natural language processing, and several early…

Quantum Physics · Physics 2025-01-14 Dominic Widdows , Willie Aboumrad , Dohun Kim , Sayonee Ray , Jonathan Mei

Quantum computers leverage the unique advantages of quantum mechanics to achieve acceleration over classical computers for certain problems. Currently, various quantum simulators provide powerful tools for researchers, but simulating…

Quantum Physics · Physics 2024-10-31 Shuangxiang Zhou , Ronghang Chen , Zheng An , Shi-Yao Hou

While transformer-based pre-trained language models (PLMs) have dominated a number of NLP applications, these models are heavy to deploy and expensive to use. Therefore, effectively compressing large-scale PLMs becomes an increasingly…

Computation and Language · Computer Science 2023-06-02 Zhuocheng Gong , Jiahao Liu , Qifan Wang , Yang Yang , Jingang Wang , Wei Wu , Yunsen Xian , Dongyan Zhao , Rui Yan

The rapid development of quantum computing has demonstrated many unique characteristics of quantum advantages, such as richer feature representation and more secured protection on model parameters. This work proposes a vertical federated…

Computation and Language · Computer Science 2022-03-08 Chao-Han Huck Yang , Jun Qi , Samuel Yen-Chi Chen , Yu Tsao , Pin-Yu Chen

Pre-trained language models learn informative word representations on a large-scale text corpus through self-supervised learning, which has achieved promising performance in fields of natural language processing (NLP) after fine-tuning.…

Computation and Language · Computer Science 2023-10-31 Jian Yang , Xinyu Hu , Gang Xiao , Yulong Shen

Guided by grammatical structure, words compose to form sentences, and guided by discourse structure, sentences compose to form dialogues and documents. The compositional aspect of sentence and discourse units is often overlooked by machine…

Computation and Language · Computer Science 2023-12-04 Hadi Wazni , Mehrnoosh Sadrzadeh

Machine learning using quantum convolutional neural networks (QCNNs) has demonstrated success in both quantum and classical data classification. In previous studies, QCNNs attained a higher classification accuracy than their classical…

Quantum Physics · Physics 2023-09-29 Juhyeon Kim , Joonsuk Huh , Daniel K. Park

Recently, pre-trained models have been the dominant paradigm in natural language processing. They achieved remarkable state-of-the-art performance across a wide range of related tasks, such as textual entailment, natural language inference,…

Computation and Language · Computer Science 2019-05-21 Dongfang Li , Yifei Yu , Qingcai Chen , Xinyu Li

Despite significant advances in quantum computing across various domains, research on applying quantum approaches to language compositionality - such as modeling linguistic structures and interactions - remains limited. This gap extends to…

Computation and Language · Computer Science 2024-11-11 Hala Hawashin

The emergence of noisy medium-scale quantum devices has led to proof-of-concept applications for quantum computing in various domains. Examples include Natural Language Processing (NLP) where sentence classification experiments have been…

Quantum Physics · Physics 2022-11-03 Amin Karamlou , Marcel Pfaffhauser , James Wootton

Transfer learning with large pretrained transformer-based language models like BERT has become a dominating approach for most NLP tasks. Simply fine-tuning those large language models on downstream tasks or combining it with task-specific…

Computation and Language · Computer Science 2021-08-06 Wenjuan Han , Bo Pang , Yingnian Wu

Forecasting demand for assets and services can be addressed in various markets, providing a competitive advantage when the predictive models used demonstrate high accuracy. However, the training of machine learning models incurs high…

Natural language processing (NLP) tasks tend to suffer from a paucity of suitably annotated training data, hence the recent success of transfer learning across a wide variety of them. The typical recipe involves: (i) training a deep,…

Computation and Language · Computer Science 2019-09-11 Lyan Verwimp , Jerome R. Bellegarda

This paper presents a comprehensive evaluation of quantum text generation models against traditional Transformer/MLP architectures, addressing the growing interest in quantum computing applications for natural language processing. We…

Quantum Physics · Physics 2025-09-01 Chi-Sheng Chen , En-Jui Kuo

Transfer learning, where a model is first pre-trained on a data-rich task before being fine-tuned on a downstream task, has emerged as a powerful technique in natural language processing (NLP). The effectiveness of transfer learning has…

Machine Learning · Computer Science 2023-09-20 Colin Raffel , Noam Shazeer , Adam Roberts , Katherine Lee , Sharan Narang , Michael Matena , Yanqi Zhou , Wei Li , Peter J. Liu