English
Related papers

Related papers: Approximating CKY with Transformers

200 papers

This paper describes Picky, a probabilistic agenda-based chart parsing algorithm which uses a technique called {\em probabilistic prediction} to predict which grammar rules are likely to lead to an acceptable parse of the input. Using a…

cmp-lg · Computer Science 2008-02-03 David M. Magerman , Carl Weir

Large transformer-based language models have been shown to be very effective in many classification tasks. However, their computational complexity prevents their use in applications requiring the classification of a large set of candidates.…

Computation and Language · Computer Science 2020-05-08 Luca Soldaini , Alessandro Moschitti

Recently CKY-based models show great potential in unsupervised grammar induction thanks to their human-like encoding paradigm, which runs recursively and hierarchically, but requires $O(n^3)$ time-complexity. Recursive Transformer based on…

Computation and Language · Computer Science 2022-11-03 Xiang Hu , Haitao Mi , Liang Li , Gerard de Melo

Most recent studies on neural constituency parsing focus on encoder structures, while few developments are devoted to decoders. Previous research has demonstrated that probabilistic statistical methods based on syntactic rules are…

Computation and Language · Computer Science 2022-12-19 Tianyu Shi , Zhicheng Wang , Liyin Xiao , Cong Liu

Pre-trained language models have been shown to encode linguistic structures, e.g. dependency and constituency parse trees, in their embeddings while being trained on unsupervised loss functions like masked language modeling. Some doubts…

Computation and Language · Computer Science 2023-10-17 Haoyu Zhao , Abhishek Panigrahi , Rong Ge , Sanjeev Arora

We discuss the advantages of using the approximate quantum Fourier transform (AQFT) in algorithms which involve periodicity estimations. We analyse quantum networks performing AQFT in the presence of decoherence and show that extensive…

Quantum Physics · Physics 2009-10-30 Adriano Barenco , Artur Ekert , Kalle-Antti Suominen , Päivi Törmä

While transformer models have been highly successful, they are computationally inefficient. We observe that for each layer, the full width of the layer may be needed only for a small subset of tokens inside a batch and that the "effective"…

Machine Learning · Computer Science 2024-12-19 Bartosz Wójcik , Alessio Devoto , Karol Pustelnik , Pasquale Minervini , Simone Scardapane

Transformers have gained popularity in machine learning due to their application in the field of natural language processing. They manipulate and process text efficiently, capturing long-range dependencies among data and performing the next…

Quantum Physics · Physics 2026-03-06 Michele Banfi , Paolo Zentilini , Sebastiano Corli , Enrico Prati

Unsupervised parsing, also known as grammar induction, aims to infer syntactic structure from raw text. Recently, binary representation has exhibited remarkable information-preserving capabilities at both lexicon and syntax levels. In this…

Computation and Language · Computer Science 2024-10-08 Yiran Wang , Masao Utiyama

We propose a novel algorithm that improves on the previous neural span-based CKY decoder for constituency parsing. In contrast to the traditional span-based decoding, where spans are combined only based on the sum of their scores, we…

Computation and Language · Computer Science 2022-11-02 Zhicheng Wang , Tianyu Shi , Liyin Xiao , Cong Liu

Abstract Meaning Representation parsing is a sentence-to-graph prediction task where target nodes are not explicitly aligned to sentence tokens. However, since graph nodes are semantically based on one or more sentence tokens, implicit…

Computation and Language · Computer Science 2021-05-19 Jiawei Zhou , Tahira Naseem , Ramón Fernandez Astudillo , Radu Florian

This paper describes a parsing model that combines the exact dynamic programming of CRF parsing with the rich nonlinear featurization of neural net approaches. Our model is structurally a CRF that factors over anchored rule productions, but…

Computation and Language · Computer Science 2015-07-15 Greg Durrett , Dan Klein

We propose a novel constituency parsing model that casts the parsing problem into a series of pointing tasks. Specifically, our model estimates the likelihood of a span being a legitimate tree constituent via the pointing score…

Computation and Language · Computer Science 2020-06-25 Thanh-Tung Nguyen , Xuan-Phi Nguyen , Shafiq Joty , Xiaoli Li

The Transformer-Kernel (TK) model has demonstrated strong reranking performance on the TREC Deep Learning benchmark---and can be considered to be an efficient (but slightly less effective) alternative to BERT-based ranking models. In this…

Information Retrieval · Computer Science 2020-07-22 Bhaskar Mitra , Sebastian Hofstatter , Hamed Zamani , Nick Craswell

The computational complexity of the self-attention mechanism in popular transformer architectures poses significant challenges for training and inference, and becomes the bottleneck for long inputs. Is it possible to significantly reduce…

Machine Learning · Computer Science 2024-10-16 Yingyu Liang , Zhizhou Sha , Zhenmei Shi , Zhao Song , Yufa Zhou

A generation algorithm based on an active chart parsing algorithm is introduced which can be used in conjunction with a Shake and Bake machine translation system. A concise Prolog implementation of the algorithm is provided, and some…

cmp-lg · Computer Science 2008-02-03 Fred Popowich

The skip-thought model has been proven to be effective at learning sentence representations and capturing sentence semantics. In this paper, we propose a suite of techniques to trim and improve it. First, we validate a hypothesis that,…

Computation and Language · Computer Science 2017-06-13 Shuai Tang , Hailin Jin , Chen Fang , Zhaowen Wang , Virginia R. de Sa

Human language understanding operates at multiple levels of granularity (e.g., words, phrases, and sentences) with increasing levels of abstraction that can be hierarchically combined. However, existing deep models with stacked layers do…

Computation and Language · Computer Science 2022-03-04 Xiang Hu , Haitao Mi , Zujie Wen , Yafang Wang , Yi Su , Jing Zheng , Gerard de Melo

Human language is known to exhibit a nested, hierarchical structure, allowing us to form complex sentences out of smaller pieces. However, many state-of-the-art neural networks models such as Transformers have no explicit hierarchical…

Computation and Language · Computer Science 2023-07-12 Nilay Patel , Jeffrey Flanigan

Transformers are a type of neural network that have demonstrated remarkable performance across various domains, particularly in natural language processing tasks. Motivated by this success, research on the theoretical understanding of…

Machine Learning · Computer Science 2025-02-18 Naoki Takeshita , Masaaki Imaizumi
‹ Prev 1 2 3 10 Next ›