English
Related papers

Related papers: Targeted Syntactic Evaluation of Language Models o…

200 papers

With the advent of powerful neural language models over the last few years, research attention has increasingly focused on what aspects of language they represent that make them so successful. Several testing methodologies have been…

Computation and Language · Computer Science 2023-05-26 Jordan Kodner , Nitish Gupta

Word embeddings are an essential component in a wide range of natural language processing applications. However, distributional semantic models are known to struggle when only a small number of context sentences are available. Several…

Computation and Language · Computer Science 2019-10-02 Jeroen Van Hautte , Guy Emerson , Marek Rei

Language models and software tools are essential to support the continuing vitality of lesser-used languages; however, currently popular neural models require considerable data for training, which normally is not available for such…

Computation and Language · Computer Science 2026-02-13 Peter J Barclay

Generating fluent natural language responses from structured semantic representations is a critical step in task-oriented conversational systems. Avenues like the E2E NLG Challenge have encouraged the development of neural approaches,…

Computation and Language · Computer Science 2019-06-19 Anusha Balakrishnan , Jinfeng Rao , Kartikeya Upasani , Michael White , Rajen Subba

The long-standing challenge of building effective classification models for small and imbalanced datasets has seen little improvement since the creation of the Synthetic Minority Over-sampling Technique (SMOTE) over 20 years ago. Though GAN…

Machine Learning · Computer Science 2022-11-21 Leon O. Guertler , Andri Ashfahani , Anh Tuan Luu

We study the problem of conditional generative modeling based on designated semantics or structures. Existing models that build conditional generators either require massive labeled instances as supervision or are unable to accurately…

Machine Learning · Computer Science 2017-11-06 Zhijie Deng , Hao Zhang , Xiaodan Liang , Luona Yang , Shizhen Xu , Jun Zhu , Eric P. Xing

In Grammatical Error Correction (GEC), sequence labeling models enjoy fast inference compared to sequence-to-sequence models; however, inference in sequence labeling GEC models is an iterative process, as sentences are passed to the model…

Computation and Language · Computer Science 2021-06-01 Kevin Parnow , Zuchao Li , Hai Zhao

Text classification is vital for Web for Good applications like hate speech and misinformation detection. However, traditional models (e.g., BERT) often fail in dynamic few-shot settings where labeled data are scarce, and target labels…

Computation and Language · Computer Science 2026-01-30 Yubo Wang , Haoyang Li , Fei Teng , Lei Chen

This paper explores the instruction fine-tuning technique for speech-to-semantic tasks by introducing a unified end-to-end (E2E) framework that generates target text conditioned on a task-related prompt for audio data. We pre-train the…

Computation and Language · Computer Science 2023-09-12 Aobo Xia , Shuyu Lei , Yushu Yang , Xiang Guo , Hua Chai

Morphological parsing is the task of decomposing words into morphemes, the smallest units of meaning in a language, and labelling their grammatical roles. It is a particularly challenging task for agglutinative languages, such as the Nguni…

Computation and Language · Computer Science 2025-05-20 Cael Marquard , Simbarashe Mawere , Francois Meyer

Semantics, morphology and syntax are strongly interdependent. However, the majority of computational methods for semantic change detection use distributional word representations which encode mostly semantics. We investigate an alternative…

Computation and Language · Computer Science 2021-09-23 Mario Giulianelli , Andrey Kutuzov , Lidia Pivovarova

Syntactic constituency parsing is a fundamental problem in natural language processing and has been the subject of intensive research and engineering for decades. As a result, the most accurate parsers are domain specific, complex, and…

Computation and Language · Computer Science 2015-06-11 Oriol Vinyals , Lukasz Kaiser , Terry Koo , Slav Petrov , Ilya Sutskever , Geoffrey Hinton

Textual graphs (TGs) are graphs whose nodes correspond to text (sentences or documents), which are widely prevalent. The representation learning of TGs involves two stages: (i) unsupervised feature extraction and (ii) supervised graph…

Computation and Language · Computer Science 2023-08-08 Keyu Duan , Qian Liu , Tat-Seng Chua , Shuicheng Yan , Wei Tsang Ooi , Qizhe Xie , Junxian He

Amidst the swift evolution of social media platforms and e-commerce ecosystems, the domain of opinion mining has surged as a pivotal area of exploration within natural language processing. A specialized segment within this field focuses on…

Computation and Language · Computer Science 2024-09-24 Linxiao Wu , Yuanshuai Luo , Binrong Zhu , Guiran Liu , Rui Wang , Qian Yu

Aligning large language models to handle instructions with extremely long contexts has yet to be fully investigated. Previous studies have attempted to scale up the available data volume by synthesizing long instruction-following samples,…

Computation and Language · Computer Science 2025-09-16 Shuzheng Si , Haozhe Zhao , Gang Chen , Yunshui Li , Kangyang Luo , Chuancheng Lv , Kaikai An , Fanchao Qi , Baobao Chang , Maosong Sun

Score-based generative models (SGMs) have recently shown impressive results for difficult generative tasks such as the unconditional and conditional generation of natural images and audio signals. In this work, we extend these models to the…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-08 Simon Welker , Julius Richter , Timo Gerkmann

Recent work has shown that generation from a prompted or fine-tuned language model can perform well at semantic parsing when the output is constrained to be a valid semantic representation. We introduce BenchCLAMP, a Benchmark to evaluate…

Computation and Language · Computer Science 2024-01-11 Subhro Roy , Sam Thomson , Tongfei Chen , Richard Shin , Adam Pauls , Jason Eisner , Benjamin Van Durme

A range of studies have concluded that neural word prediction models can distinguish grammatical from ungrammatical sentences with high accuracy. However, these studies are based primarily on monolingual evidence from English. To…

Computation and Language · Computer Science 2020-05-22 Aaron Mueller , Garrett Nicolai , Panayiota Petrou-Zeniou , Natalia Talmina , Tal Linzen

Dialogue-Based Generalized Referring Expression Comprehension (GREC) requires models to ground the expression and unlimited targets in complex visual scenes while resolving coreference across a long dialogue context. However, existing…

Computation and Language · Computer Science 2026-04-28 Juexi Shao , Siyou Li , Yujian Gan , Chris Madge , Vanja Karan , Massimo Poesio

Graph-matching metrics such as Smatch are the de facto standard for evaluating neural semantic parsers, yet they capture surface overlap rather than logical equivalence. We reassess evaluation by pairing graph-matching with automated…

Computation and Language · Computer Science 2025-10-14 Hayate Funakura , Hyunsoo Kim , Koji Mineshima