English
Related papers

Related papers: Encoding Syntactic Constituency Paths for Frame-Se…

200 papers

In this work, we aim for temporally consistent semantic segmentation throughout frames in a video. Many semantic segmentation algorithms process images individually which leads to an inconsistent scene interpretation due to illumination…

Computer Vision and Pattern Recognition · Computer Science 2020-08-31 Manuel Rebol , Patrick Knöbelreiter

This report extends the Spectral Neuro-Symbolic Reasoning (Spectral NSR) framework by introducing three semantically grounded enhancements: (1) transformer-based node merging using contextual embeddings (e.g., Sentence-BERT, SimCSE) to…

Computation and Language · Computer Science 2025-11-17 Andrew Kiruluta , Priscilla Burity

Recent models have shown that incorporating syntactic knowledge into the semantic role labelling (SRL) task leads to a significant improvement. In this paper, we propose Syntax-aware Graph-to-Graph Transformer (SynG2G-Tr) model, which…

Computation and Language · Computer Science 2023-06-05 Alireza Mohammadshahi , James Henderson

Sequence-based neural networks show significant sensitivity to syntactic structure, but they still perform less well on syntactic tasks than tree-based networks. Such tree-based networks can be provided with a constituency parse, a…

Computation and Language · Computer Science 2020-05-04 Michael A. Lepori , Tal Linzen , R. Thomas McCoy

This paper presents the participation of the MiniTrue team in the FinSim-3 shared task on learning semantic similarities for the financial domain in English language. Our approach combines contextual embeddings learned by transformer-based…

Computation and Language · Computer Science 2021-07-14 Chao Feng , Shi-jie We

Systematically discovering semantic relationships in text is an important and extensively studied area in Natural Language Processing, with various tasks such as entailment, semantic similarity, etc. Decomposability of sentence-level scores…

Computation and Language · Computer Science 2020-07-16 Subhadeep Maji , Rohan Kumar , Manish Bansal , Kalyani Roy , Pawan Goyal

Amidst the swift evolution of social media platforms and e-commerce ecosystems, the domain of opinion mining has surged as a pivotal area of exploration within natural language processing. A specialized segment within this field focuses on…

Computation and Language · Computer Science 2024-09-24 Linxiao Wu , Yuanshuai Luo , Binrong Zhu , Guiran Liu , Rui Wang , Qian Yu

Neural network architectures have been augmented with differentiable stacks in order to introduce a bias toward learning hierarchy-sensitive regularities. It has, however, proven difficult to assess the degree to which such a bias is…

Computation and Language · Computer Science 2019-06-05 William Merrill , Lenny Khazan , Noah Amsel , Yiding Hao , Simon Mendelsohn , Robert Frank

Semantic role labeling (SRL) is a fundamental yet challenging task in the NLP community. Recent works of SRL mainly fall into two lines: 1) BIO-based; 2) span-based. Despite ubiquity, they share some intrinsic drawbacks of not considering…

Computation and Language · Computer Science 2022-09-20 Yu Zhang , Qingrong Xia , Shilin Zhou , Yong Jiang , Guohong Fu , Min Zhang

Existing Scene Text Recognition (STR) methods typically use a language model to optimize the joint probability of the 1D character sequence predicted by a visual recognition (VR) model, which ignore the 2D spatial context of visual…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Yue He , Chen Chen , Jing Zhang , Juhua Liu , Fengxiang He , Chaoyue Wang , Bo Du

Syntactic structure of sentences in a document substantially informs about its authorial writing style. Sentence representation learning has been widely explored in recent years and it has been shown that it improves the generalization of…

Computation and Language · Computer Science 2022-02-25 Fereshteh Jafariakinabad , Kien A. Hua

Much recent work suggests that incorporating syntax information from dependency trees can improve task-specific transformer models. However, the effect of incorporating dependency tree information into pre-trained transformer models (e.g.,…

Computation and Language · Computer Science 2021-01-28 Devendra Singh Sachan , Yuhao Zhang , Peng Qi , William Hamilton

This paper integrates graph-to-sequence into an end-to-end text-to-speech framework for syntax-aware modelling with syntactic information of input text. Specifically, the input text is parsed by a dependency parsing module to form a…

Sound · Computer Science 2023-09-19 Jianzong Wang , Xulong Zhang , Aolan Sun , Ning Cheng , Jing Xiao

We combine character-level and contextual language model representations to improve performance on Discourse Representation Structure parsing. Character representations can easily be added in a sequence-to-sequence model in either one…

Computation and Language · Computer Science 2020-11-10 Rik van Noord , Antonio Toral , Johan Bos

We introduce a method to reduce constituent parsing to sequence labeling. For each word w_t, it generates a label that encodes: (1) the number of ancestors in the tree that the words w_t and w_{t+1} have in common, and (2) the nonterminal…

Computation and Language · Computer Science 2019-09-18 Carlos Gómez-Rodríguez , David Vilares

We propose a novel constituency parsing model that casts the parsing problem into a series of pointing tasks. Specifically, our model estimates the likelihood of a span being a legitimate tree constituent via the pointing score…

Computation and Language · Computer Science 2020-06-25 Thanh-Tung Nguyen , Xuan-Phi Nguyen , Shafiq Joty , Xiaoli Li

We present a simple and effective approach to incorporating syntactic structure into neural attention-based encoder-decoder models for machine translation. We rely on graph-convolutional networks (GCNs), a recent class of neural networks…

Computation and Language · Computer Science 2020-06-22 Jasmijn Bastings , Ivan Titov , Wilker Aziz , Diego Marcheggiani , Khalil Sima'an

How to effectively incorporate cross-utterance information cues into a neural language model (LM) has emerged as one of the intriguing issues for automatic speech recognition (ASR). Existing research efforts on improving contextualization…

Computation and Language · Computer Science 2021-10-04 Shih-Hsuan Chiu , Tien-Hong Lo , Fu-An Chao , Berlin Chen

Modern state-of-the-art Semantic Role Labeling (SRL) methods rely on expressive sentence encoders (e.g., multi-layer LSTMs) but tend to model only local (if any) interactions between individual argument labeling decisions. This contrasts…

Computation and Language · Computer Science 2019-09-10 Chunchuan Lyu , Shay B. Cohen , Ivan Titov

We present an end-to-end, multimodal, fully convolutional network for extracting semantic structures from document images. We consider document semantic structure extraction as a pixel-wise segmentation task, and propose a unified model…

Computer Vision and Pattern Recognition · Computer Science 2017-06-09 Xiao Yang , Ersin Yumer , Paul Asente , Mike Kraley , Daniel Kifer , C. Lee Giles