English
Related papers

Related papers: DuConTE: Dual-Granularity Text Encoder with Topolo…

200 papers

Graph Retrieval-Augmented Generation (GRAG or Graph RAG) architectures aim to enhance language understanding and generation by leveraging external knowledge. However, effectively capturing and integrating the rich semantic information…

Computation and Language · Computer Science 2025-01-29 Karishma Thakrar

Most existing named entity recognition (NER) approaches are based on sequence labeling models, which focus on capturing the local context dependencies. However, the way of taking one sentence as input prevents the modeling of non-sequential…

Computation and Language · Computer Science 2021-06-03 Zanbo Wang , Wei Wei , Xianling Mao , Shanshan Feng , Pan Zhou , Zhiyong He , Sheng Jiang

Pretrained Language Models (PLMs) benefit from external knowledge stored in graph structures for various downstream tasks. However, bridging the modality gap between graph structures and text remains a significant challenge. Traditional…

Computation and Language · Computer Science 2024-04-11 Shuzhou Yuan , Michael Färber

The prosperity of deep learning contributes to the rapid progress in scene text detection. Among all the methods with convolutional networks, segmentation-based ones have drawn extensive attention due to their superiority in detecting text…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Jingyu Lin , Jie Jiang , Yan Yan , Chunchao Guo , Hongfa Wang , Wei Liu , Hanzi Wang

In light of the recent success of Graph Neural Networks (GNNs) and their ability to perform inference on complex data structures, many studies apply GNNs to the task of text classification. In most previous methods, a heterogeneous graph,…

Machine Learning · Computer Science 2024-10-29 Yassine Abbahaddou , Johannes F. Lutzeyer , Michalis Vazirgiannis

In the realm of graph learning, there is a category of methods that conceptualize graphs as hierarchical structures, utilizing node clustering to capture broader structural information. While generally effective, these methods often rely on…

Machine Learning · Computer Science 2024-12-25 Siyuan Huang , Yunchong Song , Jiayue Zhou , Zhouhan Lin

Document-level relation extraction is a complex human process that requires logical inference to extract relationships between named entities in text. Existing approaches use graph-based neural models with words as nodes and edges as…

Computation and Language · Computer Science 2019-09-04 Fenia Christopoulou , Makoto Miwa , Sophia Ananiadou

Human-curated knowledge graphs provide critical supportive information to various natural language processing tasks, but these graphs are usually incomplete, urging auto-completion of them. Prevalent graph embedding approaches, e.g.,…

Computation and Language · Computer Science 2021-02-25 Bo Wang , Tao Shen , Guodong Long , Tianyi Zhou , Yi Chang

The representation learning on textual graph is to generate low-dimensional embeddings for the nodes based on the individual textual features and the neighbourhood information. Recent breakthroughs on pretrained language models and graph…

Computation and Language · Computer Science 2023-10-10 Junhan Yang , Zheng Liu , Shitao Xiao , Chaozhuo Li , Defu Lian , Sanjay Agrawal , Amit Singh , Guangzhong Sun , Xing Xie

We propose a method to create document representations that reflect their internal structure. We modify Tree-LSTMs to hierarchically merge basic elements such as words and sentences into blocks of increasing complexity. Our Structure…

Computation and Language · Computer Science 2019-10-08 Khalil Mrini , Claudiu Musat , Michael Baeriswyl , Martin Jaggi

We propose a novel framework for modeling the interaction between graphical structures and the natural language text associated with their nodes and edges. Existing approaches typically fall into two categories. On group ignores the…

Computation and Language · Computer Science 2021-05-12 Aryan Arbabi , Mingqiu Wang , Laurent El Shafey , Nan Du , Izhak Shafran

Feature modeling of different modalities is a basic problem in current research of cross-modal information retrieval. Existing models typically project texts and images into one embedding space, in which semantically similar information…

Multimedia · Computer Science 2019-06-13 Jing Yu , Chenghao Yang , Zengchang Qin , Zhuoqian Yang , Yue Hu , Weifeng Zhang

Text encoders based on C-DSSM or transformers have demonstrated strong performance in many Natural Language Processing (NLP) tasks. Low latency variants of these models have also been developed in recent years in order to apply them in the…

Computation and Language · Computer Science 2021-05-04 Jason Yue Zhu , Yanling Cui , Yuming Liu , Hao Sun , Xue Li , Markus Pelger , Tianqi Yang , Liangjie Zhang , Ruofei Zhang , Huasha Zhao

Large language models (LLMs) are being increasingly explored for graph tasks. Despite their remarkable success in text-based tasks, LLMs' capabilities in understanding explicit graph structures remain limited, particularly with large…

Machine Learning · Computer Science 2024-10-31 Sambhav Khurana , Xiner Li , Shurui Gui , Shuiwang Ji

The growing interests and applications of graph learning in diverse domains have propelled the development of a unified model generalizing well across different graphs and tasks, known as the Graph Foundation Model (GFM). Existing research…

Machine Learning · Computer Science 2025-06-17 Trung-Kien Nguyen , Heng Ping , Shixuan Li , Peiyu Zhang , Nikos Kanakaris , Nicholas Kotov , Paul Bogdan

Recent years, the approaches based on neural networks have shown remarkable potential for sentence modeling. There are two main neural network structures: recurrent neural network (RNN) and convolution neural network (CNN). RNN can capture…

Computation and Language · Computer Science 2020-06-30 Zhenyu Liu , Haiwei Huang , Chaohong Lu , Shengfei Lyu

Graph Neural Networks (GNNs) have been highly successful for the node classification task. GNNs typically assume graphs are homophilic, i.e. neighboring nodes are likely to belong to the same class. However, a number of real-world graphs…

Machine Learning · Computer Science 2024-09-20 Yurui Lai , Taiyan Zhang , Rui Fan

Despite the significant progress made by transformer models in machine reading comprehension tasks, they still fall short in handling complex reasoning tasks due to the absence of explicit knowledge in the input sequence. To address this…

Computation and Language · Computer Science 2024-01-17 Shima Foolad , Kourosh Kiani

Text classification is fundamental in natural language processing (NLP), and Graph Neural Networks (GNN) are recently applied in this task. However, the existing graph-based works can neither capture the contextual word relationships within…

Computation and Language · Computer Science 2020-05-13 Yufeng Zhang , Xueli Yu , Zeyu Cui , Shu Wu , Zhongzhen Wen , Liang Wang

Graphs are essential for modeling complex interactions across domains such as social networks, biology, and recommendation systems. Traditional Graph Neural Networks, particularly Message Passing Neural Networks (MPNNs), rely heavily on…

Machine Learning · Computer Science 2025-06-13 Wei Li , Mengcheng Lan , Jiaxing Xu , Yiping Ke