English
Related papers

Related papers: KG-MTT-BERT: Knowledge Graph Enhanced BERT for Mul…

200 papers

Knowledge graph (KG) is an abstraction that can be extracted from text corpora and used for in-depth reasoning. Prior work has leveraged KGs to fine-tune language models (LMs), enabling domain-specific superintelligence. In this work, we…

Computation and Language · Computer Science 2026-05-28 Jake Stephen , Niraj K. Jha

Multi-Label Text Classification (MLTC) is a fundamental task in the field of Natural Language Processing (NLP) that involves the assignment of multiple labels to a given text. MLTC has gained significant importance and has been widely…

Computation and Language · Computer Science 2024-03-20 Bo Li , Yuyan Chen , Liang Zeng

Generating knowledge grounded responses in both goal and non-goal oriented dialogue systems is an important research challenge. Knowledge Graphs (KG) can be viewed as an abstraction of the real world, which can potentially facilitate a…

Computation and Language · Computer Science 2021-03-31 Debanjan Chaudhuri , Md Rashad Al Hasan Rony , Jens Lehmann

Healthcare domain generates a lot of unstructured and semi-structured text. Natural Language processing (NLP) has been used extensively to process this data. Deep Learning based NLP especially Large Language Models (LLMs) such as BERT have…

Computation and Language · Computer Science 2023-01-11 Kunal Suri , Atul Singh , Prakhar Mishra , Swapna Sourav Rout , Rajesh Sabapathy

Background Knowledge graphs (KGs), especially medical knowledge graphs, are often significantly incomplete, so it necessitating a demand for medical knowledge graph completion (MedKGC). MedKGC can find new facts based on the exited…

Artificial Intelligence · Computer Science 2021-05-31 Yinyu Lan , Shizhu He , Xiangrong Zeng , Shengping Liu , Kang Liu , Jun Zhao

The BERT model has arisen as a popular state-of-the-art machine learning model in the recent years that is able to cope with multiple NLP tasks such as supervised text classification without human supervision. Its flexibility to cope with…

Computation and Language · Computer Science 2023-04-26 Santiago González-Carvajal , Eduardo C. Garrido-Merchán

Existing medical RAG systems mainly leverage knowledge from medical knowledge bases, neglecting the crucial role of experiential knowledge derived from similar patient cases -- a key component of human clinical reasoning. To bridge this…

Computation and Language · Computer Science 2025-05-27 Yuxing Lu , Gecheng Fu , Wei Wu , Xukai Zhao , Sin Yee Goi , Jinzhuo Wang

Recently, the performance of Pre-trained Language Models (PLMs) has been significantly improved by injecting knowledge facts to enhance their abilities of language understanding. For medical domains, the background knowledge sources are…

Computation and Language · Computer Science 2021-08-23 Taolin Zhang , Zerui Cai , Chengyu Wang , Minghui Qiu , Bite Yang , Xiaofeng He

Recent advances in Large Language Models (LLMs) have positioned them as a prominent solution for Natural Language Processing tasks. Notably, they can approach these problems in a zero or few-shot manner, thereby eliminating the need for…

Machine Learning · Computer Science 2025-05-07 Gerard Pons , Besim Bilalli , Anna Queralt

In multi-label text classification, each textual document can be assigned with one or more labels. Due to this nature, the multi-label text classification task is often considered to be more challenging compared to the binary or multi-class…

Information Retrieval · Computer Science 2019-07-02 Jingcheng Du , Qingyu Chen , Yifan Peng , Yang Xiang , Cui Tao , Zhiyong Lu

As a natural language generation task, it is challenging to generate informative and coherent review text. In order to enhance the informativeness of the generated text, existing solutions typically learn to copy entities or triples from…

Computation and Language · Computer Science 2021-05-11 Junyi Li , Wayne Xin Zhao , Zhicheng Wei , Nicholas Jing Yuan , Ji-Rong Wen

In contrast to large text corpora, knowledge graphs (KG) provide dense and structured representations of factual information. This makes them attractive for systems that supplement or ground the knowledge found in pre-trained language…

Computation and Language · Computer Science 2023-06-06 Sondre Wold , Lilja Øvrelid , Erik Velldal

Biomedical text mining is becoming increasingly important as the number of biomedical documents rapidly grows. With the progress in natural language processing (NLP), extracting valuable information from biomedical literature has gained…

Computation and Language · Computer Science 2019-10-21 Jinhyuk Lee , Wonjin Yoon , Sungdong Kim , Donghyeon Kim , Sunkyu Kim , Chan Ho So , Jaewoo Kang

BERTScore is an effective and robust automatic metric for referencebased machine translation evaluation. In this paper, we incorporate multilingual knowledge graph into BERTScore and propose a metric named KG-BERTScore, which linearly…

Computation and Language · Computer Science 2023-01-31 Zhanglin Wu , Min Zhang , Ming Zhu , Yinglu Li , Ting Zhu , Hao Yang , Song Peng , Ying Qin

The ability of knowledge graphs to represent complex relationships at scale has led to their adoption for various needs including knowledge representation, question-answering, and recommendation systems. Knowledge graphs are often…

Computation and Language · Computer Science 2023-05-18 Jason Youn , Ilias Tagkopoulos

While neural networks have been used extensively to make substantial progress in the machine translation task, they are known for being heavily dependent on the availability of large amounts of training data. Recent efforts have tried to…

Computation and Language · Computer Science 2019-02-26 Diego Moussallem , Mihael Arčan , Axel-Cyrille Ngonga Ngomo , Paul Buitelaar

Learning to represent free text is a core task in many clinical machine learning (ML) applications, as clinical text contains observations and plans not otherwise available for inference. State-of-the-art methods use large language models…

Computation and Language · Computer Science 2023-01-30 Lecheng Kong , Christopher King , Bradley Fritz , Yixin Chen

This paper presents the novel way combining the BERT embedding method and the graph convolutional neural network. This combination is employed to solve the text classification problem. Initially, we apply the BERT embedding method to the…

Computation and Language · Computer Science 2022-09-07 Loc Hoang Tran , Tuan Tran , An Mai

Knowledge Graph Embedding (KGE) techniques are crucial in learning compact representations of entities and relations within a knowledge graph, facilitating efficient reasoning and knowledge discovery. While existing methods typically focus…

Computation and Language · Computer Science 2024-10-29 Pengcheng Jiang , Lang Cao , Cao Xiao , Parminder Bhatia , Jimeng Sun , Jiawei Han

Knowledge of a disease includes information of various aspects of the disease, such as signs and symptoms, diagnosis and treatment. This disease knowledge is critical for many health-related and biomedical tasks, including consumer health…

Computation and Language · Computer Science 2020-10-09 Yun He , Ziwei Zhu , Yin Zhang , Qin Chen , James Caverlee