English
Related papers

Related papers: Towards Efficient Methods in Medical Question Answ…

200 papers

Learning to represent free text is a core task in many clinical machine learning (ML) applications, as clinical text contains observations and plans not otherwise available for inference. State-of-the-art methods use large language models…

Computation and Language · Computer Science 2023-01-30 Lecheng Kong , Christopher King , Bradley Fritz , Yixin Chen

Parameter-efficient finetuning (PEFT) is a key technique for adapting large language models (LLMs) to downstream tasks. In this paper, we study leveraging knowledge graph embeddings to improve the effectiveness of PEFT. We propose a…

Computation and Language · Computer Science 2024-03-25 Xindi Luo , Zequn Sun , Jing Zhao , Zhe Zhao , Wei Hu

In recent years, multimodal large language models (MLLMs) have made significant strides by training on vast high-quality image-text datasets, enabling them to generally understand images well. However, the inherent difficulty in explicitly…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Yuanze Lin , Yunsheng Li , Dongdong Chen , Weijian Xu , Ronald Clark , Philip Torr , Lu Yuan

Integrating large language models (LLMs) with knowledge graphs derived from domain-specific data represents an important advancement towards more powerful and factual reasoning. As these models grow more capable, it is crucial to enable…

Artificial Intelligence · Computer Science 2024-04-19 Stefan Dernbach , Khushbu Agarwal , Alejandro Zuniga , Michael Henry , Sutanay Choudhury

Massively multilingual language models such as multilingual BERT offer state-of-the-art cross-lingual transfer performance on a range of NLP tasks. However, due to limited capacity and large differences in pretraining data sizes, there is a…

Computation and Language · Computer Science 2021-09-13 Jonas Pfeiffer , Ivan Vulić , Iryna Gurevych , Sebastian Ruder

Biomedical Named Entity Recognition (NER) is a fundamental task of Biomedical Natural Language Processing for extracting relevant information from biomedical texts, such as clinical records, scientific publications, and electronic health…

Computation and Language · Computer Science 2023-12-27 Fahime Shahrokh , Nasser Ghadiri , Rasoul Samani , Milad Moradi

Deep neural network models have been very successfully applied to Natural Language Processing (NLP) and Image based tasks. Their application to network analysis and management tasks is just recently being pursued. Our interest is in…

Networking and Internet Architecture · Computer Science 2022-06-22 Franck Le , Davis Wertheimer , Seraphin Calo , Erich Nahum

While deep learning techniques have shown promising results in many natural language processing (NLP) tasks, it has not been widely applied to the clinical domain. The lack of large datasets and the pervasive use of domain-specific language…

Computation and Language · Computer Science 2019-06-20 Jiin Nam , Seunghyun Yoon , Kyomin Jung

Biomedical machine reading comprehension (biomedical-MRC) aims to comprehend complex biomedical narratives and assist healthcare professionals in retrieving information from them. The high performance of modern neural network-based MRC…

Computation and Language · Computer Science 2022-07-27 Maria Mahbub , Sudarshan Srinivasan , Edmon Begoli , Gregory D Peterson

Word embeddings play a significant role in today's Natural Language Processing tasks and applications. While pre-trained models may be directly employed and integrated into existing pipelines, they are often fine-tuned to better fit with…

Computation and Language · Computer Science 2022-11-10 Denys Amore Bondarenko , Roger Ferrod , Luigi Di Caro

Large language models (LLMs) have emerged as powerful machine-learning systems capable of handling a myriad of tasks. Tuned versions of these systems have been turned into chatbots that can respond to user queries on a vast diversity of…

Computation and Language · Computer Science 2024-08-16 Kevin G. Yager

In multilingual healthcare applications, the availability of domain-specific natural language processing(NLP) tools is limited, especially for low-resource languages. Although multilingual bidirectional encoder representations from…

Pretrained Language Models (PLMs) such as BERT have revolutionized the landscape of Natural Language Processing (NLP). Inspired by their proliferation, tremendous efforts have been devoted to Pretrained Graph Models (PGMs). Owing to the…

Machine Learning · Computer Science 2022-03-22 Jun Xia , Yanqiao Zhu , Yuanqi Du , Stan Z. Li

Clinical diagnosis is time-consuming, requiring intensive interactions between patients and medical professionals. While large language models (LLMs) could ease the pre-diagnostic workload, their limited domain knowledge hinders effective…

Computation and Language · Computer Science 2026-03-03 Liwen Sun , Xiang Yu , Ming Tan , Zhuohao Chen , Anqi Cheng , Ashutosh Joshi , Chenyan Xiong

Large language models (LLMs) are increasingly recognized as valuable tools across the medical environment, supporting clinical, research, and administrative workflows. However, strict privacy and network security regulations in hospital…

Computation and Language · Computer Science 2026-01-09 Seokhwan Ko , Donghyeon Lee , Jaewoo Chun , Hyungsoo Han , Junghwan Cho

Knowledge graphs (KGs) contain rich information about world knowledge, entities and relations. Thus, they can be great supplements to existing pre-trained language models. However, it remains a challenge to efficiently integrate information…

Computation and Language · Computer Science 2020-10-05 Donghan Yu , Chenguang Zhu , Yiming Yang , Michael Zeng

We focus on a conversational question answering task which combines the challenges of understanding questions in context and reasoning over evidence gathered from heterogeneous sources like text, knowledge graphs, tables, and infoboxes. Our…

Computation and Language · Computer Science 2024-07-16 Parag Jain , Mirella Lapata

Online medical forums have become a predominant platform for answering health-related information needs of consumers. However, with a significant rise in the number of queries and the limited availability of experts, it is necessary to…

Deep learning (DL) based predictive models from electronic health records (EHR) deliver impressive performance in many clinical tasks. Large training cohorts, however, are often required to achieve high accuracy, hindering the adoption of…

Computation and Language · Computer Science 2020-05-27 Laila Rasmy , Yang Xiang , Ziqian Xie , Cui Tao , Degui Zhi

Large Language Models (LLMs) have achieved exceptional capabilities in open generation across various domains, yet they encounter difficulties with tasks that require intensive knowledge. To address these challenges, methods for integrating…

Computation and Language · Computer Science 2024-12-17 Fali Wang , Runxue Bao , Suhang Wang , Wenchao Yu , Yanchi Liu , Wei Cheng , Haifeng Chen