English
Related papers

Related papers: BigBIO: A Framework for Data-Centric Biomedical Na…

200 papers

Large-language models have recently demonstrated impressive zero-shot capabilities in a variety of natural language tasks such as summarization, dialogue generation, and question-answering. Despite many promising applications in clinical…

Language models built using semi-supervised machine learning on large corpora of natural language have very quickly enveloped the fields of natural language generation and understanding. In this paper we apply a zero-shot approach…

Computation and Language · Computer Science 2022-01-25 Darren Abramson , Ali Emami

Recent advances in natural language processing (NLP) have been driven bypretrained language models like BERT, RoBERTa, T5, and GPT. Thesemodels excel at understanding complex texts, but biomedical literature, withits domain-specific…

Computation and Language · Computer Science 2025-07-28 K. Sahit Reddy , N. Ragavenderan , Vasanth K. , Ganesh N. Naik , Vishalakshi Prabhu , Nagaraja G. S

Despite advancements in conversational AI, language models encounter challenges to handle diverse conversational tasks, and existing dialogue dataset collections often lack diversity and comprehensiveness. To tackle these issues, we…

Computation and Language · Computer Science 2024-02-06 Jianguo Zhang , Kun Qian , Zhiwei Liu , Shelby Heinecke , Rui Meng , Ye Liu , Zhou Yu , Huan Wang , Silvio Savarese , Caiming Xiong

In this work, we explore the application of Large Language Models to zero-shot Lay Summarisation. We propose a novel two-stage framework for Lay Summarisation based on real-life processes, and find that summaries generated with this method…

Computation and Language · Computer Science 2025-01-10 Tomas Goldsack , Carolina Scarton , Chenghua Lin

Publicly accessible benchmarks that allow for assessing and comparing model performances are important drivers of progress in artificial intelligence (AI). While recent advances in AI capabilities hold the potential to transform medical…

Artificial Intelligence · Computer Science 2022-12-26 Kathrin Blagec , Jakob Kraiger , Wolfgang Frühwirt , Matthias Samwald

Curated datasets for healthcare are often limited due to the need of human annotations from experts. In this paper, we present MedEval, a multi-level, multi-task, and multi-domain medical benchmark to facilitate the development of language…

Computation and Language · Computer Science 2023-11-16 Zexue He , Yu Wang , An Yan , Yao Liu , Eric Y. Chang , Amilcare Gentili , Julian McAuley , Chun-Nan Hsu

Recent researches of large language models(LLM), which is pre-trained on massive general-purpose corpora, have achieved breakthroughs in responding human queries. However, these methods face challenges including limited data insufficiency…

Computation and Language · Computer Science 2025-01-07 Yiming Zhang , Zheng Chang , Wentao Cai , MengXing Ren , Kang Yuan , Yining Sun , Zenghui Ding

A long-running goal of the clinical NLP community is the extraction of important variables trapped in clinical notes. However, roadblocks have included dataset shift from the general domain and a lack of public clinical corpora and…

Computation and Language · Computer Science 2022-12-01 Monica Agrawal , Stefan Hegselmann , Hunter Lang , Yoon Kim , David Sontag

In recent years, large language models (LLMs) have demonstrated significant potential across various natural language processing (NLP) tasks. However, their performance in domain-specific applications and non-English languages remains less…

Computation and Language · Computer Science 2025-10-01 Dragos-Dumitru Ghinea , Adela-Nicoleta Corbeanu , Adrian-Marius Dumitran

While developments in machine learning led to impressive performance gains on big data, many human subjects data are, in actuality, small and sparsely labeled. Existing methods applied to such data often do not easily generalize to…

Machine Learning · Computer Science 2023-04-04 Julie Jiang , Kristina Lerman , Emilio Ferrara

We provide an overview of the emergence of large language models for scientific computing applications. We highlight use cases that involve natural language processing of scientific documents and specialized languages designed to describe…

Computation and Language · Computer Science 2024-06-12 Christopher Culver , Peter Hicks , Mihailo Milenkovic , Sanjif Shanmugavelu , Tobias Becker

Learning what to share between tasks has been a topic of great importance recently, as strategic sharing of knowledge has been shown to improve downstream task performance. This is particularly important for multilingual applications, as…

Computation and Language · Computer Science 2020-10-06 Farhad Nooralahzadeh , Giannis Bekoulis , Johannes Bjerva , Isabelle Augenstein

Despite the progress we have recorded in the last few years in multilingual natural language processing, evaluation is typically limited to a small set of languages with available datasets which excludes a large number of low-resource…

Computation and Language · Computer Science 2024-03-08 David Ifeoluwa Adelani , Hannah Liu , Xiaoyu Shen , Nikita Vassilyev , Jesujoba O. Alabi , Yanke Mao , Haonan Gao , Annie En-Shiun Lee

The inherent complexity of structured longitudinal Electronic Health Records (EHR) data poses a significant challenge when integrated with Large Language Models (LLMs), which are traditionally tailored for natural language processing.…

Computation and Language · Computer Science 2024-02-13 Yinghao Zhu , Zixiang Wang , Junyi Gao , Yuning Tong , Jingkun An , Weibin Liao , Ewen M. Harrison , Liantao Ma , Chengwei Pan

Large language models have recently been shown to attain reasonable zero-shot generalization on a diverse set of tasks (Brown et al., 2020). It has been hypothesized that this is a consequence of implicit multitask learning in language…

This work presents a systematic and in-depth investigation of the utility of large language models as text classifiers for biomedical article classification. The study uses several small and mid-size open source models, as well as selected…

Computation and Language · Computer Science 2026-03-13 Jakub Proboszcz , Paweł Cichosz

Natural language dialogue systems raise great attention recently. As many dialogue models are data-driven, high-quality datasets are essential to these systems. In this paper, we introduce Pchatbot, a large-scale dialogue dataset that…

Computation and Language · Computer Science 2021-06-01 Hongjin Qian , Xiaohe Li , Hanxun Zhong , Yu Guo , Yueyuan Ma , Yutao Zhu , Zhanliang Liu , Zhicheng Dou , Ji-Rong Wen

Large models are a hot research topic in the field of artificial intelligence. Leveraging their generative capabilities has the potential to enhance the level and quality of medical services. In response to the limitations of current large…

Computation and Language · Computer Science 2024-10-29 Haitao Zhang , Bo An

Metadata play a crucial role in ensuring the findability, accessibility, interoperability, and reusability of datasets. This paper investigates the potential of large language models (LLMs), specifically GPT-4, to improve adherence to…

Artificial Intelligence · Computer Science 2025-02-24 Sowmya S. Sundaram , Benjamin Solomon , Avani Khatri , Anisha Laumas , Purvesh Khatri , Mark A. Musen