English
Related papers

Related papers: Transfer Learning with Clinical Concept Embeddings…

200 papers

Reading comprehension, a fundamental cognitive ability essential for knowledge acquisition, is a complex skill, with a notable number of learners lacking proficiency in this domain. This study introduces innovative tasks for Brain-Computer…

Human-Computer Interaction · Computer Science 2024-01-30 Yuhong Zhang , Shilai Yang , Gert Cauwenberghs , Tzyy-Ping Jung

This study investigates uncertainty quantification in large language models (LLMs) for medical applications, emphasizing both technical innovations and philosophical implications. As LLMs become integral to clinical decision-making,…

Artificial Intelligence · Computer Science 2025-04-08 Zahra Atf , Seyed Amir Ahmad Safavi-Naini , Peter R. Lewis , Aref Mahjoubfar , Nariman Naderi , Thomas R. Savage , Ali Soroush

Transformer-based large language models (LLMs) rely on contextual embeddings which generate different (continuous) representations for the same token depending on its surrounding context. Nonetheless, words and tokens typically have a…

Computation and Language · Computer Science 2025-07-10 Qitong Wang , Mohammed J. Zaki , Georgios Kollias , Vasileios Kalantzis

The purpose of this study is to analyze the efficacy of transfer learning techniques and transformer-based models as applied to medical natural language processing (NLP) tasks, specifically radiological text classification. We used 1,977…

Computation and Language · Computer Science 2020-02-19 Daniel Ranti , Katie Hanss , Shan Zhao , Varun Arvind , Joseph Titano , Anthony Costa , Eric Oermann

Working within specific NLP subdomains presents significant challenges, primarily due to a persistent deficit of data. Stringent privacy concerns and limited data accessibility often drive this shortage. Additionally, the medical domain…

Computation and Language · Computer Science 2024-11-19 Priyanka Singh , Vladislav D. Mosin , Ivan P. Yamshchikov

We conduct investigations on clinical text machine translation by examining multilingual neural network models using deep learning such as Transformer based structures. Furthermore, to address the language resource imbalance issue, we also…

Computation and Language · Computer Science 2024-02-22 Lifeng Han , Serge Gladkoff , Gleb Erofeev , Irina Sorokina , Betty Galiano , Goran Nenadic

Transfer learning is a standard technique to improve performance on tasks with limited data. However, for medical imaging, the value of transfer learning is less clear. This is likely due to the large domain mismatch between the usual…

Cross-capability transfer is a key challenge in large language model (LLM) research, with applications in multi-task integration, model compression, and continual learning. Recent works like FuseLLM and FuseChat have demonstrated the…

Artificial Intelligence · Computer Science 2026-02-27 Guodong Du , Zhuo Li , Xuanning Zhou , Junlin Li , Zesheng Shi , Wanyu Lin , Ho-Kin Tang , Xiucheng Li , Fangming Liu , Wenya Wang , Min Zhang , Jing Li

There is growing evidence that pretrained language models improve task-specific fine-tuning not just for the languages seen in pretraining, but also for new languages and even non-linguistic data. What is the nature of this surprising…

Computation and Language · Computer Science 2021-04-20 Zhengxuan Wu , Nelson F. Liu , Christopher Potts

Healthcare domain generates a lot of unstructured and semi-structured text. Natural Language processing (NLP) has been used extensively to process this data. Deep Learning based NLP especially Large Language Models (LLMs) such as BERT have…

Computation and Language · Computer Science 2023-01-11 Kunal Suri , Atul Singh , Prakhar Mishra , Swapna Sourav Rout , Rajesh Sabapathy

Although deep learning models like CNNs have achieved great success in medical image analysis, the small size of medical datasets remains a major bottleneck in this area. To address this problem, researchers have started looking for…

Image and Video Processing · Electrical Eng. & Systems 2021-02-09 Xiaozheng Xie , Jianwei Niu , Xuefeng Liu , Zhengsu Chen , Shaojie Tang , Shui Yu

Advancements in sensing and computing technologies, the development of human and computer interaction frameworks, big data storage capabilities, and the emergence of cloud storage and could computing have resulted in an abundance of data in…

Machine Learning · Computer Science 2020-07-07 Ramin Moradi , Katrina M. Groth

The utilization of large language models (LLMs) in the Healthcare domain has generated both excitement and concern due to their ability to effectively respond to freetext queries with certain professional knowledge. This survey outlines the…

Computation and Language · Computer Science 2025-01-28 Kai He , Rui Mao , Qika Lin , Yucheng Ruan , Xiang Lan , Mengling Feng , Erik Cambria

Biomedical word embeddings are usually pre-trained on free text corpora with neural methods that capture local and global distributional properties. They are leveraged in downstream tasks using various neural architectures that are designed…

Computation and Language · Computer Science 2021-07-26 Jiho Noh , Ramakanth Kavuluru

Named entity recognition is a key component of Information Extraction (IE), particularly in scientific domains such as biomedicine and chemistry, where large language models (LLMs), e.g., ChatGPT, fall short. We investigate the…

Computation and Language · Computer Science 2024-04-02 Hongyi Liu , Qingyun Wang , Payam Karisani , Heng Ji

The rapid advancements in large language models (LLMs) have opened up new opportunities for transforming patient engagement in healthcare through conversational AI. This paper presents an overview of the current landscape of LLMs in…

Artificial Intelligence · Computer Science 2024-11-27 Bo Wen , Raquel Norel , Julia Liu , Thaddeus Stappenbeck , Farhana Zulkernine , Huamin Chen

Large Language Models (LLMs) have demonstrated significant potential in handling specialized tasks, including medical problem-solving. However, most studies predominantly focus on English-language contexts. This study introduces a novel…

Computation and Language · Computer Science 2025-09-15 Łukasz Grzybowski , Jakub Pokrywka , Michał Ciesiółka , Jeremi I. Kaczmarek , Marek Kubis

Expert-layman text style transfer technologies have the potential to improve communication between members of scientific communities and the general public. High-quality information produced by experts is often filled with difficult jargon…

Computation and Language · Computer Science 2021-12-21 Wenda Xu , Michael Saxon , Misha Sra , William Yang Wang

Multilingual machine translation systems aim to make knowledge accessible across languages, yet learning effective cross-lingual representations remains challenging. These challenges are especially pronounced for low-resource languages,…

Computation and Language · Computer Science 2026-01-08 David Stap

Machine learning for tabular data remains constrained by poor schema generalization, a challenge rooted in the lack of semantic understanding of structured variables. This challenge is particularly acute in domains like clinical medicine,…

Machine Learning · Computer Science 2026-05-05 Hongxi Mao , Wei Zhou , Mengting Jia , Tao Fang , Huan Gao , Bin Zhang , Shangyang Li