中文
相关论文

相关论文: Localising In-Domain Adaptation of Transformer-Bas…

200 篇论文

In the ongoing wave of impact driven by large language models (LLMs) like ChatGPT, the adaptation of LLMs to medical domain has emerged as a crucial research frontier. Since mainstream LLMs tend to be designed for general-purpose…

计算与语言 · 计算机科学 2023-12-04 Issey Sukeda , Masahiro Suzuki , Hiroki Sakaji , Satoshi Kodera

Abstracts derived from biomedical literature possess distinct domain-specific characteristics, including specialised writing styles and biomedical terminologies, which necessitate a deep understanding of the related literature. As a result,…

计算与语言 · 计算机科学 2023-10-25 Chen Tang , Shun Wang , Tomas Goldsack , Chenghua Lin

The deployment of large language models (LLMs) within the healthcare sector has sparked both enthusiasm and apprehension. These models exhibit the remarkable capability to provide proficient responses to free-text queries, demonstrating a…

计算与语言 · 计算机科学 2024-07-09 Zabir Al Nazi , Wei Peng

Domain adaptation is a widely used method in natural language processing (NLP) to improve the performance of a language model within a specific domain. This method is particularly common in the biomedical domain, which sees regular…

计算与语言 · 计算机科学 2024-09-05 Mathieu Laï-king , Patrick Paroubek

The overwhelming amount of biomedical scientific texts calls for the development of effective language models able to tackle a wide range of biomedical natural language processing (NLP) tasks. The most recent dominant approaches are…

计算与语言 · 计算机科学 2021-04-21 Giacomo Miolo , Giulio Mantoan , Carlotta Orsenigo

Large Language Models represent state-of-the-art linguistic models designed to equip computers with the ability to comprehend natural language. With its exceptional capacity to capture complex contextual relationships, the LLaMA (Large…

计算与语言 · 计算机科学 2023-12-18 Pierpaolo Basile , Elio Musacchio , Marco Polignano , Lucia Siciliani , Giuseppe Fiameni , Giovanni Semeraro

Deep learning-based models in medical imaging often struggle to generalize effectively to new scans due to data heterogeneity arising from differences in hardware, acquisition parameters, population, and artifacts. This limitation presents…

图像与视频处理 · 电气工程与系统科学 2023-08-09 Sebastian Nørgaard Llambias , Mads Nielsen , Mostafa Mehdipour Ghazi

With large training datasets and massive amounts of computing sources, large language models (LLMs) achieve remarkable performance in comprehensive and generative ability. Based on those powerful LLMs, the model fine-tuned with…

计算与语言 · 计算机科学 2024-01-12 Xuyang Zhao , Qibin Zhao , Toshihisa Tanaka

Large pre-trained models have achieved great success in many natural language processing tasks. However, when they are applied in specific domains, these models suffer from domain shift and bring challenges in fine-tuning and online serving…

计算与语言 · 计算机科学 2021-06-30 Yunzhi Yao , Shaohan Huang , Wenhui Wang , Li Dong , Furu Wei

Despite being a unique source of information on patients' status and disease progression, clinical notes are characterized by high levels of duplication and information redundancy. In general domain text, it has been shown that…

计算与语言 · 计算机科学 2023-12-18 Isotta Landi , Eugenia Alleva , Alissa A. Valentine , Lauren A. Lepow , Alexander W. Charney

Translating biomedical ontologies is an important challenge, but doing it manually requires much time and money. We study the possibility to use open-source knowledge bases to translate biomedical ontologies. We focus on two aspects:…

定量方法 · 定量生物学 2020-04-08 Léo Bouscarrat , Antoine Bonnefoy , Cécile Capponi , Carlos Ramisch

The number of pretrained Large Language Models (LLMs) is increasing steadily, though the majority are designed predominantly for the English language. While state-of-the-art LLMs can handle other languages, due to language contamination or…

Several recent works seek to develop foundation models specifically for medical applications, adapting general-purpose large language models (LLMs) and vision-language models (VLMs) via continued pretraining on publicly available biomedical…

计算与语言 · 计算机科学 2024-11-21 Daniel P. Jeong , Saurabh Garg , Zachary C. Lipton , Michael Oberst

Off-the-shelf models are widely used by computational social science researchers to measure properties of text, such as sentiment. However, without access to source data it is difficult to account for domain shift, which represents a threat…

计算与语言 · 计算机科学 2022-05-02 Junshen K. Chen , Dallas Card , Dan Jurafsky

The utilization of clinical reports for various secondary purposes, including health research and treatment monitoring, is crucial for enhancing patient care. Natural Language Processing (NLP) tools have emerged as valuable assets for…

计算与语言 · 计算机科学 2023-06-14 Iker de la Iglesia , Aitziber Atutxa , Koldo Gojenola , Ander Barrena

Large Language Models (LLMs) have demonstrated remarkable versatility in recent years, offering potential applications across specialized domains such as healthcare and medicine. Despite the availability of various open-source LLMs tailored…

计算与语言 · 计算机科学 2024-07-18 Yanis Labrak , Adrien Bazoge , Emmanuel Morin , Pierre-Antoine Gourraud , Mickael Rouvier , Richard Dufour

Italy exhibits rich linguistic diversity across its territory due to the distinct regional languages spoken in different areas. Recent advances in self-supervised learning provide new opportunities to analyze Italy's linguistic varieties…

计算与语言 · 计算机科学 2025-11-13 Moreno La Quatra , Alkis Koudounas , Elena Baralis , Sabato Marco Siniscalchi

Predicting the quality of multimedia content is often needed in different fields. In some applications, quality metrics are crucial with a high impact, and can affect decision making such as diagnosis from medical multimedia. In this paper,…

图像与视频处理 · 电气工程与系统科学 2022-10-20 Marouane Tliba , Aymen Sekhri , Mohamed Amine Kerkouri , Aladine Chetouani

The aim of this work is to define a speech emotion recognition (SER) model able to recognize positive, neutral and negative emotions in natural conversations of Italian elderly people. Several datasets for SER are available in the…

音频与语音处理 · 电气工程与系统科学 2022-11-15 Francesca Gasparini , Alessandra Grossi

This study reviewed the use of Large Language Models (LLMs) in healthcare, focusing on their training corpora, customization techniques, and evaluation metrics. A systematic search of studies from 2021 to 2024 identified 61 articles. Four…

计算与语言 · 计算机科学 2025-02-18 Shuqi Yang , Mingrui Jing , Shuai Wang , Jiaxin Kou , Manfei Shi , Weijie Xing , Yan Hu , Zheng Zhu