English
Related papers

Related papers: Igea: a Decoder-Only Language Model for Biomedical…

200 papers

Large language models exhibit promising general capabilities but often lack specialized knowledge for domain-specific tasks. Developing domain experts from a base model enables a range of applications without prohibitive training costs.…

Computation and Language · Computer Science 2023-11-02 Zhen Guo , Yining Hua

Large Language Models (LLMs) have substantially driven scientific progress in various domains, and many papers have demonstrated their ability to tackle complex problems with creative solutions. Our paper introduces a new foundation model,…

Relation extraction is a fundamental problem in natural language processing. Most existing models are defined for relation extraction in the general domain. However, their performance on specific domains (e.g., biomedicine) is yet unclear.…

Computation and Language · Computer Science 2021-12-14 Yongkang Li

Purpose: Large Language Models (LLMs) hold significant promise for medical applications. Retrieval Augmented Generation (RAG) emerges as a promising approach for customizing domain knowledge in LLMs. This case study presents the development…

We describe Evalita-LLM, a new benchmark designed to evaluate Large Language Models (LLMs) on Italian tasks. The distinguishing and innovative features of Evalita-LLM are the following: (i) all tasks are native Italian, avoiding issues of…

Computation and Language · Computer Science 2025-02-05 Bernardo Magnini , Roberto Zanoli , Michele Resta , Martin Cimmino , Paolo Albano , Marco Madeddu , Viviana Patti

Generative models have recently gained increasing attention in image generation and editing tasks. However, they often lack a direct connection to object geometry, which is crucial in sensitive domains such as computational anatomy,…

Graphics · Computer Science 2025-04-14 Nian Wu , Nivetha Jayakumar , Jiarui Xing , Miaomiao Zhang

Cutting edge techniques developed in the general NLP domain are often subsequently applied to the high-value, data-rich biomedical domain. The past few years have seen generative language models (LMs), instruction finetuning, and few-shot…

Computation and Language · Computer Science 2025-07-28 Aviv Brokman , Ramakanth Kavuluru

Visual Information Extraction (VIE) plays a crucial role in the comprehension of semi-structured documents, and several pre-trained models have been developed to enhance performance. However, most of these works are monolingual (usually…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Huawen Shen , Gengluo Li , Jinwen Zhong , Yu Zhou

Tiny Aya redefines what a small multilingual language model can achieve. Trained on 70 languages and refined through region-aware posttraining, it delivers state-of-the-art in translation quality, strong multilingual understanding, and…

This work presents a Biomedical Literature Question Answering (Q&A) system based on a Retrieval-Augmented Generation (RAG) architecture, designed to improve access to accurate, evidence-based medical information. Addressing the shortcomings…

Computation and Language · Computer Science 2025-09-09 Mansi Garg , Lee-Chi Wang , Bhavesh Ghanchi , Sanjana Dumpala , Shreyash Kakde , Yen Chih Chen

The question-answering system for Life science research, which is characterized by the rapid pace of discovery, evolving insights, and complex interactions among knowledge entities, presents unique challenges in maintaining a comprehensive…

Computation and Language · Computer Science 2024-08-15 Chengrui Wang , Qingqing Long , Meng Xiao , Xunxin Cai , Chengjun Wu , Zhen Meng , Xuezhi Wang , Yuanchun Zhou

Advances in natural language processing and large language models have sparked growing interest in modeling DNA, often referred to as the "language of life". However, DNA modeling poses unique challenges. First, it requires the ability to…

Background: Biomedical entity normalization is critical to biomedical research because the richness of free-text clinical data, such as progress notes, can often be fully leveraged only after translating words and phrases into structured…

Computation and Language · Computer Science 2024-05-27 Nicholas J Dobbins

Text generating capabilities have undergone a substantial transformation with the introduction of large language models (LLMs). Electroencephalography (EEG)-based text production is still difficult, though, because it requires a lot of data…

Human-Computer Interaction · Computer Science 2025-11-18 Khushiyant

We introduce VIGiA, a novel multimodal dialogue model designed to understand and reason over complex, multi-step instructional video action plans. Unlike prior work which focuses mainly on text-only guidance, or treats vision and language…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Diogo Glória-Silva , David Semedo , João Maglhães

The growing convergence between Large Language Models (LLMs) and electroencephalography (EEG) research is enabling new directions in neural decoding, brain-computer interfaces (BCIs), and affective computing. This survey offers a systematic…

Signal Processing · Electrical Eng. & Systems 2025-06-11 Naseem Babu , Jimson Mathew , A. P. Vinod

The advancement in healthcare has shifted focus toward patient-centric approaches, particularly in self-care and patient education, facilitated by access to Electronic Health Records (EHR). However, medical jargon in EHRs poses significant…

Computation and Language · Computer Science 2024-10-28 Zonghai Yao , Nandyala Siddharth Kantu , Guanghao Wei , Hieu Tran , Zhangqi Duan , Sunjae Kwon , Zhichao Yang , README annotation team , Hong Yu

With the rapid development of multimodal large language models (MLLMs), especially their capabilities in visual chat through refer and ground functionalities, their significance is increasingly recognized. However, the biomedical field…

Computer Vision and Pattern Recognition · Computer Science 2024-07-01 Xiaoshuang Huang , Haifeng Huang , Lingdong Shen , Yehui Yang , Fangxin Shang , Junwei Liu , Jia Liu

Large language models (LLMs) are rapidly transforming various domains, including biomedicine and healthcare, and demonstrate remarkable potential from scientific research to new drug discovery. Graph-based retrieval-augmented generation…

Quantitative Methods · Quantitative Biology 2025-11-14 Guofeng Meng , Li Shen , Qiuyan Zhong , Wei Wang , Haizhou Zhang , Xiaozhen Wang