English
Related papers

Related papers: LLaMA-Gene: A General-purpose Gene Task Large Lang…

200 papers

To enhance the performance of large language models (LLMs) in biomedical natural language processing (BioNLP) by introducing a domain-specific instruction dataset and examining its impact when combined with multi-task learning principles.…

Computation and Language · Computer Science 2024-06-10 Hieu Tran , Zhichao Yang , Zonghai Yao , Hong Yu

Pre-trained large language models demonstrate potential in extracting information from DNA sequences, yet adapting to a variety of tasks and data modalities remains a challenge. To address this, we propose DNAGPT, a generalized DNA…

Genomics · Quantitative Biology 2023-09-01 Daoan Zhang , Weitong Zhang , Yu Zhao , Jianguo Zhang , Bing He , Chenchen Qin , Jianhua Yao

This study aims to innovatively explore adaptive applications of large language models (LLM) in urban renewal. It also aims to improve its performance and text generation quality for knowledge question-answering (QA) tasks. Based on the…

Computation and Language · Computer Science 2023-11-28 Xi Wang , Xianyao Ling , Tom Zhang , Xuecao Li , Shaolan Wang , Zhixing Li , Liang Zhang , Peng Gong

Multilingual transfer ability, which reflects how well models fine-tuned on one source language can be applied to other languages, has been well studied in multilingual pre-trained models. However, the existence of such capability transfer…

Computation and Language · Computer Science 2025-01-20 Wang Liang

While Genetic Improvement (GI) is a useful paradigm to improve functional and nonfunctional aspects of software, existing techniques tended to use the same set of mutation operators for differing objectives, due to the difficulty of writing…

Software Engineering · Computer Science 2023-04-20 Sungmin Kang , Shin Yoo

Large Language Models (LLMs), such as ChatGPT, have taken the world by storm and have passed certain forms of the Turing test. However, LLMs are not limited to human language and analyze sequential data, such as DNA, protein, and gene…

Genomics · Quantitative Biology 2024-01-08 Hilbert Yuen In Lam , Xing Er Ong , Marek Mutwil

AI tasks encompass a wide range of domains and fields. While numerous AI models have been designed for specific tasks and applications, they often require considerable human efforts in finding the right model architecture, optimization…

Computation and Language · Computer Science 2023-05-05 Shujian Zhang , Chengyue Gong , Lemeng Wu , Xingchao Liu , Mingyuan Zhou

Large Language Models (LLMs) have revo lutionized natural language processing Natural Language Processing (NLP), with Chat Generative Pre-trained Transformer (ChatGPT) standing out as a notable exampledue to its advanced capabilities and…

Computation and Language · Computer Science 2025-03-25 Azim Akhtarshenas , Afshin Dini , Navid Ayoobi

Grammatical error correction aims to correct ungrammatical sentences automatically. Recently, some work has demonstrated the excellent capabilities of closed-source Large Language Models (LLMs, e.g., ChatGPT) in grammatical error…

Computation and Language · Computer Science 2023-08-21 Yaxin Fan , Feng Jiang , Peifeng Li , Haizhou Li

With the productive evolution of large language models (LLMs) in the field of natural language processing (NLP), tons of effort has been made to effectively fine-tune common pre-trained LLMs to fulfill a variety of tasks in one or multiple…

Computation and Language · Computer Science 2024-02-06 Chao Song , Zhihao Ye , Qiqiang Lin , Qiuying Peng , Jun Wang

Recently, ChatGPT and GPT-4 have emerged and gained immense global attention due to their unparalleled performance in language processing. Despite demonstrating impressive capability in various open-domain tasks, their adequacy in highly…

Computation and Language · Computer Science 2023-04-19 Zihao Wu , Lu Zhang , Chao Cao , Xiaowei Yu , Haixing Dai , Chong Ma , Zhengliang Liu , Lin Zhao , Gang Li , Wei Liu , Quanzheng Li , Dinggang Shen , Xiang Li , Dajiang Zhu , Tianming Liu

Large Language Models (LLMs), such as ChatGPT and GPT-4, have dramatically transformed natural language processing research and shown promising strides towards Artificial General Intelligence (AGI). Nonetheless, the high costs associated…

Computation and Language · Computer Science 2024-02-26 Yiming Cui , Ziqing Yang , Xin Yao

Objective To solve major clinical natural language processing (NLP) tasks using a unified text-to-text learning architecture based on a generative large language model (LLM) via prompt tuning. Methods We formulated 7 key clinical NLP tasks…

Computation and Language · Computer Science 2023-12-12 Cheng Peng , Xi Yang , Aokun Chen , Zehao Yu , Kaleb E Smith , Anthony B Costa , Mona G Flores , Jiang Bian , Yonghui Wu

In 2022, with the release of ChatGPT, large-scale language models gained widespread attention. ChatGPT not only surpassed previous models in terms of parameters and the scale of its pretraining corpus but also achieved revolutionary…

Artificial Intelligence · Computer Science 2024-11-13 Yiming Ju , Huanhuan Ma

Large Language Models (LLMs) such as GPT-4 have demonstrated their ability to understand natural language and generate complex code snippets. This paper introduces a novel Large Language Model Evolutionary Algorithm (LLaMEA) framework,…

Neural and Evolutionary Computing · Computer Science 2025-01-31 Niki van Stein , Thomas Bäck

Large language models (LLMs) are having transformative impacts across a wide range of scientific fields, particularly in the biomedical sciences. Just as the goal of Natural Language Processing is to understand sequences of words, a major…

Genomics · Quantitative Biology 2024-09-24 Gonzalo Benegas , Chengzhong Ye , Carlos Albors , Jianan Canal Li , Yun S. Song

Large Language Models (LLMs) have demonstrated excellent performance in general language understanding, generation and other tasks. However, when fine-tuning for specific domain tasks, the general knowledge accumulated in the pre-training…

Computation and Language · Computer Science 2026-04-21 Weijie Wan , Jiangjiang Zhao

While Large Language Models (LLMs) have demonstrated exceptional multitasking abilities, fine-tuning these models on downstream, domain-specific datasets is often necessary to yield superior performance on test sets compared to their…

Computation and Language · Computer Science 2024-03-15 Haoran Yang , Yumeng Zhang , Jiaqi Xu , Hongyuan Lu , Pheng Ann Heng , Wai Lam

Large language models (LLMs) are widely applied in various natural language processing tasks such as question answering and machine translation. However, due to the lack of labeled data and the difficulty of manual annotation for…

Artificial Intelligence · Computer Science 2026-05-27 Xuan Lin , Long Chen , Yile Wang , Yangyang Chen , Xiangxiang Zeng

There is enormous enthusiasm and concerns in using large language models (LLMs) in healthcare, yet current assumptions are all based on general-purpose LLMs such as ChatGPT. This study develops a clinical generative LLM, GatorTronGPT, using…