English
Related papers

Related papers: GrammarGPT: Exploring Open-Source LLMs for Native …

200 papers

This study investigates the capabilities of large language models (LLMs), specifically ChatGPT, in annotating MT outputs based on an error typology. In contrast to previous work focusing mainly on general language, we explore ChatGPT's…

Computation and Language · Computer Science 2025-04-22 Joachim Minder , Guillaume Wisniewski , Natalie Kübler

Prior work has shown that finetuning large language models (LLMs) using machine-generated instruction-following data enables such models to achieve remarkable zero-shot capabilities on new tasks, and no human-written instructions are…

Computation and Language · Computer Science 2023-04-07 Baolin Peng , Chunyuan Li , Pengcheng He , Michel Galley , Jianfeng Gao

ASR error correction is an interesting option for post processing speech recognition system outputs. These error correction models are usually trained in a supervised fashion using the decoding results of a target ASR system. This approach…

Computation and Language · Computer Science 2023-10-02 Rao Ma , Mengjie Qian , Potsawee Manakul , Mark Gales , Kate Knill

Source code identifiers often contain abbreviations. Such abbreviations may reduce the readability of the source code, which in turn hinders the maintenance of the software applications. To this end, accurate and automated approaches to…

Software Engineering · Computer Science 2024-11-01 Yanjie Jiang , Hui Liu , Lu Zhang

Upon its release in late 2022, ChatGPT has brought a seismic shift in the entire landscape of AI, both in research and commerce. Through instruction-tuning a large language model (LLM) with supervised fine-tuning and reinforcement learning…

Computation and Language · Computer Science 2024-01-17 Hailin Chen , Fangkai Jiao , Xingxuan Li , Chengwei Qin , Mathieu Ravaut , Ruochen Zhao , Caiming Xiong , Shafiq Joty

As ChatGPT and GPT-4 spearhead the development of Large Language Models (LLMs), more researchers are investigating their performance across various tasks. But more research needs to be done on the interpretability capabilities of LLMs, that…

Computation and Language · Computer Science 2023-10-27 Dongfang Li , Jindi Yu , Baotian Hu , Zhenran Xu , Min Zhang

The primary objective of Chinese grammatical error correction (CGEC) is to detect and correct errors in Chinese sentences. Recent research shows that large language models (LLMs) have been applied to CGEC with significant results. For LLMs,…

Computation and Language · Computer Science 2025-10-01 Baoxin Wang , Yumeng Luo , Yixuan Wang , Dayong Wu , Wanxiang Che , Shijin Wang

Developing intelligent pediatric consultation systems offers promising prospects for improving diagnostic efficiency, especially in China, where healthcare resources are scarce. Despite recent advances in Large Language Models (LLMs) for…

Computation and Language · Computer Science 2024-11-12 Dingkang Yang , Jinjie Wei , Dongling Xiao , Shunli Wang , Tong Wu , Gang Li , Mingcheng Li , Shuaibing Wang , Jiawei Chen , Yue Jiang , Qingyao Xu , Ke Li , Peng Zhai , Lihua Zhang

Thanks to recent advances in generative AI, we are able to prompt large language models (LLMs) to produce texts which are fluent and grammatical. In addition, it has been shown that we can elicit attempts at grammatical error correction…

This work proposes a simple training-free prompt-free approach to leverage large language models (LLMs) for the Chinese spelling correction (CSC) task, which is totally different from all previous CSC approaches. The key idea is to use an…

Computation and Language · Computer Science 2024-10-08 Houquan Zhou , Zhenghua Li , Bo Zhang , Chen Li , Shaopeng Lai , Ji Zhang , Fei Huang , Min Zhang

Recently, the increasing demand for superior medical services has highlighted the discrepancies in the medical infrastructure. With big data, especially texts, forming the foundation of medical services, there is an exigent need for…

Computation and Language · Computer Science 2024-07-17 Yuanhe Tian , Ruyi Gan , Yan Song , Jiaxing Zhang , Yongdong Zhang

Medical dialogue generation relies on natural language generation techniques to enable online medical consultations. Recently, the widespread adoption of large-scale models in the field of natural language processing has facilitated rapid…

Computation and Language · Computer Science 2023-11-27 Zhijie Qu , Juan Li , Zerui Ma , Jianqiang Li

Large Language Models (LLMs), such as ChatGPT and GPT-4, have dramatically transformed natural language processing research and shown promising strides towards Artificial General Intelligence (AGI). Nonetheless, the high costs associated…

Computation and Language · Computer Science 2024-02-26 Yiming Cui , Ziqing Yang , Xin Yao

Large language models (LLMs) have shown great potential for the automatic generation of feedback in a wide range of computing contexts. However, concerns have been voiced around the privacy and ethical implications of sending student work…

Computation and Language · Computer Science 2024-05-09 Charles Koutcheme , Nicola Dainese , Sami Sarsa , Arto Hellas , Juho Leinonen , Paul Denny

Large language models (LLMs) have notably enhanced the fluency and diversity of machine-generated text. However, this progress also presents a significant challenge in detecting the origin of a given text, and current research on detection…

Computation and Language · Computer Science 2023-10-05 Xianjun Yang , Wei Cheng , Yue Wu , Linda Petzold , William Yang Wang , Haifeng Chen

Large language models (LLMs) have shown impressive ability for open-domain NLP tasks. However, LLMs are sometimes too footloose for natural language understanding (NLU) tasks which always have restricted output and input format. Their…

An emerging method to cheaply improve a weaker language model is to finetune it on outputs from a stronger model, such as a proprietary system like ChatGPT (e.g., Alpaca, Self-Instruct, and others). This approach looks to cheaply imitate…

Computation and Language · Computer Science 2023-05-26 Arnav Gudibande , Eric Wallace , Charlie Snell , Xinyang Geng , Hao Liu , Pieter Abbeel , Sergey Levine , Dawn Song

In the swiftly expanding domain of Natural Language Processing (NLP), the potential of GPT-based models for the financial sector is increasingly evident. However, the integration of these models with financial datasets presents challenges,…

Computation and Language · Computer Science 2023-11-14 Neng Wang , Hongyang Yang , Christina Dan Wang

Pretrained Language Models (PLMs) harbor inherent social biases that can result in harmful real-world implications. Such social biases are measured through the probability values that PLMs output for different social groups and attributes…

Computation and Language · Computer Science 2023-12-07 Rafal Kocielnik , Shrimai Prabhumoye , Vivian Zhang , Roy Jiang , R. Michael Alvarez , Anima Anandkumar

In this paper, we present HuatuoGPT, a large language model (LLM) for medical consultation. The core recipe of HuatuoGPT is to leverage both \textit{distilled data from ChatGPT} and \textit{real-world data from doctors} in the supervised…

Computation and Language · Computer Science 2023-05-25 Hongbo Zhang , Junying Chen , Feng Jiang , Fei Yu , Zhihong Chen , Jianquan Li , Guiming Chen , Xiangbo Wu , Zhiyi Zhang , Qingying Xiao , Xiang Wan , Benyou Wang , Haizhou Li