English
Related papers

Related papers: LLMSurgeon: Diagnosing Data Mixture of Large Langu…

200 papers

Training a model for food recognition is challenging because the training samples, which are typically crawled from the Internet, are visually different from the pictures captured by users in the free-living environment. In addition to this…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Qing Wang , Chong-Wah Ngo , Ee-Peng Lim , Qianru Sun

Large Language Models (LLMs), typified by OpenAI's GPT, have marked a significant advancement in artificial intelligence. Trained on vast amounts of text data, LLMs are capable of understanding and generating human-like text across a…

Artificial Intelligence · Computer Science 2024-10-29 Haochen Zhang , Yuyang Dong , Chuan Xiao , Masafumi Oyamada

Large Language Models (LLMs) demonstrate strong generalization and reasoning abilities, making them well-suited for complex decision-making tasks such as medical consultation (MC). However, existing LLM-based methods often fail to capture…

Computation and Language · Computer Science 2025-10-13 Zhihao Jia , Mingyi Jia , Junwen Duan , Jianxin Wang

This survey reviews how large language models (LLMs) are transforming synthetic training data generation in both natural language and code domains. By producing artificial but task-relevant examples, these models can significantly augment…

Computation and Language · Computer Science 2025-11-21 Mihai Nadas , Laura Diosan , Andreea Tomescu

Large language models (LLMs) have achieved significant success in interacting with human. However, recent studies have revealed that these models often suffer from hallucinations, leading to overly confident but incorrect judgments. This…

Computation and Language · Computer Science 2023-09-06 Yusheng Liao , Yutong Meng , Hongcheng Liu , Yanfeng Wang , Yu Wang

Large Language Models (LLMs) can acquire unintended biases from seemingly benign training data even without explicit cues or malicious content. Existing methods struggle to detect such risks before fine-tuning, making post hoc evaluation…

Machine Learning · Computer Science 2026-02-05 Mengru Wang , Zhenqian Xu , Junfeng Fang , Yunzhi Yao , Shumin Deng , Huajun Chen , Ningyu Zhang

The rapid advancement of large language models (LLMs) in biological-medical applications has highlighted a gap between their potential and the limited scale and often low quality of available open-source annotated textual datasets. In…

Computation and Language · Computer Science 2025-12-19 Xunxin Cai , Chengrui Wang , Qingqing Long , Yuanchun Zhou , Meng Xiao

The classification of genetic variants, particularly Variants of Uncertain Significance (VUS), poses a significant challenge in clinical genetics and precision medicine. Large Language Models (LLMs) have emerged as transformative tools in…

Despite the success of Large Language Models (LLMs) across various fields, their potential to generate untruthful, biased and harmful responses poses significant risks, particularly in critical applications. This highlights the urgent need…

Artificial Intelligence · Computer Science 2025-05-27 Mengdi Zhang , Kai Kiat Goh , Peixin Zhang , Jun Sun , Rose Lin Xin , Hongyu Zhang

Recent advancements in large language models (LLMs) have significantly improved Natural Language to SQL (NL2SQL) tasks, yet most NL2SQL systems continue to rely on the autoregressive (AR) paradigm. The highly structured nature of SQL makes…

Databases · Computer Science 2026-05-28 Peixian Ma , Xialie Zhuang , Jiantao Tan , Changlun Li , Ruirui Chen , Chengwei Qin

Large Language Models (LLMs) have demonstrated remarkable proficiency in understanding and generating natural language. However, their capabilities wane in highly specialized domains underrepresented in the pretraining corpus, such as…

Machine Learning · Computer Science 2024-07-29 Junhong Shen , Neil Tenenholtz , James Brian Hall , David Alvarez-Melis , Nicolo Fusi

Adapting large language models (LLMs) to specific domains often faces a critical bottleneck: the scarcity of high-quality, human-curated data. While large volumes of unchecked data are readily available, indiscriminately using them for…

Computation and Language · Computer Science 2025-09-09 Jian Wu , Hang Yu , Bingchang Liu , Wenjie Yang , Peng Di , Jianguo Li , Yue Zhang

This paper introduces an approach that combines the language reasoning capabilities of large language models (LLMs) with the benefits of local training to tackle complex, domain-specific tasks. Specifically, the authors demonstrate their…

Computation and Language · Computer Science 2023-08-04 V. K. Cody Bumgardner , Aaron Mullen , Sam Armstrong , Caylin Hickey , Jeff Talbert

Large language models have demonstrated remarkable capabilities across various tasks, primarily attributed to the utilization of diversely sourced data. However, the impact of pretraining data composition on model performance remains poorly…

Machine Learning · Computer Science 2025-01-28 Ce Ge , Zhijian Ma , Daoyuan Chen , Yaliang Li , Bolin Ding

Recent breakthroughs in large language modeling have facilitated rigorous exploration of their application in diverse tasks related to tabular data modeling, such as prediction, tabular data synthesis, question answering, and table…

As large language models (LLMs) become progressively more embedded in clinical decision-support, documentation, and patient-information systems, ensuring their privacy and trustworthiness has emerged as an imperative challenge for the…

Cryptography and Security · Computer Science 2025-10-22 Alexander Nemecek , Zebin Yun , Zahra Rahmani , Yaniv Harel , Vipin Chaudhary , Mahmood Sharif , Erman Ayday

The exponential increase in scientific literature and online information necessitates efficient methods for extracting knowledge from textual data. Natural language processing (NLP) plays a crucial role in addressing this challenge,…

Computation and Language · Computer Science 2025-10-22 Zhyar Rzgar K. Rostam , Gábor Kertész

Large language models (LLMs) are increasingly exposed to data contamination, i.e., performance gains driven by prior exposure of test datasets rather than generalization. However, in the context of tabular data, this problem is largely…

Computation and Language · Computer Science 2026-03-31 Matteo Silvestri , Fabiano Veglianti , Flavio Giorgi , Fabrizio Silvestri , Gabriele Tolomei

Software reuse has long been recognized as a critical and widely studied topic in software engineering, offering substantial benefits in reducing development costs, improving software quality, and enhancing operational efficiency. This…

Software Engineering · Computer Science 2026-02-02 You Lu , Jiyang Zhang , Bihuan Chen , Chaofeng Sha , Dingji Wang , Xin Peng

Large Language Models (LLMs) have shown promising results on machine translation for high resource language pairs and domains. However, in specialised domains (e.g. medical) LLMs have shown lower performance compared to standard neural…

Computation and Language · Computer Science 2025-07-31 Miguel Rios