English
Related papers

Related papers: Towards Understanding Bias in Synthetic Data for E…

200 papers

Tabular machine learning problems often require time-consuming and labor-intensive feature engineering. Recent efforts have focused on using large language models (LLMs) to capitalize on their potential domain knowledge. At the same time,…

Machine Learning · Computer Science 2025-07-16 Jaris Küken , Lennart Purucker , Frank Hutter

As more content generated by large language models (LLMs) floods into the Internet, information retrieval (IR) systems now face the challenge of distinguishing and handling a blend of human-authored and machine-generated texts. Recent…

Information Retrieval · Computer Science 2025-08-26 Wei Huang , Keping Bi , Yinqiong Cai , Wei Chen , Jiafeng Guo , Xueqi Cheng

New Large Language Models (LLMs) become available every few weeks, and modern application developers confronted with the unenviable task of having to decide if they should switch to a new model. While human evaluation remains the gold…

Artificial Intelligence · Computer Science 2025-12-25 Suryaansh Jain , Umair Z. Ahmed , Shubham Sahai , Ben Leong

Data is fundamental to large language models (LLMs). However, understanding of what makes certain data useful for different stages of an LLM workflow, including training, tuning, alignment, in-context learning, etc., and why, remains an…

Artificial Intelligence · Computer Science 2026-05-20 Shiqiang Wang , Herbert Woisetschläger , Hans Arno Jacobsen , Mingyue Ji

Large Language Models (LLMs) like GPT-4o can help automate text classification tasks at low cost and scale. However, there are major concerns about the validity and reliability of LLM outputs. By contrast, human coding is generally more…

Computation and Language · Computer Science 2025-01-17 Conrad Borchers , Danielle R. Thomas , Jionghao Lin , Ralph Abboud , Kenneth R. Koedinger

This study introduces a hypothesis-testing framework to assess whether large language models (LLMs) possess genuine reasoning abilities or primarily depend on token bias. We go beyond evaluating LLMs on accuracy; rather, we aim to…

Computation and Language · Computer Science 2024-10-07 Bowen Jiang , Yangxinyu Xie , Zhuoqun Hao , Xiaomeng Wang , Tanwi Mallick , Weijie J. Su , Camillo J. Taylor , Dan Roth

Neural networks are increasingly used to support decision-making. To verify their reliability and adaptability, researchers and practitioners have proposed a variety of tools and methods for tasks such as NN code verification, refactoring,…

Machine Learning · Computer Science 2026-02-05 Nadia Daoudi , Jordi Cabot

This research explores a hybrid approach to fine-tuning large language models (LLMs) by integrating real-world and synthetic data to boost model performance, particularly in generating accurate and contextually relevant responses. By…

Computation and Language · Computer Science 2024-10-15 Alexey Zhezherau , Alexei Yanockin

This paper investigates the subtle and often concealed biases present in Large Language Models (LLMs), focusing on implicit biases that may remain despite passing explicit bias tests. Implicit biases are significant because they influence…

Computation and Language · Computer Science 2024-10-01 Serene Lim , María Pérez-Ortiz

Modern large language models (LLMs) are used in many business applications in general, and specifically in web search systems and applications that generate overviews of search results - LLM Overview systems. Such systems are using an LLM…

Information Retrieval · Computer Science 2026-05-04 Roman Smirnov

Large Language Models (LLMs) have democratized synthetic data generation, which in turn has the potential to simplify and broaden a wide gamut of NLP tasks. Here, we tackle a pervasive problem in synthetic data generation: its generative…

Computation and Language · Computer Science 2023-05-25 Veniamin Veselovsky , Manoel Horta Ribeiro , Akhil Arora , Martin Josifoski , Ashton Anderson , Robert West

Materials discovery and design are essential for advancing technology across various industries by enabling the development of application-specific materials. Recent research has leveraged Large Language Models (LLMs) to accelerate this…

Computation and Language · Computer Science 2025-02-11 Shrinidhi Kumbhar , Venkatesh Mishra , Kevin Coutinho , Divij Handa , Ashif Iquebal , Chitta Baral

The rapid development of Large Language Models (LLMs) has led to great strides in model capabilities like long-context understanding and reasoning. However, as LLMs are able to process longer contexts, it becomes more challenging to…

Computation and Language · Computer Science 2024-04-09 Fangyu Lei , Qian Liu , Yiming Huang , Shizhu He , Jun Zhao , Kang Liu

Warning: This research studies AI persuasion and bias amplification that could be misused; all experiments are for safety evaluation. Large Language Models (LLMs) now generate convincing, human-like text and are widely used in content…

Computation and Language · Computer Science 2025-08-25 Saumya Roy

Recent advancements in large language models (LLMs) have led to the development of highly potent models like OpenAI's ChatGPT. These models have exhibited exceptional performance in a variety of tasks, such as question answering, essay…

Computation and Language · Computer Science 2023-04-12 Ruixiang Tang , Xiaotian Han , Xiaoqian Jiang , Xia Hu

The scarcity of high-quality annotated medical data, particularly in mental health, poses a significant bottleneck for training robust machine learning models. Privacy regulations restrict data sharing, making synthetic data generation a…

An increasingly common practice is to train large language models (LLMs) using synthetic data. Often this synthetic data is produced by the same or similar LLMs as those it is being used to train. This raises the question of whether the…

Computation and Language · Computer Science 2025-03-18 Lingze Zhang , Ellie Pavlick

Machine learning heavily relies on data, but real-world applications often encounter various data-related issues. These include data of poor quality, insufficient data points leading to under-fitting of machine learning models, and…

Machine Learning · Computer Science 2025-04-07 Yingzhou Lu , Lulu Chen , Yuanyuan Zhang , Minjie Shen , Huazheng Wang , Xiao Wang , Capucine van Rechem , Tianfan Fu , Wenqi Wei

Background: Large language models (LLMs) are rapidly being integrated into healthcare, promising to enhance various clinical tasks. However, concerns exist regarding their potential for bias, which could compromise patient care and…

Computation and Language · Computer Science 2025-04-07 Thanathip Suenghataiphorn , Narisara Tribuddharat , Pojsakorn Danpanichkul , Narathorn Kulthamrongsri

Large Language Models (LLMs) have shown capabilities close to human performance in various analytical tasks, leading researchers to use them for time and labor-intensive analyses. However, their capability to handle highly specialized and…

Computation and Language · Computer Science 2024-10-08 Alexander S. Choi , Syeda Sabrina Akter , JP Singh , Antonios Anastasopoulos