English
Related papers

Related papers: Towards Transparency: Exploring LLM Trainings Data…

200 papers

Large language models (LLMs) are transforming how students learn by providing readily available tools that can quickly augment or complete various learning activities with non-trivial performance. Similar paradigm shifts have occurred in…

Human-Computer Interaction · Computer Science 2025-07-29 Rahul R. Divekar , Sophia Guerra , Lisette Gonzalez , Natasha Boos , Helen Zhou

As large language models (LLMs) like OpenAI's GPT series continue to make strides, we witness the emergence of artificial intelligence applications in an ever-expanding range of fields. In medicine, these LLMs hold considerable promise for…

This study introduces a hypothesis-testing framework to assess whether large language models (LLMs) possess genuine reasoning abilities or primarily depend on token bias. We go beyond evaluating LLMs on accuracy; rather, we aim to…

Computation and Language · Computer Science 2024-10-07 Bowen Jiang , Yangxinyu Xie , Zhuoqun Hao , Xiaomeng Wang , Tanwi Mallick , Weijie J. Su , Camillo J. Taylor , Dan Roth

Language models (LMs) increasingly drive real-world applications that require world knowledge. However, the internal processes through which models turn data into representations of knowledge and beliefs about the world, are poorly…

Computation and Language · Computer Science 2025-09-04 Daniela Gottesman , Alon Gilae-Dotan , Ido Cohen , Yoav Gur-Arieh , Marius Mosbach , Ori Yoran , Mor Geva

Large Language Models (LLMs) are rapidly reshaping machine translation (MT), particularly by introducing instruction-following, in-context learning, and preference-based alignment into what has traditionally been a supervised…

Computation and Language · Computer Science 2026-04-29 Baban Gain , Dibyanayan Bandyopadhyay , Asif Ekbal , Trilok Nath Singh

In recent years, data science agents powered by Large Language Models (LLMs), known as "data agents," have shown significant potential to transform the traditional data analysis paradigm. This survey provides an overview of the evolution,…

Artificial Intelligence · Computer Science 2025-12-01 Maojun Sun , Ruijian Han , Binyan Jiang , Houduo Qi , Defeng Sun , Yancheng Yuan , Jian Huang

Multimodal large language models (MLLMs) improve performance on vision-language tasks by integrating visual features from pre-trained vision encoders into large language models (LLMs). However, how MLLMs process and utilize visual…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Hao Yin , Guangzong Si , Zilei Wang

Large language models (LLMs) are known to generate politically biased text. Yet, it remains unclear how such biases arise, making it difficult to design effective mitigation strategies. We hypothesize that these biases are rooted in the…

Computation and Language · Computer Science 2026-04-06 Tanise Ceron , Dmitry Nikolaev , Dominik Stammbach , Debora Nozza

Modern language models are trained on large amounts of data. These data inevitably include controversial and stereotypical content, which contains all sorts of biases related to gender, origin, age, etc. As a result, the models express…

Computation and Language · Computer Science 2025-09-03 Aleksandra Sorokovikova , Pavel Chizhov , Iuliia Eremenko , Ivan P. Yamshchikov

Large language models are increasingly used to predict human preferences in both scientific and business endeavors, yet current approaches rely exclusively on analyzing model outputs without considering the underlying mechanisms. Using…

Computers and Society · Computer Science 2026-02-04 Sarah Ball , Simeon Allmendinger , Niklas Kühl , Frauke Kreuter

Vision-Language Models (VLMs) have rapidly advanced by leveraging powerful pre-trained Large Language Models (LLMs) as core reasoning backbones. As new and more capable LLMs emerge with improved reasoning, instruction-following, and…

Artificial Intelligence · Computer Science 2026-04-14 Sameera Horawalavithana , Lauren Phillips , Ian Stewart , Sai Munikoti , Karl Pazdernik

High-quality datasets are typically required for accomplishing data-driven tasks, such as training medical diagnosis models, predicting real-time traffic conditions, or conducting experiments to validate research hypotheses. Consequently,…

Information Retrieval · Computer Science 2025-09-03 Pengyue Li , Sheng Wang , Hua Dai , Zhiyu Chen , Zhifeng Bao , Brian D. Davison

In recent years, vision-language models have made significant strides, excelling in tasks like optical character recognition and geometric problem-solving. However, several critical issues remain: 1) Proprietary models often lack…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Yuan Liu , Zhongyin Zhao , Ziyuan Zhuang , Le Tian , Xiao Zhou , Jie Zhou

Checkboxes are critical in real-world document processing where the presence or absence of ticks directly informs data extraction and decision-making processes. Yet, despite the strong performance of Large Vision and Language Models across…

Computation and Language · Computer Science 2025-04-16 Michał Turski , Mateusz Chiliński , Łukasz Borchmann

In this paper, we investigate the phenomena of "selection biases" in Large Language Models (LLMs), focusing on problems where models are tasked with choosing the optimal option from an ordered sequence. We delve into biases related to…

Computation and Language · Computer Science 2024-06-06 Sheng-Lun Wei , Cheng-Kuang Wu , Hen-Hsen Huang , Hsin-Hsi Chen

Large Language Models (LLMs) are being adopted across a wide range of tasks, including decision-making processes in industries where bias in AI systems is a significant concern. Recent research indicates that LLMs can harbor implicit biases…

Computation and Language · Computer Science 2024-10-18 Divyanshu Kumar , Umang Jain , Sahil Agarwal , Prashanth Harshangi

Language Models (LMs) have significantly advanced natural language processing and enabled remarkable progress across diverse domains, yet their black-box nature raises critical concerns about the interpretability of their internal…

Computation and Language · Computer Science 2025-09-29 Avash Palikhe , Zichong Wang , Zhipeng Yin , Rui Guo , Qiang Duan , Jie Yang , Wenbin Zhang

Pre-trained transformer language models (LMs) have in recent years become the dominant paradigm in applied NLP. These models have achieved state-of-the-art performance on tasks such as information extraction, question answering, sentiment…

Computation and Language · Computer Science 2025-04-14 Aidan Mannion , Thierry Chevalier , Didier Schwab , Lorraine Geouriot

Large Language Models (LLMs) have demonstrated remarkable success across various domains. However, despite their promising performance in numerous real-world applications, most of these algorithms lack fairness considerations. Consequently,…

Computation and Language · Computer Science 2024-12-20 Zhibo Chu , Zichong Wang , Wenbin Zhang

While the widespread use of Large Language Models (LLMs) brings convenience, it also raises concerns about the credibility of academic research and scholarly processes. To better understand these dynamics, we evaluate the penetration of…

Computation and Language · Computer Science 2025-02-18 Li Zhou , Ruijie Zhang , Xunlian Dai , Daniel Hershcovich , Haizhou Li