English
Related papers

Related papers: Towards Trustworthy LLMs for Code: A Data-Centric …

200 papers

This paper provides a systematic analysis of the opportunities, challenges, and potential solutions of harnessing Large Language Models (LLMs) such as GPT-4 to dig out vulnerabilities within smart contracts based on our ongoing research.…

Cryptography and Security · Computer Science 2023-10-18 Sihao Hu , Tiansheng Huang , Fatih İlhan , Selim Furkan Tekin , Ling Liu

The digitalization of energy sectors has expanded the coding responsibilities for power engineers and researchers. This research article explores the potential of leveraging Large Language Models (LLMs) to alleviate this burden. Here, we…

Human-Computer Interaction · Computer Science 2023-10-20 Ran Li , Chuanqing Pu , Junyi Tao , Canbing Li , Feilong Fan , Yue Xiang , Sijie Chen

Machine learning (ML) in medicine has transitioned from research to concrete applications aimed at supporting several medical purposes like therapy selection, monitoring and treatment. Acceptance and effective adoption by clinicians and…

Ensuring alignment, which refers to making models behave in accordance with human intentions [1,2], has become a critical task before deploying large language models (LLMs) in real-world applications. For instance, OpenAI devoted six months…

Artificial Intelligence · Computer Science 2024-03-22 Yang Liu , Yuanshun Yao , Jean-Francois Ton , Xiaoying Zhang , Ruocheng Guo , Hao Cheng , Yegor Klochkov , Muhammad Faaiz Taufiq , Hang Li

Large Language Models (LLMs) are emerging as transformative tools for software vulnerability detection, addressing critical challenges in the security domain. Traditional methods, such as static and dynamic analysis, often falter due to…

Cryptography and Security · Computer Science 2025-02-19 Ze Sheng , Zhicheng Chen , Shuning Gu , Heqing Huang , Guofei Gu , Jeff Huang

This paper explores the evolving relationship between clinician trust in LLMs, the transformation of data sources from predominantly human-generated to AI-generated content, and the subsequent impact on the precision of LLMs and clinician…

Computers and Society · Computer Science 2024-04-02 Avishek Choudhury , Zaria Chaudhry

How to generate a large, realistic set of tables along with joinability relationships, to stress-test dataset discovery methods? Dataset discovery methods aim to automatically identify related data assets in a data lake. The development and…

Databases · Computer Science 2025-07-09 Zhenwei Dai , Chuan Lei , Asterios Katsifodimos , Xiao Qin , Christos Faloutsos , Huzefa Rangwala

Large language models (LLMs) are deployed at scale, yet their training data life cycle remains opaque. This survey synthesizes research from the past ten years on three tightly coupled axes: (1) data provenance, (2) transparency, and (3)…

Cryptography and Security · Computer Science 2026-01-22 Richard Hohensinner , Belgin Mutlu , Inti Gabriel Mendoza Estrada , Matej Vukovic , Simone Kopeinik , Roman Kern

To trust the fluent generations of large language models (LLMs), humans must be able to verify their correctness against trusted, external sources. Recent efforts, such as providing citations via retrieved documents or post-hoc provenance,…

Computation and Language · Computer Science 2025-02-25 Jingyu Zhang , Marc Marone , Tianjian Li , Benjamin Van Durme , Daniel Khashabi

We present two comprehensive benchmarks to evaluate the performance of language models in coding assistance tasks, covering code writing, debugging, code review, and conceptual understanding. Our main contribution includes two curated…

Software Engineering · Computer Science 2024-12-10 Nidhish Shah , Zulkuf Genc , Dogu Araci

As large language models (LLMs) continue to advance, the need for up-to-date and well-organized benchmarks becomes increasingly critical. However, many existing datasets are scattered, difficult to manage, and make it challenging to perform…

Machine Learning · Computer Science 2025-06-03 Eunsu Kim , Haneul Yoo , Guijin Son , Hitesh Patel , Amit Agarwal , Alice Oh

Large Language Models (LLMs) have transformed natural language processing (NLP) by enabling robust text generation and understanding. However, their deployment in sensitive domains like healthcare, finance, and legal services raises…

Artificial Intelligence · Computer Science 2024-12-09 Georgios Feretzakis , Vassilios S. Verykios

The recent popularity of large language models (LLMs) has brought a significant impact to boundless fields, particularly through their open-ended ecosystem such as the APIs, open-sourced models, and plugins. However, with their widespread…

Machine Learning · Computer Science 2023-08-31 Wentao Ye , Mingfeng Ou , Tianyi Li , Yipeng chen , Xuetao Ma , Yifan Yanggong , Sai Wu , Jie Fu , Gang Chen , Haobo Wang , Junbo Zhao

In today's world, emotional support is increasingly essential, yet it remains challenging for both those seeking help and those offering it. Multimodal approaches to emotional support show great promise by integrating diverse data sources…

The rapid progress in open-source Large Language Models (LLMs) is significantly driving AI development forward. However, there is still a limited understanding of their trustworthiness. Deploying these models at scale without sufficient…

Computation and Language · Computer Science 2024-04-03 Lingbo Mo , Boshi Wang , Muhao Chen , Huan Sun

Large language models (LLMs) are increasingly embedded in consequential decisions across healthcare, finance, employment, and public services. Yet accountability remains fragile because process transparency is rarely recorded in a durable…

Computers and Society · Computer Science 2026-01-29 Victor Ojewale , Harini Suresh , Suresh Venkatasubramanian

The growing use of large language models (LLMs) has increased the need for automatic evaluation systems, particularly to address the challenge of information hallucination. Although existing faithfulness evaluation approaches have shown…

Computation and Language · Computer Science 2025-07-29 Carlo Alfano , Aymen Al Marjani , Zeno Jonke , Amin Mantrach , Saab Mansour , Marcello Federico

By virtue of its great utility in solving real-world problems, optimization modeling has been widely employed for optimal decision-making across various sectors, but it requires substantial expertise from operations research professionals.…

Code reuse is a widespread practice across software development projects, suggesting an inherent trust in the reused code. Yet, there is a lack of a fundamental understanding of developers' trust and how various factors mold their…

Software Engineering · Computer Science 2026-04-13 Sara Yabesi , Mahta Amini , Jelena Ristic , Zohreh Sharafi

Large Language Models (LLMs) like LLaMA, Mistral, and Gemma are increasingly used in decision-critical domains such as healthcare, law, and finance, yet their reliability remains uncertain. They often make overconfident errors, degrade…

Computation and Language · Computer Science 2026-01-01 Rohit Kumar Salla , Manoj Saravanan , Shrikar Reddy Kota