English
Related papers

Related papers: Auditing large language models: a three-layered ap…

200 papers

We examine one particular dimension of AI governance: how to monitor and audit AI-enabled products and services throughout the AI development lifecycle, from pre-deployment testing to post-deployment auditing. Combining principles from…

Artificial Intelligence · Computer Science 2026-05-18 Parand A. Alamdari , Toryn Q. Klassen , Sheila A. McIlraith

Given the success of ChatGPT, LaMDA and other large language models (LLMs), there has been an increase in development and usage of LLMs within the technology sector and other sectors. While the level in which LLMs has not reached a level…

Computers and Society · Computer Science 2024-09-20 Soaad Hossain , Syed Ishtiaque Ahmed

Large Language Models (LLMs) have significantly advanced the development of Legal Artificial Intelligence (Legal AI) in recent years, enhancing the efficiency and accuracy of legal tasks. To advance research and applications of LLM-based…

Computation and Language · Computer Science 2025-09-15 Zhitian Hou , Zihan Ye , Nanli Zeng , Tianyong Hao , Kun Zeng

Intelligent auditing represents a crucial advancement in modern audit practices, enhancing both the quality and efficiency of audits within the realm of artificial intelligence. With the rise of large language model (LLM), there is enormous…

Computation and Language · Computer Science 2024-10-16 Jiajia Huang , Haoran Zhu , Chao Xu , Tianming Zhan , Qianqian Xie , Jimin Huang

Large language models (LLMs) are being increasingly integrated into legal applications, including judicial decision support, legal practice assistance, and public-facing legal services. While LLMs show strong potential in handling legal…

The growing adoption and deployment of Machine Learning (ML) systems came with its share of ethical incidents and societal concerns. It also unveiled the necessity to properly audit these systems in light of ethical principles. For such a…

Large language models (LLMs) have become central to modern AI workflows, powering applications from open-ended text generation to complex agent-based reasoning. However, debugging these models remains a persistent challenge due to their…

[Context] Generative AI technologies, particularly Large Language Models (LLMs), have transformed numerous domains by enhancing convenience and efficiency in information retrieval, content generation, and decision-making processes. However,…

Computers and Society · Computer Science 2025-08-25 Yutan Huang , Chetan Arora , Wen Cheng Houng , Tanjila Kanij , Anuradha Madulgalla , John Grundy

The advancement of generative AI, particularly large language models (LLMs), has a significant impact on politics and democracy, offering potential across various domains, including policymaking, political communication, analysis, and…

Computation and Language · Computer Science 2024-12-17 Goshi Aoki

Ethics review is a foundational mechanism of modern research governance, yet contemporary systems face increasing strain as ethical risks arise as structural consequences of large-scale, interdisciplinary scientific practice. The demand for…

Artificial Intelligence · Computer Science 2026-02-17 Yifan Ding , Yuhui Shi , Zhiyan Li , Zilong Wang , Yifeng Gao , Yajun Yang , Mengjie Yang , Yixiu Liang , Xipeng Qiu , Xuanjing Huang , Xingjun Ma , Yu-Gang Jiang , Guoyu Wang

The imposing evolution of artificial intelligence systems and, specifically, of Large Language Models (LLM) makes it necessary to carry out assessments of their level of risk and the impact they may have in the area of privacy, personal…

Computers and Society · Computer Science 2024-04-03 Nicola Fabiano

With the advent of Large Language Models (LLMs), medical artificial intelligence (AI) has experienced substantial technological progress and paradigm shifts, highlighting the potential of LLMs to streamline healthcare delivery and improve…

Computation and Language · Computer Science 2024-12-10 Lei Liu , Xiaoyan Yang , Junchi Lei , Yue Shen , Jian Wang , Peng Wei , Zhixuan Chu , Zhan Qin , Kui Ren

Educational technology innovations leveraging large language models (LLMs) have shown the potential to automate the laborious process of generating and analysing textual content. While various innovations have been developed to automate a…

Computation and Language · Computer Science 2023-08-29 Lixiang Yan , Lele Sha , Linxuan Zhao , Yuheng Li , Roberto Martinez-Maldonado , Guanliang Chen , Xinyu Li , Yueqiao Jin , Dragan Gašević

AI-based systems, including Large Language Models (LLM), impact millions by supporting diverse tasks but face issues like misinformation, bias, and misuse. AI ethics is crucial as new technologies and concerns emerge, but objective,…

Computers and Society · Computer Science 2025-05-19 José Antonio Siqueira de Cerqueira , Mamia Agbese , Rebekah Rousi , Nannan Xi , Juho Hamari , Pekka Abrahamsson

With the advancement of Artificial Intelligence (AI) and Large Language Models (LLMs), there is a profound transformation occurring in the realm of natural language processing tasks within the legal domain. The capabilities of LLMs are…

Computation and Language · Computer Science 2024-04-02 Weicong Qin , Zhongxiang Sun

As Large Language Models (LLMs) rise in popularity, it is necessary to assess their capability in critically relevant domains. We present a comprehensive evaluation framework, grounded in science communication research, to assess LLM…

The auditing of financial documents, historically a labor-intensive process, stands on the precipice of transformation. AI-driven solutions have made inroads into streamlining this process by recommending pertinent text passages from…

Large language models (LLMs) are increasingly embedded in consequential decisions across healthcare, finance, employment, and public services. Yet accountability remains fragile because process transparency is rarely recorded in a durable…

Computers and Society · Computer Science 2026-01-29 Victor Ojewale , Harini Suresh , Suresh Venkatasubramanian

The advent of artificial intelligence (AI) has significantly impacted the traditional judicial industry. Moreover, recently, with the development of AI-generated content (AIGC), AI and law have found applications in various domains,…

Computation and Language · Computer Science 2023-12-08 Jinqi Lai , Wensheng Gan , Jiayang Wu , Zhenlian Qi , Philip S. Yu

Large Language Models (LLMs) have emerged as powerful tools in various research domains. This article examines their potential through a literature review and firsthand experimentation. While LLMs offer benefits like cost-effectiveness and…

Human-Computer Interaction · Computer Science 2024-04-10 M. Namvarpour , A. Razi