English
Related papers

Related papers: Toward an Evaluation Science for Generative AI Sys…

200 papers

As AI systems advance, AI evaluations are becoming an important pillar of regulations for ensuring safety. We argue that such regulation should require developers to explicitly identify and justify key underlying assumptions about…

Artificial Intelligence · Computer Science 2024-11-21 Peter Barnett , Lisa Thiergart

Education in the era of generative AI faces a pivotal transformation. As AI systems reshape professional practices-from software development to creative design-educators must reconsider how to prepare students for a future where humans and…

Computers and Society · Computer Science 2025-10-22 Xinran Zhu , Liam Magee , Peg Mischler

A major challenge facing the world is the provision of equitable and universal access to quality education. Recent advances in generative AI (gen AI) have created excitement about the potential of new technologies to offer a personal tutor…

Generative AI (GenAI) models present new challenges in regulating against discriminatory behavior. In this paper, we argue that GenAI fairness research still has not met these challenges; instead, a significant gap remains between existing…

Machine Learning · Computer Science 2024-12-31 Thomas P. Zollo , Nikita Rajaneesh , Richard Zemel , Talia B. Gillis , Emily Black

User simulation is an emerging interdisciplinary topic with multiple critical applications in the era of Generative AI. It involves creating an intelligent agent that mimics the actions of a human user interacting with an AI system,…

Artificial Intelligence · Computer Science 2026-04-22 Krisztian Balog , ChengXiang Zhai

In this work, we present some recommendations on the evaluation of state-of-the-art generative models for constrained generation tasks. The progress on generative models has been rapid in recent years. These large-scale models have had…

Human-Computer Interaction · Computer Science 2022-12-02 Vikas Raunak , Matt Post , Arul Menezes

With the recent progress in generative artificial intelligence (Generative AI), particularly in the development of large language models, recommendation systems are evolving to become more versatile. Unlike traditional techniques,…

Information Retrieval · Computer Science 2025-06-23 Zihan Hong , Yushi Wu , Zhiting Zhao , Shanshan Feng , Jianghong Ma , Jiao Liu , Tianjun Wei

Generative Artificial Intelligence (GenAI) is taking the world by storm. It promises transformative opportunities for advancing and disrupting existing practices, including healthcare. From large language models (LLMs) for clinical note…

Artificial Intelligence · Computer Science 2025-10-29 Gang Chen , Changshuo Liu , Gene Anne Ooi , Marcus Tan , Zhongle Xie , Jianwei Yin , James Wei Luen Yip , Wenqiao Zhang , Jiaqi Zhu , Beng Chin Ooi

Generative AI systems have entered everyday academic, professional, and personal life with remarkable speed, yet most users encounter them as mysterious artifacts rather than intelligible systems. This chapter discusses large language…

Computers and Society · Computer Science 2026-04-21 John T. Behrens

Scientific discovery is a complex cognitive process that has driven human knowledge and technological progress for centuries. While artificial intelligence (AI) has made significant advances in automating aspects of scientific reasoning,…

Machine Learning · Computer Science 2024-12-24 Chandan K Reddy , Parshin Shojaee

Generative AI is radically changing the creative arts, by fundamentally transforming the way we create and interact with cultural artefacts. While offering unprecedented opportunities for artistic expression and commercialisation, this…

Artificial Intelligence · Computer Science 2025-03-25 Jacopo de Berardinis , Lorenzo Porcaro , Albert Meroño-Peñuela , Angelo Cangelosi , Tess Buckley

Despite growing concerns about the risks of Generative AI (GenAI), there is limited understanding of public perceptions of these risks and their associated failure modes -- defined as recurring patterns of sociotechnical breakdown across…

Human-Computer Interaction · Computer Science 2026-04-27 Megan Li , Wendy Bickersteth , Ningjing Tang , Parv Kapoor , Khinezin Win , Peter Zhong , Jason I. Hong , Lorrie Faith Cranor , Hoda Heidari , Hong Shen

This paper presents a theoretical framework for addressing the challenges posed by generative artificial intelligence (AI) in higher education assessment through a machine-versus-machine approach. Large language models like GPT-4, Claude,…

Computers and Society · Computer Science 2025-06-04 Mohammad Saleh Torkestani , Taha Mansouri

Applications of Generative AI (Gen AI) are expected to revolutionize a number of different areas, ranging from science & medicine to education. The potential for these seismic changes has triggered a lively debate about the potential risks…

Sparked by innovations in generative artificial intelligence (AI), the field of protein design has undergone a paradigm shift with an explosion of new models for optimizing existing enzymes or creating them from scratch. After more than one…

Biomolecules · Quantitative Biology 2026-02-04 Lasse Middendorf , Noelia Ferruz

As AI models scale to billions of parameters and operate with increasing autonomy, ensuring their safe, reliable operation demands engineering-grade security and assurance frameworks. This paper presents an enterprise-level, risk-aware,…

Cryptography and Security · Computer Science 2025-05-13 Krti Tallam

This paper aims to serve as a comprehensive guide for researchers and practitioners, offering insights into the current state, potential applications, and future research directions for generative artificial intelligence and foundation…

Artificial Intelligence · Computer Science 2023-05-30 Lukas Stappen , Jeremy Dillmann , Serena Striegel , Hans-Jörg Vögel , Nicolas Flores-Herr , Björn W. Schuller

Given rapid progress toward advanced AI and risks from frontier AI systems (advanced AI systems pushing the boundaries of the AI capabilities frontier), the creation and implementation of AI governance and regulatory schemes deserves…

The rapid adoption of generative artificial intelligence (AI) in educational assessment has created new opportunities for scalable item creation, personalized feedback, and efficient formative evaluation. However, despite advances in…

Computers and Society · Computer Science 2026-04-14 Antoun Yaacoub , Zainab Assaghir , Anuradha Kar

Generative Artificial Intelligence (GenAI) is rapidly reshaping higher education, yet barriers to its adoption across different disciplines and institutional roles remain underexplored. Existing literature frequently attributes adoption…

Computers and Society · Computer Science 2026-05-29 Jianhua Yang , Kerem Öge , Adrian von Mühlenen , Abdullah Bilal Akbulut , Tanya Suzanne Carey , Chidi Okorro