English
Related papers

Related papers: Software Testing of Generative AI Systems: Challen…

200 papers

There is an increasing imperative to anticipate and understand the performance and safety of generative AI systems in real-world deployment contexts. However, the current evaluation ecosystem is insufficient: Commonly used static benchmarks…

Generative AI (GenAI) models present new challenges in regulating against discriminatory behavior. In this paper, we argue that GenAI fairness research still has not met these challenges; instead, a significant gap remains between existing…

Machine Learning · Computer Science 2024-12-31 Thomas P. Zollo , Nikita Rajaneesh , Richard Zemel , Talia B. Gillis , Emily Black

Generative artificial intelligence (GenAI) has the potential to improve healthcare through automation that enhances the quality and safety of patient care. Powered by foundation models that have been pretrained and can generate complex…

Computers and Society · Computer Science 2024-07-25 Laleh Jalilian , Daniel McDuff , Achuta Kadambi

Generative Artificial Intelligence (GenAI) has become an emerging technology with the availability of several tools that could impact Software Engineering (SE) activities. As any other disruptive technology, GenAI led to the speculation…

Software Engineering · Computer Science 2024-06-17 Aline de Campos , Jorge Melegati , Nicolas Nascimento , Rafael Chanin , Afonso Sales , Igor Wiese

Software is omnipresent within all factors of society. It is thus important to ensure that software are well tested to mitigate bad user experiences as well as the potential for severe financial and human losses. Software testing is however…

Software Engineering · Computer Science 2025-04-30 Jason Wang , Basem Suleiman , Muhammad Johan Alibasa

Generative Artificial Intelligence (GenAI) is rapidly reshaping the global financial landscape, offering unprecedented opportunities to enhance customer engagement, automate complex workflows, and extract actionable insights from vast…

Cryptography and Security · Computer Science 2025-05-01 Bikash Saha , Nanda Rani , Sandeep Kumar Shukla

Across academia, industry, and government, there is an increasing awareness that the measurement tasks involved in evaluating generative AI (GenAI) systems are especially difficult. We argue that these measurement tasks are highly…

The field of engineering is shaped by the tools and methods used to solve problems. Optimization is one such class of powerful, robust, and effective engineering tools proven over decades of use. Within just a few years, generative…

Computational Engineering, Finance, and Science · Computer Science 2025-12-02 Lyle Regenwetter , Cyril Picard , Amin Heyrani Nobari , Akash Srivastava , Faez Ahmed

Applications of Generative AI (Gen AI) are expected to revolutionize a number of different areas, ranging from science & medicine to education. The potential for these seismic changes has triggered a lively debate about the potential risks…

Artificial Intelligence (AI) is making a significant impact in multiple areas like medical, military, industrial, domestic, law, arts as AI is capable to perform several roles such as managing smart factories, driving autonomous vehicles,…

Software Engineering · Computer Science 2022-01-17 Zubair Khaliq , Sheikh Umar Farooq , Dawood Ashraf Khan

Although tension between university curricula and industry expectations has existed in some form for decades, the rapid integration of generative AI (GenAI) tools into software development has recently widened the gap between the two…

Software Engineering · Computer Science 2026-04-09 Daniel Otten , Trevor Stalnaker , Nathan Wintersgill , Oscar Chaparro , Denys Poshyvanyk , Douglas Schmidt

As Generative AI (GenAI) continues to gain prominence and utility across various sectors, their integration into the realm of Internet of Things (IoT) security evolves rapidly. This work delves into an examination of the state-of-the-art…

Cryptography and Security · Computer Science 2025-02-14 Yan Lin Aung , Ivan Christian , Ye Dong , Xiaodong Ye , Sudipta Chattopadhyay , Jianying Zhou

Generative AI (GenAI) has recently emerged as a groundbreaking force in Software Engineering, capable of generating code, identifying bugs, recommending fixes, and supporting quality assurance. While its use in coding tasks shows…

Qualitative research gives rich insights into the quintessentially human aspects of software engineering as a socio-technical system. Qualitative research spans diverse strategies and methods, from interpretivist, in situ observational…

Software Engineering · Computer Science 2026-03-11 Neil A. Ernst , Christoph Treude

Generative Artificial Intelligence (GAI) systems that can automatically generate content in the form of source code or other contents (e.g., images) has seen increasing popularity due to the emergence of tools such as ChatGPT which rely on…

Software Engineering · Computer Science 2026-04-27 Shin Hwei Tan , Haibo Wang , Heng Li

With software development increasingly reliant on innovative technologies, there is a growing interest in exploring the potential of generative AI tools to streamline processes and enhance productivity. In this scenario, this paper…

Software Engineering · Computer Science 2024-06-04 Mariana Coutinho , Lorena Marques , Anderson Santos , Marcio Dahia , Cesar Franca , Ronnie de Souza Santos

The continuing, explosive developments in generative artificial intelligence (GenAI), built on large language models and related algorithms, has led to much excitement and speculation about the potential impact of this new technology.…

Computers and Society · Computer Science 2025-03-11 Veda C. Storey , Wei Thoo Yue , J. Leon Zhao , Roman Lukyanenko

Generative AI's expanding footprint across numerous industries has led to both excitement and increased scrutiny. This paper delves into the unique security challenges posed by Generative AI, and outlines potential research directions for…

Cryptography and Security · Computer Science 2024-10-24 Banghua Zhu , Norman Mu , Jiantao Jiao , David Wagner

Generative Artificial Intelligence (GenAI) has become a central component of many development tools (e.g., GitHub Copilot) that support software practitioners across multiple programming tasks, including code completion, documentation, and…

GenAI has gained the attention of a myriad of users in almost every profession. Its advancement has had an intense impact on education, significantly disrupting the assessment design and evaluation methodologies. Despite the potential…

Computers and Society · Computer Science 2024-05-06 Rajan Kadel , Bhupesh Kumar Mishra , Samar Shailendra , Samia Abid , Maneeha Rani , Shiva Prasad Mahato