English
Related papers

Related papers: Beyond the ML Model: Applying Safety Engineering F…

200 papers

Multimodal Large Language Models (MLLMs) are showing strong safety concerns (e.g., generating harmful outputs for users), which motivates the development of safety evaluation benchmarks. However, we observe that existing safety benchmarks…

Cryptography and Security · Computer Science 2024-10-25 Zonghao Ying , Aishan Liu , Siyuan Liang , Lei Huang , Jinyang Guo , Wenbo Zhou , Xianglong Liu , Dacheng Tao

Text-to-Image (T2I) Diffusion Models (DMs) have garnered widespread attention for their impressive advancements in image generation. However, their growing popularity has raised ethical and social concerns related to key non-functional…

Machine Learning · Computer Science 2025-07-22 Yi Zhang , Zhen Chen , Chih-Hong Cheng , Wenjie Ruan , Xiaowei Huang , Dezong Zhao , David Flynn , Siddartha Khastgir , Xingyu Zhao

In recent years, Text-to-Image (T2I) models have seen remarkable advancements, gaining widespread adoption. However, this progress has inadvertently opened avenues for potential misuse, particularly in generating inappropriate or…

Cryptography and Security · Computer Science 2024-04-02 Yijun Yang , Ruiyuan Gao , Xiaosen Wang , Tsung-Yi Ho , Nan Xu , Qiang Xu

Nowadays, we are witnessing a wide adoption of Machine learning (ML) models in many safety-critical systems, thanks to recent breakthroughs in deep learning and reinforcement learning. Many people are now interacting with systems based on…

Software Engineering · Computer Science 2018-12-07 Houssem Ben Braiek , Foutse Khomh

Practitioners from diverse occupations and backgrounds are increasingly using machine learning (ML) methods. Nonetheless, studies on ML Practitioners typically draw populations from Big Tech and academia, as researchers have easier access…

Machine Learning · Computer Science 2021-10-07 Aspen Hopkins , Serena Booth

LLM applications (i.e., LLM apps) leverage the powerful capabilities of LLMs to provide users with customized services, revolutionizing traditional application development. While the increasing prevalence of LLM-powered applications…

Cryptography and Security · Computer Science 2025-12-17 Yunyi Zhang , Shibo Cui , Baojun Liu , Jingkai Yu , Min Zhang , Fan Shi , Han Zheng

Rapid advances in text-to-image (T2I) generation have raised higher requirements for evaluation methodologies. Existing benchmarks center on objective capabilities and dimensions, but lack an application-scenario perspective, limiting…

Artificial Intelligence · Computer Science 2025-09-23 Xiaojing Dong , Weilin Huang , Liang Li , Yiying Li , Shu Liu , Tongtong Ou , Shuang Ouyang , Yu Tian , Fengxuan Zhao

Fatal accidents are a major issue hindering the wide acceptance of safety-critical systems that employ machine learning and deep learning models, such as automated driving vehicles. In order to use machine learning in a safety-critical…

Software Engineering · Computer Science 2019-08-23 Hiroshi Kuwajima , Hirotoshi Yasuoka , Toshihiro Nakae

Machine learning (ML) algorithms are increasingly deployed to make critical decisions in socioeconomic applications such as finance, criminal justice, and autonomous driving. However, due to their data-driven and pattern-seeking nature, ML…

Software Engineering · Computer Science 2026-01-08 Verya Monjezi , Ashish Kumar , Ashutosh Trivedi , Gang Tan , Saeid Tizpaz-Niari

As the shortage of skilled workers continues to be a pressing issue, exacerbated by demographic change, it is becoming a critical challenge for organizations to preserve the knowledge of retiring experts and to pass it on to novices. While…

Human-Computer Interaction · Computer Science 2023-05-16 Philipp Spitzer , Niklas Kühl , Daniel Heinz , Gerhard Satzger

The use of machine learning systems in clinical routine is still hampered by the necessity of a medical device certification and/or by difficulty to implement these systems in a clinic's quality management system. In this context, the key…

Medical Physics · Physics 2022-10-18 Lorenzo Mercolli , Axel Rominger , Kuangyu Shi

This thesis explores a multimodal AI framework for enhancing construction safety through the combined analysis of textual and visual data. In safety-critical environments such as construction sites, accident data often exists in multiple…

Artificial Intelligence · Computer Science 2025-11-21 Islem Sahraoui

Machine learning (ML) models have significantly grown in complexity and utility, driving advances across multiple domains. However, substantial computational resources and specialized expertise have historically restricted their wide…

Cryptography and Security · Computer Science 2025-08-28 Kaixiang Zhao , Lincan Li , Kaize Ding , Neil Zhenqiang Gong , Yue Zhao , Yushun Dong

Machine Learning (ML) is used in critical highly regulated and high-stakes fields such as finance, medicine, and transportation. The correctness of these ML applications is important for human safety and economic benefit. Progress has been…

Software Engineering · Computer Science 2023-09-06 Sheng Wong , Scott Barnett , Jessica Rivera-Villicana , Anj Simmons , Hala Abdelkader , Jean-Guy Schneider , Rajesh Vasa

Open-weight large language models (LLMs) unlock huge benefits in innovation, personalization, privacy, and democratization. However, their core advantage - modifiability - opens the door to systemic risks: bad actors can trivially subvert…

Computers and Society · Computer Science 2025-07-17 Ann-Kathrin Dombrowski , Dillon Bowen , Adam Gleave , Chris Cundy

Context: On top of the inherent challenges startup software companies face applying proper software engineering practices, the non-deterministic nature of machine learning techniques makes it even more difficult for machine learning (ML)…

Software Engineering · Computer Science 2023-04-05 Bishal Lakha , Kalyan Bhetwal , Nasir U. Eisty

Artificial Intelligence (AI) or Machine Learning (ML) systems have been widely adopted as value propositions by companies in all industries in order to create or extend the services and products they offer. However, developing AI/ML systems…

Software Engineering · Computer Science 2020-11-10 Elizamary Nascimento , Anh Nguyen-Duc , Ingrid Sundbø , Tayana Conte

Multimodal Large Language Models (MLLMs) have expanded the capabilities of traditional language models by enabling interaction through both text and images. However, ensuring the safety of these models remains a significant challenge,…

Computation and Language · Computer Science 2025-06-04 Wenxuan Wang , Xiaoyuan Liu , Kuiyi Gao , Jen-tse Huang , Youliang Yuan , Pinjia He , Shuai Wang , Zhaopeng Tu

The popularity of large language models (LLMs) continues to grow, and LLM-based assistants have become ubiquitous. Information security awareness (ISA) is an important yet underexplored area of LLM safety. ISA encompasses LLMs' security…

Cryptography and Security · Computer Science 2026-03-23 Ofir Cohen , Gil Ari Agmon , Asaf Shabtai , Rami Puzis

Malware continues to be a predominant operational risk for organizations, especially when obfuscation techniques are used to evade detection. Despite the ongoing efforts in the development of Machine Learning (ML) detection approaches,…

Cryptography and Security · Computer Science 2026-03-30 César Vieira , João Vitorino , Eva Maia , Isabel Praça