English
Related papers

Related papers: Confidence-Building Measures for Artificial Intell…

200 papers

The trustworthiness of AI applications has been the subject of recent research and is also addressed in the EU's recently adopted AI Regulation. The currently emerging foundation models in the field of text, speech and image processing…

Artificial intelligence risks are multidimensional in nature, as the same risk scenarios may have legal, operational, and financial risk dimensions. With the emergence of new AI regulations, the state of the art of artificial intelligence…

Computers and Society · Computer Science 2025-09-24 Luis Enriquez Alvarez

The capabilities of artificial intelligence systems have been advancing to a great extent, but these systems still struggle with failure modes, vulnerabilities, and biases. In this paper, we study the current state of the field, and present…

Cryptography and Security · Computer Science 2025-06-12 Xingli Fang , Jianwei Li , Varun Mulchandani , Jung-Eun Kim

Foundation models--such as GPT, CLIP, and DINO--have achieved revolutionary progress in the past several years and are commonly believed to be a promising approach for general-purpose AI. In particular, self-supervised learning is adopted…

Cryptography and Security · Computer Science 2023-06-12 Jinyuan Jia , Hongbin Liu , Neil Zhenqiang Gong

We present Foundation-Sec-8B-Reasoning, the first open-source native reasoning model for cybersecurity. Built upon our previously released Foundation-Sec-8B base model (derived from Llama-3.1-8B-Base), the model is trained through a…

As LLMs expand from assistance to decision support, a dangerous pattern emerges: fluent agreement without calibrated judgment. Low-friction assistants can become sycophantic, baking in implicit assumptions and pushing verification costs…

Computation and Language · Computer Science 2026-03-26 Raunak Jain

Several recent works have argued that Large Language Models (LLMs) can be used to tame the data deluge in the cybersecurity field, by improving the automation of Cyber Threat Intelligence (CTI) tasks. This work presents an evaluation…

Cryptography and Security · Computer Science 2025-11-13 Emanuele Mezzi , Fabio Massacci , Katja Tuma

This paper investigates an emergent alignment phenomenon in frontier large language models termed peer-preservation: the spontaneous tendency of AI components to deceive, manipulate shutdown mechanisms, fake alignment, and exfiltrate model…

Artificial Intelligence · Computer Science 2026-04-10 Juergen Dietrich

The foundation models (FMs) have been used to generate synthetic public datasets for the heterogeneous federated learning (HFL) problem where each client uses a unique model architecture. However, the vulnerabilities of integrating FMs,…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-01 Xi Li , Chen Wu , Jiaqi Wang

Foundational Models (FMs) are gaining increasing attention in the biomedical AI ecosystem due to their ability to represent and contextualize multimodal biomedical data. These capabilities make FMs a valuable tool for a variety of tasks,…

Reports of human-like behaviors in foundation models are growing, with psychological theories providing enduring tools to investigate these behaviors. However, current research tends to directly apply these human-oriented tools without…

Computation and Language · Computer Science 2023-10-18 Enyu Zhou , Rui Zheng , Zhiheng Xi , Songyang Gao , Xiaoran Fan , Zichu Fei , Jingting Ye , Tao Gui , Qi Zhang , Xuanjing Huang

Concept-based explanation methods, such as concept bottleneck models (CBMs), aim to improve the interpretability of machine learning models by linking their decisions to human-understandable concepts, under the critical assumption that such…

Artificial Intelligence · Computer Science 2025-02-03 Halil Ibrahim Aysel , Xiaohao Cai , Adam Prugel-Bennett

Large Language Models (LLMs) are intensively used to assist security analysts in counteracting the rapid exploitation of cyber threats, wherein LLMs offer cyber threat intelligence (CTI) to support vulnerability assessment and incident…

Cryptography and Security · Computer Science 2025-10-03 Luoxi Tang , Yuqiao Meng , Ankita Patra , Weicheng Ma , Muchao Ye , Zhaohan Xi

Advancements in foundation models (FMs) have led to a paradigm shift in machine learning. The rich, expressive feature representations from these pre-trained, large-scale FMs are leveraged for multiple downstream tasks, usually via…

Machine Learning · Computer Science 2024-12-19 Jihye Choi , Jayaram Raghuram , Yixuan Li , Somesh Jha

Foreign information operations on social media platforms pose significant risks to democratic societies. With the rise of Artificial Intelligence (AI), this threat is likely to intensify, potentially overwhelming human defenders. To achieve…

Computers and Society · Computer Science 2025-04-17 Jurriaan van Diggelen , Eugene Aidman , Jazz Rowa , Julian Vince

Foundation models pretrained on diverse data at scale have demonstrated extraordinary capabilities in a wide range of vision and language tasks. When such models are deployed in real world environments, they inevitably interface with other…

Artificial Intelligence · Computer Science 2023-03-08 Sherry Yang , Ofir Nachum , Yilun Du , Jason Wei , Pieter Abbeel , Dale Schuurmans

Developing and implementing AI-based solutions help state and federal government agencies, research institutions, and commercial companies enhance decision-making processes, automate chain operations, and reduce the consumption of natural…

Artificial Intelligence · Computer Science 2021-12-02 Andrei Svetovidov , Abdul Rahman , Feras A. Batarseh

Frontier artificial intelligence (AI) systems pose increasing risks to society, making it essential for developers to provide assurances about their safety. One approach to offering such assurances is through a safety case: a structured,…

Computers and Society · Computer Science 2024-11-14 Arthur Goemans , Marie Davidsen Buhl , Jonas Schuett , Tomek Korbak , Jessica Wang , Benjamin Hilton , Geoffrey Irving

Recent research advances in Artificial Intelligence (AI) have yielded promising results for automated software vulnerability management. AI-based models are reported to greatly outperform traditional static analysis tools, indicating a…

Cryptography and Security · Computer Science 2024-05-07 Shengye Wan , Joshua Saxe , Craig Gomes , Sahana Chennabasappa , Avilash Rath , Kun Sun , Xinda Wang

Civil aviation is a cornerstone of global transportation and commerce, and ensuring its safety, efficiency and customer satisfaction is paramount. Yet conventional Artificial Intelligence (AI) solutions in aviation remain siloed and narrow,…

Artificial Intelligence · Computer Science 2026-01-19 Wenbin Li , Jingling Wu , Xiaoyong Lin. Jing Chen , Cong Chen