English
Related papers

Related papers: Oracle Poisoning: Corrupting Knowledge Graphs to W…

200 papers

Deep learning models are often trained on distributed, web-scale datasets crawled from the internet. In this paper, we introduce two new dataset poisoning attacks that intentionally introduce malicious examples to a model's performance. Our…

Recent Vision-Language-Action (VLA) models increasingly adopt chain-of-thought (CoT) reasoning, generating a natural-language plan before decoding motor commands. This internal text channel between the reasoning module and the action…

Robotics · Computer Science 2026-03-16 Tuan Duong Trinh , Naveed Akhtar , Basim Azam

Data poisoning attacks, in which an adversary corrupts a training set with the goal of inducing specific desired mistakes, have raised substantial concern: even just the possibility of such an attack can make a user no longer trust the…

Machine Learning · Computer Science 2022-03-09 Maria-Florina Balcan , Avrim Blum , Steve Hanneke , Dravyansh Sharma

Link prediction in graph data uses various algorithms and Graph Nerual Network (GNN) models to predict potential relationships between graph nodes. These techniques have found widespread use in numerous real-world applications, including…

Machine Learning · Computer Science 2025-10-21 Mingchen Li , Di Zhuang , Keyu Chen , Dumindu Samaraweera , Morris Chang

Property inference attacks consider an adversary who has access to the trained model and tries to extract some global statistics of the training data. In this work, we study property inference in scenarios where the adversary can…

Machine Learning · Computer Science 2021-01-28 Melissa Chase , Esha Ghosh , Saeed Mahloujifar

With the growing adoption of AI and machine learning systems in real-world applications, ensuring their fairness has become increasingly critical. The majority of the work in algorithmic fairness focus on assessing and improving the…

Machine Learning · Computer Science 2025-11-12 Eunice Chan , Hanghang Tong

Recent AI systems combine large language models with tools, external knowledge via retrieval-augmented generation (RAG), and even autonomous multi-agent decision loops. This agentic AI paradigm greatly expands capabilities - but also vastly…

Cryptography and Security · Computer Science 2026-03-25 Ali Dehghantanha , Sajad Homayoun

Gradient attacks and data poisoning tamper with the training of machine learning algorithms to maliciously alter them and have been proven to be equivalent in convex settings. The extent of harm these attacks can produce in non-convex…

Machine Learning · Computer Science 2024-12-12 Wassim Bouaziz , El-Mahdi El-Mhamdi , Nicolas Usunier

Learned indexes are a class of index data structures that enable fast search by approximating the cumulative distribution function (CDF) using machine learning models (Kraska et al., SIGMOD'18). However, recent studies have shown that…

Machine Learning · Computer Science 2026-03-03 Atsuki Sato , Martin Aumüller , Yusuke Matsui

Retrieval-Augmented Generation (RAG) enhances large language models (LLMs) by retrieving external data to mitigate hallucinations and outdated knowledge issues. Benefiting from the strong ability in facilitating diverse data sources and…

Cryptography and Security · Computer Science 2025-07-15 Tianzhe Zhao , Jiaoyan Chen , Yanchi Ru , Haiping Zhu , Nan Hu , Jun Liu , Qika Lin

While Large Language Models (LLMs) are increasingly being used in real-world applications, they remain vulnerable to prompt injection attacks: malicious third party prompts that subvert the intent of the system designer. To help researchers…

Adversarial training instances can severely distort a model's behavior. This work investigates certified regression defenses, which provide guaranteed limits on how much a regressor's prediction may change under a poisoning attack. Our key…

Machine Learning · Computer Science 2023-01-02 Zayd Hammoudeh , Daniel Lowd

Recommendation and collaborative filtering systems are important in modern information and e-commerce applications. As these systems are becoming increasingly popular in the industry, their outputs could affect business decision making,…

Machine Learning · Computer Science 2016-10-07 Bo Li , Yining Wang , Aarti Singh , Yevgeniy Vorobeychik

Large Language Models (LLMs) have advanced Graph Neural Networks (GNNs) by enriching node representations with semantic features, giving rise to LLM-enhanced GNNs that achieve notable performance gains. However, the robustness of these…

Machine Learning · Computer Science 2026-03-30 Yuhang Ma , Jie Wang , Zheng Yan

Tool-using LLM agents must act on untrusted webpages, emails, files, and API outputs while issuing privileged tool calls. Existing defenses often mediate trust at the granularity of an entire tool invocation, forcing a brittle choice in…

Cryptography and Security · Computer Science 2026-05-13 Linfeng Fan , Ziwei Li , Yuan Tian , Yichen Wang , Rongsheng Li , Xiong Wang

By providing a standardized interface for LLM agents to interact with external tools, the Model Context Protocol (MCP) is quickly becoming a cornerstone of the modern autonomous agent ecosystem. However, it creates novel attack surfaces due…

Cryptography and Security · Computer Science 2025-08-22 Zhiqiang Wang , Yichao Gao , Yanting Wang , Suyuan Liu , Haifeng Sun , Haoran Cheng , Guanquan Shi , Haohua Du , Xiangyang Li

Off-policy Evaluation (OPE) methods are a crucial tool for evaluating policies in high-stakes domains such as healthcare, where exploration is often infeasible, unethical, or expensive. However, the extent to which such methods can be…

Machine Learning · Computer Science 2024-04-09 Elita Lobo , Harvineet Singh , Marek Petrik , Cynthia Rudin , Himabindu Lakkaraju

The perturbation analysis of linear solvers applied to systems arising broadly in machine learning settings -- for instance, when using linear regression models -- establishes an important perspective when reframing these analyses through…

Machine Learning · Computer Science 2024-10-02 Yixin Liu , Arielle Carr , Lichao Sun

Reasoning is a fundamental problem for computers and deeply studied in Artificial Intelligence. In this paper, we specifically focus on answering multi-hop logical queries on Knowledge Graphs (KGs). This is a complicated task because, in…

Artificial Intelligence · Computer Science 2022-09-30 Alfonso Amayuelas , Shuai Zhang , Susie Xi Rao , Ce Zhang

This demo paper examines the susceptibility of Federated Learning (FL) systems to targeted data poisoning attacks, presenting a novel system for visualizing and mitigating such threats. We simulate targeted data poisoning attacks via label…

Cryptography and Security · Computer Science 2024-05-28 Xueqing Zhang , Junkai Zhang , Ka-Ho Chow , Juntao Chen , Ying Mao , Mohamed Rahouti , Xiang Li , Yuchen Liu , Wenqi Wei