中文
相关论文

相关论文: Constraining Representations Yields Models That Kn…

200 篇论文

Machine learning (ML) models that use deep neural networks are vulnerable to backdoor attacks. Such attacks involve the insertion of a (hidden) trigger by an adversary. As a consequence, any input that contains the trigger will cause the…

密码学与安全 · 计算机科学 2022-03-30 Arezoo Rajabi , Bhaskar Ramasubramanian , Radha Poovendran

Deep neural networks are vulnerable to backdoor attacks (Trojans), where an attacker poisons the training set with backdoor triggers so that the neural network learns to classify test-time triggers to the attacker's designated target class.…

机器学习 · 计算机科学 2023-08-10 Hang Wang , Zhen Xiang , David J. Miller , George Kesidis

In recent years, there has been a growing interest in using machine learning techniques for the estimation of treatment effects. Most of the best-performing methods rely on representation learning strategies that encourage shared behavior…

机器学习 · 计算机科学 2024-04-19 Roger Pros , Jordi Vitrià

Machine unlearning is the process of efficiently removing specific information from a trained machine learning model without retraining from scratch. Existing unlearning methods, which often provide provable guarantees, typically involve…

Many active learning methods belong to the retraining-based approaches, which select one unlabeled instance, add it to the training set with its possible labels, retrain the classification model, and evaluate the criteria that we base our…

机器学习 · 统计学 2017-03-01 Yazhou Yang , Marco Loog

In-context learning is a remarkable capability of transformers, referring to their ability to adapt to specific tasks based on a short history or context. Previous research has found that task-specific information is locally encoded within…

机器学习 · 计算机科学 2025-01-17 Liu Yang , Ziqian Lin , Kangwook Lee , Dimitris Papailiopoulos , Robert Nowak

Concept Activation Vectors (CAVs) are a tool from explainable AI, offering a promising approach for understanding how human-understandable concepts are encoded in a model's latent spaces. They are computed from hidden-layer activations of…

机器学习 · 统计学 2026-01-28 Ekkehard Schnoor , Malik Tiomoko , Jawher Said , Alex Jung , Wojciech Samek

Despite the recent success of artificial neural networks on a variety of tasks, we have little knowledge or control over the exact solutions these models implement. Instilling inductive biases -- preferences for some solutions over others…

机器学习 · 计算机科学 2024-02-02 Enyan Zhang , Michael A. Lepori , Ellie Pavlick

The contribution of this paper is a framework for training and evaluation of Model Predictive Control (MPC) implemented using constrained neural networks. Recent studies have proposed to use neural networks with differentiable convex…

机器学习 · 统计学 2020-05-11 Rebecka Winqvist , Arun Venkitaraman , Bo Wahlberg

In traditional software programs, it is easy to trace program logic from variables back to input, apply assertion statements to block erroneous behavior, and compose programs together. Although deep learning programs have demonstrated…

机器学习 · 计算机科学 2021-10-27 Mike Wu , Noah Goodman , Stefano Ermon

Today's most powerful machine learning approaches are typically designed to train stateless architectures with predefined layers and differentiable activation functions. While these approaches have led to unprecedented successes in areas…

机器学习 · 计算机科学 2023-12-25 Alexander Grushin

Representation learning based on multi-task pretraining has become a powerful approach in many domains. In particular, task-aware representation learning aims to learn an optimal representation for a specific target task by sampling data…

机器学习 · 计算机科学 2023-06-16 Yifang Chen , Yingbing Huang , Simon S. Du , Kevin Jamieson , Guanya Shi

We introduce Learning-Augmented Control (LAC), an approach that integrates untrusted machine learning predictions into the control of constrained, nonlinear dynamical systems. LAC is designed to achieve the "best-of-both-worlds" guarantees,…

系统与控制 · 电气工程与系统科学 2025-07-22 Tongxin Li

Considering a probability distribution over parameters is known as an efficient strategy to learn a neural network with non-differentiable activation functions. We study the expectation of a probabilistic neural network as a predictor by…

机器学习 · 计算机科学 2023-04-17 Louis Fortier-Dubois , Gaël Letarte , Benjamin Leblanc , François Laviolette , Pascal Germain

With the increasing adoption of AI, inherent security and privacy vulnerabilities formachine learning systems are being discovered. One such vulnerability makes itpossible for an adversary to obtain private information about the types of…

机器学习 · 计算机科学 2019-10-11 Samyadeep Basu , Rauf Izmailov , Chris Mesterharm

Although neural networks are capable of reaching astonishing performances on a wide variety of contexts, properly training networks on complicated tasks requires expertise and can be expensive from a computational perspective. In industrial…

机器学习 · 统计学 2021-05-11 Théo Lacombe , Yuichi Ike , Mathieu Carriere , Frédéric Chazal , Marc Glisse , Yuhei Umeda

In open set recognition, deep neural networks encounter object classes that were unknown during training. Existing open set classifiers distinguish between known and unknown classes by measuring distance in a network's logit space, assuming…

计算机视觉与模式识别 · 计算机科学 2021-03-04 Dimity Miller , Niko Sünderhauf , Michael Milford , Feras Dayoub

Despite the tremendous success of deep neural networks in various learning problems, it has been observed that adding an intentionally designed adversarial perturbation to inputs of these architectures leads to erroneous classification with…

机器学习 · 计算机科学 2018-12-19 Emilio Rafael Balda , Arash Behboodi , Rudolf Mathar

Promising results have driven a recent surge of interest in continuous optimization methods for Bayesian network structure learning from observational data. However, there are theoretical limitations on the identifiability of underlying…

The following work presents how autoencoding all the possible hidden activations of a network for a given problem can provide insight about its structure, behavior, and vulnerabilities. The method, termed self-introspection, can show that a…