English
Related papers

Related papers: Null It Out: Guarding Protected Attributes by Iter…

200 papers

Neural network models trained on text data have been found to encode undesirable linguistic or sensitive concepts in their representation. Removing such concepts is non-trivial because of a complex relationship between the concept, text…

Machine Learning · Computer Science 2023-06-21 Abhinav Kumar , Chenhao Tan , Amit Sharma

In this paper, we address the problem of learning a binary (positive vs. negative) classifier given Positive and Unlabeled data commonly referred to as PU learning. Although rudimentary techniques like clustering, out-of-distribution…

Machine Learning · Computer Science 2023-10-09 Omar Zamzam , Haleh Akrami , Mahdi Soltanolkotabi , Richard Leahy

In this paper, we address the question of information preservation in ill-posed, non-linear inverse problems, assuming that the measured data is close to a low-dimensional model set. We provide necessary and sufficient conditions for the…

Information Theory · Computer Science 2018-12-05 Nicolas Keriven , Rémi Gribonval

Implicit neural representations have emerged as a powerful tool in learning 3D geometry, offering unparalleled advantages over conventional representations like mesh-based methods. A common type of INR implicitly encodes a shape's boundary…

Computer Vision and Pattern Recognition · Computer Science 2024-10-17 Shen Fan , Przemyslaw Musialski

Objective: To automatically create large labeled training datasets and reduce the efforts of feature engineering for training accurate machine learning models for clinical information extraction. Materials and Methods: We propose a distant…

Information Retrieval · Computer Science 2018-04-24 Yanshan Wang , Sunghwan Sohn , Sijia Liu , Feichen Shen , Liwei Wang , Elizabeth J. Atkinson , Shreyasee Amin , Hongfang Liu

As privacy protection receives much attention, unlearning the effect of a specific node from a pre-trained graph learning model has become equally important. However, due to the node dependency in the graph-structured data, representation…

Machine Learning · Computer Science 2023-02-20 Weilin Cong , Mehrdad Mahdavi

Word vector embeddings have been shown to contain and amplify biases in data they are extracted from. Consequently, many techniques have been proposed to identify, mitigate, and attenuate these biases in word representations. In this paper,…

Computation and Language · Computer Science 2021-04-08 Archit Rathore , Sunipa Dev , Jeff M. Phillips , Vivek Srikumar , Yan Zheng , Chin-Chia Michael Yeh , Junpeng Wang , Wei Zhang , Bei Wang

Many machine learning classification systems lack competency awareness. Specifically, many systems lack the ability to identify when outliers (e.g., samples that are distinct from and not represented in the training data distribution) are…

Machine Learning · Computer Science 2020-07-03 Matthew Cook , Alina Zare , Paul Gader

Reliably reconstructing physical fields from sparse sensor data is a challenge that frequently arises in many scientific domains. In practice, the process generating the data often is not understood to sufficient accuracy. Therefore, there…

Machine Learning · Computer Science 2024-01-23 Xihaier Luo , Wei Xu , Yihui Ren , Shinjae Yoo , Balu Nadiga

This work proposes a novel privacy-preserving neural network feature representation to suppress the sensitive information of a learned space while maintaining the utility of the data. The new international regulation for personal data…

Computer Vision and Pattern Recognition · Computer Science 2020-08-10 Aythami Morales , Julian Fierrez , Ruben Vera-Rodriguez , Ruben Tolosana

Pretrained language models are long known to be subpar in capturing sentence and document-level semantics. Though heavily investigated, transferring perturbation-based methods from unsupervised visual representation learning to NLP remains…

Computation and Language · Computer Science 2024-02-14 Chenghao Xiao , Zhuoxu Huang , Danlu Chen , G Thomas Hudson , Yizhi Li , Haoran Duan , Chenghua Lin , Jie Fu , Jungong Han , Noura Al Moubayed

We present the Assignment-Maximization Spectral Attribute removaL (AMSAL) algorithm, which erases information from neural representations when the information to be erased is implicit rather than directly being aligned to each input…

Computation and Language · Computer Science 2023-04-19 Shun Shao , Yftah Ziser , Shay Cohen

Neural Radiance Fields (NeRFs) are emerging as a ubiquitous scene representation that allows for novel view synthesis. Increasingly, NeRFs will be shareable with other people. Before sharing a NeRF, though, it might be desirable to remove…

Computer Vision and Pattern Recognition · Computer Science 2022-12-23 Silvan Weder , Guillermo Garcia-Hernando , Aron Monszpart , Marc Pollefeys , Gabriel Brostow , Michael Firman , Sara Vicente

One approach to explaining the hierarchical levels of understanding within a machine learning model is the symbolic method of inductive logic programming (ILP), which is data efficient and capable of learning first-order logic rules that…

Machine Learning · Computer Science 2023-09-01 Andreas Bueff , Vaishak Belle

Previous studies have found that an adversary attacker can often infer unintended input information from intermediate-layer features. We study the possibility of preventing such adversarial inference, yet without too much accuracy…

Machine Learning · Computer Science 2020-01-15 Liyao Xiang , Haotian Ma , Hao Zhang , Yifan Zhang , Jie Ren , Quanshi Zhang

Machine unlearning aims to remove sensitive or undesired data from large language models. However, recent studies suggest that unlearning is often shallow, claiming that removed knowledge can easily be recovered. In this work, we critically…

Machine Learning · Computer Science 2025-06-03 Zhili Feng , Yixuan Even Xu , Alexander Robey , Robert Kirk , Xander Davies , Yarin Gal , Avi Schwarzschild , J. Zico Kolter

Machine unlearning in Vision-Language Models (VLMs) is typically performed at the image or instance level, making it difficult to precisely remove target knowledge without affecting unrelated semantics. This issue is especially pronounced…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Shen Lin , Jing Lin , Junhao Dong , Piotr Koniusz , Li Xu

Supervised neural networks, which first map an input $x$ to a single representation $z$, and then map $z$ to the output label $y$, have achieved remarkable success in a wide range of natural language processing (NLP) tasks. Despite their…

Computation and Language · Computer Science 2020-09-22 Jiawei Wu , Xiaoya Li , Xiang Ao , Yuxian Meng , Fei Wu , Jiwei Li

Recently, Implicit Neural Representations (INRs) parameterized by neural networks have emerged as a powerful and promising tool to represent different kinds of signals due to its continuous, differentiable properties, showing superiorities…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Wentao Yuan , Qingtian Zhu , Xiangyue Liu , Yikang Ding , Haotian Zhang , Chi Zhang

The task of infomin learning aims to learn a representation with high utility while being uninformative about a specified target, with the latter achieved by minimising the mutual information between the representation and the target. It…

Machine Learning · Computer Science 2023-02-22 Yanzhi Chen , Weihao Sun , Yingzhen Li , Adrian Weller