English
Related papers

Related papers: Information theoretic learning of robust deep repr…

200 papers

Test-time defenses are used to improve the robustness of deep neural networks to adversarial examples during inference. However, existing methods either require an additional trained classifier to detect and correct the adversarial samples,…

Machine Learning · Computer Science 2024-08-26 Anurag Singh , Mahalakshmi Sabanayagam , Krikamol Muandet , Debarghya Ghoshdastidar

Self-supervised feature learning enables perception systems to benefit from the vast raw data recorded by vehicle fleets worldwide. While video-level self-supervised learning approaches have shown strong generalizability on classification…

Computer Vision and Pattern Recognition · Computer Science 2023-11-09 Christopher Lang , Alexander Braun , Lars Schillingmann , Karsten Haug , Abhinav Valada

We study the problem of learning the objective functions or constraints of a multiobjective decision making model, based on a set of sequentially arrived decisions. In particular, these decisions might not be exact and possibly carry…

Machine Learning · Computer Science 2022-12-27 Chaosheng Dong , Yijia Wang , Bo Zeng

Recent self-supervised learning methods are able to learn high-quality image representations and are closing the gap with supervised approaches. However, these methods are unable to acquire new knowledge incrementally -- they are, in fact,…

Computer Vision and Pattern Recognition · Computer Science 2022-05-03 Alex Gomez-Villa , Bartlomiej Twardowski , Lu Yu , Andrew D. Bagdanov , Joost van de Weijer

Deep reinforcement learning has achieved great success in laser-based collision avoidance work because the laser can sense accurate depth information without too much redundant data, which can maintain the robustness of the algorithm when…

Robotics · Computer Science 2021-08-24 Lingping Gao , Jianchuan Ding , Wenxi Liu , Haiyin Piao , Yuxin Wang , Xin Yang , Baocai Yin

Extracting informative representations from videos is fundamental for effectively learning various downstream tasks. We present a novel approach for unsupervised learning of meaningful representations from videos, leveraging the concept of…

Computer Vision and Pattern Recognition · Computer Science 2023-06-07 Ali Younes , Simone Schaub-Meyer , Georgia Chalvatzaki

Learning representations of data is an important problem in statistics and machine learning. While the origin of learning representations can be traced back to factor analysis and multidimensional scaling in statistics, it has become a…

Machine Learning · Statistics 2019-11-27 Jianwen Xie , Ruiqi Gao , Erik Nijkamp , Song-Chun Zhu , Ying Nian Wu

Given the apparent difficulty of learning models that are robust to adversarial perturbations, we propose tackling the simpler problem of developing adversarially robust features. Specifically, given a dataset and metric of interest, the…

Machine Learning · Computer Science 2024-08-27 Shivam Garg , Vatsal Sharan , Brian Hu Zhang , Gregory Valiant

Feature transformation aims to reconstruct an effective representation space by mathematically refining the existing features. It serves as a pivotal approach to combat the curse of dimensionality, enhance model generalization, mitigate…

Machine Learning · Computer Science 2023-06-30 Meng Xiao , Dongjie Wang , Min Wu , Kunpeng Liu , Hui Xiong , Yuanchun Zhou , Yanjie Fu

Progress in self-supervised learning has brought strong general image representation learning methods. Yet so far, it has mostly focused on image-level learning. In turn, tasks such as unsupervised image segmentation have not benefited from…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Adrian Ziegler , Yuki M. Asano

In this paper, we introduce a new functional point of view on bilevel optimization problems for machine learning, where the inner objective is minimized over a function space. These types of problems are most often solved by using methods…

Machine Learning · Statistics 2024-12-10 Ieva Petrulionyte , Julien Mairal , Michael Arbel

We study the new feature utility prediction problem: statistically testing whether adding a new feature to the data representation can improve predictive accuracy on a supervised learning task. In many applications, identifying new…

Machine Learning · Computer Science 2012-06-22 Hoyt Koepke , Mikhail Bilenko

The problem of identifying the most discriminating features when performing supervised learning has been extensively investigated. In particular, several methods for variable selection in model-based classification have been proposed.…

Applications · Statistics 2020-12-16 Andrea Cappozzo , Francesca Greselin , Thomas Brendan Murphy

This work tackles an intriguing and fundamental open challenge in representation learning: Given a well-trained deep learning model, can it be reprogrammed to enhance its robustness against adversarial or noisy input perturbations without…

Machine Learning · Computer Science 2024-10-08 Zhichao Hou , MohamadAli Torkamani , Hamid Krim , Xiaorui Liu

This paper proposes a new principled multi-task representation learning framework (InfoMTL) to extract noise-invariant sufficient representations for all tasks. It ensures sufficiency of shared representations for all tasks and mitigates…

Computation and Language · Computer Science 2025-03-07 Dou Hu , Lingwei Wei , Wei Zhou , Songlin Hu

The recent impressive results of deep learning-based methods on computer vision applications brought fresh air to the research and industrial community. This success is mainly due to the process that allows those methods to learn…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Keiller Nogueira , Jocelyn Chanussot , Mauro Dalla Mura , Jefersson A. dos Santos

We propose a method for the approximation of high- or even infinite-dimensional feature vectors, which play an important role in supervised learning. The goal is to reduce the size of the training data, resulting in lower storage…

Machine Learning · Statistics 2021-04-06 Patrick Gelß , Stefan Klus , Ingmar Schuster , Christof Schütte

Recently, a deep reinforcement learning method is proposed to solve multiobjective optimization problem. In this method, the multiobjective optimization problem is decomposed to a number of single-objective optimization subproblems and all…

Neural and Evolutionary Computing · Computer Science 2020-02-14 Hong Wu , Jiahai Wang , Zizhen Zhang

Neural network architectures have been extensively employed in the fair representation learning setting, where the objective is to learn a new representation for a given vector which is independent of sensitive information. Various…

Machine Learning · Computer Science 2022-01-19 Mattia Cerrato , Marius Köppel , Alexander Segner , Stefan Kramer

The study of object representations in computer vision has primarily focused on developing representations that are useful for image classification, object detection, or semantic segmentation as downstream tasks. In this work we aim to…

Computer Vision and Pattern Recognition · Computer Science 2019-11-21 Tejas Kulkarni , Ankush Gupta , Catalin Ionescu , Sebastian Borgeaud , Malcolm Reynolds , Andrew Zisserman , Volodymyr Mnih