English
Related papers

Related papers: Balancing Robustness and Sensitivity using Feature…

200 papers

Contrastive learning has significantly improved representation quality, enhancing knowledge transfer across tasks in continual learning (CL). However, catastrophic forgetting remains a key challenge, as contrastive based methods primarily…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Trung-Anh Dang , Vincent Nguyen , Ngoc-Son Vu , Christel Vrain

In decentralized financial systems, robust and efficient Federated Learning (FL) is promising to handle diverse client environments and ensure resilience to systemic risks. We propose Federated Risk-Aware Learning with Central Sensitivity…

Machine Learning · Computer Science 2025-02-26 Lei Zhao , Lin Cai , Wu-Sheng Lu

Federated Learning (FL) is a machine learning paradigm that allows decentralized clients to learn collaboratively without sharing their private data. However, excessive computation and communication demands pose challenges to current FL…

Cryptography and Security · Computer Science 2022-09-22 Yue Tan , Guodong Long , Jie Ma , Lu Liu , Tianyi Zhou , Jing Jiang

Deep neural networks are known to be vulnerable to security risks due to the inherent transferable nature of adversarial examples. Despite the success of recent generative model-based attacks demonstrating strong transferability, it still…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Hunmin Yang , Jongoh Jeong , Kuk-Jin Yoon

To advance the understanding of robust deep learning, we delve into the effects of adversarial training on self-supervised and supervised contrastive learning alongside supervised learning. Our analysis uncovers significant disparities…

Machine Learning · Computer Science 2023-06-08 Fatemeh Ghofrani , Mehdi Yaghouti , Pooyan Jamshidi

Predicting the neural response to natural images in the visual cortex requires extracting relevant features from the images and relating those feature to the observed responses. In this work, we optimize the feature extraction in order to…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Alex Mulrooney , Austin J. Brockmeier

The remarkable performance of deep learning models and their applications in consequential domains (e.g., facial recognition) introduces important challenges at the intersection of equity and security. Fairness and robustness are two…

Machine Learning · Computer Science 2022-11-24 Cuong Tran , Keyu Zhu , Ferdinando Fioretto , Pascal Van Hentenryck

Many of the successes of machine learning are based on minimizing an averaged loss function. However, it is well-known that this paradigm suffers from robustness issues that hinder its applicability in safety-critical domains. These issues…

Machine Learning · Computer Science 2022-06-09 Alexander Robey , Luiz F. O. Chamon , George J. Pappas , Hamed Hassani

In the contemporary of deep learning, where models often grapple with the challenge of simultaneously achieving robustness against adversarial attacks and strong generalization capabilities, this study introduces an innovative Local Feature…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Yunpeng Gong , Chuangliang Zhang , Yongjie Hou , Lifei Chen , Min Jiang

Adversarial training is a widely-applied approach to training deep neural networks to be robust against adversarial perturbation. However, although adversarial training has achieved empirical success in practice, it still remains unclear…

Machine Learning · Computer Science 2025-02-10 Binghui Li , Yuanzhi Li

Contrastive learning is a representation learning method performed by contrasting a sample to other similar samples so that they are brought closely together, forming clusters in the feature space. The learning process is typically…

Machine Learning · Computer Science 2022-09-28 Valentino Vito , Lim Yohanes Stefanus

Contrastive self-supervised learning (CSL) has attracted increasing attention for model pre-training via unlabeled data. The resulted CSL models provide instance-discriminative visual features that are uniformly scattered in the feature…

Computer Vision and Pattern Recognition · Computer Science 2021-10-15 Yifan Zhang , Bryan Hooi , Dapeng Hu , Jian Liang , Jiashi Feng

Network robustness is critical for various societal and industrial networks again malicious attacks. In particular, connectivity robustness and controllability robustness reflect how well a networked system can maintain its connectedness…

Systems and Control · Electrical Eng. & Systems 2023-07-25 Yang Lou , Ruizi Wu , Junli Li , Lin Wang , Xiang Li , Guanrong Chen

Feature quality is paramount for classification performance, particularly in few-shot scenarios. Contrastive learning, a widely adopted technique for enhancing feature quality, leverages sample relations to extract intrinsic features that…

Computer Vision and Pattern Recognition · Computer Science 2025-01-24 Guowei Yin , Sheng Huang , Luwen Huangfu , Yi Zhang , Xiaohong Zhang

Neural networks have revolutionized various domains, exhibiting remarkable accuracy in tasks like natural language processing and computer vision. However, their vulnerability to slight alterations in input samples poses challenges,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-15 Shashank Kotyan , Danilo Vasconcellos Vargas

Learning visual representation of high quality is essential for image classification. Recently, a series of contrastive representation learning methods have achieved preeminent success. Particularly, SupCon outperformed the dominant methods…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Sungho Park , Jewook Lee , Pilhyeon Lee , Sunhee Hwang , Dohyung Kim , Hyeran Byun

Robustness is widely regarded as a fundamental problem in the analysis of machine learning (ML) models. Most often robustness equates with deciding the non-existence of adversarial examples, where adversarial examples denote situations…

Machine Learning · Computer Science 2023-12-19 Yacine Izza , Joao Marques-Silva

While deep learning has resulted in major breakthroughs in many application domains, the frameworks commonly used in deep learning remain fragile to artificially-crafted and imperceptible changes in the data. In response to this fragility,…

Machine Learning · Computer Science 2020-11-03 Alexander Robey , Hamed Hassani , George J. Pappas

Multi-modal contrastive learning with language supervision has presented a paradigm shift in modern machine learning. By pre-training on a web-scale dataset, multi-modal contrastive learning can learn high-quality representations that…

Machine Learning · Computer Science 2024-11-06 Wei Huang , Andi Han , Yongqiang Chen , Yuan Cao , Zhiqiang Xu , Taiji Suzuki

Medical image classification is one of the most important tasks for computer-aided diagnosis. Deep learning models, particularly convolutional neural networks, have been successfully used for disease classification from medical images,…

Computer Vision and Pattern Recognition · Computer Science 2023-05-05 Md. Atik Ahamed , Jin Chen , Abdullah-Al-Zubaer Imran