English
Related papers

Related papers: Feature Distribution Shift Mitigation with Contras…

200 papers

The Information Contrastive (I-Con) framework revealed that over 23 representation learning methods implicitly minimize KL divergence between data and learned distributions that encode similarities between data points. However, a KL-based…

Machine Learning · Computer Science 2025-12-05 Jasmine Shone , Zhening Li , Shaden Alshammari , Mark Hamilton , William Freeman

The problem of distance metric learning is mostly considered from the perspective of learning an embedding space, where the distances between pairs of examples are in correspondence with a similarity metric. With the rise and success of…

Computer Vision and Pattern Recognition · Computer Science 2019-09-10 Yehao Li , Ting Yao , Yingwei Pan , Hongyang Chao , Tao Mei

Machine Learning (ML) models are very effective in many learning tasks, due to the capability to extract meaningful information from large data sets. Nevertheless, there are learning problems that cannot be easily solved relying on pure…

Machine Learning · Computer Science 2021-01-29 Andrea Borghesi , Federico Baldo , Michele Lombardi , Michela Milano

Deep neural networks often degrade significantly when training data suffer from class imbalance problems. Existing approaches, e.g., re-sampling and re-weighting, commonly address this issue by rearranging the label distribution of training…

Computer Vision and Pattern Recognition · Computer Science 2020-08-11 Renzhen Wang , Kaiqin Hu , Yanwen Zhu , Jun Shu , Qian Zhao , Deyu Meng

A major challenge in machine learning is resilience to out-of-distribution data, that is data that exists outside of the distribution of a model's training data. Training is often performed using limited, carefully curated datasets and so…

Computer Vision and Pattern Recognition · Computer Science 2022-11-30 Christopher J. Holder , Majid Khonji , Jorge Dias , Muhammad Shafique

Convolutional neural networks (CNNs) have achieved great success in skin lesion classification. A balanced dataset is required to train a good model. However, due to the appearance of different skin lesions in practice, severe or even…

Computer Vision and Pattern Recognition · Computer Science 2022-02-14 Keyu Chen , Di Zhuang , J. Morris Chang

It has been shown that instead of learning actual object features, deep networks tend to exploit non-robust (spurious) discriminative features that are shared between training and test sets. Therefore, while they achieve state of the art…

Machine Learning · Statistics 2019-11-19 Devansh Arpit , Caiming Xiong , Richard Socher

Machine Learning (ML) can be incredibly valuable to automate anomaly detection and cyber-attack classification, improving the way that Network Intrusion Detection (NID) is performed. However, despite the benefits of ML models, they are…

Cryptography and Security · Computer Science 2024-02-27 João Vitorino , Isabel Praça , Eva Maia

Deep neural networks have been widely used in computer vision. There are several well trained deep neural networks for the ImageNet classification challenge, which has played a significant role in image recognition. However, little work has…

Computer Vision and Pattern Recognition · Computer Science 2019-04-19 Youshan Zhang , Brian D. Davison

A large number of network security breaches in IoT networks have demonstrated the unreliability of current Network Intrusion Detection Systems (NIDSs). Consequently, network interruptions and loss of sensitive data have occurred, which led…

Networking and Internet Architecture · Computer Science 2023-05-12 Mohanad Sarhan , Siamak Layeghy , Nour Moustafa , Marcus Gallagher , Marius Portmann

Modern deep learning models in computer vision require large datasets of real images, which are difficult to curate and pose privacy and legal concerns, limiting their commercial use. Recent works suggest synthetic data as an alternative,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Farnood Salehi , Vandit Sharma , Amirhossein Askari Farsangi , Tunç Ozan Aydın

Metric learning is a fundamental problem in computer vision whereby a model is trained to learn a semantically useful embedding space via ranking losses. Traditionally, the effectiveness of a ranking loss depends on the minibatch size, and…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Thalaiyasingam Ajanthan , Matt Ma , Anton van den Hengel , Stephen Gould

The performance of deep segmentation models often degrades due to distribution shifts in image intensities between the training and test data sets. This is particularly pronounced in multi-centre studies involving data acquired using…

Image and Video Processing · Electrical Eng. & Systems 2021-08-03 Zhendong Liu , Van Manh , Xin Yang , Xiaoqiong Huang , Karim Lekadir , Víctor Campello , Nishant Ravikumar , Alejandro F Frangi , Dong Ni

In a K-best detector for multiple-input-multiple-output(MIMO) systems, the value of K needs to be sufficiently large to achieve near-maximum-likelihood (ML) performance. By treating K as a variable that can be adjusted according to a…

Signal Processing · Electrical Eng. & Systems 2022-08-10 Haomiao Huo , Jindan Xu , Gege Su , Wei Xu , Ning Wang

Despite all the advantages associated with Network Intrusion Detection Systems (NIDSs) that utilize machine learning (ML) models, there is a significant reluctance among cyber security experts to implement these models in real-world…

Cryptography and Security · Computer Science 2025-09-26 Ayush Kumar , Kar Wai Fok , Vrizlynn L. L. Thing

In the context of cybersecurity of modern communications networks, Intrusion Detection Systems (IDS) have been continuously improved, many of them incorporating machine learning (ML) techniques to identify threats. Although there are…

While most ML models expect independent and identically distributed data, this assumption is often violated in real-world scenarios due to distribution shifts, resulting in the degradation of machine learning model performance. Until now,…

Machine Learning · Computer Science 2024-11-19 Kai Helli , David Schnurr , Noah Hollmann , Samuel Müller , Frank Hutter

Training of deep neural networks heavily depends on the data distribution. In particular, the networks easily suffer from class imbalance. The trained networks would recognize the frequent classes better than the infrequent classes. To…

Computer Vision and Pattern Recognition · Computer Science 2020-03-12 Byungju Kim , Junmo Kim

Inverting visual representations within deep neural networks (DNNs) presents a challenging and important problem in the field of security and privacy for deep learning. The main goal is to invert the features of an unidentified target image…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Sai Qian Zhang , Ziyun Li , Chuan Guo , Saeed Mahloujifar , Deeksha Dangwal , Edward Suh , Barbara De Salvo , Chiao Liu

With massive data being generated daily and the ever-increasing interconnectivity of the world's Internet infrastructures, a machine learning based intrusion detection system (IDS) has become a vital component to protect our economic and…

Cryptography and Security · Computer Science 2021-08-20 Zachary Tauscher , Yushan Jiang , Kai Zhang , Jian Wang , Houbing Song