English
Related papers

Related papers: Feature Distribution Shift Mitigation with Contras…

200 papers

Although distributed machine learning (distributed ML) is gaining considerable attention in the community, prior works have independently looked at instances of distributed ML in either the training or the inference phase. No prior work has…

Machine Learning · Computer Science 2024-12-19 Sébastien Andreina , Pascal Zimmer , Ghassan Karame

Model-based deep learning (MBDL) is a powerful methodology for designing deep models to solve imaging inverse problems. MBDL networks can be seen as iterative algorithms that estimate the desired image using a physical measurement model and…

Image and Video Processing · Electrical Eng. & Systems 2025-04-04 Chicago Y. Park , Weijie Gan , Zihao Zou , Yuyang Hu , Zhixin Sun , Ulugbek S. Kamilov

Pre-trained machine learning (ML) models have shown great performance for a wide range of applications, in particular in natural language processing (NLP) and computer vision (CV). Here, we study how pre-training could be used for…

Machine Learning · Computer Science 2024-01-05 Shashank Subramanian , Peter Harrington , Kurt Keutzer , Wahid Bhimji , Dmitriy Morozov , Michael Mahoney , Amir Gholami

With the ever-increasing complexity of large-scale pre-trained models coupled with a shortage of labeled data for downstream training, transfer learning has become the primary approach in many fields, including natural language processing,…

Machine Learning · Computer Science 2024-07-22 Xiao Li , Sheng Liu , Jinxin Zhou , Xinyu Lu , Carlos Fernandez-Granda , Zhihui Zhu , Qing Qu

Machine learning (ML) is rapidly transforming the way molecular dynamics simulations are performed and analyzed, from materials modeling to studies of protein folding and function. ML algorithms are often employed to learn low-dimensional…

Soft Condensed Matter · Physics 2025-09-23 Jayashrita Debnath , Gerhard Hummer

Network Intrusion Detection Systems (NIDS) are essential for securing networks by identifying and mitigating unauthorized activities indicative of cyberattacks. As cyber threats grow increasingly sophisticated, NIDS must evolve to detect…

Cryptography and Security · Computer Science 2025-12-19 Sudhanshu Sekhar Tripathy , Bichitrananda Behera

The dominating NLP paradigm of training a strong neural predictor to perform one task on a specific dataset has led to state-of-the-art performance in a variety of applications (eg. sentiment classification, span-prediction based question…

Computation and Language · Computer Science 2021-09-06 Paul Michel

Modern deep convolutional networks (CNNs) are often criticized for not generalizing under distributional shifts. However, several recent breakthroughs in transfer learning suggest that these networks can cope with severe distribution shifts…

Class-Incremental Learning (CIL) is a critical capability for real-world applications, enabling learning systems to adapt to new tasks while retaining knowledge from previous ones. Recent advancements in pre-trained models (PTMs) have…

Machine Learning · Computer Science 2025-04-28 Kun He , Zijian Song , Shuoxi Zhang , John E. Hopcroft

Machine learning-based intrusion detection requires complex models to capture patterns in high-dimensional, noisy, and class-imbalanced raw network traffic, yet deploying such models remains impractical on resource-constrained devices with…

Inverse medium scattering is an ill-posed, nonlinear wave-based imaging problem arising in medical imaging, remote sensing, and non-destructive testing. Machine learning (ML) methods offer increased inference speed and flexibility in…

Computational Physics · Physics 2025-12-12 Olivia Tsang , Owen Melia , Vasileios Charisopoulos , Jeremy Hoskins , Yuehaw Khoo , Rebecca Willett

The increased success of Deep Learning (DL) has recently sparked large-scale deployment of DL models in many diverse industry segments. Yet, a crucial weakness of supervised model is the inherent difficulty in handling out-of-distribution…

Machine Learning · Computer Science 2021-07-15 Lixuan Yang , Dario Rossi

Feature discrimination is a crucial aspect of neural network design, as it directly impacts the network's ability to distinguish between classes and generalize across diverse datasets. The accomplishment of achieving high-quality feature…

Neural and Evolutionary Computing · Computer Science 2025-02-18 Katerina Maria Oikonomou , Ioannis Kansizoglou , Antonios Gasteratos

Deep learning based image reconstruction methods outperform traditional methods. However, neural networks suffer from a performance drop when applied to images from a different distribution than the training images. For example, a model…

Image and Video Processing · Electrical Eng. & Systems 2022-06-22 Mohammad Zalbagi Darestani , Jiayu Liu , Reinhard Heckel

Network security is a critical concern in the digital landscape of today, with users demanding secure browsing experiences and protection of their personal data. This study explores the dynamic integration of Machine Learning (ML)…

Networking and Internet Architecture · Computer Science 2026-04-17 Pablo Benlloch , Oscar Romero , Antonio Leon , Jaime Lloret

We introduce Neural Representation of Distribution (NeRD) technique, a module for convolutional neural networks (CNNs) that can estimate the feature distribution by optimizing an underlying function mapping image coordinates to the feature…

Image and Video Processing · Electrical Eng. & Systems 2021-03-10 Hang Zhang , Rongguang Wang , Jinwei Zhang , Chao Li , Gufeng Yang , Pascal Spincemaille , Thanh Nguyen , Yi Wang

Many of the proposed machine learning (ML) based network intrusion detection systems (NIDSs) achieve near perfect detection performance when evaluated on synthetic benchmark datasets. Though, there is no record of if and how these results…

Networking and Internet Architecture · Computer Science 2023-05-12 Siamak Layeghy , Marius Portmann

Discovering distinct features and their relations from data can help us uncover valuable knowledge crucial for various tasks, e.g., classification. In neuroimaging, these features could help to understand, classify, and possibly prevent…

Machine Learning · Computer Science 2022-02-15 Usman Mahmood , Zening Fu , Vince Calhoun , Sergey Plis

Machine Learning (ML) models are extensively used in various applications due to their significant advantages over traditional learning methods. However, the developed ML models often underperform when deployed in the real world due to the…

Machine Learning · Computer Science 2025-11-05 Abdullah Almansour , Ozan Tonguz

The use of supervised Machine Learning (ML) to enhance Intrusion Detection Systems has been the subject of significant research. Supervised ML is based upon learning by example, demanding significant volumes of representative instances for…

Cryptography and Security · Computer Science 2022-11-08 Hanan Hindy , Christos Tachtatzis , Robert Atkinson , David Brosset , Miroslav Bures , Ivan Andonovic , Craig Michie , Xavier Bellekens