English
Related papers

Related papers: A new algorithm for Subgroup Set Discovery based o…

200 papers

Stochastic Gradient Descent (SGD) is an important algorithm in machine learning. With constant learning rates, it is a stochastic process that, after an initial phase of convergence, generates samples from a stationary distribution. We show…

Machine Learning · Statistics 2017-09-12 Stephan Mandt , Matthew D. Hoffman , David M. Blei

We present a novel sparse signal reconstruction method "ISD", aiming to achieve fast reconstruction and a reduced requirement on the number of measurements compared to the classical l_1 minimization approach. ISD addresses failed…

Information Theory · Computer Science 2015-11-23 Yilun Wang , Wotao Yin

Likelihood-based deep generative models (DGMs) have gained significant attention for their ability to approximate the distributions of high-dimensional data. However, these models lack a performance guarantee in assigning higher likelihood…

Machine Learning · Computer Science 2025-02-04 Behrooz Montazeran , Ullrich Köthe

Reliable out-of-distribution (OOD) detection is fundamental to implementing safer modern machine learning (ML) systems. In this paper, we introduce Igeood, an effective method for detecting OOD samples. Igeood applies to any pre-trained…

Machine Learning · Statistics 2022-03-16 Eduardo Dadalto Camara Gomes , Florence Alberge , Pierre Duhamel , Pablo Piantanida

Detecting out-of-distribution (OOD) data is a task that is receiving an increasing amount of research attention in the domain of deep learning for computer vision. However, the performance of detection methods is generally evaluated on the…

Machine Learning · Computer Science 2023-03-15 Guoxuan Xia , Christos-Savvas Bouganis

Out-of-distribution (OoD) detection for data-based programs is a goal of paramount importance. Common approaches in the literature tend to train detectors requiring inside-of-distribution (in-distribution, or IoD) and OoD validation…

Computer Vision and Pattern Recognition · Computer Science 2023-02-22 Romain Xu-Darme , Julien Girard-Satabin , Darryl Hond , Gabriele Incorvaia , Zakaria Chihani

An Intrusion Detection System (IDS) is a key cybersecurity tool for network administrators as it identifies malicious traffic and cyberattacks. With the recent successes of machine learning techniques such as deep learning, more and more…

Cryptography and Security · Computer Science 2019-12-20 Simon Msika , Alejandro Quintero , Foutse Khomh

Detecting out-of-distribution (OOD) inputs during the inference stage is crucial for deploying neural networks in the real world. Previous methods commonly relied on the output of a network derived from the highly activated feature map. In…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Yeonguk Yu , Sungho Shin , Seongju Lee , Changhyun Jun , Kyoobin Lee

With the human pursuit of knowledge, open-set object detection (OSOD) has been designed to identify unknown objects in a dynamic world. However, an issue with the current setting is that all the predicted unknown objects share the same…

Computer Vision and Pattern Recognition · Computer Science 2022-04-13 Jiyang Zheng , Weihao Li , Jie Hong , Lars Petersson , Nick Barnes

Deep learning-based fine-grained network intrusion detection systems (NIDS) enable different attacks to be responded to in a fast and targeted manner with the help of large-scale labels. However, the cost of labeling causes insufficient…

Cryptography and Security · Computer Science 2023-08-02 Xinran Zheng , Shuo Yang , Xingjun Wang

In this paper, we present a simple and parameter-efficient drop-in module for one-stage object detectors like SSD when learning from scratch (i.e., without pre-trained models). We call our module GFR (Gated Feature Reuse), which exhibits…

Computer Vision and Pattern Recognition · Computer Science 2019-07-09 Zhiqiang Shen , Honghui Shi , Jiahui Yu , Hai Phan , Rogerio Feris , Liangliang Cao , Ding Liu , Xinchao Wang , Thomas Huang , Marios Savvides

Equivariant neural networks incorporate symmetries into their architecture, achieving higher generalization performance. However, constructing equivariant neural networks typically requires prior knowledge of data types and symmetries,…

Machine Learning · Computer Science 2024-10-15 Lexiang Hu , Yikang Li , Zhouchen Lin

SGD is the widely adopted method to train CNN. Conceptually it approximates the population with a randomly sampled batch; then it evenly trains batches by conducting a gradient update on every batch in an epoch. In this paper, we…

Machine Learning · Computer Science 2017-03-29 Linnan Wang , Yi Yang , Martin Renqiang Min , Srimat Chakradhar

With the advent of large-scale heterogeneous networks comes the problem of unified network control resulting in security lapses that could have otherwise avoided. A mechanism is needed to detect and deflect intruders to safeguard resource…

Cryptography and Security · Computer Science 2018-11-13 Nazim Uddin Sheikh , Hasina Rahman , Shashwat Vikram , Hamed AlQahtani

We propose a new stochastic optimization framework for empirical risk minimization problems such as those that arise in machine learning. The traditional approaches, such as (mini-batch) stochastic gradient descent (SGD), utilize an…

Machine Learning · Statistics 2020-02-04 Kenji Kawaguchi , Haihao Lu

Subgroup discovery is a descriptive and exploratory data mining technique to identify subgroups in a population that exhibit interesting behavior with respect to a variable of interest. Subgroup discovery has numerous applications in…

Machine Learning · Computer Science 2022-07-19 Ali Arab , Dev Arora , Jialin Lu , Martin Ester

Recent studies show that even highly biased dense networks contain an unbiased substructure that can achieve better out-of-distribution (OOD) generalization than the original model. Existing works usually search the invariant subnetwork…

Machine Learning · Computer Science 2022-12-20 Yingchun Wang , Jingcai Guo , Song Guo , Weizhan Zhang , Jie Zhang

Few-shot Out-of-Distribution (OOD) detection has emerged as a critical research direction in machine learning for practical deployment. Most existing Few-shot OOD detection methods suffer from insufficient generalization capability for the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Pinxuan Li , Bing Cao , Changqing Zhang , Qinghua Hu

Session-based recommendation (SBR) aims at predicting the next item for an ongoing anonymous session. The major challenge of SBR is how to capture richer relations in between items and learn ID-based item embeddings to capture such…

Information Retrieval · Computer Science 2022-02-22 Zizhuo Zhang , Bang Wang

Stochastic gradient descent (SGD) is an immensely popular approach for online learning in settings where data arrives in a stream or data sizes are very large. However, despite an ever-increasing volume of work on SGD, much less is known…

Machine Learning · Statistics 2025-03-06 Weijie J. Su , Yuancheng Zhu