English
Related papers

Related papers: The Blind Normalized Stein Variational Gradient De…

200 papers

We propose a novel distributed inference algorithm for continuous graphical models, by extending Stein variational gradient descent (SVGD) to leverage the Markov dependency structure of the distribution of interest. Our approach combines…

Machine Learning · Statistics 2018-06-11 Dilin Wang , Zhe Zeng , Qiang Liu

Device activity detection and channel estimation for massive grant-free access under frequency-selective fading have unfortunately been an outstanding problem. This paper aims to address the challenge. Specifically, we present an orthogonal…

Information Theory · Computer Science 2022-01-04 Yuhang Jia , Ying Cui , Wuyang Jiang

Bias field artifacts in magnetic resonance imaging (MRI) scans introduce spatially smooth intensity inhomogeneities that degrade image quality and hinder downstream analysis. To address this challenge, we propose a novel variational…

Massive machine type communication (mMTC) has been identified as an important use case in Beyond 5G networks and future massive Internet of Things (IoT). However, for the massive multiple access in mMTC, there is a serious access preamble…

Information Theory · Computer Science 2021-02-26 Gaofeng Cheng , Huan Chen , Pingzhi Fan , Li Li , Li Hao

Gradient-based approximate inference methods, such as Stein variational gradient descent (SVGD), provide simple and general-purpose inference engines for differentiable continuous distributions. However, existing forms of SVGD cannot be…

Machine Learning · Computer Science 2020-03-03 Jun Han , Fan Ding , Xianglong Liu , Lorenzo Torresani , Jian Peng , Qiang Liu

In recent years, even though Stochastic Gradient Descent (SGD) and its variants are well-known for training neural networks, it suffers from limitations such as the lack of theoretical guarantees, vanishing gradients, and excessive…

Optimization and Control · Mathematics 2022-02-17 Junxiang Wang , Hongyi Li , Liang Zhao

Massive access is a critical design challenge of Internet of Things (IoT) networks. In this paper, we consider the grant-free uplink transmission of an IoT network with a multiple-antenna base station (BS) and a large number of…

Information Theory · Computer Science 2021-06-22 Yandong Shi , Hayoung Choi , Yuanming Shi , Yong Zhou

We propose a novel particle-based variational inference method designed to work with multimodal distributions. Our approach, referred to as Branched Stein Variational Gradient Descent (BSVGD), extends the classical Stein Variational…

Machine Learning · Computer Science 2025-07-18 Isaías Bañales , Arturo Jaramillo , Joshué Helí Ricalde-Guerrero

Security risk assessment and prediction are critical for organisations deploying Internet of Things (IoT) devices. An absolute minimum requirement for enterprises is to verify the security risk of IoT devices for the reported…

Cryptography and Security · Computer Science 2021-11-29 Carlos A. Rivera Alvarez , Arash Shaghaghi , David D. Nguyen , Salil S. Kanhere

We present an approach to efficiently and effectively adapt a masked image modeling (MIM) pre-trained vanilla Vision Transformer (ViT) for object detection, which is based on our two novel observations: (i) A MIM pre-trained vanilla ViT…

Computer Vision and Pattern Recognition · Computer Science 2022-05-20 Yuxin Fang , Shusheng Yang , Shijie Wang , Yixiao Ge , Ying Shan , Xinggang Wang

The discrete nature of transmitted symbols poses challenges for achieving optimal detection in multiple-input multiple-output (MIMO) systems associated with a large number of antennas. Recently, the combination of two powerful machine…

Signal Processing · Electrical Eng. & Systems 2024-12-11 Xingyu Zhou , Le Liang , Jing Zhang , Chao-Kai Wen , Shi Jin

Stein variational gradient descent (SVGD) is a general-purpose optimization-based sampling algorithm that has recently exploded in popularity, but is limited by two issues: it is known to produce biased samples, and it can be slow to…

Machine Learning · Statistics 2022-04-20 Alex Leviyev , Joshua Chen , Yifei Wang , Omar Ghattas , Aaron Zimmerman

Fast and accurate device activity detection is the critical challenge in grant-free access for supporting massive machine-type communications (mMTC) and ultra-reliable low-latency communications (URLLC) in 5G and beyond. The…

Optimization and Control · Mathematics 2025-03-25 Bowen Tan , Ying Cui

Network intrusion detection systems (NIDSs) play an important role in computer network security. There are several detection mechanisms where anomaly-based automated detection outperforms others significantly. Amid the sophistication and…

We study the problem of blind super-resolution, which can be formulated as a low-rank matrix recovery problem via vectorized Hankel lift (VHL). The previous gradient descent method based on VHL named PGD-VHL relies on additional…

Information Theory · Computer Science 2024-09-30 Jinsheng Li , Wei Cui , Xu Zhang

Massive machine-type communications (mMTC) are poised to provide ubiquitous connectivity for billions of Internet-of-Things (IoT) devices. However, the required low-latency massive access necessitates a paradigm shift in the design of…

Information Theory · Computer Science 2021-08-24 Yikun Mei , Zhen Gao , Yongpeng Wu , Wei Chen , Jun Zhang , Derrick Wing Kwan Ng , Marco Di Renzo

Stein variational gradient descent (SVGD) is a kernel-based and non-parametric particle method for sampling from a target distribution, such as in Bayesian inference and other machine learning tasks. Different from other particle methods,…

Optimization and Control · Mathematics 2025-10-02 Viktor Stein , Wuchen Li

Stein Variational Gradient Descent (SVGD) is a popular variational inference algorithm which simulates an interacting particle system to approximately sample from a target distribution, with impressive empirical performance across various…

Machine Learning · Statistics 2023-10-09 Aniket Das , Dheeraj Nagaraj

RGB-Thermal Video Object Detection (RGBT VOD) can address the limitation of traditional RGB-based VOD in challenging lighting conditions, making it more practical and effective in many applications. However, similar to most RGBT fusion…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Qishun Wang , Zhengzheng Tu , Chenglong Li , Bo Jiang

This paper proposes a hardware-aware intrusion detection system (IDS) for Internet of Things (IoT) and Industrial IoT (IIoT) networks; it targets scenarios where classification is essential for fast, privacy-preserving, and…

Networking and Internet Architecture · Computer Science 2025-12-09 Ali Diab , Adel Chehade , Edoardo Ragusa , Paolo Gastaldo , Rodolfo Zunino , Amer Baghdadi , Mostafa Rizk