English
Related papers

Related papers: Softplus and Neural Architectures for Enhanced Neg…

200 papers

Negative sampling plays a crucial role in training successful sequential recommendation models. Instead of merely employing random negative sample selection, numerous strategies have been proposed to mine informative negative samples to…

Information Retrieval · Computer Science 2023-06-21 Lu Fan , Jiashu Pu , Rongsheng Zhang , Xiao-Ming Wu

In this paper, we present Partially Stochastic Infinitely Deep Bayesian Neural Networks, a novel family of architectures that integrates partial stochasticity into the framework of infinitely deep neural networks. Our new class of…

Machine Learning · Computer Science 2024-07-16 Sergio Calvo-Ordonez , Matthieu Meunier , Francesco Piatti , Yuantao Shi

Recent research has shown the vulnerability of Spiking Neural Networks (SNNs) under adversarial examples that are nearly indistinguishable from clean data in the context of frame-based and event-based information. The majority of these…

Machine Learning · Computer Science 2025-09-01 Jiaqi Lin , Abhronil Sengupta

Crime forecasting is a critical component of urban analysis and essential for stabilizing society today. Unlike other time series forecasting problems, crime incidents are sparse, particularly in small regions and within specific time…

Machine Learning · Computer Science 2024-08-09 Zepu Wang , Xiaobo Ma , Huajie Yang , Weimin Lvu , Peng Sun , Sharath Chandra Guntuku

Unsupervised sentence embedding aims to obtain the most appropriate embedding for a sentence to reflect its semantic. Contrastive learning has been attracting developing attention. For a sentence, current models utilize diverse data…

Computation and Language · Computer Science 2022-03-03 Hao Wang , Yangguang Li , Zhen Huang , Yong Dou , Lingpeng Kong , Jing Shao

Adversarial Robustness is a growing field that evidences the brittleness of neural networks. Although the literature on adversarial robustness is vast, a dimension is missing in these studies: assessing how severe the mistakes are. We call…

Machine Learning · Computer Science 2021-08-27 Guillaume Jeanneret , Juan C Perez , Pablo Arbelaez

Robustness of deep neural networks to input noise remains a critical challenge, as naive noise injection often degrades accuracy on clean (uncorrupted) data. We propose a novel training framework that addresses this trade-off through two…

Machine Learning · Statistics 2026-01-06 Hai-Vy Nguyen , Fabrice Gamboa , Sixin Zhang , Reda Chhaibi , Serge Gratton , Thierry Giaccone

In the recent quest for trustworthy neural networks, we present Spiking Neural Network (SNN) as a potential candidate for inherent robustness against adversarial attacks. In this work, we demonstrate that adversarial accuracy of SNNs under…

Computer Vision and Pattern Recognition · Computer Science 2020-07-27 Saima Sharmin , Nitin Rathi , Priyadarshini Panda , Kaushik Roy

There is a growing interest in subject-specific predictions using deep neural networks (DNNs) because real-world data often exhibit correlations, which has been typically overlooked in traditional DNN frameworks. In this paper, we propose a…

Machine Learning · Computer Science 2023-10-19 Hangbin Lee , Il Do Ha , Changha Hwang , Youngjo Lee

Sequential recommendation (SR) systems predict user preferences by analyzing time-ordered interaction sequences. A common challenge for SR is data sparsity, as users typically interact with only a limited number of items. While contrastive…

Information Retrieval · Computer Science 2025-04-10 Yu-Hsuan Huang , Ling Lo , Hongxia Xie , Hong-Han Shuai , Wen-Huang Cheng

We use interval reachability analysis to obtain robustness guarantees for implicit neural networks (INNs). INNs are a class of implicit learning models that use implicit equations as layers and have been shown to exhibit several notable…

Machine Learning · Computer Science 2022-04-04 Alexander Davydov , Saber Jafarpour , Matthew Abate , Francesco Bullo , Samuel Coogan

Uncertainty estimation in Neural Networks (NNs) is vital in improving reliability and confidence in predictions, particularly in safety-critical applications. Bayesian Neural Networks (BayNNs) with Dropout as an approximation offer a…

Machine Learning · Computer Science 2024-01-12 Soyed Tuhin Ahmed , Kamal Danouchi , Michael Hefenbrock , Guillaume Prenat , Lorena Anghel , Mehdi B. Tahoori

Volatility, which indicates the dispersion of returns, is a crucial measure of risk and is hence used extensively for pricing and discriminating between different financial investments. As a result, accurate volatility prediction receives…

Computational Finance · Quantitative Finance 2024-10-02 Zeda Xu , John Liechty , Sebastian Benthall , Nicholas Skar-Gislinge , Christopher McComb

This paper investigates the continuous-time limit of score-driven models with long memory. By extending score-driven models to incorporate infinite-lag structures with coefficients exhibiting heavy-tailed decay, we establish their weak…

Probability · Mathematics 2025-12-09 Yinhao Wu , Ping He

Higher-order sensor networks are more accurate in characterizing the nonlinear dynamics of sensory time-series data in modern industrial settings by allowing multi-node connections beyond simple pairwise graph edges. In light of this, we…

Machine Learning · Computer Science 2025-01-07 Hwa Hui Tew , Fan Ding , Gaoxuan Li , Junn Yong Loo , Chee-Ming Ting , Ze Yang Ding , Chee Pin Tan

Inverse problems challenge existing neural operator architectures because ill-posed inverse maps violate continuity, uniqueness, and stability assumptions. We introduce B2B${}^{-1}$, an inverse basis-to-basis neural operator framework that…

Machine Learning · Computer Science 2025-12-23 Adam J. Thorpe , Stepan Tretiakov , Dibakar Roy Sarkar , Krishna Kumar , Ufuk Topcu

In order to calculate the unobserved volatility in conditional heteroscedastic time series models, the natural recursive approximation is very often used. Following \cite{StraumannMikosch2006}, we will call the model \emph{invertible} if…

Statistics Theory · Mathematics 2012-12-18 Alexey Sorokin

We develop an effective generation of adversarial attacks on neural models that output a sequence of probability distributions rather than a sequence of single values. This setting includes the recently proposed deep probabilistic…

Machine Learning · Computer Science 2020-03-26 Raphaël Dang-Nhu , Gagandeep Singh , Pavol Bielik , Martin Vechev

In practical scenarios where training data is limited, many predictive signals in the data can be rather from some biases in data acquisition (i.e., less generalizable), so that one cannot prevent a model from co-adapting on such…

Machine Learning · Computer Science 2023-03-27 Jongheon Jeong , Sihyun Yu , Hankook Lee , Jinwoo Shin

This paper investigates the cumulative Integer-Valued Autoregressive model of infinite order, denoted as INAR($\infty$), a class of processes crucial for modeling count time series and equivalent to discrete-time Hawkes processes. We…

Statistics Theory · Mathematics 2025-06-12 Yingli Wang , Xiaohong Duan , Ping He