English
Related papers

Related papers: Fundamental component enhancement via adaptive non…

200 papers

In this paper, we study a nonlinear spiked random matrix model where a nonlinear function is applied element-wise to a noise matrix perturbed by a rank-one signal. We establish a signal-plus-noise decomposition for this model and identify…

Statistics Theory · Mathematics 2024-05-29 Behrad Moniri , Hamed Hassani

Over the past two decades, vibrational resonance has garnered significant interest and evolved into a prominent research field. Classical vibrational resonance examines the response of a nonlinear system excited by two signals: a weak,…

Adaptation and Self-Organizing Systems · Physics 2024-03-19 Jianhua Yang , S. Rajasekar , Miguel A. F. Sanjuan

We propose a scheme to enhance quantum entanglement in an optomechanical system by exploiting the so-called Duffing nonlinearity. Our model system consists of two mechanically coupled mechanical resonators, both driven by an optical field.…

Real-world analog systems intrinsically suffer from noise that can impede model convergence and accuracy on a variety of deep learning models. We demonstrate that differentiable activations like GELU and SiLU enable robust propagation of…

Machine Learning · Computer Science 2025-02-25 Vivswan Shah , Nathan Youngblood

We introduce stochastic activations. This novel strategy randomly selects between several non-linear functions in the feed-forward layer of a large language model. In particular, we choose between SILU or RELU depending on a Bernoulli draw.…

We consider detecting the evolutionary oscillatory pattern of a signal when it is contaminated by non-stationary noises with complexly time-varying data generating mechanism. A high-dimensional dense progressive periodogram test is proposed…

Methodology · Statistics 2023-07-20 Hau-Tieng Wu , Zhou Zhou

This work is devoted to quantifying how periodic perturbation can change the rate of metastable transition in stochastic mechanical systems with weak noises. A closed-form explicit expression for approximating the rate change is provided,…

Dynamical Systems · Mathematics 2021-09-30 Ying Chao , Molei Tao

The binary neutron star coalescence GW170817 was observed by gravitational wave detectors during the inspiral phase but sensitivity in the 1-5 kHz band was insufficient to observe the expected nuclear matter signature of the merger itself,…

The oscillatory response of nonlinear systems exhibits characteristic phenomena such as multistability, discontinuous jumps and hysteresis. These can be utilized in applications leading, e.g., to precise frequency measurement, mixing,…

Mesoscale and Nanoscale Physics · Physics 2015-05-14 Quirin P. Unterreithmeier , Thomas Faust , Jorg P. Kotthaus

Common nonlinear activation functions used in neural networks can cause training difficulties due to the saturation behavior of the activation function, which may hide dependencies that are not visible to vanilla-SGD (using first order…

Machine Learning · Computer Science 2016-04-05 Caglar Gulcehre , Marcin Moczulski , Misha Denil , Yoshua Bengio

This article introduces the Generalized Fourier Series (GFS), a novel spectral method that extends the clas- sical Fourier series to non-periodic functions. GFS addresses key challenges such as the Gibbs phenomenon and poor convergence in…

Numerical Analysis · Mathematics 2025-10-17 Narsimha Reddy Rapakaa , Mohamed Kamel Riahi

Fast Fourier Transform based phase screen simulations give accurate results only when the screen size ($G$) is much larger than the outer scale parameter ($L_0$). Otherwise, they fall short in correctly predicting both the low and high…

Instrumentation and Methods for Astrophysics · Physics 2021-06-03 Sorabh Chhabra , Jyotirmay Paul , Anamparambu N. Ramaprakash , Avinash Surendran

Spectrograms visualize the frequency components of a given signal which may be an audio signal or even a time-series signal. Audio signals have higher sampling rate and high variability of frequency with time. Spectrograms can capture such…

Signal Processing · Electrical Eng. & Systems 2021-09-06 Sidharth Srivatsav Sribhashyam , Md Sirajus Salekin , Dmitry Goldgof , Ghada Zamzmi , Mark Last , Yu Sun

Precision spectroscopy of atoms and molecules allows one to search for and to put stringent limits on the variation of fundamental constants. These experiments are typically interpreted in terms of variations of the fine structure constant…

We propose the Gaussian Error Linear Unit (GELU), a high-performing neural network activation function. The GELU activation function is $x\Phi(x)$, where $\Phi(x)$ the standard Gaussian cumulative distribution function. The GELU…

Machine Learning · Computer Science 2023-06-07 Dan Hendrycks , Kevin Gimpel

This paper proposes a novel and insightful activation method termed FPLUS, which exploits mathematical power function with polar signs in form. It is enlightened by common inverse operation while endowed with an intuitive meaning of…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Boxi Duan

This study focuses on extending the concept of weak signal enhancement from dynamical systems based on vibrational resonance of nonlinear systems, to non-smooth systems. A Van der Pol- Duffing oscillator with a one-sided barrier, subjected…

Chaotic Dynamics · Physics 2024-07-26 Somnath Roy , Sayan Gupta

It is by now established that, remarkably, the addition of noise to a nonlinear system may sometimes facilitate, rather than hamper the detection of weak signals. This phenomenon, usually referred to as stochastic resonance, was originally…

Condensed Matter · Physics 2009-10-31 Redouane Fakir

Self-similar structures occur naturally and have been employed to engineer exotic physical properties. Here we show that acoustic modes of a fractal-like system of tensioned strings can display increased mechanical quality factors due to…

Mesoscale and Nanoscale Physics · Physics 2020-02-19 Sergey A. Fedorov , Alberto Beccari , Nils J. Engelsen , Tobias J. Kippenberg

A number theoretical model of $1/f$ noise found in phase locked loops is developed. The dynamics of phases and frequencies involved in the nonlinear mixing of oscillators and the low-pass filtering is formulated thanks to the rules of the…

High Energy Physics - Theory · Physics 2007-05-23 Michel Planat
‹ Prev 1 3 4 5 6 7 10 Next ›