English
Related papers

Related papers: Transfer Learning for Transformer-Based Modeling o…

200 papers

We develop a new type of model for solving the task of inverting the transmission effects of multi-mode optical fibres through the construction of an $\mathrm{SO}^{+}(2,1)$-equivariant neural network. This model takes advantage of the of…

Self-action nonlinearity is a key aspect -- either as a foundational element or a detrimental factor -- of several optical spectroscopies and photonic devices. Supercontinuum generation, wavelength converters and chirped pulse amplification…

The ultrafast dynamic evolution of an atomic system under medium-strength laser fields is studied by performing transient absorption measurement. An analytical model developed from perturbation theory with a modified transition dipole…

Atomic Physics · Physics 2019-05-22 Zhenhao Wang , Yu He , Quanjun Wang , Jingjie Ding , Shaohua Sun , Zuoye Liu , Bitao Hu

We introduce a novel algorithm for nonlinear processing of data gathered by an active array of sensors which probes a medium with pulses and measures the resulting waves. The algorithm is motivated by the application of array imaging. We…

Numerical Analysis · Mathematics 2019-02-20 Liliana Borcea , Vladimir Druskin , Alexander V. Mamonov , Mikhail Zaslavsky

We provide a theoretical, numerical, and experimental investigation of the Kerr nonlinearity impact on the performance of a frequency-multiplexed Extreme Learning Machine (ELM). In such ELM, the neuron signals are encoded in the lines of a…

Optics · Physics 2023-12-20 Marina Zajnulina , Alessandro Lupo , Serge Massar

The main challenge that sets transfer learning apart from traditional supervised learning is the distribution shift, reflected as the shift between the source and target models and that between the marginal covariate distributions. In this…

Machine Learning · Statistics 2024-04-02 Zelin He , Ying Sun , Jingyuan Liu , Runze Li

A novel device that can be used as a tunable support-free phase plate for transmission electron microscopy of weakly scattering specimens is described. The device relies on the generation of a controlled phase shift by the magnetic field of…

Electromagnetically-induced transparency (EIT) has been proposed as a way to greatly enhance cross-phase modulation, with the possibility of leading to few-photon-level optical nonlinearities. This enhancement grows as the transparency…

Atomic Physics · Physics 2016-01-27 Amir Feizpour , Greg Dmochowski , Aephraim M. Steinberg

Fine-tuning large pre-trained models is an effective transfer mechanism in NLP. However, in the presence of many downstream tasks, fine-tuning is parameter inefficient: an entire new model is required for every task. As an alternative, we…

Transfer learning for partial differential equations (PDEs) is to develop a pre-trained neural network that can be used to solve a wide class of PDEs. Existing transfer learning approaches require much information of the target PDEs such as…

Numerical Analysis · Mathematics 2023-01-30 Zezhong Zhang , Feng Bao , Lili Ju , Guannan Zhang

Nonlinearity of power amplifier is one of the major limitations to the achievable capacity in wireless transmission systems. Nonlinear impairments are determined by the nonlinear distortions of the power amplifier and modulator…

Signal Processing · Electrical Eng. & Systems 2020-06-09 Xin Hu , Zhijun Liu , You Li , Lexi Xu , Sun Zhang , Qinlong Li , Jia Hu , Wenhua Chen , Weidong Wang , Mohamed Helaoui , Fadhel M. Ghannouchi

We show that neural networks trained by evolutionary reinforcement learning can enact efficient molecular self-assembly protocols. Presented with molecular simulation trajectories, networks learn to change temperature and chemical potential…

Statistical Mechanics · Physics 2020-06-01 Stephen Whitelam , Isaac Tamblyn

By means of the emerging Dispersive Fourier transformation technique, we captured the pulse-resolved spectral evolution dynamics of the double-soliton (DS) states in a single-walled carbon nanotube based Er-doped fiber laser from the…

Optics · Physics 2018-07-30 Guomei Wang , Guangwei Chen , Wenlei Li , Chao Zeng , Wei Zhao

Existing transfer learning-based beam prediction approaches primarily rely on simple fine-tuning. When there is a significant difference in data distribution between the target domain and the source domain, simple fine-tuning limits the…

Information Theory · Computer Science 2025-09-26 Zhiqiang Xiao , Yuwen Cao , Mondher Bouazizi , Tomoaki Ohtsuki , Shahid Mumtaz

Transfer learning is a machine learning technique that uses previously acquired knowledge from a source domain to enhance learning in a target domain by reusing learned weights. This technique is ubiquitous because of its great advantages…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Nermeen Abou Baker , Nico Zengeler , Uwe Handmann

We explore unsupervised speech enhancement using diffusion models as expressive generative priors for clean speech. Existing approaches guide the reverse diffusion process using noisy speech through an approximate, noise-perturbed…

Sound · Computer Science 2025-07-04 Mostafa Sadeghi , Jean-Eudes Ayilo , Romain Serizel , Xavier Alameda-Pineda

Biological structure and function depend on complex regulatory interactions between many genes. A wealth of gene expression data is available from high-throughput genome-wide measurement technologies, but effective gene regulatory network…

Molecular Networks · Quantitative Biology 2016-03-28 Arwen Vanice Bradley , Ye Henry Li , Bokyung Choi , Wing Hung Wong

Purpose: Some advanced RF pulses, like multi-dimensional RF pulses, are often long and require substantial computation time due to a number of constraints and requirements, sometimes hampering clinical use. However, the pulses offer…

Medical Physics · Physics 2019-01-08 Mads Sloth Vinding , Birk Skyum , Ryan Sangill , Torben Ellegaard Lund

Transformer is a state-of-the-art model in the field of natural language processing (NLP). Current NLP models primarily increase the number of transformers to improve processing performance. However, this technique requires a lot of…

Computation and Language · Computer Science 2023-10-18 Woohyeon Moon , Taeyoung Kim , Bumgeun Park , Dongsoo Har

Optical communication systems are always evolving to support the need for ever-increasing transmission rates. This demand is supported by the growth in complexity of communication systems which are moving towards ultra-wideband transmission…