English
Related papers

Related papers: Transfer Learning for Transformer-Based Modeling o…

200 papers

In this paper, we present a deep learning based wireless transceiver. We describe in detail the corresponding artificial neural network architecture, the training process, and report on excessive over-the-air measurement results. We employ…

Signal Processing · Electrical Eng. & Systems 2019-05-28 Johannes Schmitz , Caspar von Lengerke , Nikita Airee , Arash Behboodi , Rudolf Mathar

We propose an AE-based transceiver for a WDM system impaired by hardware imperfections. We design our AE following the architecture of conventional communication systems. This enables to initialize the AE-based transceiver to have similar…

Signal Processing · Electrical Eng. & Systems 2021-11-30 Jinxiang Song , Christian Häger , Jochen Schröder , Alexandre Graell i Amat , Henk Wymeersch

Automatic speech emotion recognition (SER) is a challenging task that plays a crucial role in natural human-computer interaction. One of the main challenges in SER is data scarcity, i.e., insufficient amounts of carefully labeled data to…

Sound · Computer Science 2021-08-17 Sarala Padi , Seyed Omid Sadjadi , Dinesh Manocha , Ram D. Sriram

The Transfer Matrix Method is a powerful numerical tool for simulating wave propagation in layered media. It has been widely applied in many fields, although its use is typically restricted to passive media. In this paper, we develop the…

This article presents the development, implementation, and validation of a loss-optimized and circuit parameter-sensitive TPS modulation scheme for a dual-active-bridge DC-DC converter. The proposed approach dynamically adjusts control…

Signal Processing · Electrical Eng. & Systems 2025-02-26 Saikat Dey , Ayan Mallik

Transfer learning is a machine learning technique designed to improve generalization performance by using pre-trained parameters obtained from other learning tasks. For image recognition tasks, many previous studies have reported that, when…

Computer Vision and Pattern Recognition · Computer Science 2018-10-16 Aiga Suzuki , Hidenori Sakanashi , Shoji Kido , Hayaru Shouno

Power electronic converter control is typically tuned per topology, limiting transfer across heterogeneous designs. This letter proposes a topology-agnostic meta-control framework that encodes converter netlists as typed bipartite graphs…

Systems and Control · Electrical Eng. & Systems 2026-01-13 Darius Jakobeit , Oliver Wallscheid

Ultrafast lasers ($< 500$ fs) have enabled laser-matter interactions at intensities exceeding $10^{18} \rm{Wcm}^{-2}$ with only millijoules of laser energy. However, as pulse durations become shorter, larger spectral bandwidths are…

Recently, the pre-trained Transformer models have received a rising interest in the field of speech processing thanks to their great success in various downstream tasks. However, most fine-tuning approaches update all the parameters of the…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-31 Junyi Peng , Themos Stafylakis , Rongzhi Gu , Oldřich Plchot , Ladislav Mošner , Lukáš Burget , Jan Černocký

Recurrent Neural Networks were, until recently, one of the best ways to capture the timely dependencies in sequences. However, with the introduction of the Transformer, it has been proven that an architecture with only attention-mechanisms…

Machine Learning · Computer Science 2021-08-19 Radostin Cholakov , Todor Kolev

This work concerns receiver design for light emitting diode (LED) communications where the LED nonlinearity can severely degrade the performance of communications. We propose extreme learning machine (ELM) based non-iterative receivers and…

Signal Processing · Electrical Eng. & Systems 2020-12-30 Dawei Gao , Qinghua Guo , Jun Tong , Nan Wu , Jiangtao Xi , Yanguang Yu

We report on the design and numerical simulation of a tunable, near-infrared (NIR) femtosecond noncollinear optical parametric amplifier (OPA) seeded by a nonlinear fiber amplifier operating in the parabolic and gain-managed regime. With…

Optics · Physics 2023-05-08 Brittany Lu , Keith Wernsing , Sergio Carbajo

The increasing complexity of neural networks and the energy consumption associated with training and inference create a need for alternative neuromorphic approaches, e.g. using optics. Current proposals and implementations rely on physical…

Optics · Physics 2023-08-31 Clara C. Wanjura , Florian Marquardt

We explore a data-driven approach for learning to optimize neural networks. We construct a dataset of neural network checkpoints and train a generative model on the parameters. In particular, our model is a conditional diffusion transformer…

Machine Learning · Computer Science 2022-09-27 William Peebles , Ilija Radosavovic , Tim Brooks , Alexei A. Efros , Jitendra Malik

With the development of Artificial Intelligence, numerous real-world tasks have been accomplished using technology integrated with deep learning. To achieve optimal performance, deep neural networks typically require large volumes of data…

Machine Learning · Computer Science 2025-05-09 Yuren Zhang , Zhongnan Pu , Lei Jing

In this paper, a novel architecture of electro-optical neural networks based on the time-stretch method is proposed and numerically simulated. By stretching time-domain ultrashort pulses, multiplications of large scale weight matrices and…

Signal Processing · Electrical Eng. & Systems 2019-09-18 Yubin Zang , Minghua Chen , Sigang Yang , Hongwei Chen

Evolutionary optimisation algorithm is employed to design networks of phase-repulsive oscillators that achieve an anti-phase synchronised state. By introducing the link frustration, the evolutionary process is implemented by rewiring the…

Statistical Mechanics · Physics 2012-11-21 Zoran Levnajić

Research on multimode optical fibers is arousing a growing interest, for their capability to transport high-power laser beams, coupled with novel nonlinear optics-based applications. However, when beam intensities exceed a certain critical…

Transformers have become the dominant architecture for sequence modeling tasks such as natural language processing or audio processing, and they are now even considered for tasks that are not naturally sequential such as image…

Machine Learning · Computer Science 2024-03-05 Jorg Bornschein , Yazhe Li , Amal Rannen-Triki

We calculate the frequency-dispersed nonlinear transmission signal of a phase-shaped visible pulse to fourth order in the field. Two phase profiles, a phase-step and phase-pulse, are considered. Two dimensional signals obtained by varying…

Chemical Physics · Physics 2015-06-22 Rachel Glenn , Shaul Mukamel
‹ Prev 1 3 4 5 6 7 10 Next ›