English
Related papers

Related papers: Power and Modulation Format Transfer Learning for …

200 papers

We introduce a principled method to train end-to-end analog neural networks by stochastic gradient descent. In these analog neural networks, the weights to be adjusted are implemented by the conductances of programmable resistive devices…

Neural and Evolutionary Computing · Computer Science 2020-06-11 Jack Kendall , Ross Pantone , Kalpana Manickavasagam , Yoshua Bengio , Benjamin Scellier

Simulations of high-energy density physics often need non-local thermodynamic equilibrium (NLTE) opacity data. This data, however, is expensive to produce at relatively low-fidelity. It is even more so at high-fidelity such that the opacity…

Computational Physics · Physics 2023-01-25 Michael D. Vander Wal , Ryan G. McClarren , Kelli D. Humbird

There has been much interest in the non-linear frequency-division multiplexing (NFDM) transmission scheme in the optical fibre communication system. Up to date, most of the demonstrated NFDM schemes have employed only single polarisation…

Signal Processing · Electrical Eng. & Systems 2019-02-21 Xianhe Yangzhang , Vahid Aref , Son Thai Le , Henning Buelow , Domanic Lavery , Polina Bayvel

As one of the most popular sequence-to-sequence modeling approaches for speech recognition, the RNN-Transducer has achieved evolving performance with more and more sophisticated neural network models of growing size and increasing training…

Computation and Language · Computer Science 2023-10-20 Wei Zhou , Wilfried Michel , Ralf Schlüter , Hermann Ney

Transfer learning between different language pairs has shown its effectiveness for Neural Machine Translation (NMT) in low-resource scenario. However, existing transfer methods involving a common target language are far from success in the…

Computation and Language · Computer Science 2019-12-04 Baijun Ji , Zhirui Zhang , Xiangyu Duan , Min Zhang , Boxing Chen , Weihua Luo

A machine-learning non-contact method to determine the temperature of a laser gain medium via its laser emission with a trained few-layer neural net model is presented. The training of the feed-forward Neural Network (NN) enables the…

Optics · Physics 2024-10-31 Jakob Mannstadt , Arash Rahimi-Iman

Recent artificial intelligence-based methods have shown great promise in the use of neural networks for real-time sensing and detection of transmission line faults and estimation of their locations. The expansion of power systems including…

Machine Learning · Computer Science 2022-01-21 Fatemeh Mohammadi Shakiba , Milad Shojaee , S. Mohsen Azizi , Mengchu Zhou

The rapid scaling of deep neural networks comes at the cost of unsustainable power consumption. While optical neural networks offer an alternative, their capabilities remain constrained by the lack of efficient optical nonlinearities. To…

Optics · Physics 2026-01-06 Qingyi Zhou , Jungmin Kim , Yutian Tao , Guoming Huang , Ming Zhou , Zewei Shao , Zongfu Yu

The transfer learning technique is widely used to learning in one context and applying it to another, i.e. the capacity to apply acquired knowledge and skills to new situations. But is it possible to transfer the learning from a deep neural…

Machine Learning · Computer Science 2020-05-08 Nicola Landro , Ignazio Gallo , Riccardo La Grassa

Fine-tuning large pre-trained models is an effective transfer mechanism in NLP. However, in the presence of many downstream tasks, fine-tuning is parameter inefficient: an entire new model is required for every task. As an alternative, we…

While analog neural network (NN) accelerators promise massive energy and time savings, an important challenge is to make them robust to static fabrication error. Present-day training methods for programmable photonic interferometer…

Emerging Technologies · Computer Science 2022-10-14 Sri Krishna Vadlamani , Dirk Englund , Ryan Hamerly

The nonlinear Fourier transform has the potential to overcome limits on performance and achievable data rates which arise in modern optical fiber communication systems when nonlinear interference is treated as noise. The periodic nonlinear…

Signal Processing · Electrical Eng. & Systems 2020-12-24 Jan-Willem Goossens , Hartmut Hafermann , Yves Jaouën

This study introduces simple yet effective continuous- and discrete-variable quantum neural network (QNN) models as a transfer-learning approach for forecasting tasks. The CV-QNN features a single quantum layer with two qubits to establish…

Machine Learning · Computer Science 2025-03-26 Ismael Abdulrahman

As large language models (LLMs) become more prevalent, there is a growing need for new and improved quantization methods that can meet the computationalast layer demands of these modern architectures while maintaining the accuracy. In this…

Computation and Language · Computer Science 2023-10-18 Wenhua Cheng , Yiyang Cai , Kaokao Lv , Haihao Shen

In this paper, we introduce a new regularization technique for transfer learning. The aim of the proposed approach is to capture statistical relationships among convolution filters learned from a well-trained network and transfer this…

Computer Vision and Pattern Recognition · Computer Science 2017-08-24 Mehmet Aygün , Yusuf Aytar , Hazım Kemal Ekenel

Precise load forecasting in buildings could increase the bill savings potential and facilitate optimized strategies for power generation planning. With the rapid evolution of computer science, data-driven techniques, in particular the Deep…

Machine Learning · Computer Science 2023-01-30 Menna Nawar , Moustafa Shomer , Samy Faddel , Huangjie Gong

Wireless Network-on-Chip (WNoC) systems enable low-latency communication in many-core platforms through short-range wireless links. However, the power consumption of integrated transceivers (TRXs), dominated by that of the RF front-end…

Signal Processing · Electrical Eng. & Systems 2026-04-08 Mohammad Shahmoradi , Ahmet Yelboğa , Eduard Alarcón , Korkut Kaan Tokgöz , Sergi Abadal

Multi-plane light converter (MPLC) designs supporting hundreds of modes are attractive in high-throughput optical communications. These photonic structures typically comprise >10 phase masks in free space, with millions of independent…

Signal Processing · Electrical Eng. & Systems 2023-04-14 Zheyuan Zhu , Joe H. Doerr , Guifang Li , Shuo Pang

Terahertz (THz) communications, ranging from 100 GHz to 10 THz, are envisioned as a promising technology for 6G and beyond wireless systems. As foundation of designing THz communications, channel modeling and characterization are crucial to…

Signal Processing · Electrical Eng. & Systems 2024-07-26 Zhengdong Hu , Yuanbo Li , Chong Han

Efficient transfer learning methods such as adapter-based methods have shown great success in unimodal models and vision-language models. However, existing methods have two main challenges in fine-tuning multimodal models. Firstly, they are…

Machine Learning · Computer Science 2024-12-13 Zirun Guo , Xize Cheng , Yangyang Wu , Tao Jin