English
Related papers

Related papers: Integrated electro-optic attention nonlinearities …

200 papers

The coherent transmission technology using digital signal processing and advanced modulation formats, is bringing networks closer to the theoretical capacity limit of optical fibres, the Shannon limit. The in-phase quadrature electro-optic…

Practical quantum networks will require quantum nodes consisting of many memory qubits. This in turn will increase the complexity of the photonic circuits needed to control each qubit and will require strategies to multiplex memories and…

Optical modulators are essential building blocks for high-capacity optical communication and massively parallel computing. Among all types of optical modulators, travelling-wave Mach-Zehnder modulators (TW-MZMs) featuring high speed and…

Optics · Physics 2025-07-14 Shuyi Li , Wei Luo , Zhenyu Li , Junqiu Liu

Non-linear operations such as GELU, Layer normalization, and Softmax are essential yet costly building blocks of Transformer models. Several prior works simplified these operations with look-up tables or integer computations, but such…

Machine Learning · Computer Science 2021-12-07 Joonsang Yu , Junki Park , Seongmin Park , Minsoo Kim , Sihwa Lee , Dong Hyun Lee , Jungwook Choi

Transformers have had tremendous impact for several sequence related tasks, largely due to their ability to retrieve from any part of the sequence via softmax based dot-product attention. This mechanism plays a crucial role in Transformer's…

Machine Learning · Computer Science 2025-07-15 Sai Surya Duvvuri , Inderjit S. Dhillon

Modern advanced photonic integrated circuits require dense integration of high-speed electro-optic functional elements on a compact chip that consumes only moderate power. Energy efficiency, operation speed, and device dimension are thus…

Applied Physics · Physics 2020-09-09 Mingxiao Li , Jingwei Ling , Yang He , Usman A. Javid , Shixin Xue , Qiang Lin

This paper presents a compact dual-arm thin film lithium niobate (TFLN) electro-optic phase modulator fabricated using the photolithography-assisted chemo-mechanical etching (PLACE) technique. The design of the device allows for complete…

Thin-film lithium niobate (TFLN) has emerged as a leading platform for large-scale programmable photonic circuits for quantum and classical applications. As circuits scale in complexity, low-loss routing of broadband pump and signal fields…

Electro-optic modulators for next-generation optical interconnects require low loss-efficiency products, compact footprints, high modulation efficiency, broad bandwidths, and low losses. Here we propose and demonstrate a low-loss…

Frequency mixers are fundamental components in modern wireless communication and radar systems, responsible for up- and down-conversion of target radio-frequency (RF) signals. Recently, photonic-assisted RF mixers have shown unique…

Photonic neural networks (PNNs) of sufficiently large physical dimensions and high operation accuracies are envisaged as an ideal candidate for breaking the major bottlenecks in the current artificial intelligence architectures in terms of…

Optics · Physics 2025-07-30 Ruixue Liu , Rongbo Wu , Yong Zheng , Yuan Ren , Boyang Nan , Min Wang , Yunpeng Song , Ya Cheng

The rapid development of the Transformer-based Large Language Models (LLMs) in recent years has been closely linked to their ever-growing and already enormous sizes. Many LLMs contain hundreds of billions of parameters and require dedicated…

Computation and Language · Computer Science 2025-02-26 Mahsa Salmani , Ilya Soloveychik

While the Transformer architecture dominates many fields, its quadratic self-attention complexity hinders its use in large-scale applications. Linear attention offers an efficient alternative, but its direct application often degrades…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Kewei Zhang , Ye Huang , Yufan Deng , Jincheng Yu , Junsong Chen , Huan Ling , Enze Xie , Daquan Zhou

Non-local (NL) block is a popular module that demonstrates the capability to model global contexts. However, NL block generally has heavy computation and memory costs, so it is impractical to apply the block to high-resolution feature maps.…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Yooshin Cho , Youngsoo Kim , Hanbyel Cho , Jaesung Ahn , Hyeong Gwon Hong , Junmo Kim

The transformer architecture has driven many successes in a variety of tasks within the field of deep learning, in particular the recent advances in natural language processing (NLP) culminating with large language models (LLM). Adding to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Abdullah Nazhat Abdullah , Tarkan Aydin

Electro-optic modulation, the imprinting of a radio-frequency (RF) waveform on an optical carrier, is one of the most important photonics functions, being crucial for high-bandwidth signal generation, optical switching, waveform shaping,…

High bandwidth, low voltage electro-optic modulators with high optical power handling capability are important for improving the performance of analog optical communications and RF photonic links. Here we designed and fabricated a thin-film…

Thin-Film Lithium Niobate (TFLN) is an emerging integrated photonic platform showing great promise due to its large second-order nonlinearity at microwave and optical frequencies, cryogenic compatibility, large piezoelectric response, and…

With the advantages of large electro-optical coefficient, wide transparency window, and strong optical confinement, thin-film lithium niobate (TFLN) technique has enabled the development of various high-performance optoelectronics devices,…

Integrated microwave photonics (MWP) offers a powerful paradigm for handling high-speed microwave signals within chip-scale optical systems. It provides a cost-effective solution to address bandwidth, tunability, and loss bottlenecks of…