English
Related papers

Related papers: End-to-End Learning for Task-Oriented Semantic Com…

200 papers

Identifying the features learned by neural networks is a core challenge in mechanistic interpretability. Sparse autoencoders (SAEs), which learn a sparse, overcomplete dictionary that reconstructs a network's internal activations, have been…

Machine Learning · Computer Science 2024-05-27 Dan Braun , Jordan Taylor , Nicholas Goldowsky-Dill , Lee Sharkey

Edge Learning (EL) pushes the computational resources toward the edge of 5G/6G network to assist mobile users requesting delay-sensitive and energy-aware intelligent services. A common challenge in running inference tasks from remote is to…

Signal Processing · Electrical Eng. & Systems 2023-05-04 Francesco Binucci , Paolo Banelli , Paolo Di Lorenzo , Sergio Barbarossa

Molecular communication (MC) provides a foundational framework for information transmission in the Internet of Bio-Nano Things (IoBNT), where efficiency and reliability are crucial. However, the inherent limitations of molecular channels,…

Signal Processing · Electrical Eng. & Systems 2025-04-02 Hanlin Cai , Ozgur B. Akan

In this paper, we propose a single multi-task learning framework to perform End-to-End (E2E) speech recognition (ASR) and accent recognition (AR) simultaneously. The proposed framework is not only more compact but can also yield comparable…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-16 Jicheng Zhang , Yizhou Peng , Pham Van Tung , Haihua Xu , Hao Huang , Eng Siong Chng

Transformer networks and self-supervised pre-training have consistently delivered state-of-art results in the field of natural language processing (NLP); however, their merits in the field of spoken language understanding (SLU) still need…

Computation and Language · Computer Science 2020-11-18 Edmilson Morais , Hong-Kwang J. Kuo , Samuel Thomas , Zoltan Tuske , Brian Kingsbury

Advances in the motor imagery (MI)-based brain-computer interfaces (BCIs) allow control of several applications by decoding neurophysiological phenomena, which are usually recorded by electroencephalography (EEG) using a non-invasive…

End-to-end speech summarization (E2E SSum) directly summarizes input speech into easy-to-read short sentences with a single model. This approach is promising because it, in contrast to the conventional cascade approach, can utilize full…

Computation and Language · Computer Science 2023-06-08 Kohei Matsuura , Takanori Ashihara , Takafumi Moriya , Tomohiro Tanaka , Takatomo Kano , Atsunori Ogawa , Marc Delcroix

Cooperative inference in Mobile Edge Computing (MEC), achieved by deploying partitioned Deep Neural Network (DNN) models between resource-constrained user equipments (UEs) and edge servers (ESs), has emerged as a promising paradigm.…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-10-20 Xinrui Ye , Yanzan Sun , Dingzhu Wen , Guanjin Pan , Shunqing Zhang

This paper investigates task-oriented communication for edge inference, where a low-end edge device transmits the extracted feature vector of a local data sample to a powerful edge server for processing. It is critical to encode the data…

Signal Processing · Electrical Eng. & Systems 2023-01-19 Jiawei Shao , Yuyi Mao , Jun Zhang

\emph{Integrated communication and computation} (IC$^2$) has emerged as a new paradigm for enabling efficient edge inference in sixth-generation (6G) networks. However, the design of IC$^2$ technologies is hindered by the lack of a…

Information Theory · Computer Science 2026-03-04 Jierui Zhang , Jianhao Huang , Kaibin Huang

Owing to the large volume of sensed data from the enormous number of IoT devices in operation today, centralized machine learning algorithms operating on such data incur an unbearable training time, and thus cannot satisfy the requirements…

Signal Processing · Electrical Eng. & Systems 2020-07-21 Shashank Jere , Qiang Fan , Bodong Shang , Lianjun Li , Lingjia Liu

In this work, we learn a shared encoding representation for a multi-task neural network model optimized with connectionist temporal classification (CTC) and conventional framewise cross-entropy training criteria. Our experiments show that…

Audio and Speech Processing · Electrical Eng. & Systems 2019-04-04 Thai-Son Nguyen , Sebastian Stueker , Alex Waibel

In recent years, the end-to-end (E2E) scheme based on deep learning (DL) has been proposed as a potential scheme to jointly optimize the encoder and the decoder parameters of the optical communication system. Compared with conventional deep…

Signal Processing · Electrical Eng. & Systems 2023-05-30 Jiayu Zheng , Tianhong Zhang , Yu Wenjing , Weiqin Zhou , Chuanchuan Yang , Fan Zhang

The idea of end-to-end learning of communication systems through neural network-based autoencoders has the shortcoming that it requires a differentiable channel model. We present in this paper a novel learning algorithm which alleviates…

Information Theory · Computer Science 2019-07-02 Fayçal Ait Aoudia , Jakob Hoydis

End-to-end training of deep learning-based models allows for implicit learning of intermediate representations based on the final task loss. However, the end-to-end approach ignores the useful domain knowledge encoded in explicit…

Computation and Language · Computer Science 2017-04-20 Shubham Toshniwal , Hao Tang , Liang Lu , Karen Livescu

Image-based table recognition is a challenging task due to the diversity of table styles and the complexity of table structures. Most of the previous methods focus on a non-end-to-end approach which divides the problem into two separate…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Nam Tuan Ly , Atsuhiro Takasu

Expandable networks have demonstrated their advantages in dealing with catastrophic forgetting problem in incremental learning. Considering that different tasks may need different structures, recent methods design dynamic structures adapted…

Computer Vision and Pattern Recognition · Computer Science 2022-07-15 Guimei Cao , Zhanzhan Cheng , Yunlu Xu , Duo Li , Shiliang Pu , Yi Niu , Fei Wu

End-to-end (E2E) spoken language understanding (SLU) can infer semantics directly from speech signal without cascading an automatic speech recognizer (ASR) with a natural language understanding (NLU) module. However, paired utterance…

Computation and Language · Computer Science 2021-02-15 Yao Qian , Ximo Bian , Yu Shi , Naoyuki Kanda , Leo Shen , Zhen Xiao , Michael Zeng

Vision-language pre-training (VLP) on large-scale image-text pairs has achieved huge success for the cross-modal downstream tasks. The most existing pre-training methods mainly adopt a two-step training procedure, which firstly employs a…

Computer Vision and Pattern Recognition · Computer Science 2021-06-07 Haiyang Xu , Ming Yan , Chenliang Li , Bin Bi , Songfang Huang , Wenming Xiao , Fei Huang

This paper introduces a novel precoder design aimed at reducing pilot overhead for effective channel estimation in multiple-input multiple-output orthogonal frequency division multiplexing (MIMO-OFDM) applications utilizing high-order…

Signal Processing · Electrical Eng. & Systems 2025-04-30 Nilesh Kumar Jha , Huayan Guo , Vincent K. N. Lau