English
Related papers

Related papers: Routing Networks: Adaptive Selection of Non-linear…

200 papers

Deep Reinforcement Learning (DRL) has become a powerful tool for developing control policies in queueing networks, but the common use of Multi-layer Perceptron (MLP) neural networks in these applications has significant drawbacks. MLP…

Machine Learning · Computer Science 2025-01-22 Jerrod Wigmore , Brooke Shrader , Eytan Modiano

In Neural Machine Translation (NMT) the usage of subwords and characters as source and target units offers a simple and flexible solution for translation of rare and unseen words. However, selecting the optimal subword segmentation involves…

Computation and Language · Computer Science 2019-10-29 Tejas Srinivasan , Ramon Sanabria , Florian Metze

Nature is rife with networks that are functionally optimized to propagate inputs in order to perform specific tasks. Whether via genetic evolution or dynamic adaptation, many networks create functionality by locally tuning interactions…

Soft Condensed Matter · Physics 2019-02-14 Jason W. Rocks , Henrik Ronellenfitsch , Andrea J. Liu , Sidney R. Nagel , Eleni Katifori

Deep Multi-Task Learning (DMTL) has been widely studied in the machine learning community and applied to a broad range of real-world applications. Searching for the optimal knowledge sharing in DMTL is more challenging for sequential…

Machine Learning · Computer Science 2022-06-14 Michael X. Yang

Motivated by the observation that humans can learn patterns from two given images at one time, we propose a dual pattern learning network architecture in this paper. Unlike conventional networks, the proposed architecture has two input…

Computer Vision and Pattern Recognition · Computer Science 2018-06-12 Haimin Zhang , Min Xu

The task of multimodal learning has seen a growing interest recently as it allows for training neural architectures based on different modalities such as vision, text, and audio. One challenge in training such models is that they need to…

Computer Vision and Pattern Recognition · Computer Science 2021-12-03 Kevin Duarte , Brian Chen , Nina Shvetsova , Andrew Rouditchenko , Samuel Thomas , Alexander Liu , David Harwath , James Glass , Hilde Kuehne , Mubarak Shah

Meta-learning has been proposed as a framework to address the challenging few-shot learning setting. The key idea is to leverage a large number of similar few-shot tasks in order to learn how to adapt a base-learner to a new task for which…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Qianru Sun , Yaoyao Liu , Tat-Seng Chua , Bernt Schiele

Efficient machine learning (ML) has become increasingly important as models grow larger and data volumes expand. In this work, we address the trade-off between generalization in multi-task learning (MTL) and precision in single-task…

Machine Learning · Computer Science 2025-05-02 Dong Liu , Yanxuan Yu

In mobile communication scenarios, the acquired channel state information (CSI) rapidly becomes outdated due to fast-changing channels. Opportunistic transmitter selection based on current CSI for secrecy improvement may be outdated during…

Signal Processing · Electrical Eng. & Systems 2024-05-02 Shashi Bhushan Kotwal , Chinmoy Kundu , Sudhakar Modem , Holger Claussen , Lester Ho

We study and quantify the generalization patterns of multitask learning (MTL) models for sequence labeling tasks. MTL models are trained to optimize a set of related tasks jointly. Although multitask learning has achieved improved…

Machine Learning · Computer Science 2020-09-29 Gabriele Bettgenhäuser , Michael A. Hedderich , Dietrich Klakow

Channel modeling has always been the core part in communication system design and development, especially in 5G and 6G era. Traditional approaches like stochastic channel modeling and ray-tracing (RT) based channel modeling depend heavily…

Signal Processing · Electrical Eng. & Systems 2022-09-12 Xiping Wang , Zhao Zhang , Danping He , Ke Guan , Dongliang Liu , Jianwu Dou

Packet routing is a fundamental problem in communication networks that decides how the packets are directed from their source nodes to their destination nodes through some intermediate nodes. With the increasing complexity of network…

Artificial Intelligence · Computer Science 2021-07-29 Xuan Mai , Quanzhi Fu , Yi Chen

Multi-task learning (MTL) has emerged as an imperative machine learning tool to solve multiple learning tasks simultaneously and has been successfully applied to healthcare, marketing, and biomedical fields. However, in order to borrow…

Machine Learning · Computer Science 2025-06-02 Yang Sui , Qi Xu , Yang Bai , Annie Qu

Many real-world large-scale regression problems can be formulated as Multi-task Learning (MTL) problems with a massive number of tasks, as in retail and transportation domains. However, existing MTL methods still fail to offer both the…

Machine Learning · Computer Science 2018-11-15 Xiao He , Francesco Alesiani , Ammar Shaker

Multi-task multi-agent reinforcement learning (MT-MARL) has recently gained attention for its potential to enhance MARL's adaptability across multiple tasks. However, it is challenging for existing multi-task learning methods to handle…

Robotics · Computer Science 2025-07-10 Guobin Zhu , Rui Zhou , Wenkang Ji , Hongyin Zhang , Donglin Wang , Shiyu Zhao

Multi-Task Learning (MTL) aims to enhance the model generalization by sharing representations between related tasks for better performance. Typical MTL methods are jointly trained with the complete multitude of ground-truths for all tasks…

Computer Vision and Pattern Recognition · Computer Science 2021-10-15 Yufeng Wang , Yi-Hsuan Tsai , Wei-Chih Hung , Wenrui Ding , Shuo Liu , Ming-Hsuan Yang

Continual learning of multiple tasks remains a major challenge for neural networks. Here, we investigate how task order influences continual learning and propose a strategy for optimizing it. Leveraging a linear teacher-student model with…

Machine Learning · Statistics 2025-07-22 Ziyan Li , Naoki Hiratani

Multi-target tracking (MTT) is a classical signal processing task, where the goal is to estimate the states of an unknown number of moving targets from noisy sensor measurements. In this paper, we revisit MTT from a deep learning…

Signal Processing · Electrical Eng. & Systems 2024-05-15 Damian Owerko , Charilaos I. Kanatsoulis , Jennifer Bondarchuk , Donald J. Bucci , Alejandro Ribeiro

A given neural network in the brain is involved in many different tasks. This implies that, when considering a specific task, the network's connectivity contains a component which is related to the task and another component which can be…

Neurons and Cognition · Quantitative Biology 2021-03-17 Friedrich Schuessler , Alexis Dubreuil , Francesca Mastrogiuseppe , Srdjan Ostojic , Omri Barak

Backpropagation through time (BPTT) is the standard algorithm for training recurrent neural networks (RNNs), which requires separate simulation phases for the forward and backward passes for inference and learning, respectively. Moreover,…

Machine Learning · Computer Science 2023-03-13 Anand Subramoney