English
Related papers

Related papers: Decentralized Multi-Task Learning Based on Extreme…

200 papers

Many real-world large-scale regression problems can be formulated as Multi-task Learning (MTL) problems with a massive number of tasks, as in retail and transportation domains. However, existing MTL methods still fail to offer both the…

Machine Learning · Computer Science 2018-11-15 Xiao He , Francesco Alesiani , Ammar Shaker

The Extreme Learning Machine (ELM) is a growing statistical technique widely applied to regression problems. In essence, ELMs are single-layer neural networks where the hidden layer weights are randomly sampled from a specific distribution,…

Machine Learning · Statistics 2025-07-31 Daniela De Canditiis , Fabiano Veglianti

Due to the implementation bottleneck of training data collection in realistic wireless communications systems, supervised learning-based timing synchronization (TS) is challenged by the incompleteness of training data. To tackle this…

Signal Processing · Electrical Eng. & Systems 2023-07-03 Mintao Zhang , Shuhai Tang , Chaojin Qing , Na Yang , Xi Cai , Jiafan Wang

Federated learning (FL) is a promising paradigm that can enable collaborative model training between vehicles while protecting data privacy, thereby significantly improving the performance of intelligent transportation systems (ITSs). In…

Networking and Internet Architecture · Computer Science 2025-03-11 Dongyu Chen , Tao Deng , He Huang , Juncheng Jia , Mianxiong Dong , Di Yuan , Keqin Li

We consider the problem of distributed multi-task learning, where each machine learns a separate, but related, task. Specifically, each machine learns a linear predictor in high-dimensional space,where all tasks share the same small…

Machine Learning · Statistics 2015-10-05 Jialei Wang , Mladen Kolar , Nathan Srebro

Multi-task learning (MTL) paradigm focuses on jointly learning two or more tasks, aiming for significant improvement w.r.t model's generalizability, performance, and training/inference memory footprint. The aforementioned benefits become…

Computer Vision and Pattern Recognition · Computer Science 2022-10-27 Nitin Bansal , Pan Ji , Junsong Yuan , Yi Xu

In [1, 2], we have explored the theoretical aspects of feature extraction optimization processes for solving largescale problems and overcoming machine learning limitations. Majority of optimization algorithms that have been introduced in…

Machine Learning · Computer Science 2019-08-28 Farid Ghareh Mohammadi , M. Hadi Amini , Hamid R. Arabnia

Multi-task learning (MTL) is a machine learning technique aiming to improve model performance by leveraging information across many tasks. It has been used extensively on various data modalities, including electronic health record (EHR)…

Machine Learning · Computer Science 2020-07-21 Matthew B. A. McDermott , Bret Nestor , Evan Kim , Wancong Zhang , Anna Goldenberg , Peter Szolovits , Marzyeh Ghassemi

We develop a mathematical framework for solving multi-task reinforcement learning (MTRL) problems based on a type of policy gradient method. The goal in MTRL is to learn a common policy that operates effectively in different environments;…

Machine Learning · Computer Science 2021-05-31 Sihan Zeng , Aqeel Anwar , Thinh Doan , Arijit Raychowdhury , Justin Romberg

In multi-task learning, difficulty levels of different tasks are varying. There are many works to handle this situation and we classify them into five categories, including the direct sum approach, the weighted sum approach, the maximum…

Machine Learning · Computer Science 2020-02-13 Sicong Liang , Yu Zhang

ELM (Extreme Learning Machine) is a single hidden layer feed-forward network, where the weights between input and hidden layer are initialized randomly. ELM is efficient due to its utilization of the analytical approach to compute weights…

Machine Learning · Computer Science 2016-06-21 Qiuyan Yan , Qifa Sun , Xinming Yan

Multi-task learning (MTL) allows deep neural networks to learn from related tasks by sharing parameters with other networks. In practice, however, MTL involves searching an enormous space of possible parameter sharing architectures to find…

Machine Learning · Statistics 2018-11-20 Sebastian Ruder , Joachim Bingel , Isabelle Augenstein , Anders Søgaard

Conventional control, such as model-based control, is commonly utilized in autonomous driving due to its efficiency and reliability. However, real-world autonomous driving contends with a multitude of diverse traffic scenarios that are…

Robotics · Computer Science 2024-03-08 Vindula Jayawardana , Sirui Li , Cathy Wu , Yashar Farid , Kentaro Oguchi

The Extreme Learning Machine (ELM) technique is a machine learning approach for constructing feed-forward neural networks with a single hidden layer and their models. The ELM model can be constructed while being trained by concurrently…

Optimization and Control · Mathematics 2024-01-30 Muideen Adegoke , Lateef O. Jolaoso , Mardiyyah Oduwole

The optimal solution to an optimization problem depends on the problem's objective function, constraints, and size. While deep neural networks (DNNs) have proven effective in solving optimization problems, changes in the problem's size,…

Machine Learning · Computer Science 2025-02-17 Nikos A. Mitsiou , Pavlos S. Bouzinis , Panagiotis G. Sarigiannidis , George K. Karagiannidis

An extreme learning machine (ELM) can be regarded as a two stage feed-forward neural network (FNN) learning system which randomly assigns the connections with and within hidden neurons in the first stage and tunes the connections with…

Machine Learning · Computer Science 2014-01-27 Shaobo Lin , Xia Liu , Jian Fang , Zongben Xu

Most edge AI focuses on prediction tasks on resource-limited edge devices while the training is done at server machines. However, retraining or customizing a model is required at edge devices as the model is becoming outdated due to…

Machine Learning · Computer Science 2021-06-29 Rei Ito , Mineto Tsukada , Hiroki Matsutani

Multi-task learning (MTL) has received considerable attention, and numerous deep learning applications benefit from MTL with multiple objectives. However, constructing multiple related tasks is difficult, and sometimes only a single task is…

Computer Vision and Pattern Recognition · Computer Science 2019-11-25 Tao Gui , Lizhi Qing , Qi Zhang , Jiacheng Ye , Hang Yan , Zichu Fei , Xuanjing Huang

By leveraging large amounts of product data collected across hundreds of live e-commerce websites, we construct 1000 unique classification tasks that share similarly-structured input data, comprised of both text and images. These…

Artificial Intelligence · Computer Science 2021-07-29 Cameron R. Wolfe , Keld T. Lundgaard

Multi-Task Learning (MTL) is a framework, where multiple related tasks are learned jointly and benefit from a shared representation space, or parameter transfer. To provide sufficient learning support, modern MTL uses annotated data with…

Computer Vision and Pattern Recognition · Computer Science 2024-01-04 Dimitrios Kollias , Viktoriia Sharmanska , Stefanos Zafeiriou