English
Related papers

Related papers: A Hyper-Transformer model for Controllable Pareto …

200 papers

Federated Learning (FL) has become an established technique to facilitate privacy-preserving collaborative training across a multitude of clients. However, new approaches to FL often discuss their contributions involving small deep-learning…

Machine Learning · Computer Science 2026-05-05 Herbert Woisetschläger , Alexander Isenko , Shiqiang Wang , Ruben Mayer , Hans-Arno Jacobsen

Multi-objective reinforcement learning (MORL) excels at handling rapidly changing preferences in tasks that involve multiple criteria, even for unseen preferences. However, previous dominating MORL methods typically generate a fixed policy…

Machine Learning · Computer Science 2025-05-09 Ruohong Liu , Yuxin Pan , Linjie Xu , Lei Song , Jiang Bian , Pengcheng You , Yize Chen

In Multi-Task Learning (MTL), tasks may compete and limit the performance achieved on each other, rather than guiding the optimization to a solution, superior to all its single-task trained counterparts. Since there is often not a unique…

Machine Learning · Computer Science 2023-06-16 Nikolaos Dimitriadis , Pascal Frossard , François Fleuret

Neural networks for visual content understanding have recently evolved from convolutional ones (CNNs) to transformers. The prior (CNN) relies on small-windowed kernels to capture the regional clues, demonstrating solid local expressiveness.…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Zixuan Su , Hao Zhang , Jingjing Chen , Lei Pang , Chong-Wah Ngo , Yu-Gang Jiang

We present scalable hybrid-parallel algorithms for training large-scale 3D convolutional neural networks. Deep learning-based emerging scientific workflows often require model training with large, high-dimensional samples, which can make…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-07-28 Yosuke Oyama , Naoya Maruyama , Nikoli Dryden , Erin McCarthy , Peter Harrington , Jan Balewski , Satoshi Matsuoka , Peter Nugent , Brian Van Essen

Traditional vertical federated learning schema suffers from two main issues: 1) restricted applicable scope to overlapped samples and 2) high system challenge of real-time federated serving, which limits its application to advertising…

Machine Learning · Computer Science 2026-01-26 Wenjie Li , Shu-Tao Xia , Jiangke Fan , Teng Zhang , Xingxing Wang

Learning from limited data has been extensively studied in machine learning, considering that deep neural networks achieve optimal performance when trained using a large amount of samples. Although various strategies have been proposed for…

Machine Learning · Computer Science 2023-12-29 Ramona Ghilea , Islem Rekik

In recent years, data are typically distributed in multiple organizations while the data security is becoming increasingly important. Federated Learning (FL), which enables multiple parties to collaboratively train a model without…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-03-13 Ji Liu , Xuehai Zhou , Lei Mo , Shilei Ji , Yuan Liao , Zheng Li , Qin Gu , Dejing Dou

Many of the machine learning (ML) tasks are focused on centralized learning (CL), which requires the transmission of local datasets from the clients to a parameter server (PS) leading to a huge communication overhead. Federated learning…

Machine Learning · Computer Science 2021-02-17 Ahmet M. Elbir , Sinem Coleri , Kumar Vijay Mishra

In this paper, a communication-efficient federated learning (FL) framework is proposed for improving the convergence rate of FL under a limited uplink capacity. The central idea of the proposed framework is to transmit the values and…

Signal Processing · Electrical Eng. & Systems 2023-07-21 Jaewon Yun , Yongjeong Oh , Yo-Seb Jeon , H. Vincent Poor

A new federated learning (FL) framework enabled by large-scale wireless connectivity is proposed for designing the autonomous controller of connected and autonomous vehicles (CAVs). In this framework, the learning models used by the…

Systems and Control · Electrical Eng. & Systems 2022-06-17 Tengchan Zeng , Omid Semiari , Mingzhe Chen , Walid Saad , Mehdi Bennis

Obtaining control barrier functions (CBFs) with large safe sets for complex nonlinear systems and constraints is a challenging task. Predictive CBFs address this issue by using an online finite-horizon optimal control problem that…

Systems and Control · Electrical Eng. & Systems 2025-10-27 Kanghui He , Anil Alan , Shengling Shi , Ton van den Boom , Bart De Schutter

The longstanding goals of federated learning (FL) require rigorous privacy guarantees and low communication overhead while holding a relatively high model accuracy. However, simultaneously achieving all the goals is extremely challenging.…

Machine Learning · Computer Science 2021-06-02 He Yang

Federated learning has been predominantly concerned with collaborative training of deep networks from scratch, and especially the many challenges that arise, such as communication cost, robustness to heterogeneous data, and support for…

Split learning (SL) has been recently proposed as a way to enable resource-constrained devices to train multi-parameter neural networks (NNs) and participate in federated learning (FL). In a nutshell, SL splits the NN model into parts, and…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-06 Joana Tirana , Dimitra Tsigkari , George Iosifidis , Dimitris Chatzopoulos

Federated learning (FL) is an emerging distributed machine learning paradigm that protects privacy and tackles the problem of isolated data islands. At present, there are two main communication strategies of FL: synchronous FL and…

Machine Learning · Computer Science 2024-04-16 Yu Zhang , Moming Duan , Duo Liu , Li Li , Ao Ren , Xianzhang Chen , Yujuan Tan , Chengliang Wang

Federated learning is a privacy-focused approach towards machine learning where models are trained on client devices with locally available data and aggregated at a central server. However, the dependence on a single central server is…

Machine Learning · Computer Science 2026-01-06 Shamik Bhattacharyya , Rachel Kalpana Kalaimani

In many real-world scenarios, data to train machine learning models becomes available over time. Unfortunately, these models struggle to continually learn new concepts without forgetting what has been learnt in the past. This phenomenon is…

Computation and Language · Computer Science 2023-01-16 Beyza Ermis , Giovanni Zappella , Martin Wistuba , Aditya Rawal , Cedric Archambeau

Optimal control for safety-critical systems is often dependent on the conservativeness of constraints. Control Barrier Functions (CBFs) serve as a medium to represent such constraints, but constructing a minimally conservative CBF is a…

Systems and Control · Electrical Eng. & Systems 2026-05-08 Tanmay Dokania , Yashwanth Kumar Nakka

Federated Learning (FL) is a well-known framework for successfully performing a learning task in an edge computing scenario where the devices involved have limited resources and incomplete data representation. The basic assumption of FL is…

Machine Learning · Computer Science 2023-12-08 Lorenzo Valerio , Chiara Boldrini , Andrea Passarella , János Kertész , Márton Karsai , Gerardo Iñiguez