English
Related papers

Related papers: A Differentiable Framework for End-to-End Learning…

200 papers

This paper proposes a reinforcement learning framework for performance-driven structural design that combines bottom-up design generation with learned strategies to efficiently search large combinatorial design spaces. Motivated by the…

Computational Engineering, Finance, and Science · Computer Science 2025-07-31 Chloe S. H. Hong , Keith J. Lee , Caitlin T. Mueller

Large Language Models (LLMs) herald a transformative era in artificial intelligence (AI). However, the expansive scale of data and parameters of LLMs requires high-demand computational and memory resources, restricting their accessibility…

Machine Learning · Computer Science 2024-11-26 Shengwen Ding , Chenhui Hu

We investigate nonlinear prediction in an online setting and introduce a hybrid model that effectively mitigates, via an end-to-end architecture, the need for hand-designed features and manual model selection issues of conventional…

Machine Learning · Statistics 2023-07-11 Mustafa E. Aydın , Suleyman S. Kozat

The development of federated learning (FL) methods, which aim to learn from distributed databases (i.e., clients) without accessing data on clients, has recently attracted great attention. Most of these methods assume that the clients are…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Barış Büyüktaş , Gencer Sumbul , Begüm Demir

Deep Metric Learning (DML) is arguably one of the most influential lines of research for learning visual similarities with many proposed approaches every year. Although the field benefits from the rapid progress, the divergence in training…

Computer Vision and Pattern Recognition · Computer Science 2020-08-04 Karsten Roth , Timo Milbich , Samarth Sinha , Prateek Gupta , Björn Ommer , Joseph Paul Cohen

This paper describes several improvements to a new method for signal decomposition that we recently formulated under the name of Differentiable Dictionary Search (DDS). The fundamental idea of DDS is to exploit a class of powerful deep…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-29 Lukáš Samuel Marták , Rainer Kelz , Gerhard Widmer

Multimodal Sentiment Analysis (MSA) leverages heterogeneous modalities, such as language, vision, and audio, to enhance the understanding of human sentiment. While existing models often focus on extracting shared information across…

Machine Learning · Computer Science 2025-04-10 Pan Wang , Qiang Zhou , Yawen Wu , Tianlong Chen , Jingtong Hu

Personalized federated learning (PFL) has garnered significant attention for its ability to address heterogeneous client data distributions while preserving data privacy. However, when local client data is limited, deep learning models…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-24 Ying Chang , Xiaohu Shi , Xiaohui Zhao , Zhaohuang Chen , Deyin Ma

Federated Learning (FL) is a machine learning paradigm that allows decentralized clients to learn collaboratively without sharing their private data. However, excessive computation and communication demands pose challenges to current FL…

Cryptography and Security · Computer Science 2022-09-22 Yue Tan , Guodong Long , Jie Ma , Lu Liu , Tianyi Zhou , Jing Jiang

Federated learning (FL) is a viable technique to train a shared machine learning model without sharing data. Hierarchical FL (HFL) system has yet to be studied regrading its multiple levels of energy, computation, communication, and client…

Machine Learning · Computer Science 2024-06-24 Xiaojing Chen , Zhenyuan Li , Wei Ni , Xin Wang , Shunqing Zhang , Yanzan Sun , Shugong Xu , Qingqi Pei

Class-incremental learning aims to continuously acquire new knowledge while preserving previously learned information, thereby mitigating catastrophic forgetting. Existing methods primarily restrict parameter updates but often overlook…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Mengxin Qin , Xiang Zhang , Kun Wei , Xu Yang , Cheng Deng

Multimodal learning has seen great success mining data features from multiple modalities with remarkable model performance improvement. Meanwhile, federated learning (FL) addresses the data sharing problem, enabling privacy-preserved…

Machine Learning · Computer Science 2023-03-29 Rongyu Zhang , Xiaowei Chi , Guiliang Liu , Wenyi Zhang , Yuan Du , Fangxin Wang

Generative modeling has recently undergone remarkable advancements, primarily propelled by the transformative implications of Diffusion Probabilistic Models (DPMs). The impressive capability of these models, however, often entails…

Machine Learning · Computer Science 2023-10-03 Gongfan Fang , Xinyin Ma , Xinchao Wang

Federated learning (FL), aimed at leveraging vast distributed datasets, confronts a crucial challenge: the heterogeneity of data across different silos. While previous studies have explored discrete representations to enhance model…

Machine Learning · Computer Science 2025-06-06 Tianyi Zhang , Yu Cao , Dianbo Liu

Federated learning (FL) has emerged as a key technique for distributed machine learning (ML). Most literature on FL has focused on ML model training for (i) a single task/model, with (ii) a synchronous scheme for updating model parameters,…

Machine Learning · Computer Science 2024-02-19 Zhan-Lun Chang , Seyyedali Hosseinalipour , Mung Chiang , Christopher G. Brinton

Federated learning (FL) is a new distributed machine learning framework that can achieve reliably collaborative training without collecting users' private data. However, due to FL's frequent communication and average aggregation strategy,…

Machine Learning · Computer Science 2022-08-30 Qing Wang , Jing Jin , Xiaofeng Liu , Huixuan Zong , Yunfeng Shao , Yinchuan Li

The challenge of creating domain-centric embeddings arises from the abundance of unstructured data and the scarcity of domain-specific structured data. Conventional embedding techniques often rely on either modality, limiting their…

Machine Learning · Computer Science 2024-10-29 Sharadind Peddiraju , Srini Rajagopal

Deep learning-based fault diagnosis (FD) approaches require a large amount of training data, which are difficult to obtain since they are located across different entities. Federated learning (FL) enables multiple clients to collaboratively…

Machine Learning · Computer Science 2023-10-16 Jixuan Cui , Jun Li , Zhen Mei , Kang Wei , Sha Wei , Ming Ding , Wen Chen , Song Guo

Large language models (LLMs) excel in general tasks but struggle with domain-specific ones, requiring fine-tuning with specific data. With many open-source LLMs available, selecting the best model for fine-tuning downstream tasks is…

Computation and Language · Computer Science 2025-09-05 Wei Huang , Huang Wei , Yinggui Wang

In distributed optimization, the practical problem-solving performance is essentially sensitive to algorithm selection, parameter setting, problem type and data pattern. Thus, it is often laborious to acquire a highly efficient method for a…

Optimization and Control · Mathematics 2024-01-04 Daokuan Zhu , Tianqi Xu , Jie Lu