English
Related papers

Related papers: Constraint-Driven Warm-Freeze for Efficient Transf…

200 papers

Training large foundation models from scratch for domain-specific applications is almost impossible due to data limits and long-tailed distributions -- taking remote sensing (RS) as an example. Fine-tuning natural image pre-trained models…

Machine Learning · Computer Science 2026-03-03 Zichen Tian , Yaoyao Liu , Qianru Sun

Parametric point clouds are sampled from CAD shapes and are becoming increasingly common in industrial manufacturing. Most CAD-specific deep learning methods focus on geometric features, while overlooking constraints inherent in CAD shapes.…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Xi Cheng , Ruiqi Lei , Di Huang , Zhichao Liao , Fengyuan Piao , Yan Chen , Pingfa Feng , Long Zeng

As FMs drive progress toward Artificial General Intelligence (AGI), fine-tuning them under privacy and resource constraints has become increasingly critical particularly when highquality training data resides on distributed edge devices.…

Machine Learning · Computer Science 2025-08-27 Gang Hu , Yinglei Teng , Pengfei Wu , Nan Wang

Federated Learning (FL) has become an established technique to facilitate privacy-preserving collaborative training across a multitude of clients. However, new approaches to FL often discuss their contributions involving small deep-learning…

Machine Learning · Computer Science 2026-05-05 Herbert Woisetschläger , Alexander Isenko , Shiqiang Wang , Ruben Mayer , Hans-Arno Jacobsen

Parameter-Efficient Fine-Tuning (PEFT) has emerged as a key strategy for adapting large-scale pre-trained models to downstream tasks, but existing approaches face notable limitations. Addition-based methods, such as Adapters, introduce…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Kenneth Yang , Wen-Li Wei , Jen-Chun Lin

The emerging edge-cloud collaborative Deep Learning (DL) paradigm aims at improving the performance of practical DL implementations in terms of cloud bandwidth consumption, response latency, and data privacy preservation. Focusing on…

Machine Learning · Computer Science 2020-05-06 Yuanrui Dong , Peng Zhao , Hanqiao Yu , Cong Zhao , Shusen Yang

Feature learning with deep models has achieved impressive results for both data representation and classification for various vision tasks. Deep feature learning, however, typically requires a large amount of training data, which may not be…

Computer Vision and Pattern Recognition · Computer Science 2017-09-26 Yue Wu , Qiang Ji

Federated learning (FL) has been recognized as a viable distributed learning paradigm for training a machine learning model across distributed clients without uploading raw data. However, FL in wireless networks still faces two major…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-02-21 Xuefeng Han , Wen Chen , Jun Li , Ming Ding , Qingqing Wu , Kang Wei , Xiumei Deng , Zhen Mei

In advanced paradigms of autonomous driving, learning Bird's Eye View (BEV) representation from surrounding views is crucial for multi-task framework. However, existing methods based on depth estimation or camera-driven attention are not…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Hongxiang Jiang , Wenming Meng , Hongmei Zhu , Qian Zhang , Jihao Yin

Change detection in remote sensing imagery plays a vital role in various engineering applications, such as natural disaster monitoring, urban expansion tracking, and infrastructure management. Despite the remarkable progress of deep…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Xiaoyang Zhang , Guodong Fan , Guang-Yong Chen , Zhen Hua , Jinjiang Li , Min Gan , C. L. Philip Chen

Currently, deep learning-based methods for remote sensing pansharpening have advanced rapidly. However, many existing methods struggle to fully leverage feature heterogeneity and redundancy, thereby limiting their effectiveness. We use the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Jie Huang , Haorui Chen , Jiaxuan Ren , Siran Peng , Liangjian Deng

In the Centralized-Radio Access Network (C-RAN) architecture, functions can be placed in the central or distributed locations. This architecture can offer higher capacity and cost savings but also puts strict requirements on the fronthaul…

Systems and Control · Electrical Eng. & Systems 2023-10-02 Axel Grönland , Alessio Russo , Yassir Jedra , Bleron Klaiqi , Xavier Gelabert

Federated learning is a powerful distributed learning scheme that allows numerous edge devices to collaboratively train a model without sharing their data. However, training is resource-intensive for edge devices, and limited network…

Machine Learning · Computer Science 2024-10-25 Hui-Po Wang , Sebastian U. Stich , Yang He , Mario Fritz

Dynamic Voltage and Frequency Scaling is essential for enhancing energy efficiency in mobile platforms. However, traditional heuristic-based governors are increasingly inadequate for managing the complexity of heterogeneous System-on-Chip…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-30 Jinqi Yan , Fang He , Qianlong Sang , Bifeng Tong , Peng Sun , Yili Gong , Chuang Hu , Dazhao Cheng

In recent developments in the field of Computer Vision, a rise is seen in the use of transformer-based architectures. They are surpassing the state-of-the-art set by CNN architectures in accuracy but on the other hand, they are…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Durvesh Malpure , Onkar Litake , Rajesh Ingle

Data generated at the network edge can be processed locally by leveraging the paradigm of edge computing (EC). Aided by EC, decentralized federated learning (DFL), which overcomes the single-point-of-failure problem in the parameter server…

Networking and Internet Architecture · Computer Science 2022-12-06 Yunming Liao , Yang Xu , Hongli Xu , Lun Wang , Chen Qian

A new federated learning (FL) framework enabled by large-scale wireless connectivity is proposed for designing the autonomous controller of connected and autonomous vehicles (CAVs). In this framework, the learning models used by the…

Systems and Control · Electrical Eng. & Systems 2022-06-17 Tengchan Zeng , Omid Semiari , Mingzhe Chen , Walid Saad , Mehdi Bennis

Critical research about camera-and-LiDAR-based semantic object segmentation for autonomous driving significantly benefited from the recent development of deep learning. Specifically, the vision transformer is the novel ground-breaker that…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Junyi Gu , Mauro Bellone , Tomáš Pivoňka , Raivo Sell

Detection Transformers (DETR) are increasingly adopted in autonomous vehicle (AV) perception systems due to their superior accuracy over convolutional networks. However, concurrently executing multiple DETR tasks presents significant…

Systems and Control · Electrical Eng. & Systems 2025-05-30 Woojin Shin , Donghwa Kang , Byeongyun Park , Brent Byunghoon Kang , Jinkyu Lee , Hyeongboo Baek

Conservation Voltage Reduction (CVR) relies on the effective coordination of slow-acting devices, such as OLTCs and CBs, and fast-acting devices, such as SVGs and PV inverters, typically implemented through a hierarchical multi-stage…

Systems and Control · Electrical Eng. & Systems 2026-04-09 Qintao Du , Ran Li , Weiyi Lv , Huan Zhou , Moduo Yu , Jianzhe Liu