English
Related papers

Related papers: Decentralized LoRA augmented transformer with mult…

200 papers

Diabetic retinopathy (DR) is one of the major blindness-causing diseases currently known. Automatic grading of DR using deep learning methods not only speeds up the diagnosis of the disease but also reduces the rate of misdiagnosis.…

Image and Video Processing · Electrical Eng. & Systems 2023-05-25 Lei Shi , Bin Wang , Junxing Zhang

Low-rank adaptation (LoRA) has emerged as a powerful tool for parameter-efficient fine-tuning of large language models (LLMs). This paper studies LoRA under a federated learning setting, enabling collaborative fine-tuning across clients…

Machine Learning · Statistics 2026-05-21 Shuaida He , Liwen Chen , Long Feng

Deep learning-based image compression (LIC) has achieved state-of-the-art rate-distortion (RD) performance, yet deploying these models on resource-constrained FPGAs remains a major challenge. This work presents a complete, multi-stage…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Jiaxun Fang , Li Chen

Optical coherence tomography (OCT) helps ophthalmologists assess macular edema, accumulation of fluids, and lesions at microscopic resolution. Quantification of retinal fluids is necessary for OCT-guided treatment management, which relies…

Image and Video Processing · Electrical Eng. & Systems 2022-12-15 Reza Rasti , Armin Biglari , Mohammad Rezapourian , Ziyun Yang , Sina Farsiu

Prompt-based all-in-one image restoration (IR) frameworks have achieved remarkable performance by incorporating degradation-specific information into prompt modules. Nevertheless, handling the complex and diverse degradations encountered in…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Yuang Ai , Huaibo Huang , Ran He

The rapid iteration and widespread dissemination of deepfake technology have posed severe challenges to information security, making robust and generalizable detection of AI-generated forged images increasingly important. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Zhilin Tu , Kemou Li , Fengpeng Li , Jianwei Fei , Jiamin Zhang , Haiwei Wu

Purpose: To test the feasibility of using deep learning for optical coherence tomography angiography (OCTA) detection of diabetic retinopathy (DR). Methods: A deep learning convolutional neural network (CNN) architecture VGG16 was employed…

Quantitative Methods · Quantitative Biology 2021-12-16 David Le , Minhaj Alam , Cham Yao , Jennifer I. Lim , R. V. P. Chan , Devrim Toslak , Xincheng Yao

Apart from discriminative models for classification and object detection tasks, the application of deep convolutional neural networks to basic research utilizing natural imaging data has been somewhat limited; particularly in cases where a…

Computer Vision and Pattern Recognition · Computer Science 2020-09-22 R. Ian Etheredge , Manfred Schartl , Alex Jordan

Continual Learning (CL) requires models to sequentially adapt to new tasks without forgetting old knowledge. Recently, Low-Rank Adaptation (LoRA), a representative Parameter-Efficient Fine-Tuning (PEFT) method, has gained increasing…

Machine Learning · Computer Science 2026-05-26 Lingfeng He , De Cheng , Huaijie Wang , Xi Yang , Nannan Wang , Xinbo Gao

Low-resolution face recognition is a challenging task due to the missing of informative details. Recent approaches based on knowledge distillation have proven that high-resolution clues can well guide low-resolution face recognition via…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Ruixin Shi , Weijia Guo , Shiming Ge

Autonomous Vehicles (AVs) require precise lane and object detection to ensure safe navigation. However, centralized deep learning (DL) approaches for semantic segmentation raise privacy and scalability challenges, particularly when handling…

Systems and Control · Electrical Eng. & Systems 2025-04-29 Gharbi Khamis Alshammari , Ahmad Abubakar , Nada M. O. Sid Ahmed , Naif Khalaf Alshammari

Modern biomedical image analysis using deep learning often encounters the challenge of limited annotated data. To overcome this issue, deep generative models can be employed to synthesize realistic biomedical images. In this regard, we…

Image and Video Processing · Electrical Eng. & Systems 2026-02-23 Yuli Wu , Weidong He , Dennis Eschweiler , Ningxin Dou , Zixin Fan , Shengli Mi , Peter Walter , Johannes Stegmaier

The Segment Anything Model (SAM) stands as a foundational framework for image segmentation. While it exhibits remarkable zero-shot generalization in typical scenarios, its advantage diminishes when applied to specialized domains like…

Computer Vision and Pattern Recognition · Computer Science 2024-02-01 Zihan Zhong , Zhiqiang Tang , Tong He , Haoyang Fang , Chun Yuan

Existing text-to-image models often rely on parameter fine-tuning techniques such as Low-Rank Adaptation (LoRA) to customize visual attributes. However, when combining multiple LoRA models for content-style fusion tasks, unstructured…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Jiahui Yang , Yongjia Ma , Donglin Di , Hao Li , Wei Chen , Yan Xie , Jianxun Cui , Xun Yang , Wangmeng Zuo

In recent years, Large Language Models (LLMs) through Transformer structures have dominated many machine learning tasks, especially text processing. However, these models require massive amounts of data for training and induce high resource…

Machine Learning · Computer Science 2025-04-17 Kilian Pfeiffer , Mohamed Aboelenien Ahmed , Ramin Khalili , Jörg Henkel

Federated learning (FL) for large language models (LLMs) has attracted increasing attention as a privacy-preserving approach for adapting models over distributed data, where parameter-efficient methods such as Low-Rank Adaptation (LoRA) are…

Machine Learning · Computer Science 2026-01-30 Zhikang Shen , Jianrong Lu , Haiyuan Wan , Jianhai Chen

Convolutional networks, transformers, hybrid models, and Mamba-based architectures have demonstrated strong performance across various medical image classification tasks. However, these methods were primarily designed to classify clean…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Omid Nejati Manzari , Hojat Asgariandehkordi , Taha Koleilat , Yiming Xiao , Hassan Rivaz

Histopathology remains the gold standard for cancer diagnosis because it provides detailed cellular-level assessment of tissue morphology. However, manual histopathological examination is time-consuming, labour-intensive, and subject to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Ravi Mosalpuri , Mohammed Abdelsamea , Ahmed Karam Eldaly

Fine-tuning large diffusion models for custom applications demands substantial power and time, which poses significant challenges for efficient implementation on mobile devices. In this paper, we develop a novel training accelerator…

Graphics · Computer Science 2025-04-14 Jinming Lu , Minghao She , Wendong Mao , Zhongfeng Wang

Vision Transformers (ViTs) have achieved significant advancement in computer vision tasks due to their powerful modeling capacity. However, their performance notably degrades when trained with insufficient data due to lack of inherent…

Image and Video Processing · Electrical Eng. & Systems 2025-03-04 Omar S. EL-Assiouti , Ghada Hamed , Dina Khattab , Hala M. Ebied