English
Related papers

Related papers: DAPA: Distribution Aware Piecewise Activation Func…

200 papers

In this study, we propose an over-the-air computation (OAC) scheme to calculate the majority vote (MV) for federated edge learning (FEEL). With the proposed approach, edge devices (EDs) transmit the signs of local stochastic gradients,…

Information Theory · Computer Science 2022-10-14 Alphan Sahin

We present a new method for functional tissue unit segmentation at the cellular level, which utilizes the latest deep learning semantic segmentation approaches together with domain adaptation and semi-supervised learning techniques. This…

Image and Video Processing · Electrical Eng. & Systems 2023-12-14 Volodymyr Sydorskyi , Igor Krashenyi , Denis Sakva , Oleksandr Zarichkovyi

We propose a hardware-efficient RBD accelerator based on FPGA, introducing three key innovations. First, we propose a precision-aware quantization framework that reduces DSP demand while preserving motion accuracy. This is also the first…

Hardware Architecture · Computer Science 2025-11-25 Xingyu Liu , Jiawei Liang , Yipu Zhang , Linfeng Du , Chaofang Ma , Hui Yu , Jiang Xu , Wei Zhang

For time-critical IoT applications using deep learning, inference acceleration through distributed computing is a promising approach to meet a stringent deadline. In this paper, we implement a working prototype of a new distributed…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Zhongtian Dong , Nan Li , Alexandros Iosifidis , Qi Zhang

The rapid adaptation of data driven AI models, such as deep learning inference, training, Vision Transformers (ViTs), and other HPC applications, drives a strong need for runtime precision configurable different non linear activation…

Hardware Architecture · Computer Science 2026-02-12 Mukul Lokhande , Gopal Raut , Santosh Kumar Vishvakarma

Various health-care applications such as assisted living, fall detection etc., require modeling of user behavior through Human Activity Recognition (HAR). HAR using mobile- and wearable-based deep learning algorithms have been on the rise…

Machine Learning · Computer Science 2019-06-04 Gautham Krishna Gudur , Prahalathan Sundaramoorthy , Venkatesh Umaashankar

The self-attention mechanism, while foundational to modern Transformer architectures, suffers from a critical inefficiency: it frequently allocates substantial attention to redundant or noisy context. Differential Attention addressed this…

The increasing demand for intelligent mobile applications has made multi-agent collaboration with Transformer-based large language models (LLMs) essential in mobile edge computing (MEC) networks. However, training LLMs in such environments…

Systems and Control · Electrical Eng. & Systems 2025-09-25 Jiewei Chen , Xiumei Deng , Zehui Xiong , Shaoyong Guo , Xuesong Qiu , Ping Wang , Dusit Niyato

Denoising Diffusion Probabilistic Models (DDPMs) have garnered popularity for data generation across various domains. However, a significant bottleneck is the necessity for whole-network computation during every step of the generative…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Shuai Yang , Yukang Chen , Luozhou Wang , Shu Liu , Yingcong Chen

The need for flexibility and curtailable resources is crucial for ensuring the healthy operation of future distribution networks (DN). In this work, we propose a network-state driven framework that distribution system operators (DSOs) can…

Systems and Control · Electrical Eng. & Systems 2022-05-18 Md Umar Hashmi , Arpan Koirala , Hakan Ergun , Dirk Van Hertem

Interactive segmentation enables clinicians to guide annotation, but existing zero-shot models like nnInteractive fail to consistently reach expert-level performance across diverse medical imaging tasks. Because annotation campaigns produce…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Parhom Esmaeili , Chayanin Tangwiriyasakul , Eli Gibson , Sebastien Ourselin , M. Jorge Cardoso

We present a new tool, GPA, that can generate key performance measures for very large systems. Based on solving systems of ordinary differential equations (ODEs), this method of performance analysis is far more scalable than stochastic…

Performance · Computer Science 2010-06-29 Anton Stefanek , Richard Hayden , Jeremy Bradley

U-shaped architectures have long dominated the field of medical image segmentation, while Transformers are widely employed for modeling long-range dependencies. The former typically handles scale variations implicitly by aggregating…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Yanhua Zhang , Ke Zhang , Jingyu Wang , Gabriella Balestra , Samanta Rosati , Yulin Wu , Wuwei Wang , Valentina Giannini

Alpa automates model-parallel training of large deep learning (DL) models by generating execution plans that unify data, operator, and pipeline parallelism. Existing model-parallel training systems either require users to manually create a…

Data collected by IoT devices are often private and have a large diversity across users. Therefore, learning requires pre-training a model with available representative data samples, deploying the pre-trained model on IoT devices, and…

Machine Learning · Computer Science 2022-06-28 Zhongnan Qu , Zimu Zhou , Yongxin Tong , Lothar Thiele

To ensure the reliability of deep models in real-world applications, out-of-distribution (OOD) detection methods aim to distinguish samples close to the training distribution (in-distribution, ID) from those farther away (OOD). In this…

Machine Learning · Computer Science 2025-09-01 Barış Zöngür , Robin Hesse , Stefan Roth

The proposed method in this paper proposes an end-to-end unsupervised semantic segmentation architecture DMSA based on four loss functions. The framework uses Atrous Spatial Pyramid Pooling (ASPP) module to enhance feature extraction. At…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Kun Yang , Jun Lu

Large Language Models (LLMs), while demonstrating remarkable capabilities across various applications, present significant challenges during inference due to their substantial model size, especially when deployed on edge devices. Activation…

Machine Learning · Computer Science 2025-04-29 Zhenyu Zhang , Zechun Liu , Yuandong Tian , Harshit Khaitan , Zhangyang Wang , Steven Li

We propose a GPU-accelerated distributed optimization algorithm for controlling multi-phase optimal power flow in active distribution systems with dynamically changing topologies. To handle varying network configurations and enable…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-15 Minseok Ryu , Geunyeong Byeon , Kibaek Kim

Semantic segmentation of satellite imagery plays a vital role in land cover mapping and environmental monitoring. However, annotating large-scale, high-resolution satellite datasets is costly and time consuming, especially when covering…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Gadi Hemanth Kumar , Athira Nambiar , Pankaj Bodani