English
Related papers

Related papers: Efficient Model Adaptation for Continual Learning …

200 papers

Automatic Modulation Recognition (AMR) plays a crucial role in wireless communication systems. Deep learning AMR strategies have achieved tremendous success in recent years. Modulated signals exhibit long temporal dependencies, and…

Signal Processing · Electrical Eng. & Systems 2024-01-03 Yunpeng Qu , Zhilin Lu , Rui Zeng , Jintao Wang , Jian Wang

Detecting machine-generated text (MGT) has emerged as a critical challenge, driven by the rapid advancement of large language models (LLMs) capable of producing highly realistic, human-like content. However, the performance of current…

Computation and Language · Computer Science 2025-11-04 Guoxin Ma , Xiaoming Liu , Zhanhan Zhang , Chengzhengxu Li , Shengchao Liu , Yu Lan

In this paper, we develop a general theory for adaptive nonparametric estimation of the mean function of a non-stationary and nonlinear time series model using deep neural networks (DNNs). We first consider two types of DNN estimators,…

Statistics Theory · Mathematics 2024-05-06 Daisuke Kurisu , Riku Fukami , Yuta Koike

While training on samples drawn from independent and identical distribution has been a de facto paradigm for optimizing image classification networks, humans learn new concepts in an easy-to-hard manner and on the selected examples…

Computer Vision and Pattern Recognition · Computer Science 2020-10-16 Bowen Cheng , Yunchao Wei , Jiahui Yu , Shiyu Chang , Jinjun Xiong , Wen-Mei Hwu , Thomas S. Huang , Humphrey Shi

Network regularization is an effective tool for incorporating structural prior knowledge to learn coherent models over networks, and has yielded provably accurate estimates in applications ranging from spatial economics to neuroimaging…

Machine Learning · Computer Science 2020-06-02 Hongyuan You , Furkan Kocayusufoglu , Ambuj K. Singh

Mathematical theory shows us that multilayer feedforward Artificial Neural Networks(ANNs) are universal function approximators, capable of approximating any measurable function to any desired degree of accuracy. In practice designing…

Neural and Evolutionary Computing · Computer Science 2019-05-14 Philip Colangelo , Oren Segal , Alexander Speicher , Martin Margala

Compressed Deep Learning (DL) models are essential for deployment in resource-constrained environments. But their performance often lags behind their large-scale counterparts. To bridge this gap, we propose Alignment Adapter (AlAd): a…

Machine Learning · Computer Science 2026-02-17 Rohit Raj Rai , Abhishek Dhaka , Amit Awekar

Electroencephalography (EEG) headsets are the most commonly used sensing devices for Brain-Computer Interface. In real-world applications, there are advantages to extrapolating data from one user session to another. However, these…

Machine Learning · Computer Science 2017-02-10 Dongrui Wu , Vernon J. Lawhern , W. David Hairston , Brent J. Lance

Pervasive AI increasingly depends on on-device learning systems that deliver low-latency and energy-efficient computation under strict resource constraints. Liquid State Machines (LSMs) offer a promising approach for low-power temporal…

Machine Learning · Computer Science 2026-01-09 Zain Iqbal , Lorenzo Valerio

Out-of-distribution (OOD) detection is essential for the reliability of ML models. Most existing methods for OOD detection learn a fixed decision criterion from a given in-distribution dataset and apply it universally to decide if a data…

Machine Learning · Computer Science 2023-11-29 YiFan Zhang , Xue Wang , Tian Zhou , Kun Yuan , Zhang Zhang , Liang Wang , Rong Jin , Tieniu Tan

We introduce a deep learning (DL) framework for inverse problems in imaging, and demonstrate the advantages and applicability of this approach in passive synthetic aperture radar (SAR) image reconstruction. We interpret image recon-…

Computer Vision and Pattern Recognition · Computer Science 2018-03-14 Bariscan Yonel , Eric Mason , Birsen Yazıcı

In practice, machine learning methods commonly require anomaly detection (AD) to filter inputs or detect distributional shifts. Typically, this is implemented by running a separate AD model alongside the primary model. However, this…

Machine Learning · Computer Science 2026-03-19 Luca Hinkamp , Simon Klüttermann , Emmanuel Müller

The ubiquitous use of IoT and machine learning applications is creating large amounts of data that require accurate and real-time processing. Although edge-based smart data processing can be enabled by deploying pretrained models, the…

Machine Learning · Computer Science 2021-09-15 Yinghan Long , Indranil Chakraborty , Gopalakrishnan Srinivasan , Kaushik Roy

The empowering unmanned aerial vehicles (UAVs) have been extensively used in providing intelligence such as target tracking. In our field experiments, a pre-trained convolutional neural network (CNN) is deployed at the UAV to identify a…

Image and Video Processing · Electrical Eng. & Systems 2020-08-19 Bo Yang , Xuelin Cao , Chau Yuen , Lijun Qian

The exponential proliferation of mobile devices and data-intensive applications in future wireless networks imposes substantial computational burdens on resource-constrained devices, thereby fostering the emergence of over-the-air…

Signal Processing · Electrical Eng. & Systems 2025-12-24 Tuo Wu , Xiazhi Lai , Shihang Lu , Zihao Chen , Xiaotong Zhao , Yuanhao Cui

Deep Learning (DL) models can be used to tackle time series analysis tasks with great success. However, the performance of DL models can degenerate rapidly if the data are not appropriately normalized. This issue is even more apparent when…

Computational Finance · Quantitative Finance 2019-09-24 Nikolaos Passalis , Anastasios Tefas , Juho Kanniainen , Moncef Gabbouj , Alexandros Iosifidis

For many years, Evolutionary Algorithms (EAs) have been applied to improve Neural Networks (NNs) architectures. They have been used for solving different problems, such as training the networks (adjusting the weights), designing network…

Neural and Evolutionary Computing · Computer Science 2022-11-14 Sebastián Basterrech , Tarun Kumar Sharma

Continual learning, also known as lifelong learning or incremental learning, refers to the process by which a model learns from a stream of incoming data over time. A common problem in continual learning is the classification layer's bias…

Computer Vision and Pattern Recognition · Computer Science 2025-01-27 Haoran Chen , Micah Goldblum , Zuxuan Wu , Yu-Gang Jiang

On-device training for personalized learning is a challenging research problem. Being able to quickly adapt deep prediction models at the edge is necessary to better suit personal user needs. However, adaptation on the edge poses some…

Machine Learning · Computer Science 2021-05-28 Lorenzo Pellegrini , Vincenzo Lomonaco , Gabriele Graffieti , Davide Maltoni

In many open environment applications, data are collected in the form of a stream, which exhibits an evolving distribution over time. How to design algorithms to track these evolving data distributions with provable guarantees, particularly…

Machine Learning · Computer Science 2024-11-06 Chao Xu , Xijia Tang , Guoqing Liu , Yuhua Qian , Chenping Hou