English
Related papers

Related papers: DARDA: Domain-Aware Real-Time Dynamic Neural Netwo…

200 papers

This article presents a comprehensive survey of online test-time adaptation (OTTA), focusing on effectively adapting machine learning models to distributionally different target data upon batch arrival. Despite the recent proliferation of…

Artificial Intelligence · Computer Science 2024-07-19 Zixin Wang , Yadan Luo , Liang Zheng , Zhuoxiao Chen , Sen Wang , Zi Huang

As Deep Neural Networks (DNNs) are increasingly deployed in safety critical and privacy sensitive applications such as autonomous driving and biometric authentication, it is critical to understand the fault-tolerance nature of DNNs. Prior…

Hardware Architecture · Computer Science 2024-01-09 Abhishek Tyagi , Yiming Gan , Shaoshan Liu , Bo Yu , Paul Whatmough , Yuhao Zhu

Continual Test-time adaptation (CTTA) continuously adapts the deployed model on every incoming batch of data. While achieving optimal accuracy, existing CTTA approaches present poor real-world applicability on resource-constrained edge…

Machine Learning · Computer Science 2026-04-21 Xiao Ma , Young D. Kwon , Dong Ma

Building extraction $-$ needed for inventory management and planning of urban environment $-$ is affected by the misalignment between labels and off-nadir source imagery in training data. Teacher-Student learning of noise-tolerant…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Bipul Neupane , Jagannath Aryal , Abbas Rajabifard

Test-time adaptation (TTA) addresses distribution shifts for streaming test data in unsupervised settings. Currently, most TTA methods can only deal with minor shifts and rely heavily on heuristic and empirical studies. To advance TTA under…

Machine Learning · Computer Science 2024-04-09 Shurui Gui , Xiner Li , Shuiwang Ji

To meet the demand for designing efficient neural networks with appropriate trade-offs between model performance (e.g., classification accuracy) and computational complexity, the differentiable neural architecture distillation (DNAD)…

Machine Learning · Computer Science 2025-04-30 Xuan Rao , Bo Zhao , Derong Liu

Test-time adaptation (TTA) intends to adapt the pretrained model to test distributions with only unlabeled test data streams. Most of the previous TTA methods have achieved great success on simple test data streams such as independently…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Longhui Yuan , Binhui Xie , Shuang Li

Speech distortions are a long-standing problem that degrades the performance of supervisely trained speech processing models. It is high time that we enhance the robustness of speech processing models to obtain good performance when…

Sound · Computer Science 2022-07-26 Kuan Po Huang , Yu-Kuan Fu , Yu Zhang , Hung-yi Lee

Deep neural networks often degrade under distribution shifts. Although domain adaptation offers a solution, privacy constraints often prevent access to source data, making Test-Time Adaptation (TTA, which adapts using only unlabeled test…

Machine Learning · Computer Science 2025-06-10 Linjing You , Jiabao Lu , Xiayuan Huang

Deep unsupervised domain adaptation (UDA) has recently received increasing attention from researchers. However, existing methods are computationally intensive due to the computation cost of Convolutional Neural Networks (CNN) adopted by…

Machine Learning · Computer Science 2019-04-05 Chaohui Yu , Jindong Wang , Yiqiang Chen , Zijing Wu

Optical flow models trained on high-quality data often degrade severely when confronted with real-world corruptions such as blur, noise, and compression artifacts. To overcome this limitation, we formulate Degradation-Aware Optical Flow, a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Jaewon Min , Jaeeun Lee , Yeji Choi , Paul Hyunbin Cho , Jin Hyeon Kim , Tae-Young Lee , Jongsik Ahn , Hwayeong Lee , Seonghyun Park , Seungryong Kim

Previous robustness approaches for deep learning models such as data augmentation techniques via data transformation or adversarial training cannot capture real-world variations that preserve the semantics of the input, such as a change in…

Computer Vision and Pattern Recognition · Computer Science 2021-05-11 Shuo Wang , Lingjuan Lyu , Surya Nepal , Carsten Rudolph , Marthie Grobler , Kristen Moore

Recently, Temporal Graph Neural Networks (TGNNs) have demonstrated state-of-the-art performance in various high-impact applications, including fraud detection and content recommendation. Despite the success of TGNNs, they are prone to the…

Machine Learning · Computer Science 2024-11-26 Gangda Deng , Hongkuan Zhou , Hanqing Zeng , Yinglong Xia , Christopher Leung , Jianbo Li , Rajgopal Kannan , Viktor Prasanna

Test-time adaptation (TTA) aims to improve the performance of source-domain pre-trained models on previously unseen, shifted target domains. Traditional TTA methods primarily adapt model weights based on target data streams, making model…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Jiayi Guo , Junhao Zhao , Chaoqun Du , Yulin Wang , Chunjiang Ge , Zanlin Ni , Shiji Song , Humphrey Shi , Gao Huang

Deep neural network (DNN) inference is increasingly being executed on mobile and embedded platforms due to several key advantages in latency, privacy and always-on availability. However, due to limited computing resources, efficient DNN…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Lei Xun , Jonathon Hare , Geoff V. Merrett

Low precision deep neural network (DNN) training is one of the most effective techniques for boosting DNNs' training efficiency, as it trims down the training cost from the finest bit level. While existing works mostly fix the model…

Machine Learning · Computer Science 2022-03-16 Zhongzhi Yu , Yonggan Fu , Shang Wu , Mengquan Li , Haoran You , Yingyan Lin

Discriminative features play an important role in image and object classification and also in other fields of research such as semi-supervised learning, fine-grained classification, out of distribution detection. Inspired by Linear…

Computer Vision and Pattern Recognition · Computer Science 2021-07-14 Mai Lan Ha , Gianni Franchi , Emanuel Aldea , Volker Blanz

Unsupervised Domain Adaptation (UDA) aims to leverage a label-rich source domain to solve tasks on a related unlabeled target domain. It is a challenging problem especially when a large domain gap lies between the source and target domains.…

Computer Vision and Pattern Recognition · Computer Science 2022-04-19 Tao Sun , Cheng Lu , Tianshuo Zhang , Haibin Ling

Nighttime UAV tracking under low-illuminated scenarios has achieved great progress by domain adaptation (DA). However, previous DA training-based works are deficient in narrowing the discrepancy of temporal contexts for UAV trackers. To…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 Changhong Fu , Yiheng Wang , Liangliang Yao , Guangze Zheng , Haobo Zuo , Jia Pan

Domain adaptation (DA) is the topical problem of adapting models from labelled source datasets so that they perform well on target datasets where only unlabelled or partially labelled data is available. Many methods have been proposed to…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Da Li , Timothy Hospedales