English
Related papers

Related papers: DRIFT: Data Reduction via Informative Feature Tran…

200 papers

We hypothesize that a key bottleneck in generalizable robot manipulation is not solely data scale or policy capacity, but a structural mismatch between current visual backbones and the physical requirements of closed-loop control. While…

Robotics · Computer Science 2026-02-13 Yu Deng , Yufeng Jin , Xiaogang Jia , Jiahong Xue , Gerhard Neumann , Georgia Chalvatzaki

Early-exit deep neural networks enable adaptive inference by terminating computation when sufficient confidence is achieved, reducing cost for edge AI accelerators in resource-constrained settings. Existing methods, however, rely on…

Hardware Architecture · Computer Science 2026-03-16 Parth Patne , Mahdi Taheri , Christian Herglotz , Maksim Jenihhin , Milos Krstic , Michael Hübner

The deep learning-based analysis of medical images suffers from data scarcity because of high annotation costs and privacy concerns. Researchers in this domain have used transfer learning to avoid overfitting when using complex…

Image and Video Processing · Electrical Eng. & Systems 2022-04-29 Yasar Mehmood , Usama Ijaz Bajwa , Xianfang Sun

Due to its deficiency in prior knowledge (inductive bias), Vision Transformer (ViT) requires pre-training on large-scale datasets to perform well. Moreover, the growing layers and parameters in ViT models impede their applicability to…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Chenhao Xu , Chang-Tsun Li , Chee Peng Lim , Douglas Creighton

Foundation models encode rich representations that can be adapted to downstream tasks by fine-tuning. However, fine-tuning a model on one data distribution often degrades performance under distribution shifts. Current approaches to robust…

Machine Learning · Computer Science 2024-03-15 Caroline Choi , Yoonho Lee , Annie Chen , Allan Zhou , Aditi Raghunathan , Chelsea Finn

Text-to-image generation models represent the next step of evolution in image synthesis, offering a natural way to achieve flexible yet fine-grained control over the result. One emerging area of research is the fast adaptation of large…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Anton Voronov , Mikhail Khoroshikh , Artem Babenko , Max Ryabinin

Machine Unlearning (MU) aims at removing the influence of specific data from a pretrained model while preserving performance on the remaining data. In this work, a novel perspective for MU is presented upon low-dimensional feature…

Machine Learning · Computer Science 2026-02-02 Kun Fang , Qinghua Tao , Junxu Liu , Yaxin Xiao , Qingqing Ye , Jian Sun , Haibo Hu

Domain Generation Algorithms (DGAs) evolve continuously to evade botnet detection, posing a persistent challenge for dependable network defense. While deep learning-based detectors achieve strong performance under static conditions, they…

Cryptography and Security · Computer Science 2026-05-12 Chaeyoung Lee , Chaeri Jung , Seonghoon Jeong

Recent neuroimaging studies have highlighted the importance of network-centric brain analysis, particularly with functional magnetic resonance imaging. The emergence of Deep Neural Networks has fostered a substantial interest in predicting…

Neurons and Cognition · Quantitative Biology 2023-09-06 Xuan Kan , Antonio Aodong Chen Gu , Hejie Cui , Ying Guo , Carl Yang

Limited labeled data makes it hard to train models from scratch in medical domain, and an important paradigm is pre-training and then fine-tuning. Large pre-trained models contain rich representations, which can be adapted to downstream…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Along He , Kai Wang , Zhihong Wang , Tao Li , Huazhu Fu

Handling geometric transformations, particularly rotations, remains a challenge in deep learning for computer vision. Standard neural networks lack inherent rotation invariance and typically rely on data augmentation or architectural…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Cristian Valero-Abundio , Emilio Sansano-Sansano , Raúl Montoliu , Marina Martínez García

The rapid advancement of deep learning models often attributes to their ability to leverage massive training data. In contrast, such privilege has not yet fully benefited 3D deep learning, mainly due to the limited availability of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Xiaoyang Wu , Zhuotao Tian , Xin Wen , Bohao Peng , Xihui Liu , Kaicheng Yu , Hengshuang Zhao

Modern deep learning models in computer vision require large datasets of real images, which are difficult to curate and pose privacy and legal concerns, limiting their commercial use. Recent works suggest synthetic data as an alternative,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Farnood Salehi , Vandit Sharma , Amirhossein Askari Farsangi , Tunç Ozan Aydın

General-purpose pre-trained models ("foundation models") have enabled practitioners to produce generalizable solutions for individual machine learning problems with datasets that are significantly smaller than those required for learning…

Robotics · Computer Science 2023-10-25 Dhruv Shah , Ajay Sridhar , Nitish Dashora , Kyle Stachowicz , Kevin Black , Noriaki Hirose , Sergey Levine

We present a comprehensive overview of the Deep Image Prior (DIP) framework and its applications to image reconstruction in computed tomography. Unlike conventional deep learning methods that rely on large, supervised datasets, the DIP…

Image and Video Processing · Electrical Eng. & Systems 2026-02-24 Simon Arridge , Riccardo Barbano , Alexander Denker , Zeljko Kereta

Reinforcement learning with verifiable rewards (RLVR) can yield large reasoning gains from very few training instances, yet its strong sensitivity to which instances are used makes data selection a central bottleneck. Most existing…

Machine Learning · Computer Science 2026-05-28 Jianghao Wu , Jianfei Cai , Weiqiang Wang , Jin Ye , Daniel F. Schmidt , Yasmeen George

Foundation models pretrained on large-scale natural images are widely adapted to various cross-domain low-resource downstream tasks, benefiting from generalizable and transferable patterns captured by their representations. However, these…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Wenqiang Zu , Shenghao Xie , Hao Chen , Zhiqiang Chen , Liwen Hu , Yuanhao Xi , Yiming Liang , Junliang Ye , Bo Lei , Tiejun Huang , Guoqi Li , Lei Ma

Very deep convolutional neural networks offer excellent recognition results, yet their computational expense limits their impact for many real-world applications. We introduce BlockDrop, an approach that learns to dynamically choose which…

Computer Vision and Pattern Recognition · Computer Science 2019-01-29 Zuxuan Wu , Tushar Nagarajan , Abhishek Kumar , Steven Rennie , Larry S. Davis , Kristen Grauman , Rogerio Feris

Massive data is often considered essential for deep learning applications, but it also incurs significant computational and infrastructural costs. Therefore, dataset pruning (DP) has emerged as an effective way to improve data efficiency by…

Machine Learning · Computer Science 2023-11-21 Yihua Zhang , Yimeng Zhang , Aochuan Chen , Jinghan Jia , Jiancheng Liu , Gaowen Liu , Mingyi Hong , Shiyu Chang , Sijia Liu

Despite remarkable progress in computer vision, modern recognition systems remain fundamentally limited by their dependence on rich, redundant visual inputs. In contrast, humans can effortlessly understand sparse, minimal representations…

Computer Vision and Pattern Recognition · Computer Science 2025-11-13 Tianqin Li , George Liu , Tai Sing Lee