English
Related papers

Related papers: PeerDA: Data Augmentation via Modeling Peer Relati…

200 papers

Protein language models have excelled in a variety of tasks, ranging from structure prediction to protein engineering. However, proteins are highly diverse in functions and structures, and current state-of-the-art models including the…

Biomolecules · Quantitative Biology 2023-02-27 Chang Ma , Haiteng Zhao , Lin Zheng , Jiayi Xin , Qintong Li , Lijun Wu , Zhihong Deng , Yang Lu , Qi Liu , Lingpeng Kong

Every data selection method inherently has a target. In practice, these targets often emerge implicitly through benchmark-driven iteration: researchers develop selection strategies, train models, measure benchmark performance, then refine…

Domain adaptation targets at knowledge acquisition and dissemination from a labeled source domain to an unlabeled target domain under distribution shift. Still, the common requirement of identical class space shared across domains hinders…

Machine Learning · Computer Science 2022-03-16 Zhangjie Cao , Kaichao You , Ziyang Zhang , Jianmin Wang , Mingsheng Long

This paper presents an effective and general data augmentation framework for medical image segmentation. We adopt a computationally efficient and data-efficient gradient-based meta-learning scheme to explicitly align the distribution of…

Computer Vision and Pattern Recognition · Computer Science 2023-05-31 Zeju Li , Konstantinos Kamnitsas , Qi Dou , Chen Qin , Ben Glocker

Handwritten text and scene text suffer from various shapes and distorted patterns. Thus training a robust recognition model requires a large amount of data to cover diversity as much as possible. In contrast to data collection and…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Canjie Luo , Yuanzhi Zhu , Lianwen Jin , Yongpan Wang

Large language models record impressive performance on many natural language processing tasks. However, their knowledge capacity is limited to the pretraining corpus. Retrieval augmentation offers an effective solution by retrieving context…

Computation and Language · Computer Science 2023-11-22 Sai Munikoti , Anurag Acharya , Sridevi Wagle , Sameera Horawalavithana

We propose PeTra, a memory-augmented neural network designed to track entities in its memory slots. PeTra is trained using sparse annotation from the GAP pronoun resolution dataset and outperforms a prior memory model on the task while…

Computation and Language · Computer Science 2020-05-07 Shubham Toshniwal , Allyson Ettinger , Kevin Gimpel , Karen Livescu

Random data augmentation is a critical technique to avoid overfitting in training deep neural network models. However, data augmentation and network training are usually treated as two isolated processes, limiting the effectiveness of…

Computer Vision and Pattern Recognition · Computer Science 2018-05-25 Xi Peng , Zhiqiang Tang , Fei Yang , Rogerio Feris , Dimitris Metaxas

Supervised deep learning methods for segmentation require large amounts of labelled training data, without which they are prone to overfitting, not generalizing well to unseen images. In practice, obtaining a large number of annotations…

Computer Vision and Pattern Recognition · Computer Science 2019-03-01 Krishna Chaitanya , Neerav Karani , Christian Baumgartner , Olivio Donati , Anton Becker , Ender Konukoglu

Data augmentation has attracted a lot of research attention in the deep learning era for its ability in alleviating data sparseness. The lack of labeled data for unseen evaluation databases is exactly the major challenge for cross-domain…

Computation and Language · Computer Science 2022-11-16 Kun Wu , Lijie Wang , Zhenghua Li , Ao Zhang , Xinyan Xiao , Hua Wu , Min Zhang , Haifeng Wang

Data augmentation, a technique in which a training set is expanded with class-preserving transformations, is ubiquitous in modern machine learning pipelines. In this paper, we seek to establish a theoretical framework for understanding data…

Machine Learning · Computer Science 2019-03-21 Tri Dao , Albert Gu , Alexander J. Ratner , Virginia Smith , Christopher De Sa , Christopher Ré

While hyperspectral images (HSI) benefit from numerous spectral channels that provide rich information for classification, the increased dimensionality and sensor variability make them more sensitive to distributional discrepancies across…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Taiqin Chen , Yifeng Wang , Xiaochen Feng , Zhilin Zhu , Hao Sha , Yingjian Li , Yongbing Zhang

Training in unsupervised time series anomaly detection is constantly plagued by the discrimination between harmful `anomaly contaminations' and beneficial `hard normal samples'. These two samples exhibit analogous loss behavior that…

Machine Learning · Computer Science 2026-03-17 Ruyi Zhang , Hongzuo Xu , Songlei Jian , Yusong Tan , Haifang Zhou , Rulin Xu

Recent attention has been devoted to the pursuit of learning semantic segmentation models exclusively from image tags, a paradigm known as image-level Weakly Supervised Semantic Segmentation (WSSS). Existing attempts adopt the Class…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Ye Du , Zehua Fu , Qingjie Liu

Due to the emergence of various wireless sensing technologies, numerous positioning algorithms have been introduced in the literature, categorized into \emph{geometry-driven positioning} (GP) and \emph{data-driven positioning} (DP). These…

Information Theory · Computer Science 2023-04-11 Seung Min Yu , Jihong Park , Seung-Woo Ko

Training data attribution (TDA) methods aim to measure how training data impacts a model's predictions. While gradient-based attribution methods, such as influence functions, offer theoretical grounding, their computational costs make them…

Machine Learning · Computer Science 2025-11-27 Weiwei Sun , Haokun Liu , Nikhil Kandpal , Colin Raffel , Yiming Yang

Reward models are pivotal for aligning Large Language Models (LLMs) with human preferences. Existing approaches face two key limitations: Discriminative reward models require large-scale annotated data, as they cannot exploit the preference…

Computation and Language · Computer Science 2026-02-03 Yongfu Xue

Prior studies in privacy policies frame the question answering (QA) task as identifying the most relevant text segment or a list of sentences from a policy document given a user query. Existing labeled datasets are heavily imbalanced (only…

Computation and Language · Computer Science 2023-04-25 Md Rizwan Parvez , Jianfeng Chi , Wasi Uddin Ahmad , Yuan Tian , Kai-Wei Chang

Mixed Sample Data Augmentation (MSDA) techniques, such as Mixup, CutMix, and PuzzleMix, have been widely acknowledged for enhancing performance in a variety of tasks. A previous study reported the class dependency of traditional data…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Haeil Lee , Hansang Lee , Junmo Kim

Recent advances in large pre-trained language models (PLMs) lead to impressive gains in natural language understanding (NLU) tasks with task-specific fine-tuning. However, directly fine-tuning PLMs heavily relies on sufficient labeled…

Computation and Language · Computer Science 2023-03-24 Canyu Chen , Kai Shu