English
Related papers

Related papers: CRL+: A Novel Semi-Supervised Deep Active Contrast…

200 papers

Existing text recognition methods usually need large-scale training data. Most of them rely on synthetic training data due to the lack of annotated real images. However, there is a domain gap between the synthetic data and real data, which…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Mingkun Yang , Minghui Liao , Pu Lu , Jing Wang , Shenggao Zhu , Hualin Luo , Qi Tian , Xiang Bai

We explore a novel approach for Semantic Role Labeling (SRL) by casting it as a sequence-to-sequence process. We employ an attention-based model enriched with a copying mechanism to ensure faithful regeneration of the input sequence, while…

Computation and Language · Computer Science 2018-07-10 Angel Daza , Anette Frank

Semi-supervised learning (SSL) has achieved great success in leveraging a large amount of unlabeled data to learn a promising classifier. A popular approach is pseudo-labeling that generates pseudo labels only for those unlabeled data with…

Computer Vision and Pattern Recognition · Computer Science 2022-12-29 Qinyi Deng , Yong Guo , Zhibang Yang , Haolin Pan , Jian Chen

The exponential growth of data generated on the Internet in the current information age is a driving force for the digital economy. Extraction of information is the major value in an accumulated big data. Big data dependency on statistical…

Unsupervised cell type identification is crucial for uncovering and characterizing heterogeneous populations in single cell omics studies. Although a range of clustering methods have been developed, most focus exclusively on intrinsic…

Artificial Intelligence · Computer Science 2025-12-12 Liang Peng , Haopeng Liu , Yixuan Ye , Cheng Liu , Wenjun Shen , Si Wu , Hau-San Wong

We introduce Consistent Assignment for Representation Learning (CARL), an unsupervised learning method to learn visual representations by combining ideas from self-supervised contrastive learning and deep clustering. By viewing contrastive…

Machine Learning · Computer Science 2023-10-23 Thalles Silva , Adín Ramírez Rivera

Continual or lifelong learning has been a long-standing challenge in machine learning to date, especially in natural language processing (NLP). Although state-of-the-art language models such as BERT have ushered in a new era in this field…

Computation and Language · Computer Science 2021-09-21 Kyra Ahrens , Fares Abawi , Stefan Wermter

Implicit degradation modeling-based blind super-resolution (SR) has attracted more increasing attention in the community due to its excellent generalization to complex degradation scenarios and wide application range. How to extract more…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Jiang Yuan , Ji Ma , Bo Wang , Weiming Hu

Data-to-Text Generation (D2T), a classic natural language generation problem, aims at producing fluent descriptions for structured input data, such as a table. Existing D2T works mainly focus on describing the superficial associative…

Computation and Language · Computer Science 2024-08-16 Yuhao Dan , Junfeng Tian , Jie Zhou , Ming Yan , Ji Zhang , Qin Chen , Liang He

Sentence embeddings are an important component of many natural language processing (NLP) systems. Like word embeddings, sentence embeddings are typically learned on large text corpora and then transferred to various downstream tasks, such…

Computation and Language · Computer Science 2021-05-28 John Giorgi , Osvald Nitski , Bo Wang , Gary Bader

Purpose : Because functional MRI (fMRI) data sets are in general small, we sought a data efficient approach to resting state fMRI classification of autism spectrum disorder (ASD) versus neurotypical (NT) controls. We hypothesized that a…

Neurons and Cognition · Quantitative Biology 2022-06-23 Joseph Stember , Danielle Stember , Luca Pasquini , Jenabi Merhnaz , Andrei Holodny , Hrithwik Shalu

Semi-supervised learning on class-imbalanced data, although a realistic problem, has been under studied. While existing semi-supervised learning (SSL) methods are known to perform poorly on minority classes, we find that they still generate…

Computer Vision and Pattern Recognition · Computer Science 2021-06-18 Chen Wei , Kihyuk Sohn , Clayton Mellina , Alan Yuille , Fan Yang

Contrastive self-supervised learning has become a prominent technique in representation learning. The main step in these methods is to contrast semantically similar and dissimilar pairs of samples. However, in the domain of Natural Language…

Computation and Language · Computer Science 2022-06-07 Amrita Bhattacharjee , Mansooreh Karami , Huan Liu

Recently, image-text matching has attracted more and more attention from academia and industry, which is fundamental to understanding the latent correspondence across visual and textual modalities. However, most existing methods implicitly…

Computer Vision and Pattern Recognition · Computer Science 2024-01-09 Yang Qin , Yuan Sun , Dezhong Peng , Joey Tianyi Zhou , Xi Peng , Peng Hu

Unsupervised representation learning with variational inference relies heavily on independence assumptions over latent variables. Causal representation learning (CRL), however, argues that factors of variation in a dataset are, in fact,…

Machine Learning · Computer Science 2023-07-13 Avinash Kori , Pedro Sanchez , Konstantinos Vilouras , Ben Glocker , Sotirios A. Tsaftaris

Contrastive graph node clustering via learnable data augmentation is a hot research spot in the field of unsupervised graph learning. The existing methods learn the sampling distribution of a pre-defined augmentation to generate data-driven…

Machine Learning · Computer Science 2023-10-23 Xihong Yang , Cheng Tan , Yue Liu , Ke Liang , Siwei Wang , Sihang Zhou , Jun Xia , Stan Z. Li , Xinwang Liu , En Zhu

We propose a novel training method that integrates rules into deep learning, in a way the strengths of the rules are controllable at inference. Deep Neural Networks with Controllable Rule Representations (DeepCTRL) incorporates a rule…

Machine Learning · Computer Science 2021-11-18 Sungyong Seo , Sercan O. Arik , Jinsung Yoon , Xiang Zhang , Kihyuk Sohn , Tomas Pfister

In contemporary radiotherapy planning (RTP), a key module leaf sequencing is predominantly addressed by optimization-based approaches. In this paper, we propose a novel deep reinforcement learning (DRL) model termed as Reinforced Leaf…

Machine Learning · Computer Science 2024-06-05 Riqiang Gao , Florin C. Ghesu , Simon Arberet , Shahab Basiri , Esa Kuusela , Martin Kraus , Dorin Comaniciu , Ali Kamen

Traditional supervised learning with deep neural networks requires a tremendous amount of labelled data to converge to a good solution. For 3D medical images, it is often impractical to build a large homogeneous annotated dataset for a…

Causal representation learning (CRL) enhances machine learning models' robustness and generalizability by learning structural causal models associated with data-generating processes. We focus on a family of CRL methods that uses contrastive…

Machine Learning · Statistics 2025-03-17 Xiusi Li , Sékou-Oumar Kaba , Siamak Ravanbakhsh