English
Related papers

Related papers: Order-preserving Consistency Regularization for Do…

200 papers

Semantic segmentation requires a lot of training data, which necessitates costly annotation. There have been many studies on unsupervised domain adaptation (UDA) from one domain to another, e.g., from computer graphics to real images.…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Zhijie Wang , Xing Liu , Masanori Suganuma , Takayuki Okatani

Deep learning based object detectors struggle generalizing to a new target domain bearing significant variations in object and background. Most current methods align domains by using image or instance-level adversarial feature alignment.…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Muhammad Akhtar Munir , Muhammad Haris Khan , M. Saquib Sarfraz , Mohsen Ali

Consistency regularization (CR) improves the robustness and accuracy of Connectionist Temporal Classification (CTC) by ensuring predictions remain stable across input perturbations. In this work, we propose Align-Consistency, an extension…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-27 Wanting Huang , Weiran Wang

Optical character recognition (OCR) is a widely used pattern recognition application in numerous domains. There are several feature-rich, general-purpose OCR solutions available for consumers, which can provide moderate to excellent…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Ayantha Randika , Nilanjan Ray , Xiao Xiao , Allegra Latimer

Coherence is an important aspect of text quality and is crucial for ensuring its readability. One important limitation of existing coherence models is that training on one domain does not easily generalize to unseen categories of text.…

Computation and Language · Computer Science 2019-07-10 Peng Xu , Hamidreza Saghir , Jin Sung Kang , Teng Long , Avishek Joey Bose , Yanshuai Cao , Jackie Chi Kit Cheung

Deep learning-based multi-source unsupervised domain adaptation (MUDA) has been actively studied in recent years. Compared with single-source unsupervised domain adaptation (SUDA), domain shift in MUDA exists not only between the source and…

Computer Vision and Pattern Recognition · Computer Science 2021-06-17 Zhipeng Luo , Xiaobing Zhang , Shijian Lu , Shuai Yi

Recent studies have shown that deep neural networks are not well-calibrated and often produce over-confident predictions. The miscalibration issue primarily stems from using cross-entropy in classifications, which aims to align predicted…

Machine Learning · Computer Science 2025-02-05 Daehwan Kim , Haejun Chung , Ikbeom Jang

Contrastive representation learning (CRL) underpins many modern foundation models. Despite recent theoretical progress, existing analyses suffer from several key limitations: (i) the statistical consistency of CRL remains poorly understood;…

Machine Learning · Computer Science 2026-05-29 Yuanfan Li , Xiyuan Wei , Tianbao Yang , Yiming Ying

In search of robust and generalizable machine learning models, Domain Generalization (DG) has gained significant traction during the past few years. The goal in DG is to produce models which continue to perform well when presented with data…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Aristotelis Ballas , Christos Diou

Domain Randomization (DR) is commonly used for sim2real transfer of reinforcement learning (RL) policies in robotics. Most DR approaches require a simulator with a fixed set of tunable parameters from the start of the training, from which…

Deep neural networks are a promising approach towards multi-task learning because of their capability to leverage knowledge across domains and learn general purpose representations. Nevertheless, they can fail to live up to these promises…

Machine Learning · Computer Science 2019-12-17 Mihai Suteu , Yike Guo

The idea behind object-centric representation learning is that natural scenes can better be modeled as compositions of objects and their relations as opposed to distributed representations. This inductive bias can be injected into neural…

Machine Learning · Computer Science 2022-06-10 Andrea Dittadi , Samuele Papa , Michele De Vita , Bernhard Schölkopf , Ole Winther , Francesco Locatello

Classical approaches for one-class problems such as one-class SVM and isolation forest require careful feature engineering when applied to structured domains like images. State-of-the-art methods aim to leverage deep learning to learn…

Machine Learning · Computer Science 2020-08-18 Sachin Goyal , Aditi Raghunathan , Moksh Jain , Harsha Vardhan Simhadri , Prateek Jain

Detecting Out-of-Domain (OOD) or unknown intents from user queries is essential in a task-oriented dialog system. A key challenge of OOD detection is to learn discriminative semantic features. Traditional cross-entropy loss only focuses on…

Computation and Language · Computer Science 2021-06-01 Zhiyuan Zeng , Keqing He , Yuanmeng Yan , Zijun Liu , Yanan Wu , Hong Xu , Huixing Jiang , Weiran Xu

Consistent Recalibration models (CRC) have been introduced to capture in necessary generality the dynamic features of term structures of derivatives' prices. Several approaches have been suggested to tackle this problem, but all of them,…

Computational Finance · Quantitative Finance 2021-07-02 Matteo Gambara , Josef Teichmann

Despite growing interest in object detection, very few works address the extremely practical problem of cross-domain robustness especially for automative applications. In order to prevent drops in performance due to domain shift, we…

Computer Vision and Pattern Recognition · Computer Science 2022-05-26 Sushruth Nagesh , Shreyas Rajesh , Asfiya Baig , Savitha Srinivasan

Unlike traditional learning to rank models that depend on hand-crafted features, neural representation learning models learn higher level features for the ranking task by training on large datasets. Their ability to learn new features…

Information Retrieval · Computer Science 2018-05-10 Daniel Cohen , Bhaskar Mitra , Katja Hofmann , W. Bruce Croft

Self-supervised learning has been widely used to obtain transferrable representations from unlabeled images. Especially, recent contrastive learning methods have shown impressive performances on downstream image classification tasks. While…

Computer Vision and Pattern Recognition · Computer Science 2021-04-29 Byungseok Roh , Wuhyun Shin , Ildoo Kim , Sungwoong Kim

A typical domain adaptation approach is to adapt models trained on the annotated data in a source domain (e.g., sunny weather) for achieving high performance on the test data in a target domain (e.g., rainy weather). Whether the target…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Ziwei Liu , Zhongqi Miao , Xingang Pan , Xiaohang Zhan , Dahua Lin , Stella X. Yu , Boqing Gong

Recent advances in unsupervised domain adaptation mainly focus on learning shared representations by global distribution alignment without considering class information across domains. The neglect of class information, however, may lead to…

Computer Vision and Pattern Recognition · Computer Science 2019-04-16 Chao Chen , Zhihang Fu , Zhihong Chen , Zhaowei Cheng , Xinyu Jin , Xian-Sheng Hua