English
Related papers

Related papers: $d$-SNE: Domain Adaptation using Stochastic Neighb…

200 papers

Nearest neighbor (kNN) methods have been gaining popularity in recent years in light of advances in hardware and efficiency of algorithms. There is a plethora of methods to choose from today, each with their own advantages and…

Machine Learning · Computer Science 2017-03-01 Daniel Zoran , Balaji Lakshminarayanan , Charles Blundell

Purpose: Deep Neuroevolution (DNE) holds the promise of providing radiology artificial intelligence (AI) that performs well with small neural networks and small training sets. We seek to realize this potential via a proof-of-principle…

Neural and Evolutionary Computing · Computer Science 2021-12-28 Joseph N Stember , Hrithwik Shalu

Bridging the 'reality gap' that separates simulated robotics from experiments on hardware could accelerate robotic research through improved data availability. This paper explores domain randomization, a simple technique for training models…

Robotics · Computer Science 2017-03-22 Josh Tobin , Rachel Fong , Alex Ray , Jonas Schneider , Wojciech Zaremba , Pieter Abbeel

Deep learning has revolutionized neuroimage analysis by delivering unprecedented speed and accuracy. However, the narrow scope of many training datasets constrains model robustness and generalizability. This challenge is particularly acute…

Image and Video Processing · Electrical Eng. & Systems 2025-12-08 Malte Hoffmann

Domain adaptation (DA) is a representation learning methodology that transfers knowledge from a label-sufficient source domain to a label-scarce target domain. While most of early methods are focused on unsupervised DA (UDA), several…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Yoonhyung Kim , Changick Kim

Dimensionality reduction methods, also known as projections, are frequently used for exploring multidimensional data in machine learning, data science, and information visualization. Among these, t-SNE and its variants have become very…

Machine Learning · Computer Science 2019-02-22 Mateus Espadoto , Nina S. T. Hirata , Alexandru C. Telea

Datasets with significant proportions of noisy (incorrect) class labels present challenges for training accurate Deep Neural Networks (DNNs). We propose a new perspective for understanding DNN generalization for such datasets, by…

Computer Vision and Pattern Recognition · Computer Science 2018-08-01 Xingjun Ma , Yisen Wang , Michael E. Houle , Shuo Zhou , Sarah M. Erfani , Shu-Tao Xia , Sudanthi Wijewickrema , James Bailey

We propose a direct domain adaptation (DDA) approach to enrich the training of supervised neural networks on synthetic data by features from real-world data. The process involves a series of linear operations on the input features to the NN…

Machine Learning · Computer Science 2021-08-18 Tariq Alkhalifah , Oleg Ovcharenko

Training machine learning models based on neural networks requires large datasets, which may contain sensitive information. The models, however, should not expose private information from these datasets. Differentially private SGD [DP-SGD]…

Machine Learning · Computer Science 2024-09-26 Francisco Aguilera-Martínez , Fernando Berzal

This report contributes to the field of unsupervised domain adaptation by providing an analysis of existing methods, introducing a new approach, and demonstrating the potential for improving visual recognition tasks across different…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Artem Bituitskii

Deep neural networks (DNNs) have been recently found popular for image captioning problems in remote sensing (RS). Existing DNN based approaches rely on the availability of a training set made up of a high number of RS images with their…

Computer Vision and Pattern Recognition · Computer Science 2020-10-14 Gencer Sumbul , Sonali Nayak , Begüm Demir

Supervised learning with large scale labeled datasets and deep layered models has made a paradigm shift in diverse areas in learning and recognition. However, this approach still suffers generalization issues under the presence of a domain…

Machine Learning · Statistics 2016-03-28 Ozan Sener , Hyun Oh Song , Ashutosh Saxena , Silvio Savarese

Accurate approximation of scalar-valued functions from sample points is a key task in computational science. Recently, machine learning with Deep Neural Networks (DNNs) has emerged as a promising tool for scientific computing, with…

Machine Learning · Computer Science 2021-03-08 Ben Adcock , Simone Brugiapaglia , Nick Dexter , Sebastian Moraga

Unsupervised domain adaptation (UDA) aims to transfer and adapt knowledge from a labeled source domain to an unlabeled target domain. Traditionally, subspace-based methods form an important class of solutions to this problem. Despite their…

Machine Learning · Computer Science 2022-01-07 Kowshik Thopalli , Jayaraman J Thiagarajan , Rushil Anirudh , Pavan K Turaga

Recent deep networks achieved state of the art performance on a variety of semantic segmentation tasks. Despite such progress, these models often face challenges in real world `wild tasks' where large difference between labeled…

Computer Vision and Pattern Recognition · Computer Science 2018-10-26 Yang Zou , Zhiding Yu , B. V. K. Vijaya Kumar , Jinsong Wang

Motivated by the gap between theoretical optimal approximation rates of deep neural networks (DNNs) and the accuracy realized in practice, we seek to improve the training of DNNs. The adoption of an adaptive basis viewpoint of DNNs leads to…

Machine Learning · Computer Science 2019-12-11 Eric C. Cyr , Mamikon A. Gulian , Ravi G. Patel , Mauro Perego , Nathaniel A. Trask

Domain generalization (DG) is the challenging and topical problem of learning models that generalize to novel testing domains with different statistics than a set of known training domains. The simple approach of aggregating data from all…

Computer Vision and Pattern Recognition · Computer Science 2019-12-09 Da Li , Jianshu Zhang , Yongxin Yang , Cong Liu , Yi-Zhe Song , Timothy M. Hospedales

Deep Neural Networks (DNNs)-based semantic segmentation models trained on a source domain often struggle to generalize to unseen target domains, i.e., a domain gap problem. Texture often contributes to the domain gap, making DNNs vulnerable…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Sunghwan Kim , Dae-hwan Kim , Hoseong Kim

Learning the structure of Bayesian networks (BNs) from data is challenging, especially for datasets involving a large number of variables. The recently proposed divide-and-conquer (D\&D) strategies present a promising approach for learning…

Machine Learning · Computer Science 2025-07-01 Shengcai Liu , Hui Ou-yang , Zhiyuan Wang , Cheng Chen , Qijun Cai , Yew-Soon Ong , Ke Tang

Continual learning of deep neural networks is a key requirement for scaling them up to more complex applicative scenarios and for achieving real lifelong learning of these architectures. Previous approaches to the problem have considered…

Machine Learning · Computer Science 2020-06-25 Jary Pomponi , Simone Scardapane , Vincenzo Lomonaco , Aurelio Uncini