中文
相关论文

相关论文: Is In-Domain Data Really Needed? A Pilot Study on …

200 篇论文

Training neural networks is an optimization problem, and finding a decent set of parameters through gradient descent can be a difficult task. A host of techniques has been developed to aid this process before and during the training phase.…

机器学习 · 计算机科学 2020-08-19 Divya Gaur , Joachim Folz , Andreas Dengel

While coreference resolution is defined independently of dataset domain, most models for performing coreference resolution do not transfer well to unseen domains. We consolidate a set of 8 coreference resolution datasets targeting different…

计算与语言 · 计算机科学 2021-09-21 Shubham Toshniwal , Patrick Xia , Sam Wiseman , Karen Livescu , Kevin Gimpel

Probabilistic predictions from neural networks which account for predictive uncertainty during classification is crucial in many real-world and high-impact decision making settings. However, in practice most datasets are trained on…

机器学习 · 计算机科学 2022-09-30 Satya Borgohain , Klaus Ackermann , Ruben Loaiza-Maya

In-context learning enables transformer models to generalize to new tasks based solely on input prompts, without any need for weight updates. However, existing training paradigms typically rely on large, unstructured datasets that are…

We consider machine learning applications that train a model by leveraging data distributed over a trusted network, where communication constraints can create a performance bottleneck. A number of recent approaches propose to overcome this…

机器学习 · 计算机科学 2021-09-10 Osama A. Hanna , Yahya H. Ezzeldin , Christina Fragouli , Suhas Diggavi

Unlike traditional learning to rank models that depend on hand-crafted features, neural representation learning models learn higher level features for the ranking task by training on large datasets. Their ability to learn new features…

信息检索 · 计算机科学 2018-05-10 Daniel Cohen , Bhaskar Mitra , Katja Hofmann , W. Bruce Croft

Unsupervised Domain Adaptation (UDA) endeavors to adjust models trained on a source domain to perform well on a target domain without requiring additional annotations. In the context of domain adaptive semantic segmentation, which tackles…

计算机视觉与模式识别 · 计算机科学 2024-03-25 Wenlve Zhou , Zhiheng Zhou , Tianlei Wang , Delu Zeng

Applying an object detector, which is neither trained nor fine-tuned on data close to the final application, often leads to a substantial performance drop. In order to overcome this problem, it is necessary to consider a shift between…

计算机视觉与模式识别 · 计算机科学 2020-05-27 Alexey Abramov , Christopher Bayer , Claudio Heller

Domain adaptation techniques address the problem of reducing the sensitivity of machine learning methods to the so-called domain shift, namely the difference between source (training) and target (test) data distributions. In particular,…

计算机视觉与模式识别 · 计算机科学 2017-05-24 Pietro Morerio , Vittorio Murino

Deep Neural Networks have shown great promise on a variety of downstream applications; but their ability to adapt and generalize to new data and tasks remains a challenge. However, the ability to perform few or zero-shot adaptation to novel…

机器学习 · 计算机科学 2020-10-14 Samarth Sinha , Karsten Roth , Anirudh Goyal , Marzyeh Ghassemi , Hugo Larochelle , Animesh Garg

A pretrain-finetune strategy is widely used to reduce the overfitting that can occur when data is insufficient for CNN training. First few layers of a CNN pretrained on a large-scale RGB dataset are capable of acquiring general image…

计算机视觉与模式识别 · 计算机科学 2022-04-08 Hyungtae Lee , Sungmin Eum , Heesung Kwon

While deep learning has led to significant advances in visual recognition over the past few years, such advances often require a lot of annotated data. Unsupervised domain adaptation has emerged as an alternative approach that does not…

计算机视觉与模式识别 · 计算机科学 2018-12-03 Yunhan Zhao , Haider Ali , Rene Vidal

Current machine learning methods for medical image analysis primarily focus on developing models tailored for their specific tasks, utilizing data within their target domain. These specialized models tend to be data-hungry and often exhibit…

图像与视频处理 · 电气工程与系统科学 2024-07-08 Ece Ozkan , Xavier Boix

Deep learning models, including modern systems like large language models, are well known to offer unreliable estimates of the uncertainty of their decisions. In order to improve the quality of the confidence levels, also known as…

机器学习 · 计算机科学 2024-04-15 Jiayi Huang , Sangwoo Park , Osvaldo Simeone

It has been well proved that deep networks are efficient at extracting features from a given (source) labeled dataset. However, it is not always the case that they can generalize well to other (target) datasets which very often have a…

计算机视觉与模式识别 · 计算机科学 2021-09-29 Alan Preciado-Grijalva , Venkata Santosh Sai Ramireddy Muthireddy

Deep learning has produced state-of-the-art results for a variety of tasks. While such approaches for supervised learning have performed well, they assume that training and testing data are drawn from the same distribution, which may not…

机器学习 · 计算机科学 2020-02-10 Garrett Wilson , Diane J. Cook

We investigate the utility of in-domain self-supervised pre-training of vision models in the analysis of remote sensing imagery. Self-supervised learning (SSL) has emerged as a promising approach for remote sensing image classification due…

计算机视觉与模式识别 · 计算机科学 2024-02-06 Ivica Dimitrovski , Ivan Kitanovski , Nikola Simidjievski , Dragi Kocev

Calibration is an essential prerequisite for the accurate data fusion of LiDAR and camera sensors. Traditional calibration techniques often require specific targets or suitable scenes to obtain reliable 2D-3D correspondences. To tackle the…

计算机视觉与模式识别 · 计算机科学 2025-01-29 Shujuan Huang , Chunyu Lin , Yao Zhao

Uncertainty quantification is essential for the reliable deployment of machine learning models to high-stakes application domains. Uncertainty quantification is all the more challenging when training distribution and test distribution are…

机器学习 · 计算机科学 2022-06-07 Yaodong Yu , Stephen Bates , Yi Ma , Michael I. Jordan

Data augmentation is one of the most effective techniques for regularizing deep learning models and improving their recognition performance in a variety of tasks and domains. However, this holds for standard in-domain settings, in which the…