English
Related papers

Related papers: A Quantitative Perspective on Values of Domain Kno…

200 papers

Although deep learning models like CNNs have achieved great success in medical image analysis, the small size of medical datasets remains a major bottleneck in this area. To address this problem, researchers have started looking for…

Image and Video Processing · Electrical Eng. & Systems 2021-02-09 Xiaozheng Xie , Jianwei Niu , Xuefeng Liu , Zhengsu Chen , Shaojie Tang , Shui Yu

A machine learning (ML) method aided by domain knowledge was proposed to predict saturated magnetization (Bs) and critical diameter (Dmax) of soft magnetic metallic glass (MGs). Two datasets were established based on published experimental…

Materials Science · Physics 2022-03-22 Xin Li , Guang-cun Shan , Hong-bin Zhao , Chan-Hung Shek

Cross-domain sentiment analysis aims to predict the sentiment of texts in the target domain using the model trained on the source domain to cope with the scarcity of labeled data. Previous studies are mostly cross-entropy-based methods for…

Computation and Language · Computer Science 2022-08-19 Yun Luo , Fang Guo , Zihan Liu , Yue Zhang

Humans are incredibly good at transferring knowledge from one domain to another, enabling rapid learning of new tasks. Likewise, transfer learning has enabled enormous success in many computer vision problems using pretraining. However, the…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Yipeng Zhang , Tyler L. Hayes , Christopher Kanan

This work studies semantic segmentation using 3D LiDAR data. Popular deep learning methods applied for this task require a large number of manual annotations to train the parameters. We propose a new method that makes full use of the…

Robotics · Computer Science 2019-05-24 Jilin Mei , Huijing Zhao

Contrary to the conventional emphasis on dataset size, we explore the role of data alignment -- an often overlooked aspect of data quality -- in training capable Large Language Models (LLMs). To do so, we use the Task2Vec-based alignment…

Computation and Language · Computer Science 2025-07-04 Krrish Chawla , Aryan Sahai , Mario DePavia , Sudharsan Sundar , Brando Miranda , Elyas Obbad , Sanmi Koyejo

Machine learning models are typically deployed in a test setting that differs from the training setting, potentially leading to decreased model performance because of domain shift. If we could estimate the performance that a pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Zeju Li , Konstantinos Kamnitsas , Mobarakol Islam , Chen Chen , Ben Glocker

As a recent noticeable topic, domain generalization aims to learn a generalizable model on multiple source domains, which is expected to perform well on unseen test domains. Great efforts have been made to learn domain-invariant features by…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Jianxin Lin , Yongqiang Tang , Junping Wang , Wensheng Zhang

Countless domains rely on Machine Learning (ML) models, including safety-critical domains, such as autonomous driving, which this paper focuses on. While the black box nature of ML is simply a nuisance in some domains, in safety-critical…

Artificial Intelligence · Computer Science 2024-06-24 Lynn Vonderhaar , Timothy Elvira , Tyler Procko , Omar Ochoa

Despite the remarkable success achieved by graph convolutional networks for functional brain activity analysis, the heterogeneity of functional patterns and the scarcity of imaging data still pose challenges in many tasks. Transferring…

Machine Learning · Computer Science 2022-12-19 Wenhui Cui , Haleh Akrami , Anand A. Joshi , Richard M. Leahy

Shapley values have seen widespread use in machine learning as a way to explain model predictions and estimate the importance of covariates. Accurately explaining models is critical in real-world models to both aid in decision making and to…

Machine Learning · Statistics 2024-08-19 Daniel de Marchi , Michael Kosorok , Scott de Marchi

Machine learning algorithms minimizing the average training loss usually suffer from poor generalization performance due to the greedy exploitation of correlations among the training data, which are not stable under distributional shifts.…

Machine Learning · Computer Science 2022-07-29 Xi Leng , Xiaoying Tang , Yatao Bian

Uncertainty quantification is at the core of the reliability and robustness of machine learning. In this paper, we provide a theoretical framework to dissect the uncertainty, especially the \textit{epistemic} component, in deep learning…

Machine Learning · Computer Science 2023-06-21 Ziyi Huang , Henry Lam , Haofeng Zhang

Deep learning models obtain impressive accuracy in road scenes understanding, however they need a large quantity of labeled samples for their training. Additionally, such models do not generalise well to environments where the statistical…

Computer Vision and Pattern Recognition · Computer Science 2021-10-28 Francesco Barbato , Umberto Michieli , Marco Toldo , Pietro Zanuttigh

Clinical machine learning models experience significantly degraded performance in datasets not seen during training, e.g., new hospitals or populations. Recent developments in domain generalization offer a promising solution to this problem…

Machine Learning · Computer Science 2021-04-16 Haoran Zhang , Natalie Dullerud , Laleh Seyyed-Kalantari , Quaid Morris , Shalmali Joshi , Marzyeh Ghassemi

Machine learning models rely on various assumptions to attain high accuracy. One of the preliminary assumptions of these models is the independent and identical distribution, which suggests that the train and test data are sampled from the…

Machine Learning · Computer Science 2022-11-08 Paras Sheth , Raha Moraffah , K. Selçuk Candan , Adrienne Raglin , Huan Liu

Deep learning models exhibit limited generalizability across different domains. Specifically, transferring knowledge from available entangled domain features(source/target domain) and categorical features to new unseen categorical features…

Computer Vision and Pattern Recognition · Computer Science 2020-03-03 Qingjie Meng , Daniel Rueckert , Bernhard Kainz

Quantifying the impact of individual data samples on machine learning models is an open research problem. This is particularly relevant when complex and high-dimensional relationships have to be learned from a limited sample of the data…

Machine Learning · Computer Science 2023-11-07 Dmitrii Usynin , Moritz Knolle , Georgios Kaissis

This work focuses on developing efficient post-hoc explanations for quantum AI algorithms. In classical contexts, the cooperative game theory concept of the Shapley value adapts naturally to post-hoc explanations, where it can be used to…

Quantum Physics · Physics 2025-04-18 Iain Burge , Michel Barbeau , Joaquin Garcia-Alfaro

Domain adaptation has become a prominent problem setting in machine learning and related fields. This review asks the question: how can a classifier learn from a source domain and generalize to a target domain? We present a categorization…

Machine Learning · Computer Science 2021-06-18 Wouter M. Kouw , Marco Loog