中文
相关论文

相关论文: How Data Augmentation Shapes Neural Representation…

200 篇论文

In this article, we analyze how changing the underlying 3D shape of the base identity in face images can distort their overall appearance, especially from the perspective of deep face recognition. As done in popular training data…

计算机视觉与模式识别 · 计算机科学 2022-08-08 Sandipan Banerjee , Walter Scheirer , Kevin Bowyer , Patrick Flynn

Deep neural networks implement a sequence of layer-by-layer operations that are each relatively easy to understand, but the resulting overall computation is generally difficult to understand. We consider a simple hypothesis for interpreting…

机器学习 · 计算机科学 2022-11-29 Richard D. Lange , Devin Kwok , Jordan Matelsky , Xinyue Wang , David S. Rolnick , Konrad P. Kording

Data augmentation is a technique to improve the generalization ability of machine learning methods by increasing the size of the dataset. However, since every augmentation method is not equally effective for every dataset, you need to…

机器学习 · 计算机科学 2022-05-31 Daisuke Oba , Shinnosuke Matsuo , Brian Kenji Iwana

Contrary to most machine learning models, modern deep artificial neural networks typically include multiple components that contribute to regularization. Despite the fact that some (explicit) regularization techniques, such as weight decay…

计算机视觉与模式识别 · 计算机科学 2020-11-13 Alex Hernández-García , Peter König

Pre-trained deep image representations are useful for post-training tasks such as classification through transfer learning, image retrieval, and object detection. Data augmentations are a crucial aspect of pre-training robust…

计算机视觉与模式识别 · 计算机科学 2023-02-23 Sangnie Bhardwaj , Willie McClinton , Tongzhou Wang , Guillaume Lajoie , Chen Sun , Phillip Isola , Dilip Krishnan

Deep neural networks come in many sizes and architectures. The choice of architecture, in conjunction with the dataset and learning algorithm, is commonly understood to affect the learned neural representations. Yet, recent results have…

机器学习 · 计算机科学 2024-07-08 Loek van Rossem , Andrew M. Saxe

Deep neural networks have emerged as very successful tools for image restoration and reconstruction tasks. These networks are often trained end-to-end to directly reconstruct an image from a noisy or corrupted measurement of that image. To…

图像与视频处理 · 电气工程与系统科学 2021-06-30 Zalan Fabian , Reinhard Heckel , Mahdi Soltanolkotabi

Neural models often exploit superficial features to achieve good performance, rather than deriving more general features. Overcoming this tendency is a central challenge in areas such as representation learning and ML fairness. Recent work…

计算与语言 · 计算机科学 2020-10-12 Rohan Jha , Charles Lovering , Ellie Pavlick

Recent advances in the field of artificial intelligence have been made possible by deep neural networks. In applications where data are scarce, transfer learning and data augmentation techniques are commonly used to improve the…

计算机视觉与模式识别 · 计算机科学 2020-02-13 Mohammad Saeed Abrishami , Amir Erfan Eshratifar , David Eigen , Yanzhi Wang , Shahin Nazarian , Massoud Pedram

Recent work has found that neural networks with stronger generalization tend to exhibit higher representational alignment with one another across architectures and training paradigms. In this work, we show that models with stronger…

机器学习 · 计算机科学 2026-02-02 Junjie Yu , Wenxiao Ma , Chen Wei , Jianyu Zhang , Haotian Deng , Zihan Deng , Quanying Liu

Shape information is crucial for human perception and cognition, and should therefore also play a role in cognitive AI systems. We employ the interdisciplinary framework of conceptual spaces, which proposes a geometric representation of…

机器学习 · 计算机科学 2021-11-17 Lucas Bechberger , Kai-Uwe Kühnberger

Recognizing symmetries in data allows for significant boosts in neural network training. In many cases, however, the underlying symmetry is present only in an idealized dataset, and is broken in the training data, due to effects such as…

高能物理 - 实验 · 物理学 2023-11-13 Edmund Witkowski , Daniel Whiteson

Researchers have now achieved great success on dealing with 2D images using deep learning. In recent years, 3D computer vision and Geometry Deep Learning gain more and more attention. Many advanced techniques for 3D shapes have been…

图形学 · 计算机科学 2020-04-16 Yun-Peng Xiao , Yu-Kun Lai , Fang-Lue Zhang , Chunpeng Li , Lin Gao

Though data augmentation has become a standard component of deep neural network training, the underlying mechanism behind the effectiveness of these techniques remains poorly understood. In practice, augmentation policies are often chosen…

机器学习 · 计算机科学 2020-06-08 Raphael Gontijo-Lopes , Sylvia J. Smullin , Ekin D. Cubuk , Ethan Dyer

In recent years, there has been interest in how geometric properties such as intrinsic dimension (ID) of a neural network's hidden representations change through its layers, and how such properties are predictive of important model behavior…

计算机视觉与模式识别 · 计算机科学 2024-10-22 Nicholas Konz , Maciej A. Mazurowski

Despite significant advances in the field of deep learning in ap-plications to various areas, an explanation of the learning pro-cess of neural network models remains an important open ques-tion. The purpose of this paper is a comprehensive…

机器学习 · 计算机科学 2023-06-07 German Magai

Data augmentation is a popular technique which helps improve generalization capabilities of deep neural networks. It plays a pivotal role in remote-sensing scenarios in which the amount of high-quality ground truth data is limited, and…

计算机视觉与模式识别 · 计算机科学 2019-03-14 Jakub Nalepa , Michal Myller , Michal Kawulok

3D shape editing is widely used in a range of applications such as movie production, computer games and computer aided design. It is also a popular research topic in computer graphics and computer vision. In past decades, researchers have…

图形学 · 计算机科学 2021-03-03 Yu-Jie Yuan , Yu-Kun Lai , Tong Wu , Lin Gao , Ligang Liu

Performing machine learning on structured data is complicated by the fact that such data does not have vectorial form. Therefore, multiple approaches have emerged to construct vectorial representations of structured data, from kernel and…

机器学习 · 计算机科学 2019-05-16 Benjamin Paaßen , Claudio Gallicchio , Alessio Micheli , Alessandro Sperduti

High-dimensional representations for words, text, images, knowledge graphs and other structured data are commonly used in different paradigms of machine learning and data mining. These representations have different degrees of…

计算与语言 · 计算机科学 2020-11-26 Sunipa Dev