中文
相关论文

相关论文: Self-Supervised learning for Neural Architecture S…

200 篇论文

Self-training, a semi-supervised learning algorithm, leverages a large amount of unlabeled data to improve learning when the labeled data are limited. Despite empirical successes, its theoretical characterization remains elusive. To the…

机器学习 · 计算机科学 2022-02-15 Shuai Zhang , Meng Wang , Sijia Liu , Pin-Yu Chen , Jinjun Xiong

In recent years, neural architecture-based recommender systems have achieved tremendous success, but they still fall short of expectation when dealing with highly sparse data. Self-supervised learning (SSL), as an emerging technique for…

信息检索 · 计算机科学 2023-06-05 Junliang Yu , Hongzhi Yin , Xin Xia , Tong Chen , Jundong Li , Zi Huang

Monumental advances in deep learning have led to unprecedented achievements across various domains. While the performance of deep neural networks is indubitable, the architectural design and interpretability of such models are nontrivial.…

机器学习 · 计算机科学 2023-07-06 Zachariah Carmichael , Tim Moon , Sam Ade Jacobs

Semisupervised learning is a learning standard which deals with the study of how computers and natural systems such as human beings acquire knowledge in the presence of both labeled and unlabeled data. Semisupervised learning based methods…

机器学习 · 计算机科学 2014-02-20 V. Jothi Prakash , Dr. L. M. Nithya

We propose a novel strategy for Neural Architecture Search (NAS) based on Bregman iterations. Starting from a sparse neural network our gradient-based one-shot algorithm gradually adds relevant parameters in an inverse scale space manner.…

机器学习 · 计算机科学 2021-06-07 Leon Bungert , Tim Roith , Daniel Tenbrinck , Martin Burger

The advancement of visual tracking has continuously been brought by deep learning models. Typically, supervised learning is employed to train these models with expensive labeled data. In order to reduce the workload of manual annotations…

计算机视觉与模式识别 · 计算机科学 2020-07-24 Ning Wang , Wengang Zhou , Yibing Song , Chao Ma , Wei Liu , Houqiang Li

In the past decade, advances in deep learning have resulted in breakthroughs in a variety of areas, including computer vision, natural language understanding, speech recognition, and reinforcement learning. Specialized, high-performing…

机器学习 · 计算机科学 2023-01-26 Colin White , Mahmoud Safari , Rhea Sukthanker , Binxin Ru , Thomas Elsken , Arber Zela , Debadeepta Dey , Frank Hutter

Self-supervision can dramatically cut back the amount of manually-labelled data required to train deep neural networks. While self-supervision has usually been considered for tasks such as image classification, in this paper we aim at…

计算机视觉与模式识别 · 计算机科学 2018-04-06 David Novotny , Samuel Albanie , Diane Larlus , Andrea Vedaldi

Estimating the parameters of a model describing a set of observations using a neural network is in general solved in a supervised way. In cases when we do not have access to the model's true parameters this approach can not be applied.…

星系天体物理 · 物理学 2020-09-30 Miguel A. Aragon-Calvo

The supervised learning paradigm is limited by the cost - and sometimes the impracticality - of data collection and labeling in multiple domains. Self-supervised learning, a paradigm which exploits the structure of unlabeled data to create…

The goal of our research is to develop methods advancing automatic visual recognition. In order to predict the unique or multiple labels associated to an image, we study different kind of Deep Neural Networks architectures and methods for…

计算机视觉与模式识别 · 计算机科学 2016-10-19 Rémi Cadène , Nicolas Thome , Matthieu Cord

This work proposes an overview of the recent semi-supervised learning approaches and related works. Despite the remarkable success of neural networks in various applications, there exist a few formidable constraints, including the need for…

机器学习 · 计算机科学 2024-08-09 Gyeongho Kim

Neural Architecture Search (NAS) methods are widely used in various industries to obtain high quality taskspecific solutions with minimal human intervention. Event Sequences find widespread use in various industrial applications including…

Neural Architecture Search (NAS) has emerged as a powerful framework for automatically discovering neural architectures that balance accuracy and efficiency. However, as AI transitions from static benchmarks to real-world deployment, the…

机器学习 · 计算机科学 2026-05-07 Matteo Gambella , Fabrizio Pittorino , Manuel Roveri

One-shot Imitation Learning~(OSIL) aims to imbue AI agents with the ability to learn a new task from a single demonstration. To supervise the learning, OSIL typically requires a prohibitively large number of paired expert demonstrations --…

机器学习 · 计算机科学 2024-08-13 Philipp Wu , Kourosh Hakhamaneshi , Yuqing Du , Igor Mordatch , Aravind Rajeswaran , Pieter Abbeel

This paper proposes a novel paradigm for the unsupervised learning of object landmark detectors. Contrary to existing methods that build on auxiliary tasks such as image generation or equivariance, we propose a self-training approach where,…

计算机视觉与模式识别 · 计算机科学 2023-02-28 Dimitrios Mallis , Enrique Sanchez , Matt Bell , Georgios Tzimiropoulos

Neural Architecture Search (NAS) aims to facilitate the design of deep networks for new tasks. Existing techniques rely on two stages: searching over the architecture space and validating the best architecture. NAS algorithms are currently…

机器学习 · 计算机科学 2019-11-25 Kaicheng Yu , Christian Sciuto , Martin Jaggi , Claudiu Musat , Mathieu Salzmann

Recent advancements in artificial intelligence (AI) have positioned deep learning (DL) as a pivotal technology in fields like computer vision, data mining, and natural language processing. A critical factor in DL performance is the…

机器学习 · 计算机科学 2024-06-26 Jiaming Yan

Mining tasks over sequential data, such as clickstreams and gene sequences, require a careful design of embeddings usable by learning algorithms. Recent research in feature learning has been extended to sequential data, where each instance…

机器学习 · 计算机科学 2020-07-28 Zhongfang Zhuang , Xiangnan Kong , Elke Rundensteiner , Jihane Zouaoui , Aditya Arora

Recently, Neural Architecture Search (NAS) methods have been introduced and show impressive performance on many benchmarks. Among those NAS studies, Neural Architecture Transformer (NAT) aims to adapt the given neural architecture to…

机器学习 · 计算机科学 2022-05-17 Do-Guk Kim , Heung-Chang Lee