中文
相关论文

相关论文: Feature Partitioning for Efficient Multi-Task Arch…

200 篇论文

Automated protein function prediction is a challenging problem with distinctive features, such as the hierarchical organization of protein functions and the scarcity of annotated proteins for most biological functions. We propose a…

机器学习 · 统计学 2019-04-09 Marco Frasca , Nicolò Cesa Bianchi

Vast amounts of artistic data is scattered on-line from both museums and art applications. Collecting, processing and studying it with respect to all accompanying attributes is an expensive process. With a motivation to speed up and improve…

多媒体 · 计算机科学 2017-08-03 Gjorgji Strezoski , Marcel Worring

Learning multiple domains/tasks with a single model is important for improving data efficiency and lowering inference cost for numerous vision tasks, especially on resource-constrained mobile devices. However, hand-crafting a…

计算机视觉与模式识别 · 计算机科学 2021-01-11 Qifei Wang , Junjie Ke , Joshua Greaves , Grace Chu , Gabriel Bender , Luciano Sbaiz , Alec Go , Andrew Howard , Feng Yang , Ming-Hsuan Yang , Jeff Gilbert , Peyman Milanfar

Automated Machine Learning (AutoML) techniques have recently been introduced to design Collaborative Filtering (CF) models in a data-specific manner. However, existing works either search architectures or hyperparameters while ignoring the…

信息检索 · 计算机科学 2023-07-21 Yan Wen , Chen Gao , Lingling Yi , Liwei Qiu , Yaqing Wang , Yong Li

Differentiable ARchiTecture Search (DARTS) is one of the most trending Neural Architecture Search (NAS) methods. It drastically reduces search cost by resorting to weight-sharing. However, it also dramatically reduces the search space, thus…

机器学习 · 计算机科学 2022-11-02 Alexandre Heuillet , Hedi Tabia , Hichem Arioui , Kamal Youcef-Toumi

Multi-Task Learning (MTL) aims to learn multiple tasks simultaneously while exploiting their mutual relationships. By using shared resources to simultaneously calculate multiple outputs, this learning paradigm has the potential to have…

机器学习 · 计算机科学 2024-08-29 Maxime Fontana , Michael Spratling , Miaojing Shi

Multi-Task Learning (MTL) is a learning paradigm in machine learning and its aim is to leverage useful information contained in multiple related tasks to help improve the generalization performance of all the tasks. In this paper, we give a…

机器学习 · 计算机科学 2021-03-30 Yu Zhang , Qiang Yang

Architecture search is the process of automatically learning the neural model or cell structure that best suits the given task. Recently, this approach has shown promising performance improvements (on language modeling and image…

计算与语言 · 计算机科学 2019-06-13 Ramakanth Pasunuru , Mohit Bansal

An important long-term goal in machine learning systems is to build learning agents that, like humans, can learn many tasks over their lifetime, and moreover use information from these tasks to improve their ability to do so efficiently. In…

机器学习 · 计算机科学 2017-07-03 Maria-Florina Balcan , Avrim Blum , Vaishnavh Nagarajan

Previous works on meta-learning either relied on elaborately hand-designed network structures or adopted specialized learning rules to a particular domain. We propose a universal framework to optimize the meta-learning process automatically…

机器学习 · 计算机科学 2019-09-10 Xinyue Zheng , Peng Wang , Qigang Wang , Zhongchao shi , Feiyu Xu

Neural architecture search (NAS) enables finding the best-performing architecture from a search space automatically. Most NAS methods exploit an over-parameterized network (i.e., a supernet) containing all possible architectures (i.e.,…

计算机视觉与模式识别 · 计算机科学 2024-12-20 Youngmin Oh , Hyunju Lee , Bumsub Ham

Multi-Task Learning (MTL) involves the concurrent training of multiple tasks, offering notable advantages for dense prediction tasks in computer vision. MTL not only reduces training and inference time as opposed to having multiple…

计算机视觉与模式识别 · 计算机科学 2024-12-05 Maxime Fontana , Michael Spratling , Miaojing Shi

Image search engines enable the retrieval of images relevant to a query image. In this work, we consider the setting where a query for similar images is derived from a collection of images. For visual search, the similarity measurements may…

计算机视觉与模式识别 · 计算机科学 2023-02-07 Nihal Jain , Praneetha Vaddamanu , Paridhi Maheshwari , Vishwa Vinay , Kuldeep Kulkarni

In the paradigm of multi-task learning, mul- tiple related prediction tasks are learned jointly, sharing information across the tasks. We propose a framework for multi-task learn- ing that enables one to selectively share the information…

机器学习 · 计算机科学 2012-07-03 Abhishek Kumar , Hal Daume

This paper proposes a novel differentiable architecture search method by formulating it into a distribution learning problem. We treat the continuously relaxed architecture mixing weight as random variables, modeled by Dirichlet…

机器学习 · 计算机科学 2021-03-17 Xiangning Chen , Ruochen Wang , Minhao Cheng , Xiaocheng Tang , Cho-Jui Hsieh

The recent advent of automated neural network architecture search led to several methods that outperform state-of-the-art human-designed architectures. However, these approaches are computationally expensive, in extreme cases consuming GPU…

机器学习 · 计算机科学 2019-03-11 Martin Wistuba , Tejaswini Pedapati

An important step in the task of neural network design, such as hyper-parameter optimization (HPO) or neural architecture search (NAS), is the evaluation of a candidate model's performance. Given fixed computational resources, one can…

机器学习 · 计算机科学 2021-03-09 Shengcao Cao , Xiaofang Wang , Kris Kitani

While neural architecture search (NAS) has enabled automated machine learning (AutoML) for well-researched areas, its application to tasks beyond computer vision is still under-explored. As less-studied domains are precisely those where we…

机器学习 · 计算机科学 2022-10-11 Junhong Shen , Mikhail Khodak , Ameet Talwalkar

Neural Architecture Search (NAS) has proved effective in offering outperforming alternatives to handcrafted neural networks. In this paper we analyse the benefits of NAS for image classification tasks under strict computational constraints.…

计算机视觉与模式识别 · 计算机科学 2020-09-30 Cristian Cioflan , Radu Timofte

In this article the most fundamental decomposition-based optimization method - block coordinate search, based on the sequential decomposition of problems in subproblems - and building performance simulation programs are used to reason about…

最优化与控制 · 数学 2016-09-12 Gian Luca Brunetti