中文
相关论文

相关论文: Rethinking of Encoder-based Warm-start Methods in …

200 篇论文

Conventional image classifiers are trained by randomly sampling mini-batches of images. To achieve state-of-the-art performance, practitioners use sophisticated data augmentation schemes to expand the amount of training data available for…

机器学习 · 计算机科学 2021-06-23 Renkun Ni , Micah Goldblum , Amr Sharaf , Kezhi Kong , Tom Goldstein

Meta-learning has been proposed as a promising machine learning topic in recent years, with important applications to image classification, robotics, computer games, and control systems. In this paper, we study the problem of using…

系统与控制 · 电气工程与系统科学 2025-03-04 Yunian Pan , Tao Li , Quanyan Zhu

Meta-learning of shared initialization parameters has shown to be highly effective in solving few-shot learning tasks. However, extending the framework to many-shot scenarios, which may further enhance its practicality, has been relatively…

机器学习 · 计算机科学 2022-02-17 Jaewoong Shin , Hae Beom Lee , Boqing Gong , Sung Ju Hwang

Universal graph pre-training has emerged as a key paradigm in graph representation learning, offering a promising way to train encoders to learn transferable representations from unlabeled graphs and to effectively generalize across a wide…

机器学习 · 计算机科学 2026-02-27 Lianze Shan , Jitao Zhao , Dongxiao He , Yongqi Huang , Zhiyong Feng , Weixiong Zhang

The expansiveness of compositional phase space is too vast to fully search using current theoretical tools for many emergent problems in condensed matter physics. The reliance on a deep chemical understanding is one method to identify local…

超导电性 · 物理学 2023-01-26 Lazar Novakovic , Ashkan Salamat , Keith V. Lawler

Learning useful representations with little or no supervision is a key challenge in artificial intelligence. We provide an in-depth review of recent advances in representation learning with a focus on autoencoder-based models. To organize…

机器学习 · 计算机科学 2018-12-13 Michael Tschannen , Olivier Bachem , Mario Lucic

The deployment of large-scale models, such as large language models (LLMs) and sophisticated image generation systems, incurs substantial costs due to their computational demands. To mitigate these costs and address challenges related to…

Quantum machine learning methods often rely on fixed, hand-crafted quantum encodings that may not capture optimal features for downstream tasks. In this work, we study the power of quantum autoencoders in learning data-driven quantum…

The ability of deep networks to learn superior representations hinges on leveraging the proper inductive biases, considering the inherent properties of datasets. In tabular domains, it is critical to effectively handle heterogeneous…

机器学习 · 计算机科学 2024-05-15 Kyungeun Lee , Ye Seul Sim , Hye-Seung Cho , Moonjung Eo , Suhee Yoon , Sanghyu Yoon , Woohyung Lim

Meta learning has attracted much attention recently in machine learning community. Contrary to conventional machine learning aiming to learn inherent prediction rules to predict labels for new query data, meta learning aims to learn the…

机器学习 · 计算机科学 2023-07-04 Jun Shu , Deyu Meng , Zongben Xu

Object detectors trained on large-scale RGB datasets are being extensively employed in real-world applications. However, these RGB-trained models suffer a performance drop under adverse illumination and lighting conditions. Infrared (IR)…

计算机视觉与模式识别 · 计算机科学 2021-10-08 Vibashan VS , Domenick Poster , Suya You , Shuowen Hu , Vishal M. Patel

Performing inference on data obtained through observational studies is becoming extremely relevant due to the widespread availability of data in fields such as healthcare, education, retail, etc. Furthermore, this data is accrued from…

机器学习 · 计算机科学 2021-02-18 Ankit Sharma , Garima Gupta , Ranjitha Prasad , Arnab Chatterjee , Lovekesh Vig , Gautam Shroff

This paper explores meta-learning in sequential recommendation to alleviate the item cold-start problem. Sequential recommendation aims to capture user's dynamic preferences based on historical behavior sequences and acts as a key component…

信息检索 · 计算机科学 2020-12-11 Yujia Zheng , Siyi Liu , Zekun Li , Shu Wu

Meta-learning represents a strong class of approaches for solving few-shot learning tasks. Nonetheless, recent research suggests that simply pre-training a generic encoder can potentially surpass meta-learning algorithms. In this paper, we…

机器学习 · 计算机科学 2025-03-14 Wei Cui , Tongzi Wu , Jesse C. Cresswell , Yi Sui , Keyvan Golestan

The goal of meta-learning is to train a model on a variety of learning tasks, such that it can adapt to new problems within only a few iterations. Here we propose a principled information-theoretic model that optimally partitions the…

机器学习 · 统计学 2020-09-10 Heinke Hihn , Daniel A. Braun

Many meta-learning approaches for few-shot learning rely on simple base learners such as nearest-neighbor classifiers. However, even in the few-shot regime, discriminatively trained linear predictors can offer better generalization. We…

计算机视觉与模式识别 · 计算机科学 2019-04-24 Kwonjoon Lee , Subhransu Maji , Avinash Ravichandran , Stefano Soatto

Spatio-temporal machine learning is critically needed for a variety of societal applications, such as agricultural monitoring, hydrological forecast, and traffic management. These applications greatly rely on regional features that…

机器学习 · 计算机科学 2023-03-09 Zhexiong Liu , Licheng Liu , Yiqun Xie , Zhenong Jin , Xiaowei Jia

In this work, we learn a shared encoding representation for a multi-task neural network model optimized with connectionist temporal classification (CTC) and conventional framewise cross-entropy training criteria. Our experiments show that…

音频与语音处理 · 电气工程与系统科学 2019-04-04 Thai-Son Nguyen , Sebastian Stueker , Alex Waibel

In machine learning, data is usually represented in a (flat) Euclidean space where distances between points are along straight lines. Researchers have recently considered more exotic (non-Euclidean) Riemannian manifolds such as hyperbolic…

机器学习 · 计算机科学 2021-01-12 Marc T. Law , Jos Stam

Meta-learning algorithms use past experience to learn to quickly solve new tasks. In the context of reinforcement learning, meta-learning algorithms acquire reinforcement learning procedures to solve new problems more efficiently by…

机器学习 · 计算机科学 2020-05-01 Abhishek Gupta , Benjamin Eysenbach , Chelsea Finn , Sergey Levine