English
Related papers

Related papers: A Two-Stage Learning-to-Defer Approach for Multi-T…

200 papers

This paper presents a framework for deep transfer learning, which aims to leverage information from multi-domain upstream data with a large number of samples $n$ to a single-domain downstream task with a considerably smaller number of…

Machine Learning · Computer Science 2025-01-07 Yuling Jiao , Huazhen Lin , Yuchen Luo , Jerry Zhijian Yang

Retrieval-Augmented Generation (RAG) has emerged as the predominant paradigm for grounding Large Language Model outputs in factual knowledge, effectively mitigating hallucinations. However, conventional RAG systems operate under a…

Information Retrieval · Computer Science 2026-01-13 Sergii Voloshyn

Bilevel optimization is a central tool in machine learning for high-dimensional hyperparameter tuning. Its applications are vast; for instance, in imaging it can be used for learning data-adaptive regularizers and optimizing forward…

Optimization and Control · Mathematics 2025-11-11 Mohammad Sadegh Salehi , Subhadip Mukherjee , Lindon Roberts , Matthias J. Ehrhardt

We present a novel view that unifies two frameworks that aim to solve sequential prediction problems: learning to search (L2S) and recurrent neural networks (RNN). We point out equivalences between elements of the two frameworks. By…

Computation and Language · Computer Science 2016-07-19 Khanh Nguyen

We propose and address a novel few-shot RL problem, where a task is characterized by a subtask graph which describes a set of subtasks and their dependencies that are unknown to the agent. The agent needs to quickly adapt to the task over…

Machine Learning · Computer Science 2020-04-15 Sungryull Sohn , Hyunjae Woo , Jongwook Choi , Honglak Lee

Many advanced Learning from Demonstration (LfD) methods consider the decomposition of complex, real-world tasks into simpler sub-tasks. By reusing the corresponding sub-policies within and between tasks, they provide training data for each…

Machine Learning · Computer Science 2018-08-13 Kyriacos Shiarlis , Markus Wulfmeier , Sasha Salter , Shimon Whiteson , Ingmar Posner

Inspired by human-like behaviors for navigation: first searching to explore unknown areas before discovering the target, and then the pathfinding of moving towards the discovered target, recent studies design parallel submodules to achieve…

Artificial Intelligence · Computer Science 2025-07-23 Yanwei Zheng , Shaopu Feng , Bowen Huang , Chuanlin Lan , Xiao Zhang , Dongxiao Yu

Stochastic control with both inherent random system noise and lack of knowledge on system parameters constitutes the core and fundamental topic in reinforcement learning (RL), especially under non-episodic situations where online learning…

Systems and Control · Electrical Eng. & Systems 2019-06-24 Xin Huang , Duan Li , Daniel Zhuoyu Long

The typical multi-task learning methods for spatio-temporal data prediction involve low-rank tensor computation. However, such a method have relatively weak performance when the task number is small, and we cannot integrate it into…

Machine Learning · Computer Science 2019-10-14 Qichen Li , Jiaxin Pei , Jianding Zhang , Bo Han

We present a two-stage framework that integrates a learning-based estimator and a controller, designed to address contact-intensive tasks. The estimator leverages a Bayesian particle filter with a mixture density network (MDN) structure,…

Robotics · Computer Science 2023-08-02 Bukun Son , Hyelim Choi , Jaemin Yoon , Dongjun Lee

Lifelong learning aims to train a model with good performance for new tasks while retaining the capacity of previous tasks. However, some practical scenarios require the system to forget undesirable knowledge due to privacy issues, which is…

Artificial Intelligence · Computer Science 2024-05-30 Lianlei Shan , Wenzhang Zhou , Wei Li , Xingyu Ding

Despite the success on few-shot learning problems, most meta-learned models only focus on achieving good performance on clean examples and thus easily break down when given adversarially perturbed samples. While some recent works have shown…

Machine Learning · Computer Science 2023-10-27 Minseon Kim , Hyeonjeong Ha , Dong Bok Lee , Sung Ju Hwang

As face recognition is widely used in diverse security-critical applications, the study of face anti-spoofing (FAS) has attracted more and more attention. Several FAS methods have achieved promising performances if the attack types in the…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Yu-Chun Wang , Chien-Yi Wang , Shang-Hong Lai

Sequential fine-tuning and multi-task learning are methods aiming to incorporate knowledge from multiple tasks; however, they suffer from catastrophic forgetting and difficulties in dataset balancing. To address these shortcomings, we…

Computation and Language · Computer Science 2021-01-27 Jonas Pfeiffer , Aishwarya Kamath , Andreas Rücklé , Kyunghyun Cho , Iryna Gurevych

In machine learning, the goal of multi-task learning (MTL) is to optimize multiple objectives together. Recent works, for example, Multiple Gradient Descent Algorithm (MGDA) and its variants, show promising results with dynamically adjusted…

Machine Learning · Computer Science 2026-03-10 Xuxing Chen , Yun He , Jiayi Xu , Minhui Huang , Xiaoyi Liu , Boyang Liu , Fei Tian , Xiaohan Wei , Rong Jin , Sem Park , Bo Long , Xue Feng

Unsupervised domain adaptation object detection (UDAOD) research on Detection Transformer(DETR) mainly focuses on feature alignment and existing methods can be divided into two kinds, each of which has its unresolved issues. One-stage…

Computer Vision and Pattern Recognition · Computer Science 2024-01-19 Weixi Weng , Chun Yuan

Embedding parameterized optimization problems as layers into machine learning architectures serves as a powerful inductive bias. Training such architectures with stochastic gradient descent requires care, as degenerate derivatives of the…

Machine Learning · Computer Science 2024-12-16 Anselm Paulus , Georg Martius , Vít Musil

In recent years, semi-supervised learning has been widely explored and shows excellent data efficiency for 2D data. There is an emerging need to improve data efficiency for 3D tasks due to the scarcity of labeled 3D data. This paper…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Zhimin Chen , Longlong Jing , Yang Liang , YingLi Tian , Bing Li

With the rapid proliferation of autonomous driving, there has been a heightened focus on the research of lidar-based 3D semantic segmentation and object detection methodologies, aiming to ensure the safety of traffic participants. In recent…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Jiahua Xu , Si Zuo , Chenfeng Wei , Wei Zhou

This paper presents a new exact method to calculate worst-case parameter realizations in two-stage robust optimization problems with categorical or binary-valued uncertain data. Traditional exact algorithms for these problems, notably…

Optimization and Control · Mathematics 2022-01-19 Anirudh Subramanyam