English
Related papers

Related papers: Multi-Environment Pretraining Enables Transfer to …

200 papers

In recent years, deep neural networks (DNNs) have been found very successful for multi-label classification (MLC) of remote sensing (RS) images. Self-supervised pre-training combined with fine-tuning on a randomly selected small training…

Computer Vision and Pattern Recognition · Computer Science 2023-06-22 Lars Möllenbrok , Begüm Demir

Enabling robots to learn novel visuomotor skills in a data-efficient manner remains an unsolved problem with myriad challenges. A popular paradigm for tackling this problem is through leveraging large unlabeled datasets that have many…

Robotics · Computer Science 2023-05-16 Maximilian Du , Suraj Nair , Dorsa Sadigh , Chelsea Finn

The past decade has seen the rapid development of Reinforcement Learning, which acquires impressive performance with numerous training resources. However, one of the greatest challenges in RL is generalization efficiency (i.e.,…

Machine Learning · Computer Science 2021-08-18 Qi Yang , Peng Yang , Ke Tang

Offline reinforcement learning leverages previously-collected offline datasets to learn optimal policies with no necessity to access the real environment. Such a paradigm is also desirable for multi-agent reinforcement learning (MARL)…

Machine Learning · Computer Science 2022-06-13 Linghui Meng , Muning Wen , Yaodong Yang , Chenyang Le , Xiyun Li , Weinan Zhang , Ying Wen , Haifeng Zhang , Jun Wang , Bo Xu

In the context of text classification, the financial burden of annotation exercises for creating training data is a critical issue. Active learning techniques, particularly those rooted in uncertainty sampling, offer a cost-effective…

Computation and Language · Computer Science 2024-06-19 Hamidreza Rouzegar , Masoud Makrehchi

Multi-target multi-camera tracking (MTMCT) plays an important role in intelligent video analysis, surveillance video retrieval, and other application scenarios. Nowadays, the deep-learning-based MTMCT has been the mainstream and has…

Computer Vision and Pattern Recognition · Computer Science 2022-09-21 Haohong Liao , Silin Zheng , Xuelin Shen , Mark Junjie Li , Xu Wang

Pre-trained vision-language models learn massive data to model unified representations of images and natural languages, which can be widely applied to downstream machine learning tasks. In addition to zero-shot inference, in order to better…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Qian-Wei Wang , Yuqiu Xie , Letian Zhang , Zimo Liu , Shu-Tao Xia

Recent Vision-based Large Language Models~(VisionLLMs) for autonomous driving have seen rapid advancements. However, such promotion is extremely dependent on large-scale high-quality annotated data, which is costly and labor-intensive. To…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Chaoqun Wang , Jie Yang , Xiaobin Hong , Ruimao Zhang

In traffic engineering, vehicle detectors are trained on limited datasets resulting in poor accuracy when deployed in real world applications. Annotating large-scale high quality datasets is challenging. Typically, these datasets have…

Computer Vision and Pattern Recognition · Computer Science 2015-10-08 Justin A. Eichel , Akshaya Mishra , Nicholas Miller , Nicholas Jankovic , Mohan A. Thomas , Tyler Abbott , Douglas Swanson , Joel Keller

Active learning (AL) is a widely-used training strategy for maximizing predictive performance subject to a fixed annotation budget. In AL one iteratively selects training examples for annotation, often those for which the current model is…

Machine Learning · Computer Science 2019-11-05 David Lowell , Zachary C. Lipton , Byron C. Wallace

We consider the task of few-shot intent detection, which involves training a deep learning model to classify utterances based on their underlying intents using only a small amount of labeled data. The current approach to address this…

Computation and Language · Computer Science 2024-09-17 Haode Zhang , Haowen Liang , Liming Zhan , Albert Y. S. Lam , Xiao-Ming Wu

We introduce Action-GPT, a plug-and-play framework for incorporating Large Language Models (LLMs) into text-based action generation models. Action phrases in current motion capture datasets contain minimal and to-the-point information. By…

Computer Vision and Pattern Recognition · Computer Science 2023-03-08 Sai Shashank Kalakonda , Shubh Maheshwari , Ravi Kiran Sarvadevabhatla

In the realm of artificial intelligence, where a vast majority of data is unstructured, obtaining substantial amounts of labeled data to train supervised machine learning models poses a significant challenge. To address this, we delve into…

Machine Learning · Computer Science 2024-01-19 Natan Vidra , Thomas Clifford , Katherine Jijo , Eden Chung , Liang Zhang

Unsupervised pre-training methods utilizing large and diverse datasets have achieved tremendous success across a range of domains. Recent work has investigated such unsupervised pre-training methods for model-based reinforcement learning…

Computer Vision and Pattern Recognition · Computer Science 2023-10-30 Jialong Wu , Haoyu Ma , Chaoyi Deng , Mingsheng Long

Although weakly-supervised techniques can reduce the labeling effort, it is unclear whether a saliency model trained with weakly-supervised data (e.g., point annotation) can achieve the equivalent performance of its fully-supervised…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Zhenyu Wu , Lin Wang , Wei Wang , Qing Xia , Chenglizhao Chen , Aimin Hao , Shuo Li

Many machine learning systems today are trained on large amounts of human-annotated data. Data annotation tasks that require a high level of competency make data acquisition expensive, while the resulting labels are often subjective,…

Machine Learning · Computer Science 2020-04-08 Emmanouil Antonios Platanios , Maruan Al-Shedivat , Eric Xing , Tom Mitchell

Video action understanding tasks in real-world scenarios always suffer data limitations. In this paper, we address the data-limited action understanding problem by bridging data scarcity. We propose a novel method that employs a…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Wei Li , Dezhao Luo , Dongbao Yang , Zhenhang Li , Weiping Wang , Yu Zhou

Collecting annotated data for semantic segmentation is time-consuming and hard to scale up. In this paper, we for the first time propose a unified framework, termed as Multi-Dataset Pretraining, to take full advantage of the fragmented…

Computer Vision and Pattern Recognition · Computer Science 2021-06-09 Bowen Shi , Xiaopeng Zhang , Haohang Xu , Wenrui Dai , Junni Zou , Hongkai Xiong , Qi Tian

State-of-the-art supervised NLP models achieve high accuracy but are also susceptible to failures on inputs from low-data regimes, such as domains that are not represented in training data. As an approximation to collecting ground-truth…

Computation and Language · Computer Science 2023-06-29 Parikshit Bansal , Amit Sharma

Low-resource languages face significant barriers in AI development due to limited linguistic resources and expertise for data labeling, rendering them rare and costly. The scarcity of data and the absence of preexisting tools exacerbate…

Computation and Language · Computer Science 2024-06-25 Nataliia Kholodna , Sahib Julka , Mohammad Khodadadi , Muhammed Nurullah Gumus , Michael Granitzer