English
Related papers

Related papers: Domain-Adaptive Pretraining Improves Primate Behav…

200 papers

LiDAR place recognition approaches based on deep learning suffer from significant performance degradation when there is a shift between the distribution of training and test datasets, often requiring re-training the networks to achieve peak…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Joshua Knights , Stephen Hausler , Sridha Sridharan , Clinton Fookes , Peyman Moghadam

Deep learning has become the standard methodology to approach computer vision tasks when large amounts of labeled data are available. One area where traditional deep learning approaches fail to perform is one-shot learning tasks where a…

Computer Vision and Pattern Recognition · Computer Science 2020-07-02 Stefan Schneider , Graham W. Taylor , Stefan Linquist , Stefan C. Kremer

Reinforcement learning provides a general framework for flexible decision making and control, but requires extensive data collection for each new task that an agent needs to learn. In other machine learning fields, such as natural language…

Machine Learning · Computer Science 2020-11-20 Avi Singh , Huihan Liu , Gaoyue Zhou , Albert Yu , Nicholas Rhinehart , Sergey Levine

We propose a scheme for supervised image classification that uses privileged information, in the form of keypoint annotations for the training data, to learn strong models from small and/or biased training sets. Our main motivation is the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-07 Andres C. Rodriguez , Stefano D'Aronco , Konrad Schindler , Jan Dirk Wegner

In this work, we tackle the problem of unsupervised domain adaptation (UDA) for video action recognition. Our approach, which we call UNITE, uses an image teacher model to adapt a video student model to the target domain. UNITE first…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Arun Reddy , William Paul , Corban Rivera , Ketul Shah , Celso M. de Melo , Rama Chellappa

We introduce ADEPT: Adaptive Data ExPloiTation, a simple yet powerful framework to enhance the **data efficiency** and **generalization** in deep reinforcement learning (RL). Specifically, ADEPT adaptively manages the use of sampled data…

Machine Learning · Computer Science 2025-01-23 Mingqi Yuan , Bo Li , Xin Jin , Wenjun Zeng

State-of-the-art computer vision models are mostly trained with supervised learning using human-labeled images, which limits their scalability due to the expensive annotation cost. While self-supervised representation learning has achieved…

Computer Vision and Pattern Recognition · Computer Science 2023-03-13 Junnan Li , Silvio Savarese , Steven C. H. Hoi

Unsupervised Domain Adaptive Object Detection (UDA-OD) uses unlabelled data to improve the reliability of robotic vision systems in open-world environments. Previous approaches to UDA-OD based on self-training have been effective in…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Nicolas Harvey Chapman , Feras Dayoub , Will Browne , Christopher Lehnert

Most deep-learning frameworks for understanding biological swarms are designed to fit perceptive models of group behavior to individual-level data (e.g., spatial coordinates of identified features of individuals) that have been separately…

Computational Engineering, Finance, and Science · Computer Science 2021-08-24 Taeyeong Choi , Benjamin Pyenson , Juergen Liebig , Theodore P. Pavlic

One of the key limitations of Molecular Dynamics simulations is the computational intractability of sampling protein conformational landscapes associated with either large system size or long timescales. To overcome this bottleneck, we…

Biomolecules · Quantitative Biology 2018-07-09 Zahra Shamsi , Kevin J. Cheng , Diwakar Shukla

Recently, large vision and language models have shown their success when adapting them to many downstream tasks. In this paper, we present a unified framework named CLIP-ADA for Anomaly Detection by Adapting a pre-trained CLIP model. To…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Yuxuan Cai , Xinwei He , Dingkang Liang , Ao Tong , Xiang Bai

The goal of this paper is to self-train a 3D convolutional neural network on an unlabeled video collection for deployment on small-scale video collections. As smaller video datasets benefit more from motion than appearance, we strive to…

Computer Vision and Pattern Recognition · Computer Science 2021-05-05 Kirill Gavrilyuk , Mihir Jain , Ilia Karmanov , Cees G. M. Snoek

Language models pretrained on text from a wide variety of sources form the foundation of today's NLP. In light of the success of these broad-coverage models, we investigate whether it is still helpful to tailor a pretrained model to the…

Computation and Language · Computer Science 2020-05-07 Suchin Gururangan , Ana Marasović , Swabha Swayamdipta , Kyle Lo , Iz Beltagy , Doug Downey , Noah A. Smith

While self-supervised pretraining has proven beneficial for many computer vision tasks, it requires expensive and lengthy computation, large amounts of data, and is sensitive to data augmentation. Prior work demonstrates that models…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 Colorado J. Reed , Xiangyu Yue , Ani Nrusimha , Sayna Ebrahimi , Vivek Vijaykumar , Richard Mao , Bo Li , Shanghang Zhang , Devin Guillory , Sean Metzger , Kurt Keutzer , Trevor Darrell

Visual object recognition -- the behavioral ability to rapidly and accurately categorize many visually encountered objects -- is core to primate cognition. This behavioral capability is algorithmically impressive because of the myriad…

Neurons and Cognition · Quantitative Biology 2023-12-12 Kohitij Kar , James J DiCarlo

Data-driven techniques for machine vision heavily depend on the training data to sufficiently resemble the data occurring during test and application. However, in practice unknown distortion can lead to a domain gap between training and…

Image and Video Processing · Electrical Eng. & Systems 2022-10-25 Maximiliane Gruber , Fabian Brand , Alina Mosebach , Jürgen Seiler , André Kaup

This paper presents Dual Action Policy (DAP), a novel approach to address the dynamics mismatch inherent in the sim-to-real gap of reinforcement learning. DAP uses a single policy to predict two sets of actions: one for maximizing task…

Machine Learning · Computer Science 2024-10-17 Ng Wen Zheng Terence , Chen Jianda

In the context of supervised statistical learning, it is typically assumed that the training set comes from the same distribution that draws the test samples. When this is not the case, the behavior of the learned model is unpredictable and…

Machine Learning · Computer Science 2022-05-12 Antonio-Javier Gallego , Jorge Calvo-Zaragoza , Robert B. Fisher

While pose estimation is an important computer vision task, it requires expensive annotation and suffers from domain shift. In this paper, we investigate the problem of domain adaptive 2D pose estimation that transfers knowledge learned on…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Donghyun Kim , Kaihong Wang , Kate Saenko , Margrit Betke , Stan Sclaroff

We propose the use of self-supervised learning for human activity recognition with smartphone accelerometer data. Our proposed solution consists of two steps. First, the representations of unlabeled input signals are learned by training a…

Signal Processing · Electrical Eng. & Systems 2021-09-03 Setareh Rahimi Taghanaki , Michael Rainbow , Ali Etemad