English
Related papers

Related papers: Contrastive Learning for Continuous Touch-Based Au…

200 papers

Markerless motion capture (MMC) is revolutionizing gait analysis in clinical settings by making it more accessible, raising the question of how to extract the most clinically meaningful information from gait data. In multiple fields ranging…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 R. James Cotton , J. D. Peiffer , Kunal Shah , Allison DeLillo , Anthony Cimorelli , Shawana Anarwala , Kayan Abdou , Tasos Karakostas

Audio-Visual Emotion Recognition (AVER) has garnered increasing attention in recent years for its critical role in creating emotion-ware intelligent machines. Previous efforts in this area are dominated by the supervised learning paradigm.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Licai Sun , Zheng Lian , Bin Liu , Jianhua Tao

Ensuring validation for highly automated driving poses significant obstacles to the widespread adoption of highly automated vehicles. Scenario-based testing offers a potential solution by reducing the homologation effort required for these…

Machine Learning · Computer Science 2023-09-19 Maximilian Zipfl , Moritz Jarosch , J. Marius Zöllner

The more new features that are being added to smartphones, the harder it becomes for users to find them. This is because the feature names are usually short, and there are just too many to remember. In such a case, the users may want to ask…

Information Retrieval · Computer Science 2023-07-19 Joonyoung Kim , Kangwook Lee , Haebin Shin , Hurnjoo Lee , Sechun Kang , Byunguk Choi , Dong Shin , Joohyung Lee

Contrastive learning has been shown to produce generalizable representations of audio and visual data by maximizing the lower bound on the mutual information (MI) between different views of an instance. However, obtaining a tight lower…

Machine Learning · Computer Science 2021-04-20 Shuang Ma , Zhaoyang Zeng , Daniel McDuff , Yale Song

Variational autoencoders are powerful algorithms for identifying dominant latent structure in a single dataset. In many applications, however, we are interested in modeling latent structure and variation that are enriched in a target…

Machine Learning · Computer Science 2019-02-14 Abubakar Abid , James Zou

With recent advancements in deep learning methods, automatically learning deep features from the original data is becoming an effective and widespread approach. However, the hand-crafted expert knowledge-based features are still insightful.…

Machine Learning · Computer Science 2021-05-10 Guanjie Huang , Fenglong Ma

Current mobile user authentication systems based on PIN codes, fingerprint, and face recognition have several shortcomings. Such limitations have been addressed in the literature by exploring the feasibility of passive authentication on…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Giuseppe Stragapede , Ruben Vera-Rodriguez , Ruben Tolosana , Aythami Morales , Alejandro Acien , Gael Le Lan

Detecting surface anomalies of industrial materials poses a significant challenge within a myriad of industrial manufacturing processes. In recent times, various methodologies have emerged, capitalizing on the advantages of employing a…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Simon Thomine , Hichem Snoussi

Learning from tabular data is of paramount importance, as it complements the conventional analysis of image and video data by providing a rich source of structured information that is often critical for comprehensive understanding and…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Kankana Roy , Lars Krämer , Sebastian Domaschke , Malik Haris , Roland Aydin , Fabian Isensee , Martin Held

Representation learning is a fundamental aspect of modern artificial intelligence, driving substantial improvements across diverse applications. While selfsupervised contrastive learning has led to significant advancements in fields like…

Machine Learning · Computer Science 2024-11-19 Suiyao Chen , Jing Wu , Yunxiao Wang , Cheng Ji , Tianpei Xie , Daniel Cociorva , Michael Sharps , Cecile Levasseur , Hakan Brunzell

This paper presents miCSE, a mutual information-based contrastive learning framework that significantly advances the state-of-the-art in few-shot sentence embedding. The proposed approach imposes alignment between the attention pattern of…

Computation and Language · Computer Science 2023-05-24 Tassilo Klein , Moin Nabi

Contrastive learning has nearly closed the gap between supervised and self-supervised learning of image representations, and has also been explored for videos. However, prior work on contrastive learning for video data has not explored the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Ishan Dave , Rohit Gupta , Mamshad Nayeem Rizve , Mubarak Shah

Contrastive learning has been widely used to train transformer-based vision-language models for video-text alignment and multi-modal representation learning. This paper presents a new algorithm called Token-Aware Cascade contrastive…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Jianwei Yang , Yonatan Bisk , Jianfeng Gao

We focus on contrastive methods for self-supervised video representation learning. A common paradigm in contrastive learning is to construct positive pairs by sampling different data views for the same instance, with different data…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Chen Sun , Arsha Nagrani , Yonglong Tian , Cordelia Schmid

This paper addresses the increasingly prominent problem of anomaly detection in distributed systems. It proposes a detection method based on federated contrastive learning. The goal is to overcome the limitations of traditional centralized…

Machine Learning · Computer Science 2025-06-25 Renzi Meng , Heyi Wang , Yumeng Sun , Qiyuan Wu , Lian Lian , Renhan Zhang

In the contrastive analysis (CA) setting, machine learning practitioners are specifically interested in discovering patterns that are enriched in a target dataset as compared to a background dataset generated from sources of variation…

Machine Learning · Computer Science 2022-02-23 Ethan Weinberger , Nicasia Beebe-Wang , Su-In Lee

In this work, we attempted to extend the thought and showcase a way forward for the Self-supervised Learning (SSL) learning paradigm by combining contrastive learning, self-distillation (knowledge distillation) and masked data modelling,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Maheswar Bora , Saurabh Atreya , Aritra Mukherjee , Abhijit Das

The major paradigm of applying a pre-trained language model to downstream tasks is to fine-tune it on labeled task data, which often suffers instability and low performance when the labeled examples are scarce.~One way to alleviate this…

Computation and Language · Computer Science 2021-06-07 Ruikun Luo , Guanhuan Huang , Xiaojun Quan

Self-supervised learning (SSL) has recently become the favorite among feature learning methodologies. It is therefore appealing for domain adaptation approaches to consider incorporating SSL. The intuition is to enforce instance-level…

Computer Vision and Pattern Recognition · Computer Science 2021-12-15 Yang Chen , Yingwei Pan , Yu Wang , Ting Yao , Xinmei Tian , Tao Mei