中文
相关论文

相关论文: Mining Gaze for Contrastive Learning toward Comput…

200 篇论文

Contrastive learning methods in computer vision typically rely on augmented views of the same image or multimodal pretraining strategies that align paired modalities. However, these approaches often overlook semantic relationships between…

计算机视觉与模式识别 · 计算机科学 2026-05-11 Marta Hasny , Maxime Di Folco , Keno Bressem , Julia Schnabel

Recent self-supervised contrastive learning provides an effective approach for unsupervised person re-identification (ReID) by learning invariance from different views (transformed versions) of an input. In this paper, we incorporate a…

计算机视觉与模式识别 · 计算机科学 2021-03-31 Hao Chen , Yaohui Wang , Benoit Lagadec , Antitza Dantcheva , Francois Bremond

In this paper, we introduce a contrastive learning framework for keypoint detection (CoKe). Keypoint detection differs from other visual tasks where contrastive learning has been applied because the input is a set of images in which…

计算机视觉与模式识别 · 计算机科学 2022-12-06 Yutong Bai , Angtian Wang , Adam Kortylewski , Alan Yuille

The integration of different imaging modalities, such as structural, diffusion tensor, and functional magnetic resonance imaging, with deep learning models has yielded promising outcomes in discerning phenotypic characteristics and…

图像与视频处理 · 电气工程与系统科学 2024-10-08 Zhiyuan Li , Hailong Li , Anca L. Ralescu , Jonathan R. Dillman , Mekibib Altaye , Kim M. Cecil , Nehal A. Parikh , Lili He

Contrastively trained vision-language models have achieved remarkable progress in vision and language representation learning, leading to state-of-the-art models for various downstream multimodal tasks. However, recent research has…

计算与语言 · 计算机科学 2023-10-26 Harman Singh , Pengchuan Zhang , Qifan Wang , Mengjiao Wang , Wenhan Xiong , Jingfei Du , Yu Chen

Approaches for teaching learning agents via human demonstrations have been widely studied and successfully applied to multiple domains. However, the majority of imitation learning work utilizes only behavioral information from the…

Dense retrieval (DR) has shown promising results in information retrieval. In essence, DR requires high-quality text representations to support effective search in the representation space. Recent studies have shown that pre-trained…

信息检索 · 计算机科学 2022-08-23 Xinyu Ma , Ruqing Zhang , Jiafeng Guo , Yixing Fan , Xueqi Cheng

In medical image analysis, regression plays a critical role in computer-aided diagnosis. It enables quantitative measurements such as age prediction from structural imaging, cardiac function quantification, and molecular measurement from…

机器学习 · 计算机科学 2025-03-25 Yilei Wu , Zijian Dong , Chongyao Chen , Wangchunshu Zhou , Juan Helen Zhou

We introduce a novel Region-based contrastive pretraining for Medical Image Retrieval (RegionMIR) that demonstrates the feasibility of medical image retrieval with similar anatomical regions. RegionMIR addresses two major challenges for…

计算机视觉与模式识别 · 计算机科学 2023-05-10 Ho Hin Lee , Alberto Santamaria-Pang , Jameson Merkow , Ozan Oktay , Fernando Pérez-García , Javier Alvarez-Valle , Ivan Tarapov

Robust gaze estimation is a challenging task, even for deep CNNs, due to the non-availability of large-scale labeled data. Moreover, gaze annotation is a time-consuming process and requires specialized hardware setups. We propose MTGLS: a…

计算机视觉与模式识别 · 计算机科学 2021-12-14 Shreya Ghosh , Munawar Hayat , Abhinav Dhall , Jarrod Knibbe

Learning scientific document representations can be substantially improved through contrastive learning objectives, where the challenge lies in creating positive and negative training samples that encode the desired similarity semantics.…

计算与语言 · 计算机科学 2022-10-20 Malte Ostendorff , Nils Rethmeier , Isabelle Augenstein , Bela Gipp , Georg Rehm

Intensive care units (ICU) are increasingly looking towards machine learning for methods to provide online monitoring of critically ill patients. In machine learning, online monitoring is often formulated as a supervised learning problem.…

机器学习 · 计算机科学 2021-09-17 Hugo Yèche , Gideon Dresdner , Francesco Locatello , Matthias Hüser , Gunnar Rätsch

This study presents a novel framework for 3D gaze tracking tailored for mixed-reality settings, aimed at enhancing joint attention and collaborative efforts in team-based scenarios. Conventional gaze tracking, often limited by monocular…

计算机视觉与模式识别 · 计算机科学 2024-06-18 Eduardo Davalos , Yike Zhang , Ashwin T. S. , Joyce H. Fonteles , Umesh Timalsina , Guatam Biswas

Contrastive Language-Image Pre-training (CLIP) stands as one of the most effective and scalable methods for training transferable vision models using paired image and text data. CLIP models are trained using contrastive loss, which…

计算机视觉与模式识别 · 计算机科学 2023-10-31 Lijie Fan , Dilip Krishnan , Phillip Isola , Dina Katabi , Yonglong Tian

Link prediction tasks focus on predicting possible future connections. Most existing researches measure the likelihood of links by different similarity scores on node pairs and predict links between nodes. However, the similarity-based…

机器学习 · 计算机科学 2023-03-09 Zehua Zhang , Shilin Sun , Guixiang Ma , Caiming Zhong

Vision-language pretraining has been shown to produce high-quality visual encoders which transfer efficiently to downstream computer vision tasks. Contrastive learning approaches have increasingly been adopted for medical vision language…

计算机视觉与模式识别 · 计算机科学 2025-01-13 Keegan Quigley , Miriam Cha , Josh Barua , Geeticka Chauhan , Seth Berkowitz , Steven Horng , Polina Golland

Modern neural recording techniques such as two-photon imaging or Neuropixel probes allow to acquire vast time-series datasets with responses of hundreds or thousands of neurons. Contrastive learning is a powerful self-supervised framework…

Contrastive learning has been proved to be a promising technique for image-level representation learning from unlabeled data. Many existing works have demonstrated improved results by applying contrastive learning in classification and…

图像与视频处理 · 电气工程与系统科学 2021-09-20 Dewen Zeng , John N. Kheir , Peng Zeng , Yiyu Shi

Medical image classification is one of the most important tasks for computer-aided diagnosis. Deep learning models, particularly convolutional neural networks, have been successfully used for disease classification from medical images,…

计算机视觉与模式识别 · 计算机科学 2023-05-05 Md. Atik Ahamed , Jin Chen , Abdullah-Al-Zubaer Imran

Deep learning in medical imaging has the potential to minimize the risk of diagnostic errors, reduce radiologist workload, and accelerate diagnosis. Training such deep learning models requires large and accurate datasets, with annotations…

计算机视觉与模式识别 · 计算机科学 2023-11-28 Daniel Wolf , Tristan Payer , Catharina Silvia Lisson , Christoph Gerhard Lisson , Meinrad Beer , Michael Götz , Timo Ropinski