English
Related papers

Related papers: DMT-JEPA: Discriminative Masked Targets for Joint-…

200 papers

Masked Autoencoders (MAE) have shown promising performance in self-supervised learning for both 2D and 3D computer vision. However, existing MAE-style methods can only learn from the data of a single modality, i.e., either images or point…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Ziyu Guo , Renrui Zhang , Longtian Qiu , Xianzhi Li , Pheng-Ann Heng

Masked autoencoder has been widely explored in point cloud self-supervised learning, whereby the point cloud is generally divided into visible and masked parts. These methods typically include an encoder accepting visible patches…

Computer Vision and Pattern Recognition · Computer Science 2024-10-25 Xiangdong Zhang , Shaofeng Zhang , Junchi Yan

This paper introduces a two-phase deep feature engineering framework for efficient learning of semantics enhanced joint embedding, which clearly separates the deep feature engineering in data preprocessing from training the text-image joint…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Zhongwei Xie , Ling Liu , Yanzhao Wu , Luo Zhong , Lin Li

Generating user intent from a sequence of user interface (UI) actions is a core challenge in comprehensive UI understanding. Recent advancements in multimodal large language models (MLLMs) have led to substantial progress in this area, but…

Computation and Language · Computer Science 2024-10-03 Yicheng Fu , Raviteja Anantha , Prabal Vashisht , Jianpeng Cheng , Etai Littwin

Current approaches to memory in neural systems rely on similarity-based retrieval: given a query, find the most representationally similar stored state. This assumption -- that useful memories are similar memories -- fails to capture a…

Machine Learning · Computer Science 2026-03-20 Jason Dury

End-to-end multi-object tracking (MOT) methods have recently achieved remarkable progress by unifying detection and association within a single framework. Despite their strong detection performance, these methods suffer from relatively low…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Yuqing Shao , Yuchen Yang , Rui Yu , Weilong Li , Xu Guo , Huaicheng Yan , Wei Wang , Xiao Sun

Conventional techniques to establish dense correspondences across visually or semantically similar images focused on designing a task-specific matching prior, which is difficult to model. To overcome this, recent learning-based methods have…

Computer Vision and Pattern Recognition · Computer Science 2021-12-16 Sunghwan Hong , Seungryong Kim

Meta-learning facilitates few-shot hyperspectral target detection (HTD), but adapting deep backbones remains challenging. Full-parameter fine-tuning is inefficient and prone to overfitting, and existing methods largely ignore the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Luqi Gong , Qixin Xie , Yue Chen , Ziqiang Chen , Fanda Fan , Shuai Zhao , Chao Li

In this work, we propose a novel data-driven machine learning (ML) technique to model and predict the dynamics of the wireless propagation environment in latent space. Leveraging the idea of channel charting, which learns compressed…

Machine Learning · Computer Science 2024-09-17 Charbel Bou Chaaya , Abanoub M. Girgis , Mehdi Bennis

High-resolution range profile (HRRP)-based radar automatic target recognition suffers from severe performance degradation in composite jamming environments. Active jamming introduces suppression- and deception-related components into the…

Signal Processing · Electrical Eng. & Systems 2026-05-25 Yunfei Zhao , Mei Liu , Shuowei Liu , Xunzhang Gao , Yujie Zhou

Masked Image Modeling has been one of the most popular self-supervised learning paradigms to learn representations from large-scale, unlabeled Earth Observation images. While incorporating multi-modal and multi-temporal Earth Observation…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Liang Zeng , Valerio Marsocci , Wufan Zhao , Andrea Nascetti , Maarten Vergauwen

Unsupervised domain adaptation (UDA) for semantic segmentation seeks to transfer models from a labeled source domain to an unlabeled target domain. While auxiliary self-supervised tasks such as contrastive learning have enhanced feature…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Wenlve Zhou , Zhiheng Zhou , Tiantao Xian , Yikui Zhai , Weibin Wu , Biyun Ma

Large Language Models (LLMs) obey consistent scaling laws -- empirical power-law fits that predict how loss decreases with compute, data, and parameters. While predictive, these laws are descriptive rather than prescriptive: they…

Machine Learning · Computer Science 2026-02-27 Hai Huang , Yann LeCun , Randall Balestriero

Target detection in high-resolution remote sensing imagery faces challenges due to the low recognition accuracy of small targets and high computational costs. The computational complexity of the Transformer architecture increases…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Qianqian Zhang , WeiJun Wang , Yunxing Liu , Li Zhou , Hao Zhao , Junshe An , Zihan Wang

Existing state-of-the-art feature matchers capture long-range dependencies with Transformers but are hindered by high spatial complexity, leading to demanding training and highlatency inference. Striking a better balance between performance…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Xiaoyong Lu , Songlin Du

Self-supervised pre-training for images without labels has recently achieved promising performance in image classification. The success of transformer-based methods, ViT and MAE, draws the community's attention to the design of backbone…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Jiantao Wu , Shentong Mo

Deep metric learning aims to learn an embedding function, modeled as deep neural network. This embedding function usually puts semantically similar images close while dissimilar images far from each other in the learned embedding space.…

Computer Vision and Pattern Recognition · Computer Science 2018-09-03 Wonsik Kim , Bhavya Goyal , Kunal Chawla , Jungmin Lee , Keunjoo Kwon

Unsupervised semantic segmentation aims to automatically partition images into semantically meaningful regions by identifying global semantic categories within an image corpus without any form of annotation. Building upon recent advances in…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Oliver Hahn , Nikita Araslanov , Simone Schaub-Meyer , Stefan Roth

Modern diffusion models encounter a fundamental trade-off between training efficiency and generation quality. While existing representation alignment methods, such as REPA, accelerate convergence through patch-wise alignment, they often…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Hesen Chen , Junyan Wang , Zhiyu Tan , Hao Li

A long-standing challenge in AI is to develop agents capable of solving a wide range of physical tasks and generalizing to new, unseen tasks and environments. A popular recent approach involves training a world model from state-action…

Artificial Intelligence · Computer Science 2026-05-19 Basile Terver , Tsung-Yen Yang , Jean Ponce , Adrien Bardes , Yann LeCun