English
Related papers

Related papers: Self-Paced Learning with Adaptive Deep Visual Embe…

200 papers

The fundamental goal of self-supervised learning (SSL) is to produce useful representations of data without access to any labels for classifying the data. Modern methods in SSL, which form representations based on known or constructed…

Machine Learning · Computer Science 2022-09-30 Bobak T. Kiani , Randall Balestriero , Yubei Chen , Seth Lloyd , Yann LeCun

Deep Metric Learning (DML) proposes to learn metric spaces which encode semantic similarities as embedding space distances. These spaces should be transferable to classes beyond those seen during training. Commonly, DML methods task…

Computer Vision and Pattern Recognition · Computer Science 2022-03-17 Karsten Roth , Oriol Vinyals , Zeynep Akata

Convolutional neural networks (CNNs) have been widely used for image classification. Despite its high accuracies, CNN has been shown to be easily fooled by some adversarial examples, indicating that CNN is not robust enough for pattern…

Computer Vision and Pattern Recognition · Computer Science 2018-05-10 Hong-Ming Yang , Xu-Yao Zhang , Fei Yin , Cheng-Lin Liu

At the core of self-supervised learning for vision is the idea of learning invariant or equivariant representations with respect to a set of data transformations. This approach, however, introduces strong inductive biases, which can render…

Machine Learning · Computer Science 2024-05-29 Sharut Gupta , Chenyu Wang , Yifei Wang , Tommi Jaakkola , Stefanie Jegelka

Deep neural networks have achieved remarkable success in single image super-resolution (SISR). The computing and memory requirements of these methods have hindered their application to broad classes of real devices with limited computing…

Computer Vision and Pattern Recognition · Computer Science 2018-06-06 Lei Zhang , Peng Wang , Chunhua Shen , Lingqiao Liu , Wei Wei , Yanning Zhang , Anton van den Hengel

t-distributed stochastic neighbor embedding (t-SNE) is a well-established visualization method for complex high-dimensional data. However, the original t-SNE method is nonparametric, stochastic, and often cannot well prevserve the global…

Computer Vision and Pattern Recognition · Computer Science 2022-01-14 Zixia Zhou , Yuanyuan Wang , Boudewijn P. F. Lelieveldt , Qian Tao

Feature matching and finding correspondences between endoscopic images is a key step in many clinical applications such as patient follow-up and generation of panoramic image from clinical sequences for fast anomalies localization.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-25 Manel Farhat , Houda Chaabouni-Chouayakh , Achraf Ben-Hamadou

Domain adaptation for semantic segmentation enables to alleviate the need for large-scale pixel-wise annotations. Recently, self-supervised learning (SSL) with a combination of image-to-image translation shows great effectiveness in…

Computer Vision and Pattern Recognition · Computer Science 2021-08-16 Yiting Cheng , Fangyun Wei , Jianmin Bao , Dong Chen , Fang Wen , Wenqiang Zhang

Attempting to fully exploit the rich information of topological structure and node features for attributed graph, we introduce self-supervised learning mechanism to graph representation learning and propose a novel Self-supervised Consensus…

Social and Information Networks · Computer Science 2021-08-12 Changshu Liu , Liangjian Wen , Zhao Kang , Guangchun Luo , Ling Tian

Deep learning is reshaping mobile applications, with a growing trend of deploying deep neural networks (DNNs) directly to mobile and embedded devices to address real-time performance and privacy. To accommodate local resource limitations,…

Artificial Intelligence · Computer Science 2024-12-03 Yuzhan Wang , Sicong Liu , Bin Guo , Boqi Zhang , Ke Ma , Yasan Ding , Hao Luo , Yao Li , Zhiwen Yu

Motivated by extreme multi-label classification applications, we consider training deep learning models over sparse data in multi-GPU servers. The variance in the number of non-zero features across training batches and the intrinsic GPU…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-10-15 Yujing Ma , Florin Rusu , Kesheng Wu , Alexander Sim

Progress has been achieved recently in object detection given advancements in deep learning. Nevertheless, such tools typically require a large amount of training data and significant manual effort to label objects. This limits their…

Robotics · Computer Science 2017-08-04 Chaitanya Mitash , Kostas E. Bekris , Abdeslam Boularias

Deep convolutional neural networks have been proved successful on a wide range of tasks, yet they are still hindered by their large computation cost in many industrial scenarios. In this paper, we propose to reduce such cost for CNNs…

Machine Learning · Computer Science 2019-10-22 Jinting Chen , Zhaocheng Zhu , Cheng Li , Yuming Zhao

Deep neural networks represent a powerful class of function approximators that can learn to compress and reconstruct images. Existing image compression algorithms based on neural networks learn quantized representations with a constant…

Computer Vision and Pattern Recognition · Computer Science 2018-02-09 David Minnen , George Toderici , Michele Covell , Troy Chinen , Nick Johnston , Joel Shor , Sung Jin Hwang , Damien Vincent , Saurabh Singh

Pooling layers are essential building blocks of convolutional neural networks (CNNs), to reduce computational overhead and increase the receptive fields of proceeding convolutional operations. Their goal is to produce downsampled volumes…

Computer Vision and Pattern Recognition · Computer Science 2022-12-05 Alexandros Stergiou , Ronald Poppe

In this work, we investigate the feasibility and effectiveness of employing deep learning algorithms for automatic recognition of the modulation type of received wireless communication signals from subsampled data. Recent work considered a…

Signal Processing · Electrical Eng. & Systems 2019-01-18 Sharan Ramjee , Shengtai Ju , Diyu Yang , Xiaoyu Liu , Aly El Gamal , Yonina C. Eldar

In this paper, we propose a novel Attentive Multi-View Deep Subspace Nets (AMVDSN), which deeply explores underlying consistent and view-specific information from multiple views and fuse them by considering each view's dynamic contribution…

Computer Vision and Pattern Recognition · Computer Science 2021-12-24 Run-kun Lu , Jian-wei Liu , Xin Zuo

Learning similarity is a key aspect in medical image analysis, particularly in recommendation systems or in uncovering the interpretation of anatomical data in images. Most existing methods learn such similarities in the embedding space…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Sukesh Adiga , Jose Dolz , Herve Lombaert

Deep neural networks (DNN) have achieved remarkable success in various fields, including computer vision and natural language processing. However, training an effective DNN model still poses challenges. This paper aims to propose a method…

Machine Learning · Computer Science 2024-07-03 Hejie Ying , Mengmeng Song , Yaohong Tang , Shungen Xiao , Zimin Xiao

Semi-supervised learning via teacher-student network can train a model effectively on a few labeled samples. It enables a student model to distill knowledge from the teacher's predictions of extra unlabeled data. However, such knowledge…

Computer Vision and Pattern Recognition · Computer Science 2023-05-29 Hongkuan Shi , Zhiwei Wang , Ying Zhou , Dun Li , Xin Yang , Qiang Li