English
Related papers

Related papers: A Large-scale Study of Representation Learning wit…

200 papers

Multi-task learning in text classification leverages implicit correlations among related tasks to extract common features and yield performance gains. However, most previous works treat labels of each task as independent and meaningless…

Computation and Language · Computer Science 2017-10-20 Honglun Zhang , Liqiang Xiao , Wenqing Chen , Yongkun Wang , Yaohui Jin

It is common within the deep learning community to first pre-train a deep neural network from a large-scale dataset and then fine-tune the pre-trained model to a specific downstream task. Recently, both supervised and unsupervised…

Machine Learning · Computer Science 2020-11-13 Jincheng Zhong , Ximei Wang , Zhi Kou , Jianmin Wang , Mingsheng Long

Visual Attention Prediction (VAP) is a significant and imperative issue in the field of computer vision. Most of existing VAP methods are based on deep learning. However, they do not fully take advantage of the low-level contrast features…

Computer Vision and Pattern Recognition · Computer Science 2021-03-10 Yuan Yuan , Hailong Ning , Xiaoqiang Lu

Human perception of surroundings is often guided by the various poses present within the environment. Many computer vision tasks, such as human action recognition and robot imitation learning, rely on pose-based entities like human…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Dominick Reilly , Aman Chadha , Srijan Das

In this work, we evaluate the effectiveness of representation learning approaches for decision making in visually complex environments. Representation learning is essential for effective reinforcement learning (RL) from high-dimensional…

Machine Learning · Computer Science 2022-04-26 Jun Yamada , Karl Pertsch , Anisha Gunjal , Joseph J. Lim

Many tasks in computer vision can be cast as a "label changing" problem, where the goal is to make a semantic change to the appearance of an image or some subject in an image in order to alter the class membership. Although successful…

Machine Learning · Computer Science 2016-03-21 Jacob R. Gardner , Paul Upchurch , Matt J. Kusner , Yixuan Li , Kilian Q. Weinberger , Kavita Bala , John E. Hopcroft

Anticipating actions and objects before they start or appear is a difficult problem in computer vision with several real-world applications. This task is challenging partly because it requires leveraging extensive knowledge of the world…

Computer Vision and Pattern Recognition · Computer Science 2016-12-01 Carl Vondrick , Hamed Pirsiavash , Antonio Torralba

Multimodality Representation Learning, as a technique of learning to embed information from different modalities and their correlations, has achieved remarkable success on a variety of applications, such as Visual Question Answering (VQA),…

Artificial Intelligence · Computer Science 2024-03-04 Muhammad Arslan Manzoor , Sarah Albarri , Ziting Xian , Zaiqiao Meng , Preslav Nakov , Shangsong Liang

Recent research tries to extend image restoration capabilities from human perception to machine perception, thereby enhancing the performance of high-level vision tasks in degraded environments. These methods, primarily based on supervised…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Jiawei Wu , Zhi Jin

Visual-Language Alignment (VLA) has gained a lot of attention since CLIP's groundbreaking work. Although CLIP performs well, the typical direct latent feature alignment lacks clarity in its representation and similarity scores. On the other…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Yifan Li , Yikai Wang , Yanwei Fu , Dongyu Ru , Zheng Zhang , Tong He

One of the biggest challenges for deep learning algorithms in medical image analysis is the indiscriminate mixing of image properties, e.g. artifacts and anatomy. These entangled image properties lead to a semantically redundant feature…

Machine Learning · Computer Science 2019-08-22 Qingjie Meng , Nick Pawlowski , Daniel Rueckert , Bernhard Kainz

Deep neural networks (DNNs) are typically evaluated under the assumption that each image has a single correct label. However, many images in benchmarks like ImageNet contain multiple valid labels, creating a mismatch between evaluation…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Esla Timothy Anzaku , Seyed Amir Mousavi , Arnout Van Messem , Wesley De Neve

Optimal viewpoint prediction is an essential task in many computer graphics applications. Unfortunately, common viewpoint qualities suffer from two major drawbacks: dependency on clean surface meshes, which are not always available, and the…

Graphics · Computer Science 2021-02-10 Michael Schelling , Pedro Hermosilla , Pere-Pau Vazquez , Timo Ropinski

Image Classification is a fundamental task in the field of computer vision that frequently serves as a benchmark for gauging advancements in Computer Vision. Over the past few years, significant progress has been made in image…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Mahmoud Khalil , Ahmad Khalil , Alioune Ngom

Deep learning has achieved impressive performance in many domains, such as computer vision and natural language processing, but its advantage over classical shallow methods on tabular datasets remains questionable. It is especially…

Machine Learning · Computer Science 2023-08-25 Witold Wydmański , Oleksii Bulenok , Marek Śmieja

A prominent technique for self-supervised representation learning has been to contrast semantically similar and dissimilar pairs of samples. Without access to labels, dissimilar (negative) points are typically taken to be randomly sampled…

Machine Learning · Computer Science 2020-10-22 Ching-Yao Chuang , Joshua Robinson , Lin Yen-Chen , Antonio Torralba , Stefanie Jegelka

3D object representation learning is a fundamental challenge in computer vision to infer about the 3D world. Recent advances in deep learning have shown their efficiency in 3D object recognition, among which view-based methods have…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 Xiang Gao , Wei Hu , Guo-Jun Qi

Deep neural networks have shown great success in representation learning. However, when learning with noisy labels (LNL), they can easily overfit and fail to generalize to new data. This paper introduces a simple and effective method, named…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Yuyin Zhou , Xianhang Li , Fengze Liu , Qingyue Wei , Xuxi Chen , Lequan Yu , Cihang Xie , Matthew P. Lungren , Lei Xing

In this work we explore the generalization characteristics of unsupervised representation learning by leveraging disentangled VAE's to learn a useful latent space on a set of relational reasoning problems derived from Raven Progressive…

Machine Learning · Computer Science 2018-11-13 Xander Steenbrugge , Sam Leroux , Tim Verbelen , Bart Dhoedt

Self-supervised representation learning methods have achieved significant success in computer vision and natural language processing, where data samples exhibit explicit spatial or semantic dependencies. However, applying these methods to…