中文
相关论文

相关论文: Understanding the limitations of self-supervised l…

200 篇论文

Selecting informative data points for expert feedback can significantly improve the performance of anomaly detection (AD) in various contexts, such as medical diagnostics or fraud detection. In this paper, we determine a set of theoretical…

机器学习 · 计算机科学 2023-07-06 Aodong Li , Chen Qiu , Marius Kloft , Padhraic Smyth , Stephan Mandt , Maja Rudolph

In the context of mobile sensing environments, various sensors on mobile devices continually generate a vast amount of data. Analyzing this ever-increasing data presents several challenges, including limited access to annotated data and a…

机器学习 · 计算机科学 2023-05-02 Jason Liu , Shohreh Deldari , Hao Xue , Van Nguyen , Flora D. Salim

Recent semi-supervised and self-supervised methods have shown great success in the image and text domain by utilizing augmentation techniques. Despite such success, it is not easy to transfer this success to tabular domains. It is not easy…

机器学习 · 计算机科学 2022-12-05 Morteza Mohammady Gharasuie , Fenjiao Wang

Despite their irresistible success, deep learning algorithms still heavily rely on annotated data. On the other hand, unsupervised settings pose many challenges, especially about determining the right inductive bias in diverse scenarios.…

计算机视觉与模式识别 · 计算机科学 2021-03-11 Beril Besbinar , Pascal Frossard

Providing visual summaries of scientific publications can increase information access for readers and thereby help deal with the exponential growth in the number of scientific publications. Nonetheless, efforts in providing visual…

信息检索 · 计算机科学 2021-01-15 Shintaro Yamamoto , Anne Lauscher , Simone Paolo Ponzetto , Goran Glavaš , Shigeo Morishima

Recent literature in self-supervised has demonstrated significant progress in closing the gap between supervised and unsupervised methods in the image and text domains. These methods rely on domain-specific augmentations that are not…

机器学习 · 计算机科学 2021-09-02 Sajad Darabi , Shayan Fazeli , Ali Pazoki , Sriram Sankararaman , Majid Sarrafzadeh

Self-supervised learning enables the training of large neural models without the need for large, labeled datasets. It has been generating breakthroughs in several fields, including computer vision, natural language processing, biology, and…

计算与语言 · 计算机科学 2023-12-19 Luis Lugo , Valentin Vielzeuf

Although self-supervised learning enables us to bootstrap the training by exploiting unlabeled data, the generic self-supervised methods for natural images do not sufficiently incorporate the context. For medical images, a desirable method…

图像与视频处理 · 电气工程与系统科学 2022-07-08 Li Sun , Ke Yu , Kayhan Batmanghelich

Though anomaly detection (AD) can be viewed as a classification problem (nominal vs. anomalous) it is usually treated in an unsupervised manner since one typically does not have access to, or it is infeasible to utilize, a dataset that…

机器学习 · 计算机科学 2023-01-30 Lukas Ruff , Robert A. Vandermeulen , Billy Joe Franks , Klaus-Robert Müller , Marius Kloft

Anomaly detection on tabular data is commonly studied under three supervision regimes, including one-class settings that assume access to anomaly-free training samples, fully unsupervised settings with unlabeled and potentially contaminated…

机器学习 · 计算机科学 2026-03-23 Jack Yi Wei , Narges Armanfard

Deep anomaly detection models using a supervised mode of learning usually work under a closed set assumption and suffer from overfitting to previously seen rare anomalies at training, which hinders their applicability in a real scenario. In…

图像与视频处理 · 电气工程与系统科学 2020-10-26 Behzad Bozorgtabar , Dwarikanath Mahapatra , Guillaume Vray , Jean-Philippe Thiran

Self-supervision as an emerging technique has been employed to train convolutional neural networks (CNNs) for more transferrable, generalizable, and robust representation learning of images. Its introduction to graph convolutional networks…

机器学习 · 计算机科学 2020-07-21 Yuning You , Tianlong Chen , Zhangyang Wang , Yang Shen

In the realms of computer vision, it is evident that deep neural networks perform better in a supervised setting with a large amount of labeled data. The representations learned with supervision are not only of high quality but also helps…

机器学习 · 计算机科学 2020-09-28 Souradip Chakraborty , Aritra Roy Gosthipaty , Sayak Paul

Deep learning perception models require a massive amount of labeled training data to achieve good performance. While unlabeled data is easy to acquire, the cost of labeling is prohibitive and could create a tremendous burden on companies or…

计算机视觉与模式识别 · 计算机科学 2021-11-19 Xinnan Du , William Zhang , Jose M. Alvarez

Self-supervised learning has attracted plenty of recent research interest. However, most works for self-supervision in speech are typically unimodal and there has been limited work that studies the interaction between audio and visual…

音频与语音处理 · 电气工程与系统科学 2021-03-19 Abhinav Shukla , Stavros Petridis , Maja Pantic

Anomaly detection is important in many real-life applications. Recently, self-supervised learning has greatly helped deep anomaly detection by recognizing several geometric transformations. However these methods lack finer features, usually…

计算机视觉与模式识别 · 计算机科学 2022-12-12 Loic Jezequel , Ngoc-Son Vu , Jean Beaudet , Aymeric Histace

Reinforcement learning optimizes policies for expected cumulative reward. Need the supervision be so narrow? Reward is delayed and sparse for many tasks, making it a difficult and impoverished signal for end-to-end optimization. To augment…

机器学习 · 计算机科学 2017-03-10 Evan Shelhamer , Parsa Mahmoudieh , Max Argus , Trevor Darrell

Human adaptability relies crucially on learning and merging knowledge from both supervised and unsupervised tasks: the parents point out few important concepts, but then the children fill in the gaps on their own. This is particularly…

计算机视觉与模式识别 · 计算机科学 2021-04-01 Silvia Bucci , Antonio D'Innocente , Yujun Liao , Fabio Maria Carlucci , Barbara Caputo , Tatiana Tommasi

Deep supervised learning has achieved great success in the last decade. However, its deficiencies of dependence on manual labels and vulnerability to attacks have driven people to explore a better solution. As an alternative,…

机器学习 · 计算机科学 2021-06-28 Xiao Liu , Fanjin Zhang , Zhenyu Hou , Zhaoyu Wang , Li Mian , Jing Zhang , Jie Tang

Semi-supervised anomaly detection, which aims to improve the anomaly detection performance by using a small amount of labeled anomaly data in addition to unlabeled data, has attracted attention. Existing semi-supervised approaches assume…

机器学习 · 统计学 2025-02-11 Hiroshi Takahashi , Tomoharu Iwata , Atsutoshi Kumagai , Yuuki Yamanaka