English
Related papers

Related papers: Measures of Complexity for Large Scale Image Datas…

200 papers

The measure of a machine learning algorithm is the difficulty of the tasks it can perform, and sufficiently difficult tasks are critical drivers of strong machine learning models. However, quantifying the generalization difficulty of…

Machine Learning · Computer Science 2023-06-06 Akhilan Boopathy , Kevin Liu , Jaedong Hwang , Shu Ge , Asaad Mohammedsaleh , Ila Fiete

Deep Neural Networks (DNNs), with its promising performance, are being increasingly used in safety critical applications such as autonomous driving, cancer detection, and secure authentication. With growing importance in deep learning,…

Machine Learning · Computer Science 2019-11-19 Senthil Mani , Anush Sankaran , Srikanth Tamilselvam , Akshay Sethi

The Web today has millions of datasets, and the number of datasets continues to grow at a rapid pace. These datasets are not standalone entities; rather, they are intricately connected through complex relationships. Semantic relationships…

Information Retrieval · Computer Science 2024-08-28 Kate Lin , Tarfah Alrashed , Natasha Noy

A key obstacle in automated analytics and meta-learning is the inability to recognize when different datasets contain measurements of the same variable. Because provided attribute labels are often uninformative in practice, this task may be…

Machine Learning · Computer Science 2019-09-12 Jonas Mueller , Alex Smola

Traditional instance-based model analysis focuses mainly on misclassified instances. However, this approach overlooks the varying difficulty associated with different instances. Ideally, a robust model should recognize and reflect the…

Human-Computer Interaction · Computer Science 2025-07-02 Linhao Meng , Stef van den Elzen , Anna Vilanova

Neural networks have dramatically increased our capacity to learn from large, high-dimensional datasets across innumerable disciplines. However, their decisions are not easily interpretable, their computational costs are high, and building…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Mackenzie J. Meni , Ryan T. White , Michael Mayo , Kevin Pilkiewicz

Measuring the complexity of high-dimensional data in physical systems becomes a critical factor in determining the information and quality of the systems. However, traditional metrics, such as Lyapunov exponent, fractal dimension, and…

Physics and Society · Physics 2026-03-03 Seong-Gyun Im , Taewoo Kang , S. Joon Kwon

This paper introduces a novel approach to evaluating deep learning models' capacity for in-diagram logic interpretation. Leveraging the intriguing realm of visual illusions, we establish a unique dataset, InDL, designed to rigorously test…

Computer Vision and Pattern Recognition · Computer Science 2023-06-07 Haobo Yang , Wenyu Wang , Ze Cao , Zhekai Duan , Xuchen Liu

The research community has increasing interest in autonomous driving research, despite the resource intensity of obtaining representative real world data. Existing self-driving datasets are limited in the scale and variation of the…

Datasets of visualization play a crucial role in automating data-driven visualization pipelines, serving as the foundation for supervised model training and algorithm benchmarking. In this paper, we survey the literature on visualization…

Human-Computer Interaction · Computer Science 2024-07-24 Can Liu , Ruike Jiang , Shaocong Tan , Jiacheng Yu , Chaofan Yang , Hanning Shao , Xiaoru Yuan

The state of the art of many learning tasks, e.g., image classification, is advanced by collecting larger datasets and then training larger models on them. As the outcome, the increasing computational cost is becoming unaffordable. In this…

Machine Learning · Computer Science 2024-06-17 Muyang He , Shuo Yang , Tiejun Huang , Bo Zhao

One fundamental challenge of vehicle re-identification (re-id) is to learn robust and discriminative visual representation, given the significant intra-class vehicle variations across different camera views. As the existing vehicle datasets…

Computer Vision and Pattern Recognition · Computer Science 2022-05-02 Zhedong Zheng , Tao Ruan , Yunchao Wei , Yi Yang , Tao Mei

Modern computer vision algorithms often rely on very large training datasets. However, it is conceivable that a carefully selected subsample of the dataset is sufficient for training. In this paper, we propose a gradient-based importance…

Machine Learning · Computer Science 2018-12-03 Kailas Vodrahalli , Ke Li , Jitendra Malik

Autonomous driving and assistance systems rely on annotated data from traffic and road scenarios to model and learn the various object relations in complex real-world scenarios. Preparation and training of deploy-able deep learning…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Shubham Dokania , A. H. Abdul Hafez , Anbumani Subramanian , Manmohan Chandraker , C. V. Jawahar

In embodied intelligence, datasets play a pivotal role, serving as both a knowledge repository and a conduit for information transfer. The two most critical attributes of a dataset are the amount of information it provides and how easily…

Robotics · Computer Science 2025-11-13 Jiahao Xiao , Bowen Yan , Jianbo Zhang , Jia Wang , Chunyi Li , Zhengxue Cheng , Guangtao Zhai

Measuring inter-dataset similarity is an important task in machine learning and data mining with various use cases and applications. Existing methods for measuring inter-dataset similarity are computationally expensive, limited, or…

Machine Learning · Computer Science 2025-05-06 Muhammad Rajabinasab , Anton D. Lautrup , Arthur Zimek

Dataset complexity assessment aims to predict classification performance on a dataset with complexity calculation before training a classifier, which can also be used for classifier selection and dataset reduction. The training process of…

Computer Vision and Pattern Recognition · Computer Science 2022-09-30 Guang Li , Ren Togo , Takahiro Ogawa , Miki Haseyama

Deep supervised models have an unprecedented capacity to absorb large quantities of training data. Hence, training on many datasets becomes a method of choice towards graceful degradation in unusual scenes. Unfortunately, different datasets…

Computer Vision and Pattern Recognition · Computer Science 2021-11-03 Petra Bevandić , Marin Oršić , Ivan Grubišić , Josip Šarić , Siniša Šegvić

The complexity of visual stimuli plays an important role in many cognitive phenomena, including attention, engagement, memorability, time perception and aesthetic evaluation. Despite its importance, complexity is poorly understood and…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Tingke Shen , Surabhi S Nath , Aenne Brielmann , Peter Dayan

The ever-increasing fine-tuning cost of large-scale pre-trained models gives rise to the importance of dataset pruning, which aims to reduce dataset size while maintaining task performance. However, existing dataset pruning methods require…

Machine Learning · Computer Science 2025-05-09 Wenyu Jiang , Zhenlong Liu , Zejian Xie , Songxin Zhang , Bingyi Jing , Hongxin Wei