English
Related papers

Related papers: Dataset vs Reality: Understanding Model Performanc…

200 papers

Advances in deep learning systems have allowed large models to match or surpass human accuracy on a number of skills such as image classification, basic programming, and standardized test taking. As the performance of the most capable…

Machine Learning · Computer Science 2024-06-10 Sarah Pratt , Seth Blumberg , Pietro Kreitlon Carolino , Meredith Ringel Morris

Continuous/Lifelong learning of high-dimensional data streams is a challenging research problem. In fact, fully retraining models each time new data become available is infeasible, due to computational and storage issues, while na\"ive…

Computer Vision and Pattern Recognition · Computer Science 2017-05-11 Vincenzo Lomonaco , Davide Maltoni

In this paper, we describe a dataset and baseline result for a question answering that utilizes web tables. It contains commonly asked questions on the web and their corresponding answers found in tables on websites. Our dataset is novel in…

Computation and Language · Computer Science 2019-04-17 Bhavya Karki , Fan Hu , Nithin Haridas , Suhail Barot , Zihua Liu , Lucile Callebert , Matthias Grabmair , Anthony Tomasic

Most Reading Comprehension methods limit themselves to queries which can be answered using a single sentence, paragraph, or document. Enabling models to combine disjoint pieces of textual evidence would extend the scope of machine…

Computation and Language · Computer Science 2018-06-12 Johannes Welbl , Pontus Stenetorp , Sebastian Riedel

Social intelligence is essential for understanding and reasoning about human expressions, intents and interactions. One representative benchmark for its study is Social Intelligence Queries (Social-IQ), a dataset of multiple-choice…

Computation and Language · Computer Science 2023-10-31 Xiao-Yu Guo , Yuan-Fang Li , Gholamreza Haffari

With the remarkable development of large language models (LLMs), ensuring the factuality of output has become a challenge. However, having all the contents of the response with given knowledge or facts is not necessarily a good thing in…

Computation and Language · Computer Science 2024-06-17 Ryohei Kamei , Daiki Shiono , Reina Akama , Jun Suzuki

Time is an important dimension in our physical world. Lots of facts can evolve with respect to time. For example, the U.S. President might change every four years. Therefore, it is important to consider the time dimension and empower the…

Computation and Language · Computer Science 2021-10-26 Wenhu Chen , Xinyi Wang , William Yang Wang

A visual relationship denotes a relationship between two objects in an image, which can be represented as a triplet of (subject; predicate; object). Visual relationship detection is crucial for scene understanding in images. Existing visual…

Computer Vision and Pattern Recognition · Computer Science 2020-10-13 Chenhui Chu , Yuto Takebayashi , Mishra Vipul , Yuta Nakashima

Retriever-augmented instruction-following models are attractive alternatives to fine-tuned approaches for information-seeking tasks such as question answering (QA). By simply prepending retrieved documents in its input along with an…

Computation and Language · Computer Science 2024-04-18 Vaibhav Adlakha , Parishad BehnamGhader , Xing Han Lu , Nicholas Meade , Siva Reddy

Current vision systems are trained on huge datasets, and these datasets come with costs: curation is expensive, they inherit human biases, and there are concerns over privacy and usage rights. To counter these costs, interest has surged in…

Computer Vision and Pattern Recognition · Computer Science 2022-05-02 Manel Baradad , Jonas Wulff , Tongzhou Wang , Phillip Isola , Antonio Torralba

In recent years, deep learning models have become the standard for agricultural computer vision. Such models are typically fine-tuned to agricultural tasks using model weights that were originally fit to more general, non-agricultural…

Computer Vision and Pattern Recognition · Computer Science 2022-08-05 Amogh Joshi , Dario Guevara , Mason Earles

This study explores the ability of Image Captioning (IC) models to decode masked visual content sourced from diverse datasets. Our findings reveal the IC model's capability to generate captions from masked images, closely resembling the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Zhicheng Du , Zhaotian Xie , Huazhang Ying , Likun Zhang , Peiwu Qin

Concept-based explanations have emerged as a popular way of extracting human-interpretable representations from deep discriminative models. At the same time, the disentanglement learning literature has focused on extracting similar…

Machine Learning · Computer Science 2021-04-15 Dmitry Kazhdan , Botty Dimanov , Helena Andres Terre , Mateja Jamnik , Pietro Liò , Adrian Weller

Continuous-time series is essential for different modern application areas, e.g. healthcare, automobile, energy, finance, Internet of things (IoT) and other related areas. Different application needs to process as well as analyse a massive…

Machine Learning · Computer Science 2024-09-17 Mansura Habiba , Barak A. Pearlmutter , Mehrdad Maleki

The success stories from deep learning models increase every day spanning different tasks from image classification to natural language understanding. With the increasing popularity of these models, scientists spend more and more time…

Computer Vision and Pattern Recognition · Computer Science 2020-09-29 Ethem F. Can , Aysu Ezen-Can

Recent progress in artificial intelligence (AI) has renewed interest in building systems that learn and think like people. Many advances have come from using deep neural networks trained end-to-end in tasks such as object recognition, video…

Artificial Intelligence · Computer Science 2016-11-03 Brenden M. Lake , Tomer D. Ullman , Joshua B. Tenenbaum , Samuel J. Gershman

The ability to train generative models that produce realistic, safe and useful tabular data is essential for data privacy, imputation, oversampling, explainability or simulation. However, generating tabular data is not straightforward due…

Machine Learning · Computer Science 2025-09-18 G. Charbel N. Kindji , Lina Maria Rojas-Barahona , Elisa Fromont , Tanguy Urvoy

The search for suitable datasets is the critical "first step" in data-driven research, but it remains a great challenge. Researchers often need to search for datasets based on high-level task descriptions. However, existing search systems…

Databases · Computer Science 2025-12-18 Zixin Wei , Yucan Guo , Jinyang Li , Xiaolin Han , Xiaolong Jin , Chenhao Ma

Artificial Intelligence (AI) has made its way into various scientific fields, providing astonishing improvements over existing algorithms for a wide variety of tasks. In recent years, there have been severe concerns over the trustworthiness…

Machine Learning · Computer Science 2024-08-20 Surbhi Mittal , Kartik Thakral , Richa Singh , Mayank Vatsa , Tamar Glaser , Cristian Canton Ferrer , Tal Hassner

The choice of model class is fundamental in statistical learning and system identification, no matter whether the class is derived from physical principles or is a generic black-box. We develop a method to evaluate the specified model class…

Machine Learning · Statistics 2017-12-20 Andreas Svensson , Dave Zachariah , Thomas B. Schön