English
Related papers

Related papers: Wrangling Messy CSV Files by Detecting Row and Typ…

200 papers

Dataset distillation aims to synthesize a compact yet representative dataset that preserves the essential characteristics of the original data for efficient model training. Existing methods mainly focus on improving data-synthetic alignment…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Jiacheng Cui , Zhaoyi Li , Xiaochen Ma , Xinyue Bi , Yaxin Luo , Zhiqiang Shen

The amount of data for processing and categorization grows at an ever increasing rate. At the same time the demand for collaboration and transparency in organizations, government and businesses, drives the release of data from internal…

Machine Learning · Computer Science 2020-08-26 Jan Neerbek

Often the challenge associated with tasks like fraud and spam detection[1] is the lack of all likely patterns needed to train suitable supervised learning models. In order to overcome this limitation, such tasks are attempted as outlier or…

Machine Learning · Computer Science 2018-08-22 Utkarsh Porwal , Smruthi Mukund

A systematic review identifies and collates various clinical studies and compares data elements and results in order to provide an evidence based answer for a particular clinical question. The process is manual and involves lot of time. A…

Information Retrieval · Computer Science 2016-06-22 Tanmay Basu , Shraman Kumar , Abhishek Kalyan , Priyanka Jayaswal , Pawan Goyal , Stephen Pettifer , Siddhartha R. Jonnalagadda

Programming language detection is a common need in the analysis of large source code bases. It is supported by a number of existing tools that rely on several features, and most notably file extensions, to determine file types. We consider…

Software Engineering · Computer Science 2021-03-02 Francesca Del Bonifro , Maurizio Gabbrielli , Stefano Zacchiroli

Motivation: Next Generation Sequencing technologies revolutionized many fields in biology by enabling the fast and cheap sequencing of large amounts of genomic data. The ever increasing sequencing capacities enabled by current sequencing…

Genomics · Quantitative Biology 2012-07-24 Himanshu Asnani , Dinesh Bharadia , Mainak Chowdhury , Idoia Ochoa , Itai Sharon , Tsachy Weissman

Text line detection is a key task in historical document analysis facing many challenges of arbitrary-shaped text lines, dense texts, and text lines with high aspect ratios, etc. In this paper, we propose a general framework for historical…

Computation and Language · Computer Science 2024-07-09 Xingjian Hu , Baole Wei , Liangcai Gao , Jun Wang

Breaking long documents into smaller segments is a fundamental challenge in information retrieval. Whether for search engines, question-answering systems, or retrieval-augmented generation (RAG), effective segmentation determines how well…

Information Retrieval · Computer Science 2026-02-17 Christos Koutsiaris

We develop an iterative subsampling approach to improve the computational efficiency of our previous work on solution path clustering (SPC). The SPC method achieves clustering by concave regularization on the pairwise distances between…

Methodology · Statistics 2016-09-16 Yuliya Marchetti , Qing Zhou

Line separators are used to segregate text-lines from one another in document image analysis. Finding the separator points at every line terminal in a document image would enable text-line segmentation. In particular, identifying the…

Computer Vision and Pattern Recognition · Computer Science 2017-08-21 Amarnath R , P. Nagabhushan

Discriminating between closely-related language varieties is considered a challenging and important task. This paper describes our submission to the DSL 2016 shared-task, which included two sub-tasks: one on discriminating similar languages…

Computation and Language · Computer Science 2016-09-27 Yonatan Belinkov , James Glass

Automatic, template-free extraction of information from form images is challenging due to the variety of form layouts. This is even more challenging for historical forms due to noise and degradation. A crucial part of the extraction process…

Computer Vision and Pattern Recognition · Computer Science 2019-09-20 Brian Davis , Bryan Morse , Scott Cohen , Brian Price , Chris Tensmeyer

The task of table structure recognition aims to recognize the internal structure of a table, which is a key step to make machines understand tables. Currently, there are lots of studies on this task for different file formats such as ASCII…

Information Retrieval · Computer Science 2019-08-29 Zewen Chi , Heyan Huang , Heng-Da Xu , Houjin Yu , Wanxuan Yin , Xian-Ling Mao

Most of the fastest-growing string collections today are repetitive, that is, most of the constituent documents are similar to many others. As these collections keep growing, a key approach to handling them is to exploit their…

Information Retrieval · Computer Science 2017-05-22 Travis Gagie , Aleksi Hartikainen , Kalle Karhu , Juha Kärkkäinen , Gonzalo Navarro , Simon J. Puglisi , Jouni Sirén

Traditionally, data compression deals with the problem of concisely representing a data source, e.g. a sequence of letters, for the purpose of eventual reproduction (either exact or approximate). In this work we are interested in the case…

Information Theory · Computer Science 2013-12-10 Amir Ingber , Tsachy Weissman

Dataset Condensation is a newly emerging technique aiming at learning a tiny dataset that captures the rich information encoded in the original dataset. As the size of datasets contemporary machine learning models rely on becomes…

Machine Learning · Computer Science 2022-10-18 Justin Cui , Ruochen Wang , Si Si , Cho-Jui Hsieh

Improving data quality in unstructured documents is a long-standing challenge. Unstructured data, especially in textual form, inherently lacks defined semantics, which poses significant challenges for effective processing and for ensuring…

Databases · Computer Science 2025-02-26 Besat Kassaie , Frank Wm. Tompa

Dataset distillation methods reduce large-scale datasets to smaller sets of synthetic data, preserving sufficient information to quickly train a new model from scratch. However, prior work on dataset distillation has focused exclusively on…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Xindi Wu , Byron Zhang , Zhiwei Deng , Olga Russakovsky

A powerful approach to detecting erroneous data is to check which potentially dirty data records are incompatible with a user's domain knowledge. Previous approaches allow the user to specify domain knowledge in the form of logical…

Databases · Computer Science 2019-02-27 Jing Nathan Yan , Oliver Schulte , Jiannan Wang , Reynold Cheng

Deep learning models have shown promising results in a wide range of computer vision applications across various domains. The success of deep learning methods relies heavily on the availability of a large amount of data. Deep neural…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Nooshin Mojab , Philip S. Yu , Joelle A. Hallak , Darvin Yi