English
Related papers

Related papers: JCTC: A Large Job posting Corpus for Text Classifi…

200 papers

Standard multi-task benchmarks are essential for developing pretraining models that can generalize to various downstream tasks. Existing benchmarks for natural language processing (NLP) usually focus only on understanding or generating…

Computation and Language · Computer Science 2022-01-19 Jian Guan , Zhuoer Feng , Yamei Chen , Ruilin He , Xiaoxi Mao , Changjie Fan , Minlie Huang

The amount of text that is generated every day is increasing dramatically. This tremendous volume of mostly unstructured text cannot be simply processed and perceived by computers. Therefore, efficient and effective techniques and…

Computation and Language · Computer Science 2017-07-31 Mehdi Allahyari , Seyedamin Pouriyeh , Mehdi Assefi , Saied Safaei , Elizabeth D. Trippe , Juan B. Gutierrez , Krys Kochut

Automatic Text Categorization (TC) is a complex and useful task for many natural language applications, and is usually performed through the use of a set of manually classified documents, a training collection. We suggest the utilization of…

cmp-lg · Computer Science 2008-02-03 Manuel de Buenaga Rodriguez , Jose Maria Gomez Hidalgo , Belen Diaz Agudo

Text classification, as the task consisting in assigning categories to textual instances, is a very common task in information science. Methods learning distributed representations of words, such as word embeddings, have become popular in…

Computation and Language · Computer Science 2020-12-15 Arkaitz Zubiaga

During the development of large language models (LLMs), the scale and quality of the pre-training data play a crucial role in shaping LLMs' capabilities. To accelerate the research of LLMs, several large-scale datasets, such as C4 [1], Pile…

Computation and Language · Computer Science 2023-11-13 Jianghao Chen , Pu Jian , Tengxiao Xi , Dongyi Yi , Qianlong Du , Chenglin Ding , Guibo Zhu , Chengqing Zong , Jinqiao Wang , Jiajun Zhang

This paper introduces the Material Contracts Corpus (MCC), a publicly available dataset comprising over one million contracts filed by public companies with the U.S. Securities and Exchange Commission (SEC) between 2000 and 2023. The MCC…

Computation and Language · Computer Science 2025-04-07 Peter Adelson , Julian Nyarko

This paper presents a machine learning methodology prototype using a large synthetic dataset of job listings to identify trends, predict salaries, and group similar job roles. Employing techniques such as regression, classification,…

Machine Learning · Computer Science 2025-06-23 Abdel Rahman Alsheyab , Mohammad Alkhasawneh , Nidal Shahin

In this paper, we introduce the Chinese corpus from CLUE organization, CLUECorpus2020, a large-scale corpus that can be used directly for self-supervised learning such as pre-training of a language model, or language generation. It has 100G…

Computation and Language · Computer Science 2020-03-06 Liang Xu , Xuanwei Zhang , Qianqian Dong

In recent years, there has been an exponential growth in the number of complex documents and texts that require a deeper understanding of machine learning methods to be able to accurately classify texts in many applications. Many machine…

Machine Learning · Computer Science 2020-05-21 Kamran Kowsari , Kiana Jafari Meimandi , Mojtaba Heidarysafa , Sanjana Mendu , Laura E. Barnes , Donald E. Brown

Most dialogue systems in real world rely on predefined intents and answers for QA service, so discovering potential intents from large corpus previously is really important for building such dialogue services. Considering that most…

Machine Learning · Computer Science 2022-01-20 Feng Wei , Zhenbo Chen , Zhenghong Hao , Fengxin Yang , Hua Wei , Bing Han , Sheng Guo

In the dynamic realm of online recruitment, accurate job classification is paramount for optimizing job recommendation systems, search rankings, and labor market analyses. As job markets evolve, the increasing complexity of job titles and…

Machine Learning · Computer Science 2025-07-15 Md Ahsanul Kabir , Kareem Abdelfatah , Mohammed Korayem , Mohammad Al Hasan

Text classification is one of the most widely studied tasks in natural language processing. Motivated by the principle of compositionality, large multilayer neural network models have been employed for this task in an attempt to effectively…

Computation and Language · Computer Science 2018-08-07 Devendra Singh Sachan , Manzil Zaheer , Ruslan Salakhutdinov

Deep learning based models have surpassed classical machine learning based approaches in various text classification tasks, including sentiment analysis, news categorization, question answering, and natural language inference. In this…

Computation and Language · Computer Science 2021-01-05 Shervin Minaee , Nal Kalchbrenner , Erik Cambria , Narjes Nikzad , Meysam Chenaghlu , Jianfeng Gao

Natural Language Processing technology has advanced vastly in the past decade. Text processing has been successfully applied to a wide variety of domains. In this paper, we propose a novel framework, Text Based Classification(TBC), that…

Artificial Intelligence · Computer Science 2023-11-22 Keshav Ramani , Daniel Borrajo

Text classification is a quintessential and practical problem in natural language processing with applications in diverse domains such as sentiment analysis, fake news detection, medical diagnosis, and document classification. A sizable…

Computation and Language · Computer Science 2024-10-15 Syed Mustafa Haider Rizvi , Ramsha Imran , Arif Mahmood

The cross-domain text-to-SQL task aims to build a system that can parse user questions into SQL on complete unseen databases, and the single-domain text-to-SQL task evaluates the performance on identical databases. Both of these setups…

Computation and Language · Computer Science 2023-05-26 Hanchong Zhang , Jieyu Li , Lu Chen , Ruisheng Cao , Yunyan Zhang , Yu Huang , Yefeng Zheng , Kai Yu

We present DepCC, the largest-to-date linguistically analyzed corpus in English including 365 million documents, composed of 252 billion tokens and 7.5 billion of named entity occurrences in 14.3 billion sentences from a web-scale crawl of…

Computation and Language · Computer Science 2018-03-01 Alexander Panchenko , Eugen Ruppert , Stefano Faralli , Simone Paolo Ponzetto , Chris Biemann

This paper presents a comprehensive study on resume classification to reduce the time and labor needed to screen an overwhelming number of applications significantly, while improving the selection of suitable candidates. A total of 6,492…

Computation and Language · Computer Science 2020-11-06 Changmao Li , Elaine Fisher , Rebecca Thomas , Steve Pittard , Vicki Hertzberg , Jinho D. Choi

With the rapid growth of the data volume and the fast increasing of the computational model complexity in the scenario of cloud computing, it becomes an important topic that how to handle users' requests by scheduling computational jobs and…

Machine Learning · Computer Science 2021-05-10 Zheqi Zhu , Pingyi Fan

Text Clustering is a text mining technique which divides the given set of text documents into significant clusters. It is used for organizing a huge number of text documents into a well-organized form. In the majority of the clustering…

Information Retrieval · Computer Science 2015-03-12 G. Hannah Grace , Kalyani Desikan