English
Related papers

Related papers: Bias Correction in Machine Learning-based Classifi…

200 papers

To address the challenges of imbalanced multi-class datasets typically used for rare event detection in critical cyber-physical systems, we propose an optimal, efficient, and adaptable mixed integer programming (MIP) ensemble weighting…

Machine Learning · Computer Science 2025-04-16 Georgios Tertytchny , Georgios L. Stavrinides , Maria K. Michael

In this paper we present the results of an experiment aimed to use machine learning methods to obtain models that can be used for the automatic classification of products. In order to apply automatic classification methods, we transformed…

Computation and Language · Computer Science 2025-02-28 Bogdan Oancea

Text classification is an important topic in the field of natural language processing. It has been preliminarily applied in information retrieval, digital library, automatic abstracting, text filtering, word semantic discrimination and many…

Computation and Language · Computer Science 2023-12-20 Hao Li , Brandon Bennett

In the field of computational physics and material science, the efficient sampling of rare events occurring at atomic scale is crucial. It aids in understanding mechanisms behind a wide range of important phenomena, including protein…

Machine Learning · Computer Science 2024-01-17 Xinru Hua , Rasool Ahmad , Jose Blanchet , Wei Cai

We present a reformulation of the regression and classification, which aims to validate the result of a machine learning algorithm. Our reformulation simplifies the original problem and validates the result of the machine learning algorithm…

Machine Learning · Computer Science 2021-01-19 Wolfgang Fuhl , Yao Rong , Thomas Motz , Michael Scheidt , Andreas Hartel , Andreas Koch , Enkelejda Kasneci

In this paper we discuss several issues related to automated text classification of web sites. We analyze the nature of web content and metadata in relation to requirements for text features. We find that HTML metatags are a good source of…

Information Retrieval · Computer Science 2007-05-23 John M. Pierre

Human biases have been shown to influence the performance of models and algorithms in various fields, including Natural Language Processing. While the study of this phenomenon is garnering focus in recent years, the available resources are…

Computation and Language · Computer Science 2024-08-15 Ana Sofia Evans , Helena Moniz , Luísa Coheur

Training classifiers is difficult with severe class imbalance, but many rare events are the culmination of a sequence with much more common intermediate outcomes. For example, in online marketing a user first sees an ad, then may click on…

Methodology · Statistics 2023-05-31 Gregory Faletto , Jacob Bien

The development of Internet technology has led to a rapid increase in news information. Filtering out valuable content from complex information has become an urgentproblem that needs to be solved. In view of the shortcomings of traditional…

Computation and Language · Computer Science 2024-09-25 Bingyao Liu , Jiajing Chen , Rui Wang , Junming Huang , Yuanshuai Luo , Jianjun Wei

Many classification applications require accurate probability estimates in addition to good class separation but often classifiers are designed focusing only on the latter. Calibration is the process of improving probability estimates by…

Machine Learning · Computer Science 2020-01-31 Tuomo Alasalmi , Jaakko Suutala , Heli Koskimäki , Juha Röning

The increasing adoption of technology to augment or even replace traditional face-to-face learning has led to the development of a myriad of tools and platforms aimed at engaging the students and facilitating the teacher's ability to…

Computation and Language · Computer Science 2020-11-25 Jernej Vivod

Institutions are increasingly relying on machine learning models to identify and alert on abnormal events, such as fraud, cyber attacks and system failures. These alerts often need to be manually investigated by specialists. Given the…

Machine Learning · Computer Science 2021-11-02 Parisa Hassanzadeh , Danial Dervovic , Samuel Assefa , Prashant Reddy , Manuela Veloso

In many real-world settings, the critical class is rare and a missed detection carries a disproportionately high cost. For example, tumors are rare and a false negative diagnosis could have severe consequences on treatment outcomes;…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Mohammadi Kiarash , Zhao He , Mengyao Zhai , Frederick Tung

The avalanche quantity of the information developed by mankind has led to concept of automation of knowledge extraction - Data Mining ([1]). This direction is connected with a wide spectrum of problems - from recognition of the fuzzy set to…

Machine Learning · Computer Science 2009-06-05 A. A. Shumeyko , S. L. Sotnik

Event detection in time series is a challenging task due to the prevalence of imbalanced datasets, rare events, and time interval-defined events. Traditional supervised deep learning methods primarily employ binary classification, where…

Machine Learning · Statistics 2024-09-16 Menouar Azib , Benjamin Renard , Philippe Garnier , Vincent Génot , Nicolas André

We propose a new approach to address the text classification problems when learning with partial labels is beneficial. Instead of offering each training sample a set of candidate labels, we assign negative-oriented labels to the ambiguous…

Machine Learning · Statistics 2019-06-11 Jiangning Chen , Zhibo Dai , Juntao Duan , Qianli Hu , Ruilin Li , Heinrich Matzinger , Ionel Popescu , Haoyan Zhai

Often, what is termed algorithmic bias in machine learning will be due to historic bias in the training data. But sometimes the bias may be introduced (or at least exacerbated) by the algorithm itself. The ways in which algorithms can…

Machine Learning · Computer Science 2021-04-20 Padraig Cunningham , Sarah Jane Delany

Task-specific word identification aims to choose the task-related words that best describe a short text. Existing approaches require well-defined seed words or lexical dictionaries (e.g., WordNet), which are often unavailable for many…

Computation and Language · Computer Science 2017-06-06 Shuhan Yuan , Xintao Wu , Yang Xiang

In this article, we propose using deep learning and transformer architectures combined with classical machine learning algorithms to detect and identify text anomalies in texts. Deep learning model provides a very crucial context…

Computation and Language · Computer Science 2022-11-28 Amir Jafari

As the amount of online text increases, the demand for text classification to aid the analysis and management of text is increasing. Text is cheap, but information, in the form of knowing what classes a text belongs to, is expensive.…

Machine Learning · Computer Science 2010-09-27 Chowdhury Mofizur Rahman , Ferdous Ahmed Sohel , Parvez Naushad , S. M. Kamruzzaman