English
Related papers

Related papers: A meta-analysis on the performance of machine-lear…

200 papers

Mitigating bias in training on biased datasets is an important open problem. Several techniques have been proposed, however the typical evaluation regime is very limited, considering very narrow data conditions. For instance, the effect of…

Machine Learning · Computer Science 2022-10-18 Xudong Han , Aili Shen , Trevor Cohn , Timothy Baldwin , Lea Frermann

Machine Learning (ML) is increasingly used across many disciplines with impressive reported results. However, recent studies suggest published performance of ML models are often overoptimistic. Validity concerns are underscored by findings…

Machine Learning · Computer Science 2024-07-15 Pouria Saidi , Gautam Dasarathy , Visar Berisha

Large language models (LLMs) achieve strong average performance yet remain unreliable at the instance level, with frequent hallucinations, brittle failures, and poorly calibrated confidence. We study reliability through the lens of…

Artificial Intelligence · Computer Science 2026-01-13 Pranav Kallem

Machine Learning (ML) is increasingly applied in real-life scenarios, raising concerns about bias in automatic decision making. We focus on bias as a notion of opinion exclusion, that stems from the direct application of traditional ML…

Machine Learning · Computer Science 2019-11-07 Agathe Balayn , Alessandro Bozzon

Sentiment analysis is a pivotal task in the domain of natural language processing. It encompasses both text-level sentiment polarity classification and word-level Part of Speech(POS) sentiment polarity determination. Such analysis…

Computation and Language · Computer Science 2023-09-15 Chengguang Gan , Qinghao Zhang , Tatsunori Mori

Large Language Models (LLMs) have the impressive ability to perform in-context learning (ICL) from only a few examples, but the success of ICL varies widely from task to task. Thus, it is important to quickly determine whether ICL is…

Computation and Language · Computer Science 2023-10-27 Harvey Yiyun Fu , Qinyuan Ye , Albert Xu , Xiang Ren , Robin Jia

Most of existing work learn sentiment-specific word representation for improving Twitter sentiment classification, which encoded both n-gram and distant supervised tweet sentiment information in learning process. They assume all words…

Computation and Language · Computer Science 2018-05-30 Shufeng Xiong

Sentiment analysis (SA) has been a long-standing research area in natural language processing. It can offer rich insights into human sentiments and opinions and has thus seen considerable interest from both academia and industry. With the…

Computation and Language · Computer Science 2023-05-25 Wenxuan Zhang , Yue Deng , Bing Liu , Sinno Jialin Pan , Lidong Bing

Sentiment analysis or opinion mining has become an open research domain after proliferation of Internet and Web 2.0 social media. People express their attitudes and opinions on social media including blogs, discussion forums, tweets, etc.…

Information Retrieval · Computer Science 2013-09-17 Anuj sharma , Shubhamoy Dey

In this paper, we investigate continual learning performance metrics used in class incremental learning strategies for continual learning (CL) using some high performing methods. We investigate especially mean task accuracy. First, we show…

Machine Learning · Computer Science 2024-04-11 Konaté Mohamed Abbas , Anne-Françoise Yao , Thierry Chateau , Pierre Bouges

This paper introduces the MCML approach for empirically studying the learnability of relational properties that can be expressed in the well-known software design language Alloy. A key novelty of MCML is quantification of the performance of…

Machine Learning · Computer Science 2020-09-08 Muhammad Usman , Wenxi Wang , Kaiyuan Wang , Marko Vasic , Haris Vikalo , Sarfraz Khurshid

We investigate large language model performance across five orders of magnitude of compute scaling in eleven recent model architectures. We show that average benchmark performance, aggregating over many individual tasks and evaluations as…

Machine Learning · Computer Science 2024-01-11 David Owen

Rapid increase in the volume of sentiment rich social media on the web has resulted in an increased interest among researchers regarding Sentimental Analysis and opinion mining. However, with so much social media available on the web,…

Information Retrieval · Computer Science 2014-10-28 Chetan Kaushik , Atul Mishra

Sentiment analysis is the process of identifying and categorizing people's emotions or opinions regarding various topics. The analysis of Twitter sentiment has become an increasingly popular topic in recent years. In this paper, we present…

Computation and Language · Computer Science 2023-08-30 Mohammad Dehghani , Zahra Yazdanparast

This paper introduces a novel deep learning framework including a lexicon-based approach for sentence-level prediction of sentiment label distribution. We propose to first apply semantic rules and then use a Deep Convolutional Neural…

Computation and Language · Computer Science 2017-06-27 Huy Nguyen , Minh-Le Nguyen

Fairness in both Machine Learning (ML) predictions and human decision-making is essential, yet both are susceptible to different forms of bias, such as algorithmic and data-driven in ML, and cognitive or subjective in humans. In this study,…

Computation and Language · Computer Science 2025-08-28 Junhua Liu , Roy Ka-Wei Lee , Kwan Hui Lim

Investors are interested in predicting future success of startup companies, preferably using publicly available data which can be gathered using free online sources. Using public-only data has been shown to work, but there is still much…

Machine Learning · Computer Science 2023-12-12 Emily Gavrilenko , Foaad Khosmood , Mahdi Rastad , Sadra Amiri Moghaddam

In translating text where sentiment is the main message, human translators give particular attention to sentiment-carrying words. The reason is that an incorrect translation of such words would miss the fundamental aspect of the source…

Computation and Language · Computer Science 2021-10-06 Hadeel Saadany , Constantin Orasan , Emad Mohamed , Ashraf Tantawy

Language development experts need tools that can automatically identify languages from fluent, conversational speech, and provide reliable estimates of usage rates at the level of an individual recording. However, language identification…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-31 Suzy J. Styles , Victoria Y. H. Chua , Fei Ting Woon , Hexin Liu , Leibny Paola Garcia Perera , Sanjeev Khudanpur , Andy W. H. Khong , Justin Dauwels

In this paper, we present computational models to predict Twitter users' attitude towards a specific brand through their personal and social characteristics. We also predict their likelihood to take different actions based on their…

Social and Information Networks · Computer Science 2017-04-18 Jalal Mahmud , Geli Fei , Anbang Xu , Aditya Pal , Michelle Zhou