English
Related papers

Related papers: Unbiased Math Word Problems Benchmark for Mitigati…

200 papers

Imbalances in covariates between treatment groups are frequent in observational studies and can lead to biased comparisons. Various adjustment methods can be employed to correct these biases in the context of multi-level treatments ($>$ 2).…

Applications · Statistics 2021-06-04 Diop S. Arona , Duchesne Thierry , Cumming Steven , Diop Awa , Talbot Denis

Natural Language Sentence Matching (NLSM) has gained substantial attention from both academics and the industry, and rich public datasets contribute a lot to this process. However, biased datasets can also hurt the generalization…

Computation and Language · Computer Science 2019-06-11 Guanhua Zhang , Bing Bai , Jian Liang , Kun Bai , Shiyu Chang , Mo Yu , Conghui Zhu , Tiejun Zhao

Multimodal Large Language Models (MLLMs) excel in solving text-based mathematical problems, but they struggle with mathematical diagrams since they are primarily trained on natural scene images. For humans, visual aids generally enhance…

Computation and Language · Computer Science 2024-09-26 Wenwen Zhuang , Xin Huang , Xiantao Zhang , Jin Zeng

Meta-learning leverages related source tasks to learn an initialization that can be quickly fine-tuned to a target task with limited labeled examples. However, many popular meta-learning algorithms, such as model-agnostic meta-learning…

Machine Learning · Statistics 2020-03-24 Diana Cai , Rishit Sheth , Lester Mackey , Nicolo Fusi

Word sense disambiguation is a well-known source of translation errors in NMT. We posit that some of the incorrect disambiguation choices are due to models' over-reliance on dataset artifacts found in training data, specifically superficial…

Computation and Language · Computer Science 2020-11-04 Denis Emelin , Ivan Titov , Rico Sennrich

Large language models (LLMs) are known to struggle with complicated reasoning tasks such as math word problems (MWPs). In this paper, we present how analogy from similarly structured questions can improve LLMs' problem-solving capabilities…

Computation and Language · Computer Science 2024-11-26 Xiaocong Yang , Jiacheng Lin , Ziqi Wang , Chengxiang Zhai

Large language models (LLMs) have significantly transformed the educational landscape. As current plagiarism detection tools struggle to keep pace with LLMs' rapid advancements, the educational community faces the challenge of assessing…

Computation and Language · Computer Science 2024-06-18 Roy Xie , Chengxuan Huang , Junlin Wang , Bhuwan Dhingra

The goal of this work is to train effective representations for keyword spotting via metric learning. Most existing works address keyword spotting as a closed-set classification problem, where both target and non-target keywords are…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-19 Jaesung Huh , Minjae Lee , Heesoo Heo , Seongkyu Mun , Joon Son Chung

The unbiased learning to rank (ULTR) problem has been greatly advanced by recent deep learning techniques and well-designed debias algorithms. However, promising results on the existing benchmark datasets may not be extended to the…

Artificial Intelligence · Computer Science 2022-09-21 Lixin Zou , Haitao Mao , Xiaokai Chu , Jiliang Tang , Wenwen Ye , Shuaiqiang Wang , Dawei Yin

Mixed-integer (MI) quadratic models subject to quadratic constraints, known as All-Quadratic MI Programs, constitute a challenging class of NP-complete optimization problems. The particular scenario of unbounded integers defines a subclass…

Optimization and Control · Mathematics 2025-09-16 Guy Zepko , Ofer M. Shir

Modern machine learning datasets can have biases for certain representations that are leveraged by algorithms to achieve high performance without learning to solve the underlying task. This problem is referred to as "representation bias".…

Computer Vision and Pattern Recognition · Computer Science 2019-04-18 Yi Li , Nuno Vasconcelos

Mathematical reasoning remains one of the most challenging domains for large language models (LLMs), requiring not only linguistic understanding but also structured logical deduction and numerical precision. While recent LLMs demonstrate…

Computation and Language · Computer Science 2026-01-27 Mahbub E Sobhani , Md. Faiyaz Abdullah Sayeedi , Tasnim Mohiuddin , Md Mofijul Islam , Swakkhar Shatabda

Despite their success in a variety of NLP tasks, pre-trained language models, due to their heavy reliance on compositionality, fail in effectively capturing the meanings of multiword expressions (MWEs), especially idioms. Therefore,…

Computation and Language · Computer Science 2021-09-10 Harish Tayyar Madabushi , Edward Gow-Smith , Carolina Scarton , Aline Villavicencio

Recent years have seen a surge of machine learning approaches aimed at reducing disparities in model outputs across different subgroups. In many settings, training data may be used in multiple downstream applications by different users,…

Machine Learning · Computer Science 2024-10-25 Zikai Xiong , Niccolò Dalmasso , Alan Mishler , Vamsi K. Potluru , Tucker Balch , Manuela Veloso

Language models are prone to dataset biases, known as shortcuts and spurious correlations in data, which often result in performance drop on new data. We present a new debiasing framework called ``FairFlow'' that mitigates dataset biases by…

Machine Learning · Computer Science 2025-03-25 Jiali Cheng , Hadi Amiri

Several works have proven that finetuning is an applicable approach for debiasing contextualized word embeddings. Similarly, discrete prompts with semantic meanings have shown to be effective in debiasing tasks. With unfixed mathematical…

Computation and Language · Computer Science 2025-05-27 Ke Yang , Charles Yu , Yi Fung , Manling Li , Heng Ji

Over the last years, word and sentence embeddings have established as text preprocessing for all kinds of NLP tasks and improved the performances significantly. Unfortunately, it has also been shown that these embeddings inherit various…

Computation and Language · Computer Science 2024-09-13 Sarah Schröder , Alexander Schulz , Philip Kenneweg , Robert Feldhans , Fabian Hinder , Barbara Hammer

Word embeddings are trained to predict word cooccurrence statistics, which leads them to possess different lexical properties (syntactic, semantic, etc.) depending on the notion of context defined at training time. These properties manifest…

Computation and Language · Computer Science 2020-11-06 Jingyi He , KC Tsiolis , Kian Kenyon-Dean , Jackie Chi Kit Cheung

Bias originates from both data and algorithmic design, often exacerbated by traditional fairness methods that fail to address the subtle impacts of protected attributes. This study introduces an approach to mitigate bias in machine learning…

Machine Learning · Computer Science 2024-10-08 Khadija Zanna , Akane Sano

Instruction-following language models often show undesirable biases. These undesirable biases may be accelerated in the real-world usage of language models, where a wide range of instructions is used through zero-shot example prompting. To…

Artificial Intelligence · Computer Science 2024-06-06 Nakyeong Yang , Taegwan Kang , Jungkyu Choi , Honglak Lee , Kyomin Jung