English
Related papers

Related papers: Multi-domain performance analysis with scores tail…

200 papers

While the NLP community has produced numerous summarization benchmarks, none provide the rich annotations required to simultaneously address many important problems related to control and reliability. We introduce a Wikipedia-derived…

Computation and Language · Computer Science 2023-12-05 Kundan Krishna , Prakhar Gupta , Sanjana Ramprasad , Byron C. Wallace , Jeffrey P. Bigham , Zachary C. Lipton

Stochastic optimization algorithms have been successfully applied in several domains to find optimal solutions. Because of the ever-growing complexity of the integrated systems, novel stochastic algorithms are being proposed, which makes…

Artificial Intelligence · Computer Science 2024-06-04 Sowmya Chandrasekaran , Thomas Bartz-Beielstein

The Dirichlet distribution, also known as multivariate beta, is the most used to analyse frequencies or proportions data. Maximum likelihood is widespread for estimation of Dirichlet's parameters. However, for small sample sizes, the…

Methodology · Statistics 2021-03-04 Vincenzo Gioia , Euloge Clovis Kenne Pagui

While machine learning (ML) technology affects diverse stakeholders, there is no one-size-fits-all metric to evaluate the quality of outputs, including performance and fairness. Using predetermined metrics without soliciting stakeholder…

Computers and Society · Computer Science 2025-03-11 Takuya Yokota , Yuri Nakao

Given a location-based social network, how to find the communities that are highly relevant to query users and have top overall scores in multiple attributes according to user preferences? Typically, in the face of such a problem setting,…

Databases · Computer Science 2021-06-29 Fangda Guo , Ye Yuan , Guoren Wang , Xiangguo Zhao , Hao Sun

Recommender systems are expected to be assistants that help human users find relevant information automatically without explicit queries. As recommender systems evolve, increasingly sophisticated learning techniques are applied and have…

Information Retrieval · Computer Science 2023-12-19 Zhengbang Zhu , Rongjun Qin , Junjie Huang , Xinyi Dai , Yang Yu , Yong Yu , Weinan Zhang

The Assignment problem is a fundamental and well-studied problem in the intersection of Social Choice, Computational Economics and Discrete Allocation. In the Assignment problem, a group of agents expresses preferences over a set of items,…

Data Structures and Algorithms · Computer Science 2021-05-24 Barak Steindl , Meirav Zehavi

Sentiment classification is a fundamental task in natural language processing, assigning one of the three classes, positive, negative, or neutral, to free texts. However, sentiment classification models are highly domain dependent; the…

Computation and Language · Computer Science 2023-07-04 Mahboobeh Sadat Kobari , Nima Karimi , Benyamin Pourhosseini , Ramin Mousa

In the settings of conventional domain adaptation, categories of the source dataset are from the same domain (or domains for multi-source domain adaptation), which is not always true in reality. In this paper, we propose…

Machine Learning · Computer Science 2020-11-06 Sitong Mao , Keli Zhang , Fu-lai Chung

Selectivity estimation - the problem of estimating the result size of queries - is a fundamental problem in databases. Accurate estimation of query selectivity involving multiple correlated attributes is especially challenging. Poor…

Databases · Computer Science 2019-06-19 Shohedul Hasan , Saravanan Thirumuruganathan , Jees Augustine , Nick Koudas , Gautam Das

We propose a general approach to construct weighted likelihood estimating equations with the aim of obtain robust estimates. The weight, attached to each score contribution, is evaluated by comparing the statistical data depth at the model…

Methodology · Statistics 2018-02-16 Claudio Agostinelli

The paper presents a comprehensive performance evaluation of some heuristic search algorithms in the context of autonomous systems and robotics. The objective of the study is to evaluate and compare the performance of different search…

Multiagent Systems · Computer Science 2023-10-05 Aya Kherrour , Marco Robol , Marco Roveri , Paolo Giorgini

While standard approaches to optimisation focus on producing a single high-performing solution, Quality-Diversity (QD) algorithms allow large diverse collections of such solutions to be found. If QD has proven promising across a large…

Neural and Evolutionary Computing · Computer Science 2023-04-27 Manon Flageat , Luca Grillotti , Antoine Cully

Sentiment analysis (SA) is an important research area in cognitive computation-thus in-depth studies of patterns of sentiment analysis are necessary. At present, rich resource data-based SA has been well developed, while the more…

Computation and Language · Computer Science 2021-05-26 Yong Dai , Jian Liu , Jian Zhang , Hongguang Fu , Zenglin Xu

Transferring learned patterns from pretrained neural language models has been shown to significantly improve effectiveness across a variety of language-based tasks, meanwhile further tuning on intermediate tasks has been demonstrated to…

Computation and Language · Computer Science 2023-03-01 Alexander Pugantsov , Richard McCreadie

Current practice for evaluating recommender systems typically focuses on point estimates of user-oriented effectiveness metrics or business metrics, sometimes combined with additional metrics for considerations such as diversity and…

Information Retrieval · Computer Science 2023-09-13 Michael D. Ekstrand , Ben Carterette , Fernando Diaz

Quality improvement methods are essential to gathering high-quality crowdsourced data, both for research and industry applications. A popular and broadly applicable method is task assignment that dynamically adjusts crowd workflow…

Human-Computer Interaction · Computer Science 2021-11-17 Danula Hettiachchi , Vassilis Kostakos , Jorge Goncalves

In a typical Internet-of-Things setting that involves scientific applications, a target computation can be evaluated in many different ways depending on the split of computations among various devices. On the one hand, different…

Performance · Computer Science 2022-08-09 Aravind Sankaran , Paolo Bientinesi

In domain adaptation, maximum mean discrepancy (MMD) has been widely adopted as a discrepancy metric between the distributions of source and target domains. However, existing MMD-based domain adaptation methods generally ignore the changes…

Computer Vision and Pattern Recognition · Computer Science 2017-05-02 Hongliang Yan , Yukang Ding , Peihua Li , Qilong Wang , Yong Xu , Wangmeng Zuo

Argumentation is one of society's foundational pillars, and, sparked by advances in NLP and the vast availability of text data, automated mining of arguments receives increasing attention. A decisive property of arguments is their strength…

Computation and Language · Computer Science 2022-05-23 Michael Fromm , Max Berrendorf , Johanna Reiml , Isabelle Mayerhofer , Siddharth Bhargava , Evgeniy Faerman , Thomas Seidl