English
Related papers

Related papers: Should we trust web-scraped data?

200 papers

Data can be collected in scientific studies via a controlled experiment or passive observation. Big data is often collected in a passive way, e.g. from social media. In studies of causation great efforts are made to guard against bias and…

Methodology · Statistics 2018-11-21 Elena Pesce , Eva Riccomagno , Henry P. Wynn

Many machine learning algorithms are based on the assumption that training examples are drawn independently. However, this assumption does not hold anymore when learning from a networked sample because two or more training examples may…

Artificial Intelligence · Computer Science 2017-06-06 Yuyi Wang , Jan Ramon , Zheng-Chu Guo

Accurately measuring discrimination in machine learning-based automated decision systems is required to address the vital issue of fairness between subpopulations and/or individuals. Any bias in measuring discrimination can lead to either…

Machine Learning · Computer Science 2023-10-23 Rūta Binkytė , Sami Zhioua , Yassine Turki

Due to the development of internet technology and computer science, data is exploding at an exponential rate. Big data brings us new opportunities and challenges. On the one hand, we can analyze and mine big data to discover hidden…

Databases · Computer Science 2020-05-12 Zhicheng Liu , Aoqian Zhang

Any network studied in the literature is inevitably just a sampled representative of its real-world analogue. Additionally, network sampling is lately often applied to large networks to allow for their faster and more efficient analysis.…

Social and Information Networks · Computer Science 2015-04-14 Neli Blagus , Lovro Šubelj , Gregor Weiss , Marko Bajec

Randomized experiments is a key part of product development in the tech industry. It is often necessary to run programs of exclusive experiments, i.e., experiments that cannot be run on the same units during the same time. These programs…

Methodology · Statistics 2020-12-21 Mårten Schultzberg , Oskar Kjellin , Johan Rydberg

In the process of information gathering on the web, confirmation bias is known to exist, exemplified in phenomena such as echo chambers and filter bubbles. Our purpose is to reveal how people consume news and discuss these phenomena. In web…

Computers and Society · Computer Science 2019-09-04 Yoshifumi Seki , Mitsuo Yoshida

Datasets scraped from the internet have been critical to the successes of large-scale machine learning. Yet, this very success puts the utility of future internet-derived datasets at potential risk, as model outputs begin to replace human…

Machine Learning · Computer Science 2022-09-09 Rohan Taori , Tatsunori B. Hashimoto

Automatic unreliable news detection is a research problem with great potential impact. Recently, several papers have shown promising results on large-scale news datasets with models that only use the article itself without resorting to any…

Computation and Language · Computer Science 2021-04-21 Xiang Zhou , Heba Elfardy , Christos Christodoulopoulos , Thomas Butler , Mohit Bansal

Bias is known to be an impediment to fair decisions in many domains such as human resources, the public sector, health care etc. Recently, hope has been expressed that the use of machine learning methods for taking such decisions would…

Machine Learning · Computer Science 2019-09-05 Jindong Gu , Daniela Oelke

From scientific experiments to online A/B testing, the previously observed data often affects how future experiments are performed, which in turn affects which data will be collected. Such adaptivity introduces complex correlations between…

Machine Learning · Statistics 2018-01-03 Xinkun Nie , Xiaoying Tian , Jonathan Taylor , James Zou

This paper presents a theoretical analysis of sample selection bias correction. The sample bias correction technique commonly used in machine learning consists of reweighting the cost of an error on each training point of a biased sample to…

Machine Learning · Computer Science 2008-12-18 Corinna Cortes , Mehryar Mohri , Michael Riley , Afshin Rostamizadeh

Traceroute sampling is an important technique in exploring the internet router graph and the autonomous system graph. Although it is one of the primary techniques used in calculating statistics about the internet, it can introduce bias that…

Physics and Society · Physics 2009-02-02 Abraham D. Flaxman , Juan Vera

Sampling biases in training data are a major source of algorithmic biases in machine learning systems. Although there are many methods that attempt to mitigate such algorithmic biases during training, the most direct and obvious way is…

Machine Learning · Statistics 2022-04-15 Laura Niss , Yuekai Sun , Ambuj Tewari

This study investigates the mechanisms of Surveillance Capitalism, focusing on personal data transfer during web navigation and searching. Analyzing network traffic reveals how various entities track and harvest digital footprints. The…

Artificial Intelligence · Computer Science 2024-12-25 Antony Seabra de Medeiros , Luiz Afonso Glatzl Junior , Sergio Lifschitz

The widespread accessibility of the Internet has led to a surge in online fraudulent activities, underscoring the necessity of shielding users' sensitive information from cybercriminals. Phishing, a well-known cyberattack, revolves around…

Cryptography and Security · Computer Science 2024-01-17 Aditya Kulkarni , Vivek Balachandran , Dinil Mon Divakaran , Tamal Das

With the recent bloom of data, there is a huge surge in threats against individuals' private information. Various techniques for optimizing privacy-preserving data analysis are at the focus of research in the recent years. In this paper, we…

Cryptography and Security · Computer Science 2022-11-11 Sayan Biswas , Graham Cormode , Carsten Maple

In this paper, we analyze the nature and distribution of structured data on the Web. Web-scale information extraction, or the problem of creating structured tables using extraction from the entire web, is gathering lots of research…

Databases · Computer Science 2012-03-30 Nilesh Dalvi , Ashwin Machanavajjhala , Bo Pang

The widespread use of machine learning and data-driven algorithms for decision making has been steadily increasing over many years. \emph{Bias} in the data can adversely affect this decision-making. We present a new mitigation strategy to…

Machine Learning · Computer Science 2025-07-25 Bruno Scarone , Alfredo Viola , Renée J. Miller , Ricardo Baeza-Yates

Web spam refers to some techniques, which try to manipulate search engine ranking algorithms in order to raise web page position in search engine results. In the best case, spammers encourage viewers to visit their sites, and provide…

Information Retrieval · Computer Science 2012-10-12 Shekoofeh Ghiam , Alireza Nemaney Pour