English
Related papers

Related papers: Engineering Crowdsourced Stream Processing Systems

200 papers

Under several emerging application scenarios, such as in smart cities, operational monitoring of large infrastructure, wearable assistance, and Internet of Things, continuous data streams must be processed under very short delays. Several…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-12-05 Marcos Dias de Assuncao , Alexandre da Silva Veith , Rajkumar Buyya

We propose a streaming algorithm for the binary classification of data based on crowdsourcing. The algorithm learns the competence of each labeller by comparing her labels to those of other labellers on the same tasks and uses this…

Machine Learning · Statistics 2016-02-24 Thomas Bonald , Richard Combes

Crowdsourcing is an online outsourcing mode which can solve the current machine learning algorithm's urge need for massive labeled data. Requester posts tasks on crowdsourcing platforms, which employ online workers over the Internet to…

Human-Computer Interaction · Computer Science 2022-04-28 Guangyang Han , Sufang Li , Runmin Wang , Chunming Wu

Crowd-sourcing has become a popular means of acquiring labeled data for a wide variety of tasks where humans are more accurate than computers, e.g., labeling images, matching objects, or analyzing sentiment. However, relying solely on the…

Machine Learning · Computer Science 2014-12-23 Barzan Mozafari , Purnamrita Sarkar , Michael J. Franklin , Michael I. Jordan , Samuel Madden

This paper introduces mixsemble, an ensemble method that adapts the Dawid-Skene model to aggregate predictions from multiple model-based clustering algorithms. Unlike traditional crowdsourcing, which relies on human labels, the framework…

Machine Learning · Computer Science 2025-10-01 Jordyn E. A. Lorentz , Katharine M. Clark

We investigate the feasibility of obtaining highly trustworthy results using crowdsourcing on complex engineering tasks. Crowdsourcing is increasingly seen as a potentially powerful way of increasing the supply of labor for solving…

Social and Information Networks · Computer Science 2014-07-01 Matthew Staffelbach , Peter Sempolinski , David Hachen , Ahsan Kareem , Tracy Kijewski-Correa , Douglas Thain , Daniel Wei , Greg Madey

The advance of Internet and Sensor technology has brought about new challenges evoked by the emergence of continuous data streams. Beyond rapid data processing, application areas like ambient assisted living, robotics, or dynamic scheduling…

Artificial Intelligence · Computer Science 2013-01-09 Martin Gebser , Torsten Grote , Roland Kaminski , Philipp Obermeier , Orkunt Sabuncu , Torsten Schaub

This paper describes HyperStream, a large-scale, flexible and robust software package, written in the Python language, for processing streaming data with workflow creation capabilities. HyperStream overcomes the limitations of other…

Machine Learning · Computer Science 2019-08-09 Tom Diethe , Meelis Kull , Niall Twomey , Kacper Sokol , Hao Song , Miquel Perello-Nieto , Emma Tonkin , Peter Flach

As the use of crowdsourcing increases, it is important to think about performance optimization. For this purpose, it is possible to think about each worker as a HPU(Human Processing Unit), and to draw inspiration from performance…

Human-Computer Interaction · Computer Science 2016-10-17 Chen Cao , Zheng Liu , Lei Chen , H. V. Jagadish

With the development of mobile social networks, more and more crowdsourced data are generated on the Web or collected from real-world sensing. The fragment, heterogeneous, and noisy nature of online/offline crowdsourced data, however, makes…

Human-Computer Interaction · Computer Science 2019-08-08 Bin Guo , Huihui Chen , Yan Liu , Chao Chen , Qi Han , Zhiwen Yu

In the burgeoning realm of Internet of Things (IoT) applications on edge devices, data stream compression has become increasingly pertinent. The integration of added compression overhead and limited hardware resources on these devices calls…

Databases · Computer Science 2024-06-18 Xianzhi Zeng , Shuhao Zhang

Today most applications continuously produce information under the form of streams, due to the advent of the means of collecting data. Sensors and social networks collect an immense variety and volume of data, from different real-life…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-02-17 Vitor Pinheiro de Almeida , Sukanya Bhowmik , Markus Endler , Kurt Rothermel

Online crowdsourcing provides a scalable and inexpensive means to collect knowledge (e.g. labels) about various types of data items (e.g. text, audio, video). However, it is also known to result in large variance in the quality of recorded…

Human-Computer Interaction · Computer Science 2018-12-10 Yuan Jin , Mark Carman , Ye Zhu , Yong Xiang

Crowdsourcing is rapidly evolving and applied in situations where ideas, labour, opinion or expertise of large groups of people are used. Crowdsourcing is now used in various policy-making initiatives; however, this use has usually focused…

Computers and Society · Computer Science 2018-02-12 Araz Taeihagh

Distributed Stream Processing Systems (DSPSs) are among the currently most emerging topics in data management, with applications ranging from real-time event monitoring to processing complex dataflow programs and big data analytics. The…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-01-06 Vinu E. Venugopal , Martin Theobald , Samira Chaychi , Amal Tawakuli

The non-stationary nature of data streams strongly challenges traditional machine learning techniques. Although some solutions have been proposed to extend traditional machine learning techniques for handling data streams, these approaches…

Machine Learning · Computer Science 2021-06-23 Xuyang Yan , Abdollah Homaifar , Mrinmoy Sarkar , Abenezer Girma , Edward Tunstel

Internet-connected smart devices are increasing at an exponential rate. These powerful devices have created a yet-untapped pool of idle resources that can be utilised, among others, for processing data in resource-depleted environments. The…

Software Engineering · Computer Science 2023-02-14 Niroshinie Fernando , Chetan Arora , Seng W. Loke , Lubna Alam , Stephen La Macchia , Helen Graesser

Stream Processing (SP) has evolved as the leading paradigm to process and gain value from the high volume of streaming data produced e.g. in the domain of the Internet of Things. An SP system is a middleware that deploys a network of…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-01-30 Henriette Röger , Ruben Mayer

With the development of mobile sensing and mobile social networking techniques, Mobile Crowd Sensing and Computing (MCSC), which leverages heterogeneous crowdsourced data for large-scale sensing, has become a leading paradigm. Built on top…

Human-Computer Interaction · Computer Science 2015-05-04 Bin Guo , Chao Chen , Daqing Zhang , Zhiwen Yu , Alvin Chin

A typical crowdsourcing software development(CSD) marketplace consists of a list of software tasks as service demands and a pool of freelancer developers as service suppliers. Highly dynamic and competitive CSD market places may result in…

Software Engineering · Computer Science 2021-03-19 Razieh Saremi , Ye Yang , Gregg Vesonder , Guenther Ruhe , He Zhang