English
Related papers

Related papers: Efficient Data Ingestion in Cloud-based architectu…

200 papers

DevOps is a quite effective approach for managing software development and operation, as confirmed by plenty of success stories in real applications and case studies. DevOps is now becoming the main-stream solution adopted by the software…

Software Engineering · Computer Science 2019-10-09 Antonio Capizzi , Salvatore Distefano , Manuel Mazzara

Neural networks have dramatically increased our capacity to learn from large, high-dimensional datasets across innumerable disciplines. However, their decisions are not easily interpretable, their computational costs are high, and building…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Mackenzie J. Meni , Ryan T. White , Michael Mayo , Kevin Pilkiewicz

The computational burden and inherent redundancy of large-scale datasets challenge the training of contemporary machine learning models. Data pruning offers a solution by selecting smaller, informative subsets, yet existing methods…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Feiyang Kang , Nadine Chang , Maying Shen , Marc T. Law , Rafid Mahmood , Ruoxi Jia , Jose M. Alvarez

The growing volume of data in modern applications has led to significant computational costs in conventional processor-centric systems. Processing-in-memory (PIM) architectures alleviate these costs by moving computation closer to memory,…

Hardware Architecture · Computer Science 2025-04-23 Geraldo F. Oliveira , Alain Kohli , David Novo , Ataberk Olgun , A. Giray Yaglikci , Saugata Ghose , Juan Gómez-Luna , Onur Mutlu

The increasing availability of data and advancements in computational intelligence have accelerated the adoption of data-driven methods (DDMs) in product development. However, their integration into product development remains fragmented.…

With the increasing importance of data and artificial intelligence, organizations strive to become more data-driven. However, current data architectures are not necessarily designed to keep up with the scale and scope of data and analytics…

Artificial Intelligence · Computer Science 2024-06-07 Jan Bode , Niklas Kühl , Dominik Kreuzberger , Sebastian Hirschl , Carsten Holtmann

We study the problem of optimizing data storage and access costs on the cloud while ensuring that the desired performance or latency is unaffected. We first propose an optimizer that optimizes the data placement tier (on the cloud) and the…

Existing state-of-the-art 3D point clouds understanding methods only perform well in a fully supervised manner. To the best of our knowledge, there exists no unified framework which simultaneously solves the downstream high-level…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Kangcheng Liu

The paper considers software development issues for large-scale enterprise information systems (IS) with databases (DB) in global heterogeneous distributed computational environment. Due to high IT development rates, the present-day society…

Software Engineering · Computer Science 2007-05-23 Sergey V. Zykov

Emergence of sophisticated technologies in IT industries has posed several challenges such as production of products using advanced technical process for instance Result Orientation Approach, Deployment, Assessment and Refinement (RADAR) in…

Other Computer Science · Computer Science 2012-07-17 T. R. Gopalakrishnan Nair , M. Vaidehi , V. Suma

Efficient resource allocation is essential in cloud systems to facilitate resource sharing among tenants. However, the growing scale of these optimization problems have outpaced commercial solvers commonly employed in production. To…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-17 Zhiying Xu , Minlan Yu , Francis Y. Yan

Deep convolutional neural networks, assisted by architectural design strategies, make extensive use of data augmentation techniques and layers with a high number of feature maps to embed object transformations. That is highly inefficient…

Computer Vision and Pattern Recognition · Computer Science 2021-12-21 Vittorio Mazzia , Francesco Salvetti , Marcello Chiaberge

In the era of Internet of Things and with the explosive worldwide growth of electronic data volume, and associated need of processing, analysis, and storage of such humongous volume of data, it has now become mandatory to exploit the power…

Large Language Models (LLMs) promise to automate data engineering on tabular data, offering enterprises a valuable opportunity to cut the high costs of manual data handling. But the enterprise domain comes with unique challenges that…

Databases · Computer Science 2025-11-18 Jan-Micha Bodensohn , Ulf Brackmann , Liane Vogel , Anupam Sanghi , Carsten Binnig

Techniques for automatically designing deep neural network architectures such as reinforcement learning based approaches have recently shown promising results. However, their success is based on vast computational resources (e.g. hundreds…

Machine Learning · Computer Science 2017-11-22 Han Cai , Tianyao Chen , Weinan Zhang , Yong Yu , Jun Wang

Deep learning technologies have demonstrated remarkable effectiveness in a wide range of tasks, and deep learning holds the potential to advance a multitude of applications, including in edge computing, where deep models are deployed on…

Machine Learning · Computer Science 2022-08-24 Dalin Zhang , Kaixuan Chen , Yan Zhao , Bin Yang , Lina Yao , Christian S. Jensen

The massive growth in the utilization of edge AI has made the applications of machine learning models ubiquitous in different domains. Despite the computation and communication efficiency of these systems, due to limited computation…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-18 Mohammad Mahdi Kamani , Zhongwei Cheng , Lin Chen

This paper proposes a novel three tier architecture for federated learning to optimize edge computing environments. The proposed architecture addresses the challenges associated with client data heterogeneity and computational constraints.…

Machine Learning · Computer Science 2025-01-09 Satwat Bashir , Tasos Dagiuklas , Kasra Kassai , Muddesar Iqbal

The true power of computational research typically can lay in either what it accomplishes or what it enables others to accomplish. In this work, both avenues are simultaneously embraced across several distinct efforts existing at three…

Materials Science · Physics 2024-11-06 Adam M. Krajewski

The pivotal key to the success of manufacturing enterprises is a sustainable and innovative product design and development. In collaborative design, stakeholders are heterogeneously distributed chain-like. Due to the growing volume of data…

Computers and Society · Computer Science 2020-01-28 Mahdi Bohlouli , Alexander Holland , Madjid Fathi