中文
相关论文

相关论文: Improving a High Productivity Data Analytics Chape…

200 篇论文

PaPy, which stands for parallel pipelines in Python, is a highly flexible framework that enables the construction of robust, scalable workflows for either generating or processing voluminous datasets. A workflow is created from user-written…

编程语言 · 计算机科学 2014-07-17 Marcin Cieslik , Cameron Mura

TensorFlow is a popular cloud computing framework that targets machine learning applications. It separates the specification of application logic (in a dataflow graph) from the execution of the logic. TensorFlow's native runtime executes…

分布式、并行与集群计算 · 计算机科学 2019-08-27 Sam Whitlock , James Larus , Edouard Bugnion

Despite being the most popular programming language, Python has not yet received enough attention from the community. To the best of our knowledge, there is no general static analysis framework proposed to facilitate the implementation of…

软件工程 · 计算机科学 2022-02-25 Li Li , Jiawei Wang , Haowei Quan

To enhance the efficiency, scalability, and cross-survey applicability of stellar parameter inference in large spectroscopic datasets, we present a modular, parallelized Python framework with automated error estimation, built on the LAMOST…

In the rapidly evolving field of deep learning, the demand for models that are both expressive and computationally efficient has never been more critical. This paper introduces Orchid, a novel architecture designed to address the quadratic…

机器学习 · 计算机科学 2026-01-01 Mahdi Karami , Ali Ghodsi

Effective features are crucial for predictive model performance, but creating them often requires domain expertise, limiting scalability across applications. We define feature engineering as an agentic code generation problem: features are…

计算与语言 · 计算机科学 2026-05-29 Hangxuan Li , Renjun Jia , Xuezhang Wu , Yunjie Qian , Zeqi Zheng , Xianling Zhang

HEP-Frame is a new C++ package designed to efficiently perform analyses of data sets from a very large number of events, like those available at the Large Hadron Collider (LHC) at CERN, Geneva. It mainly targets high performance servers and…

高能物理 - 实验 · 物理学 2023-03-10 A. Pereira , A. Onofre , A. Proenca

To put static program analysis at the fingertips of the software developer, we propose a framework for interactive abstract interpretation. While providing sound analysis results, abstract interpretation in general can be quite costly. To…

编程语言 · 计算机科学 2022-11-28 Julian Erhard , Simmo Saan , Sarah Tilscher , Michael Schwarz , Karoliine Holter , Vesal Vojdani , Helmut Seidl

The conversion of user epics or stories into their appropriate representation in pseudocode or code is a time-consuming task, which can take up a large portion of the time in an industrial project. With this research paper, we aim to…

计算与语言 · 计算机科学 2023-12-11 Gaurav Kolhatkar , Akshit Madan , Nidhi Kowtal , Satyajit Roy , Sheetal Sonawane

The development of a real-time web application often starts with a feature-driven approach allowing to quickly react to users feedbacks. However, this approach poorly scales in performance. Yet, the user-base can increase by an order of…

编程语言 · 计算机科学 2015-12-23 Etienne Brodu , Stéphane Frénot , Frédéric Oblé

Partial evaluation has recently been used for processing SPARQL queries over a large resource description framework (RDF) graph in a distributed environment. However, the previous approach is inefficient when dealing with complex queries.…

分布式、并行与集群计算 · 计算机科学 2019-02-18 Peng Peng , Lei Zou , Runyu Guan

Cost-effective and scalable video analytics are essential for precision livestock monitoring, where high-resolution footage and near-real-time monitoring needs from commercial farms generates substantial computational workloads. This paper…

分布式、并行与集群计算 · 计算机科学 2025-12-09 Saeid Ghafouri , Yuming Ding , Katerine Diaz Chito , Jesús Martinez del Rincón , Niamh O'Connell , Hans Vandierendonck

Data-intensive applications often require exploratory analysis of large datasets. If analysis is performed on distributed resources, data locality can be crucial to high throughput and performance. We propose a "data diffusion" approach…

分布式、并行与集群计算 · 计算机科学 2016-11-17 Ioan Raicu , Yong Zhao , Ian Foster , Alex Szalay

Streaming anomaly detection requires algorithms that operate under strict constraints: bounded memory, single-pass processing, and constant-time complexity. We present PySAD, a comprehensive Python framework addressing these challenges…

机器学习 · 计算机科学 2025-05-27 Selim F. Yilmaz , Suleyman S. Kozat

The emergence of energy harvesting devices creates the potential for batteryless sensing and computing devices. Such devices operate only intermittently, as energy is available, presenting a number of challenges for software developers.…

分布式、并行与集群计算 · 计算机科学 2019-09-17 Kiwan Maeng , Alexei Colin , Brandon Lucia

The IRIS-HEP software institute, as a contributor to the broader HEP Python ecosystem, is developing scalable analysis infrastructure and software tools to address the upcoming HL-LHC computing challenges with new approaches and paradigms,…

The ability of the foundation models heavily relies on large-scale, diverse, and high-quality pretraining data. In order to improve data quality, researchers and practitioners often have to manually curate datasets from difference sources…

机器学习 · 计算机科学 2024-04-24 Yiding Sun , Feng Wang , Yutao Zhu , Wayne Xin Zhao , Jiaxin Mao

Finding heavy hitters in databases and data streams is a fundamental problem with applications ranging from network monitoring to database query optimization, machine learning, and more. Approximation algorithms offer practical solutions,…

数据结构与算法 · 计算机科学 2025-11-24 Vinh Quang Ngo , Marina Papatriantafilou

Access plan recommendation is a query optimization approach that executes new queries using prior created query execution plans (QEPs). The query optimizer divides the query space into clusters in the mentioned method. However, traditional…

数据库 · 计算机科学 2022-10-14 Elham Azhir , Mehdi Hosseinzadeh , Faheem Khan , Amir Mosavi

Practical adoption of static analysis often requires trading precision for performance. This paper focuses on improving the memory efficiency of abstract interpretation without sacrificing precision or time efficiency. Computationally,…

编程语言 · 计算机科学 2020-09-15 Sung Kook Kim , Arnaud J. Venet , Aditya V. Thakur