English
Related papers

Related papers: Ntuple Wizard: An Application to Access Large-Scal…

200 papers

Array operations are one of the most concise ways of expressing common filtering and simple aggregation operations that is the hallmark of the first step of a particle physics analysis: selection, filtering, basic vector operations, and…

Databases · Computer Science 2021-09-08 Gordon Watts

Research in data warehousing and OLAP has produced important technologies for the design, management and use of information systems for decision support. With the development of Internet, the availability of various types of data has…

Location Based Services (LBS) have become extremely popular and used by millions of users. Popular LBS run the entire gamut from mapping services (such as Google Maps) to restaurants (such as Yelp) and real-estate (such as Redfin). The…

As the Large Hadron Collider (LHC) continues its upward progression in energy and luminosity towards the planned High-Luminosity LHC (HL-LHC) in 2025, the challenges of the experiments in processing increasingly complex events will also…

Instrumentation and Detectors · Physics 2022-10-05 Paul Lujan , Valerie Halyo

New technologies have led to vast troves of large and complex datasets across many scientific domains and industries. People routinely use machine learning techniques to not only process, visualize, and make predictions from this big data,…

Machine Learning · Statistics 2023-08-04 Genevera I. Allen , Luqin Gan , Lili Zheng

A major LHCb detector upgrade will be installed during long shutdown~4 (LS4) of the CERN Large Hadron Collider. The experiment will operate at a maximum luminosity of up to $1.5\times 10^{34}\mathrm{cm}^{-2}\mathrm{s}^{-1}$, with acceptance…

High Energy Physics - Experiment · Physics 2025-04-07 LHCb collaboration

Relational databases (DBs) are ideal tools to manage bulky and structured data archives. In particular for Astronomy they can be used to fulfill all the requirements of a complex project, i.e. the management of: documents, software (s/w)…

Astrophysics · Physics 2007-05-23 L. Nicastro , G. Calderone

Shared high-performance computing (HPC) platforms, such as those provided by XSEDE and Compute Canada, enable researchers to carry out large-scale computational experiments at a fraction of the cost of the cloud. Most systems require the…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-02-17 Pierre Rioux , Gregory Kiar , Alexandre Hutton , Alan C. Evans , Shawn T. Brown

Colliders, among the most successful tools of particle physics, have revealed much about matter. This review describes how colliders contribute to the search for particle dark matter, focusing on the highest-energy collider currently in…

High Energy Physics - Experiment · Physics 2018-10-30 Antonio Boveia , Caterina Doglioni

Big Data query systems represent data in a columnar format for fast, selective access, and in some cases (e.g. Apache Drill), perform calculations directly on the columnar data without row materialization, avoiding runtime costs. However,…

Programming Languages · Computer Science 2017-11-06 Jim Pivarski , Peter Elmer , Brian Bockelman , Zhe Zhang

Deep Web is content hidden behind HTML forms. Since it represents a large portion of the structured, unstructured and dynamic data on the Web, accessing Deep-Web content has been a long challenge for the database community. This paper…

Information Retrieval · Computer Science 2015-08-13 Manvi , Komal Kumar Bhatia , Ashutosh Dixit

A large number of web databases are only accessible through proprietary form-like interfaces which require users to query the system by entering desired values for a few attributes. A key restriction enforced by such an interface is the…

Databases · Computer Science 2012-08-21 Saravanan Thirumuruganathan , Nan Zhang , Gautam Das

A large hadron machine like the LHC with its high track multiplicities always asks for powerful tools that drastically reduce the large background while selecting signal events efficiently. Actually such tools are widely needed and used in…

Data Analysis, Statistics and Probability · Physics 2014-11-20 Markward Britsch , Nikolai Gagunashvili , Michael Schmelling

Big data platforms are widely used in modern enterprises, and an in-production intelligent assistant is increasingly important to help users quickly find actionable guidance and reduce operational burden. While recent LLM+RAG assistants…

Efficient handling of large data-volumes becomes a necessity in today's world. It is driven by the desire to get more insight from the data and to gain a better understanding of user trends which can be transformed into economic incentives…

Data Analysis, Statistics and Probability · Physics 2019-10-02 Valentin Kuznetsov

Modern datacenter applications are prone to high tail latencies since their requests typically follow highly-dispersive distributions. Delivering fast interrupts is essential to reducing tail latency. Prior work has proposed both OS- and…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-11-14 Lisa , Li , Nikita Lazarev , David Koufaty , Yijun Yin , Andy Anderson , Zhiru Zhang , Edward Suh , Kostis Kaffes , Christina Delimitrou

Apache Spark is a Big Data framework for working on large distributed datasets. Although widely used in the industry, it remains rather limited in the academic community or often restricted to software engineers. The goal of this paper is…

Instrumentation and Methods for Astrophysics · Physics 2019-07-17 S. Plaszczynski , J. Peloton , C. Arnault , J. E. Campagne

We describe the first major public data release from cosmological simulations carried out with Argonne's HACC code. This initial release covers a range of datasets from large gravity-only simulations. The data products include halo…

The LHCb experiment is designed to perform high-precision measurements of CP violation and search for New Physics using the enormous flux involving beauty and charm quarks produced at the LHC. The operation and the results obtained from the…

Instrumentation and Detectors · Physics 2013-10-02 Federico Alessio

Non-prehensile manipulation is essential for handling thin, large, or otherwise ungraspable objects in unstructured settings. Prior planning and search-based methods often rely on ad-hoc manual designs or generate physically unrealizable…

Robotics · Computer Science 2026-03-17 Tierui He , Chao Zhao