English
Related papers

Related papers: Coffea -- Columnar Object Framework For Effective …

200 papers

In clinical and biomedical research, multiple high-dimensional datasets are nowadays routinely collected from omics and imaging devices. Multivariate methods, such as Canonical Correlation Analysis (CCA), integrate two (or more) datasets to…

Methodology · Statistics 2025-03-20 Nuria Senar , Mark van de Wiel , Aeilko Zwinderman , Michel Hof

Mainstream knowledge management researchers generally agree that knowledge extracted from unstructured data and semi-structured data have become imperative for organizational strategic decision making. In this research, we develop a…

Information Retrieval · Computer Science 2020-07-15 Gerald Onwujekwe , Kweku-Muata Osei-Bryson , Nnatubemugo Ngwum

Principal Component Analysis (PCA) is a workhorse of modern data science. While PCA assumes the data conforms to Euclidean geometry, for specific data types, such as hierarchical and cyclic data structures, other spaces are more…

Machine Learning · Statistics 2024-07-11 Puoya Tabaghi , Michael Khanzadeh , Yusu Wang , Sivash Mirarab

In recent years, machine learning models have been increasingly applied to spectroscopic datasets for chemical and biomedical analysis. For their successful adoption, particularly in clinical and safety-critical settings, professionals and…

Reasoning over very long inputs remains difficult for large language models (LLMs). Common workarounds either shrink the input via retrieval (risking missed evidence), enlarge the context window (straining selectivity), or stage multiple…

We propose a novel hybrid quantum-classical framework that integrates the Quantum Approximate Optimization Algorithm (QAOA) and Quantum-enhanced Markov Chain Monte Carlo (QMCMC) with variational particle filters to tackle the computational…

Quantum Physics · Physics 2025-04-29 Abhiram Sripat

Metal Organic Frameworks (MOFs) are promising materials to help mitigate the effects of global warming by selectively absorbing $\text{CO}_{2}$ for direct capture. Accurate quantum chemistry simulations are a useful tool to help select and…

Python has become the programming language of choice for research and industry projects related to data science, machine learning, and deep learning. Since optimization is an inherent part of these research fields, more optimization related…

Neural and Evolutionary Computing · Computer Science 2020-05-25 Julian Blank , Kalyanmoy Deb

Charged point defects in materials are widely studied using Density Functional Theory (DFT) packages with periodic boundary conditions. The formation energy and defect level computed from these simulations need to be corrected to remove the…

Materials Science · Physics 2018-04-04 Mit H. Naik , Manish Jain

Conducting data analysis typically involves authoring code to transform, visualize, analyze, and interpret data. Large language models (LLMs) are now capable of generating such code for simple, routine analyses. LLMs promise to democratize…

Human-Computer Interaction · Computer Science 2025-04-22 Stephen N. Freund , Brooke Simon , Emery D. Berger , Eunice Jun

Canonical correlation analysis (CCA) is a technique to find statistical dependencies between a pair of multivariate data. However, its application to high dimensional data is limited due to the resulting time complexity. While the…

Machine Learning · Computer Science 2020-12-29 Naoko Koide-Majima , Kei Majima

Deriving personalized insights from popular wearable trackers requires complex numerical reasoning that challenges standard LLMs, necessitating tool-based approaches like code generation. Large language model (LLM) agents present a…

We show that distributed Infrastructure-as-a-Service (IaaS) compute clouds can be effectively used for the analysis of high energy physics data. We have designed a distributed cloud system that works with any application using large input…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-01-04 R. J. Sobie , A. Agarwal , M. Anderson , P. Armstrong , K. Fransham , I. Gable , D. Harris , C. Leavett-Brown , M. Paterson , D. Penfold-Brown , M. Vliet , A. Charbonneau , R. Impey , W. Podaima

Interpreting the internal behavior of large language models trained on code remains a critical challenge, particularly for applications demanding trust, transparency, and semantic robustness. We propose Code Concept Analysis (CoCoA): a…

Software Engineering · Computer Science 2025-10-06 Arushi Sharma , Vedant Pungliya , Christopher J. Quinn , Ali Jannesari

This paper explores the application of functional data analysis (FDA) as a means to study the dynamics of software evolution in the open source context. Several challenges in analyzing the data from software projects are discussed, an…

Statistics Theory · Mathematics 2007-06-13 Katherine J. Stewart , David P. Darcy , Sherae L. Daniel

NIFTy, "Numerical Information Field Theory", is a software framework designed to ease the development and implementation of field inference algorithms. Field equations are formulated independently of the underlying spatial geometry allowing…

Given that observational and numerical climate data are being produced at ever more prodigious rates, increasingly sophisticated and automated analysis techniques have become essential. Deep learning is quickly becoming a standard approach…

Fluid Dynamics · Physics 2017-09-12 A. Rupe , J. P. Crutchfield , K. Kashinath , Prabhat

We propose VarFA, a variational inference factor analysis framework that extends existing factor analysis models for educational data mining to efficiently output uncertainty estimation in the model's estimated factors. Such uncertainty…

Machine Learning · Statistics 2020-08-18 Zichao Wang , Yi Gu , Andrew Lan , Richard Baraniuk

Functional data analysis is becoming increasingly popular to study data from real-valued random functions. Nevertheless, there is a lack of multiple testing procedures for such data. These are particularly important in factorial designs to…

Methodology · Statistics 2024-06-04 Merle Munko , Marc Ditzhaus , Markus Pauly , Łukasz Smaga

Formal Concept Analysis (FCA) is a mathematical theory based on the formalization of the notions of concept and concept hierarchies. It has been successfully applied to several Computer Science fields such as data mining,software…

Artificial Intelligence · Computer Science 2009-05-29 Leonard Kwuida , Rokia Missaoui , Lahcen Boumedjout , Jean Vaillancourt