English
Related papers

Related papers: Learning Functional Dependencies with Sparse Regre…

200 papers

Performing multiple experiments is common when learning internal mechanisms of complex systems. These experiments can include perturbations to parameters or external disturbances. A challenging problem is to efficiently incorporate all…

Systems and Control · Computer Science 2020-08-25 Zuogong Yue , Johan Thunberg , Wei Pan , Lennart Ljung , Jorge Goncalves

Stochastic differential equations (SDEs) are a ubiquitous modeling framework that finds applications in physics, biology, engineering, social science, and finance. Due to the availability of large-scale data sets, there is growing interest…

Machine Learning · Statistics 2025-03-04 Ziheng Guo , James Greene , Ming Zhong

One of the central objectives of contemporary neuroimaging research is to create predictive models that can disentangle the connection between patterns of functional connectivity across the entire brain and various behavioral traits.…

Discovering dynamical models to describe underlying dynamical behavior is essential to draw decisive conclusions and engineering studies, e.g., optimizing a process. Experimental data availability notwithstanding has increased…

Machine Learning · Computer Science 2022-10-12 Pawan Goyal , Peter Benner

In many problem settings, parameter vectors are not merely sparse but dependent in such a way that non-zero coefficients tend to cluster together. We refer to this form of dependency as "region sparsity." Classical sparse regression…

Machine Learning · Statistics 2019-01-28 Anqi Wu , Oluwasanmi Koyejo , Jonathan W. Pillow

Motivated by modern observational studies, we introduce a class of functional models that expands nested and crossed designs. These models account for the natural inheritance of correlation structure from sampling design in studies where…

Applications · Statistics 2013-04-26 Haochang Shou , Vadim Zipunnikov , Ciprian M. Crainiceanu , Sonja Greven

Statistical morphological inflectors are typically trained on fully supervised, type-level data. One remaining open research question is the following: How can we effectively exploit raw, token-level data to improve their performance? To…

Computation and Language · Computer Science 2020-02-26 Lawrence Wolf-Sonkin , Jason Naradowsky , Sabrina J. Mielke , Ryan Cotterell

Large scale image classification datasets often contain noisy labels. We take a principled probabilistic approach to modelling input-dependent, also known as heteroscedastic, label noise in these datasets. We place a multivariate Normal…

Machine Learning · Computer Science 2021-05-24 Mark Collier , Basil Mustafa , Efi Kokiopoulou , Rodolphe Jenatton , Jesse Berent

In this paper, we focus on learning sparse graphs with a core-periphery structure. We propose a generative model for data associated with core-periphery structured networks to model the dependence of node attributes on core scores of the…

Machine Learning · Computer Science 2021-10-11 Sravanthi Gurugubelli , Sundeep Prabhakar Chepuri

We consider the task of constructing a data structure for associating a static set of keys with values, while allowing arbitrary output values for queries involving keys outside the set. Compared to hash tables, these so-called static…

Data Structures and Algorithms · Computer Science 2026-05-20 Stefan Hermann , Hans-Peter Lehmann , Giorgio Vinciguerra , Stefan Walzer

Active learning aims to reduce labeling efforts by selectively asking humans to annotate the most important data points from an unlabeled pool and is an example of human-machine interaction. Though active learning has been extensively…

Machine Learning · Computer Science 2020-01-31 Hongjing Zhang , S. S. Ravi , Ian Davidson

In practice most functional data cannot be recorded on a continuum, but rather at discrete time points. It is also quite common that these measurements come with an additive error, which one would like eliminate for the statistical…

Statistics Theory · Mathematics 2021-11-16 Siegfried Hörmann , Fatima Jammoul

Large Language Models (LLMs) have shown strong potential for tabular data generation by modeling textualized feature-value pairs. However, tabular data inherently exhibits sparse feature-level dependencies, where many feature interactions…

Computation and Language · Computer Science 2025-09-09 Zheyu Zhang , Shuo Yang , Bardh Prenkaj , Gjergji Kasneci

Learning controllable and generalizable representation of multivariate data with desired structural properties remains a fundamental problem in machine learning. In this paper, we present a novel framework for learning generative models…

Machine Learning · Computer Science 2020-10-05 Ruixiang Zhang , Masanori Koyama , Katsuhiko Ishiguro

Modeling data uncertainty is important for noisy images, but seldom explored for face recognition. The pioneer work, PFE, considers uncertainty by modeling each face image embedding as a Gaussian distribution. It is quite effective.…

Computer Vision and Pattern Recognition · Computer Science 2020-03-26 Jie Chang , Zhonghao Lan , Changmao Cheng , Yichen Wei

Federated learning (FL) has emerged as a prominent method for collaboratively training machine learning models using local data from edge devices, all while keeping data decentralized. However, accounting for the quality of data contributed…

Machine Learning · Computer Science 2024-09-05 Haoyuan Li , Mathias Funk , Nezihe Merve Gürel , Aaqib Saeed

Cross-modal metric learning is a prominent research topic that bridges the semantic heterogeneity between vision and language. Existing methods frequently utilize simple cosine or complex distance metrics to transform the pairwise features…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Haiwen Diao , Ying Zhang , Shang Gao , Jiawen Zhu , Long Chen , Huchuan Lu

The discovery of partial differential equations (PDEs) is a challenging task that involves both theoretical and empirical methods. Machine learning approaches have been developed and used to solve this problem; however, it is important to…

Machine Learning · Statistics 2023-06-09 Kalpesh More , Tapas Tripura , Rajdip Nayek , Souvik Chakraborty

We study the new feature utility prediction problem: statistically testing whether adding a new feature to the data representation can improve predictive accuracy on a supervised learning task. In many applications, identifying new…

Machine Learning · Computer Science 2012-06-22 Hoyt Koepke , Mikhail Bilenko

Sparse training is often adopted in cross-device federated learning (FL) environments where constrained devices collaboratively train a machine learning model on private data by exchanging pseudo-gradients across heterogeneous networks.…

Machine Learning · Computer Science 2025-04-08 Adriano Guastella , Lorenzo Sani , Alex Iacob , Alessio Mora , Paolo Bellavista , Nicholas D. Lane