English
Related papers

Related papers: Representing Unordered Data Using Complex-Weighted…

200 papers

Tabular datasets are ubiquitous in data science applications. Given their importance, it seems natural to apply state-of-the-art deep learning algorithms in order to fully unlock their potential. Here we propose neural network models that…

Machine Learning · Computer Science 2021-02-15 Inkit Padhi , Yair Schiff , Igor Melnyk , Mattia Rigotti , Youssef Mroueh , Pierre Dognin , Jerret Ross , Ravi Nair , Erik Altman

Learning neural subset selection tasks, such as compound selection in AI-aided drug discovery, have become increasingly pivotal across diverse applications. The existing methodologies in the field primarily concentrate on constructing…

Machine Learning · Computer Science 2024-06-11 Binghui Xie , Yatao Bian , Kaiwen zhou , Yongqiang Chen , Peilin Zhao , Bo Han , Wei Meng , James Cheng

A main object of our study is multiset functions -- that is, permutation-invariant functions over inputs of varying sizes. Deep Sets, proposed by \cite{zaheer2017deep}, provides a \emph{universal representation} for continuous multiset…

Machine Learning · Computer Science 2023-10-24 Puoya Tabaghi , Yusu Wang

Single neurons in neural networks are often interpretable in that they represent individual, intuitively meaningful features. However, many neurons exhibit $\textit{mixed selectivity}$, i.e., they represent multiple unrelated features. A…

Machine Learning · Statistics 2023-10-19 David Klindt , Sophia Sanborn , Francisco Acosta , Frédéric Poitevin , Nina Miolane

In this paper, we derive closed-form expressions for implicit controlled invariant sets for discrete-time controllable linear systems with measurable disturbances. In particular, a disturbance-reactive (or disturbance feedback) controller…

Systems and Control · Electrical Eng. & Systems 2021-10-05 Zexiang Liu , Tzanis Anevlavis , Necmiye Ozay , Paulo Tabuada

Despite tremendous progress over the past decade, deep learning methods generally fall short of human-level systematic generalization. It has been argued that explicitly capturing the underlying structure of data should allow connectionist…

Machine Learning · Computer Science 2023-04-26 Andrea Dittadi

We consider the question of which nonconvex sets can be represented exactly as the feasible sets of mixed-integer convex optimization problems. We state the first complete characterization for the case when the number of possible integer…

Optimization and Control · Mathematics 2017-06-20 Miles Lubin , Ilias Zadik , Juan Pablo Vielma

As machine learning systems get widely adopted for high-stake decisions, quantifying uncertainty over predictions becomes crucial. While modern neural networks are making remarkable gains in terms of predictive accuracy, characterizing…

Machine Learning · Computer Science 2019-06-14 Melanie F. Pradier , Weiwei Pan , Jiayu Yao , Soumya Ghosh , Finale Doshi-velez

We introduce a novel computational unit for neural networks that features multiple biases, challenging the traditional perceptron structure. This unit emphasizes the importance of preserving uncorrupted information as it is passed from one…

Large and diverse datasets have been the cornerstones of many impressive advancements in artificial intelligence. Intelligent creatures, however, learn by interacting with the environment, which changes the input sensory signals and the…

Machine Learning · Computer Science 2022-10-25 Hao Liu , Tom Zahavy , Volodymyr Mnih , Satinder Singh

Hypergraphs are used to model higher-order interactions amongst agents and there exist many practically relevant instances of hypergraph datasets. To enable efficient processing of hypergraph-structured data, several hypergraph neural…

Machine Learning · Computer Science 2022-03-29 Eli Chien , Chao Pan , Jianhao Peng , Olgica Milenkovic

Learning from the multidimensional data has been an interesting concept in the field of machine learning. However, such learning can be difficult, complex, expensive because of expensive data processing, manipulations as the number of…

Machine Learning · Computer Science 2020-12-04 Mahbubur Rahman

Recently, deep-learning-based approaches have been widely studied for deformable image registration task. However, most efforts directly map the composite image representation to spatial transformation through the convolutional neural…

Image and Video Processing · Electrical Eng. & Systems 2022-07-08 Jiashun Chen , Donghuan Lu , Yu Zhang , Dong Wei , Munan Ning , Xinyu Shi , Zhe Xu , Yefeng Zheng

Deep Operator Networks (DeepONets) and their physics-informed variants have shown significant promise in learning mappings between function spaces of partial differential equations, enhancing the generalization of traditional neural…

Machine Learning · Computer Science 2025-01-08 Milad Ramezankhani , Anirudh Deodhar , Rishi Yash Parekh , Dagnachew Birru

Deep neural networks employ specialized architectures for vision, sequential and language tasks, yet this proliferation obscures their underlying commonalities. We introduce a unified matrix-order framework that casts convolutional,…

Machine Learning · Computer Science 2025-07-24 Yuzhou Zhu

The recent success of neural networks as implicit representation of data has driven growing interest in neural functionals: models that can process other neural networks as input by operating directly over their weight spaces. Nevertheless,…

Machine Learning · Computer Science 2023-05-24 Allan Zhou , Kaien Yang , Yiding Jiang , Kaylee Burns , Winnie Xu , Samuel Sokota , J. Zico Kolter , Chelsea Finn

We introduce a compressed representation of sets of sets that exploits how much they differ from each other. Our representation supports access, membership, predecessor and successor queries on the sets within logarithmic time. In addition,…

Data Structures and Algorithms · Computer Science 2026-02-02 Travis Gagie , Meng He , Gonzalo Navarro

We introduce a new technique for the efficient management of large sequences of multidimensional data, which takes advantage of regularities that arise in real-world datasets and supports different types of aggregation queries. More…

Data Structures and Algorithms · Computer Science 2018-03-08 Nieves R. Brisaboa , Guillermo de Bernardo , Gonzalo Navarro , Tirso V. Rodeiro , Diego Seco

Neural networks are powerful tools for cognitive modeling due to their flexibility and emergent properties. However, interpreting their learned representations remains challenging due to their sub-symbolic semantics. In this work, we…

Machine Learning · Computer Science 2026-04-07 Andrew Nam , Declan Campbell , Thomas Griffiths , Jonathan Cohen , Sarah-Jane Leslie

With the proliferation of IoT devices, the distributed control systems are now capturing and processing more sensors at higher frequency than ever before. These new data, due to their volume and novelty, cannot be effectively consumed…

Signal Processing · Electrical Eng. & Systems 2022-01-25 Chao Zhang , Sthitie Bom