English
Related papers

Related papers: STORE: Sparse Tensor Response Regression and Neuro…

200 papers

Neural networks augmented with external memory have the ability to learn algorithmic solutions to complex tasks. These models appear promising for applications such as language modeling and machine translation. However, they scale poorly in…

Machine Learning · Computer Science 2016-10-31 Jack W Rae , Jonathan J Hunt , Tim Harley , Ivo Danihelka , Andrew Senior , Greg Wayne , Alex Graves , Timothy P Lillicrap

We consider the classical sparse regression problem of recovering a sparse signal $x_0$ given a measurement vector $y = \Phi x_0+w$. We propose a tree search algorithm driven by the deep neural network for sparse regression (TSN). TSN…

Machine Learning · Computer Science 2019-04-02 Kyung-Su Kim , Sae-Young Chung

We introduce a new sparse sliced inverse regression estimator called Cholesky matrix penalization and its adaptive version for achieving sparsity in estimating the dimensions of the central subspace. The new estimators use the Cholesky…

Methodology · Statistics 2021-04-21 Linh Nghiem , Francis K. C. Hui , Samuel Mueller , A. H. Welsh

Tensor-based representations are being increasingly used to represent complex data types such as imaging data, due to their appealing properties such as dimension reduction and the preservation of spatial information. Recently, there is a…

Methodology · Statistics 2023-12-15 Rongke Lyu , Marina Vannucci , Suprateek Kundu

Gradient descent optimizations and backpropagation are the most common methods for training neural networks, but they are computationally expensive for real time applications, need high memory resources, and are difficult to converge for…

Machine Learning · Computer Science 2022-07-05 Seyyed Mostafa Mousavi Janbeh Sarayi , Mansour Nikkhah Bahrami

Retinal implants aim to restore functional vision despite photoreceptor degeneration, yet are fundamentally constrained by low resolution electrode arrays and patient-specific perceptual distortions. Most deployed encoders rely on…

Image and Video Processing · Electrical Eng. & Systems 2026-02-12 Henning Konermann , Yuli Wu , Emil Mededovic , Volkmar Schulz , Peter Walter , Johannes Stegmaier

Neural networks are usually not the tool of choice for nonparametric high-dimensional problems where the number of input features is much larger than the number of observations. Though neural networks can approximate complex multivariate…

Methodology · Statistics 2019-06-25 Jean Feng , Noah Simon

In the context of the compressed sensing problem, we propose a new ensemble of sparse random matrices which allow one (i) to acquire and compress a {\rho}0-sparse signal of length N in a time linear in N and (ii) to perfectly recover the…

Information Theory · Computer Science 2013-04-15 Maria Chiara Angelini , Federico Ricci-Tersenghi , Yoshiyuki Kabashima

Sparse Tensor Cores offer exceptional performance gains for AI workloads by exploiting structured 2:4 sparsity. However, their potential remains untapped for core scientific workloads such as stencil computations, which exhibit irregular…

Computational Engineering, Finance, and Science · Computer Science 2025-07-01 Qi Li , Kun Li , Haozhi Han , Liang Yuan , Junshi Chen , Yunquan Zhang , Yifeng Chen , Hong An , Ting Cao , Mao Yang

A sparse modeling is a major topic in machine learning and statistics. LASSO (Least Absolute Shrinkage and Selection Operator) is a popular sparse modeling method while it has been known to yield unexpected large bias especially at a sparse…

Machine Learning · Computer Science 2018-08-23 Katsuyuki Hagiwara

Sparse modeling has been widely and successfully used in many applications such as computer vision, machine learning, and pattern recognition. Accompanied with those applications, significant research has studied the theoretical limits and…

Information Theory · Computer Science 2016-10-04 Yuki Itoh , Marco F. Duarte , Mario Parente

Sparse linear regression methods such as Lasso require a tuning parameter that depends on the noise variance, which is typically unknown and difficult to estimate in practice. In the presence of heavy-tailed noise or adversarial outliers,…

Statistics Theory · Mathematics 2025-06-17 Takeyuki Sasai , Hironori Fujisawa

We present a novel binary convex reformulation of the sparse regression problem that constitutes a new duality perspective. We devise a new cutting plane method and provide evidence that it can solve to provable optimality the sparse…

Optimization and Control · Mathematics 2017-09-29 Dimitris Bertsimas , Bart Van Parys

High-dimensional sparse data emerge in many critical application domains such as healthcare and cybersecurity. To extract meaningful insights from massive volumes of these multi-dimensional data, scientists employ unsupervised analysis…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-18 Jan Laukemann , Ahmed E. Helal , S. Isaac Geronimo Anderson , Fabio Checconi , Yongseok Soh , Jesmin Jahan Tithi , Teresa Ranadive , Brian J Gravelle , Fabrizio Petrini , Jee Choi

This work is a re-examination of the sparse Bayesian learning (SBL) of linear regression models of Tipping (2001) in a high-dimensional setting. We propose a hard-thresholded version of the SBL estimator that achieves, for orthogonal design…

Methodology · Statistics 2015-02-12 Yves Atchade , Chia Chye Yee

Sparse-view computed tomography (CT) enables fast and low-dose CT imaging, an essential feature for patient-save medical imaging and rapid non-destructive testing. In sparse-view CT, only a few projection views are acquired, causing…

Image and Video Processing · Electrical Eng. & Systems 2024-02-28 Nadja Gruber , Johannes Schwab , Elke Gizewski , Markus Haltmeier

In the problem of learning mixtures of linear regressions, the goal is to learn a collection of signal vectors from a sequence of (possibly noisy) linear measurements, where each measurement is evaluated on an unknown signal drawn uniformly…

Machine Learning · Computer Science 2019-11-01 Akshay Krishnamurthy , Arya Mazumdar , Andrew McGregor , Soumyabrata Pal

Signal models formed as linear combinations of few atoms from an over-complete dictionary or few frame vectors from a redundant frame have become central to many applications in high dimensional signal processing and data analysis. A core…

Information Theory · Computer Science 2024-08-30 Xuemei Chen , Christian Kümmerle , Rongrong Wang

We present the performance of a semantic segmentation network, SparseSSNet, that provides pixel-level classification of MicroBooNE data. The MicroBooNE experiment employs a liquid argon time projection chamber for the study of neutrino…

Instrumentation and Detectors · Physics 2021-04-07 MicroBooNE collaboration , P. Abratenko , M. Alrashed , R. An , J. Anthony , J. Asaadi , A. Ashkenazi , S. Balasubramanian , B. Baller , C. Barnes , G. Barr , V. Basque , L. Bathe-Peters , O. Benevides Rodrigues , S. Berkman , A. Bhanderi , A. Bhat , M. Bishai , A. Blake , T. Bolton , L. Camilleri , D. Caratelli , I. Caro Terrazas , R. Castillo Fernandez , F. Cavanna , G. Cerati , Y. Chen , E. Church , D. Cianci , J. M. Conrad , M. Convery , L. Cooper-Troendle , J. I. Crespo-Anadon , M. Del Tutto , S. R. Dennis , D. Devitt , R. Diurba , R. Dorrill , K. Duffy , S. Dytman , B. Eberly , A. Ereditato , J. J. Evans , G. A. Fiorentini Aguirre , R. S. Fitzpatrick , B. T. Fleming , N. Foppiani , D. Franco , A. P. Furmanski , D. Garcia-Gamez , S. Gardiner , G. Ge , S. Gollapinni , O. Goodwin , E. Gramellini , P. Green , H. Greenlee , W. Gu , R. Guenette , P. Guzowski , L. Hagaman , E. Hall , P. Hamilton , O. Hen , G. A. Horton-Smith , A. Hourlier , R. Itay , C. James , J. Jan de Vries , X. Ji , L. Jiang , J. H. Jo , R. A. Johnson , Y. J. Jwa , N. Kamp , N. Kaneshige , G. Karagiorgi , W. Ketchum , B. Kirby , M. Kirby , T. Kobilarcik , I. Kreslo , R. LaZur , I. Lepetic , K. Li , Y. Li , B. R. Littlejohn , W. C. Louis , X. Luo , A. Marchionni , C. Mariani , D. Marsden , J. Marshall , J. Martin-Albo , D. A. Martinez Caicedo , K. Mason , A. Mastbaum , N. McConkey , V. Meddage , T. Mettler , K. Miller , J. Mills , K. Mistry , T. Mohayai , A. Mogan , J. Moon , M. Mooney , A. F. Moor , C. D. Moore , L. Mora Lepin , J. Mousseau , M. Murphy , D. Naples , A. Navrer-Agasson , R. K. Neely , P. Nienaber , J. Nowak , O. Palamara , V. Paolone , A. Papadopoulou , V. Papavassiliou , S. F. Pate , A. Paudel , Z. Pavlovic , E. Piasetzky , I. Ponce-Pinto , S. Prince , X. Qian , J. L. Raaf , V. Radeka , A. Rafique , M. Reggiani-Guzzo , L. Ren , L. Rochester , J. Rodriguez Rondon , H. E. Rogers , M. Rosenberg , M. Ross-Lonergan , B. Russell , G. Scanavini , D. W. Schmitz , A. Schukraft , W. Seligman , M. H. Shaevitz , R. Sharankova , J. Sinclair , A. Smith , E. L. Snider , M. Soderberg , S. Soldner-Rembold , S. R. Soleti , P. Spentzouris , J. Spitz , M. Stancari , J. St. John , T. Strauss , K. Sutton , S. Sword-Fehlberg , A. M. Szelc , N. Tagg , W. Tang , K. Terao , C. Thorpe , M. Toups , Y. -T. Tsai , M. A. Uchida , T. Usher , W. Van De Pontseele , B. Viren , M. Weber , H. Wei , Z. Williams , S. Wolbers , T. Wongjirad , M. Wospakrik , W. Wu , E. Yandel , T. Yang , G. Yarbrough , L. E. Yates , G. P. Zeller , J. Zennamo , C. Zhang

Sparse decision trees are one of the most common forms of interpretable models. While recent advances have produced algorithms that fully optimize sparse decision trees for prediction, that work does not address policy design, because the…

Machine Learning · Computer Science 2022-10-27 Ali Behrouz , Mathias Lecuyer , Cynthia Rudin , Margo Seltzer