English
Related papers

Related papers: Revisiting the Design Issues of Local Models for J…

200 papers

While cross-lingual word embeddings have been studied extensively in recent years, the qualitative differences between the different algorithms remain vague. We observe that whether or not an algorithm uses a particular feature set…

Computation and Language · Computer Science 2017-01-11 Omer Levy , Anders Søgaard , Yoav Goldberg

As the application of deep neural networks proliferates in numerous areas such as medical imaging, video surveillance, and self driving cars, the need for explaining the decisions of these models has become a hot research topic, both at the…

Machine Learning · Computer Science 2021-06-01 Ronny Luss , Pin-Yu Chen , Amit Dhurandhar , Prasanna Sattigeri , Yunfeng Zhang , Karthikeyan Shanmugam , Chun-Chen Tu

Large pre-trained language models have shown remarkable performance over the past few years. These models, however, sometimes learn superficial features from the dataset and cannot generalize to the distributions that are dissimilar to the…

Computation and Language · Computer Science 2022-10-31 Jieyu Zhao , Xuezhi Wang , Yao Qin , Jilin Chen , Kai-Wei Chang

Supervised topic models are often sought to balance prediction quality and interpretability. However, when models are (inevitably) misspecified, standard approaches rarely deliver on both. We introduce a novel approach, the…

Machine Learning · Computer Science 2020-03-04 Jason Ren , Russell Kunes , Finale Doshi-Velez

Speakers sometimes omit certain arguments of a predicate in a sentence; such omission is especially frequent in pro-drop languages. This study addresses a question about ellipsis -- what can explain the native speakers' ellipsis decisions?…

Computation and Language · Computer Science 2024-10-29 Yukiko Ishizuki , Tatsuki Kuribayashi , Yuichiroh Matsubayashi , Ryohei Sasano , Kentaro Inui

Tree-based ensembles such as random forests remain the go-to for tabular data over deep learning models due to their prediction performance and computational efficiency. These advantages have led to their widespread deployment in…

Machine Learning · Computer Science 2026-05-28 Zhongyuan Liang , Zachary T. Rewolinski , Abhineet Agarwal , Tiffany M. Tang , Bin Yu

Accurate neural models are much less efficient than non-neural models and are useless for processing billions of social media posts or handling user queries in real time with a limited budget. This study revisits the fastest pattern-based…

Computation and Language · Computer Science 2023-05-31 Naoki Yoshinaga

Research in point cloud analysis with deep neural networks has made rapid progress in recent years. The pioneering work PointNet offered a direct analysis of point clouds. However, due to its architecture PointNet is not able to capture…

Computer Vision and Pattern Recognition · Computer Science 2020-06-15 Qendrim Bytyqi , Nicola Wolpert , Elmar Schömer

Although the recent progress in the deep neural network has led to the development of learnable local feature descriptors, there is no explicit answer for estimation of the necessary size of a neural network. Specifically, the local feature…

Machine Learning · Computer Science 2017-06-19 Chong Huang , Qiong Liu , Yan-Ying Chen , Kwang-Ting , Cheng

A burgeoning paradigm in algorithm design is the field of algorithms with predictions, in which algorithms can take advantage of a possibly-imperfect prediction of some aspect of the problem. While much work has focused on using predictions…

Machine Learning · Computer Science 2022-10-18 Mikhail Khodak , Maria-Florina Balcan , Ameet Talwalkar , Sergei Vassilvitskii

Most representation learning algorithms for language and image processing are local, in that they identify features for a data point based on surrounding points. Yet in language processing, the correct meaning of a word often depends on its…

Machine Learning · Computer Science 2014-02-19 Anjan Nepal , Alexander Yates

Analyzing topics extracted from text data in relation to external outcomes is important across fields such as computational social science and organizational research. However, existing topic modeling methods struggle to simultaneously…

Computation and Language · Computer Science 2026-04-27 Yura Yoshida , Masato Kanai , Masataka Nakayama , Haruki Ohsawa , Yukiko Uchida , Arata Yuminaga , Gakuse Hoshina , Nobuo Sayama

One of the major issues in signed networks is to use network structure to predict the missing sign of an edge. In this paper, we introduce a novel probabilistic approach for the sign prediction problem. The main characteristic of the…

Social and Information Networks · Computer Science 2018-02-20 Amin Javari , HongXiang Qiu , Elham Barzegaran , Mahdi Jalili , Kevin Chen-Chuan Chang

A powerful and flexible approach to structured prediction consists in embedding the structured objects to be predicted into a feature space of possibly infinite dimension by means of output kernels, and then, solving a regression problem in…

Machine Learning · Statistics 2020-11-03 Luc Brogat-Motte , Alessandro Rudi , Céline Brouard , Juho Rousu , Florence d'Alché-Buc

In this paper, we explore connections between interpretable machine learning and learning theory through the lens of local approximation explanations. First, we tackle the traditional problem of performance generalization and bound the…

Machine Learning · Computer Science 2020-11-03 Jeffrey Li , Vaishnavh Nagarajan , Gregory Plumb , Ameet Talwalkar

In order to ensure the reliability of the explanations of machine learning models, it is crucial to establish their advantages and limits and in which case each of these methods outperform. However, the current understanding of when and how…

Machine Learning · Computer Science 2025-02-12 Célia Wafa Ayad , Thomas Bonnier , Benjamin Bosch , Sonali Parbhoo , Jesse Read

Recent progress in deep learning has been driven by increasingly larger models. However, their computational and energy demands have grown proportionally, creating significant barriers to their deployment and to a wider adoption of deep…

Machine Learning · Computer Science 2025-09-16 Pedro Savarese

We extend the approach in [Ann. Statist. 38 (2010) 2499-2524] for identifying locally optimal designs for nonlinear models. Conceptually the extension is relatively simple, but the consequences in terms of applications are profound. As we…

Statistics Theory · Mathematics 2012-10-04 Min Yang , John Stufken

With the advent of FrameNet and PropBank, many semantic role labeling (SRL) systems have been proposed in English. Although research on Japanese predicate argument structure analysis (PASA) has been conducted, most studies focused on…

Computation and Language · Computer Science 2021-03-01 Tomohiro Nakamura , Tomoya Miyashita , Soh Ohara

Local learning offers an alternative to traditional end-to-end back-propagation in deep neural networks, significantly reducing GPU memory consumption. Although it has shown promise in image classification tasks, its extension to other…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Feiyu Zhu , Yuming Zhang , Xiuyuan Guo , Hengyu Shi , Junfeng Luo , Junhao Su , Jialin Gao