Computation and Language · Computer Science
When does In-context Learning Fall Short and Why? A Study on Specification-Heavy Tasks
Hao Peng, Xiaozhi Wang, Jianhui Chen, Weikai Li +7
2023-11-16
Machine Learning · Computer Science
How Robust are LLMs to In-Context Majority Label Bias?
Karan Gupta, Sumegh Roychowdhury, Siva Rajesh Kasa, Santhosh Kumar Kasa +3
2023-12-29
Computation and Language · Computer Science
Context Limitations Make Neural Language Models More Human-Like
Tatsuki Kuribayashi, Yohei Oseki, Ana Brassard, Kentaro Inui
2022-11-02
Machine Learning · Computer Science
Unraveling the Mechanics of Learning-Based Demonstration Selection for In-Context Learning
Hui Liu, Wenya Wang, Hao Sun, Chris Xing Tian +3
2024-10-16
Artificial Intelligence · Computer Science
In-Context Learning Dynamics with Random Binary Sequences
Eric J. Bigelow, Ekdeep Singh Lubana, Robert P. Dick, Hidenori Tanaka +1
2024-04-17
Computation and Language · Computer Science
What Do Language Models Learn in Context? The Structured Task Hypothesis
Jiaoda Li, Yifan Hou, Mrinmaya Sachan, Ryan Cotterell
2024-08-06
Computation and Language · Computer Science
In-Context Learning with Noisy Labels
Junyong Kang, Donghyun Son, Hwanjun Song, Buru Chang
2024-12-02
Computation and Language · Computer Science
Ambiguity-Aware In-Context Learning with Large Language Models
Lingyu Gao, Aditi Chaudhary, Krishna Srinivasan, Kazuma Hashimoto +2
2024-01-31
Computation and Language · Computer Science
Shortcut Learning in In-Context Learning: A Survey
Rui Song, Yingji Li, Lida Shi, Fausto Giunchiglia +1
2024-12-02
Computation and Language · Computer Science
The Mystery of In-Context Learning: A Comprehensive Survey on Interpretation and Analysis
Yuxiang Zhou, Jiazheng Li, Yanzheng Xiang, Hanqi Yan +2
2024-10-04
Machine Learning · Computer Science
In-Context Molecular Property Prediction with LLMs: A Blinding Study on Memorization and Knowledge Conflicts
Matthias Busch, Marius Tacke, Sviatlana V. Lamaka, Mikhail L. Zheludkevich +3
2026-03-30
Computation and Language · Computer Science
Large Language Models Can be Lazy Learners: Analyze Shortcuts in In-Context Learning
Ruixiang Tang, Dehan Kong, Longtao Huang, Hui Xue
2023-09-12
Computation and Language · Computer Science
Why does in-context learning fail sometimes? Evaluating in-context learning on open and closed questions
Xiang Li, Haoran Tang, Siyu Chen, Ziwei Wang +2
2024-07-03
Computation and Language · Computer Science
A Survey on In-context Learning
Qingxiu Dong, Lei Li, Damai Dai, Ce Zheng +10
2024-10-08
Computation and Language · Computer Science
Does In-Context Learning Really Learn? Rethinking How Large Language Models Respond and Solve Tasks via In-Context Learning
Quanyu Long, Yin Wu, Wenya Wang, Sinno Jialin Pan
2024-07-24
Computation and Language · Computer Science
What Makes In-context Learning Effective for Mathematical Reasoning: A Theoretical Analysis
Jiayu Liu, Zhenya Huang, Chaokun Wang, Xunpeng Huang +2
2024-12-18
Computation and Language · Computer Science
Investigating the Learning Behaviour of In-context Learning: A Comparison with Supervised Learning
Xindi Wang, Yufei Wang, Can Xu, Xiubo Geng +5
2023-08-02