English
Related papers

Related papers: COMET: "Cone of experience" enhanced large multimo…

200 papers

Model evolution enables learning from feedback to refine experiences and update skills, transforming models from having no domain knowledge to becoming domain experts. However, there is currently no unified and effective method for guiding…

Machine Learning · Computer Science 2024-12-02 Jiawei Li , Xiaoang Xu , Yang Gao

The computational power increases over the past decades havegreatly enhanced the ability to simulate chemical reactions andunderstand ever more complex transformations. Tensor contractions are the fundamental computational building block of…

Mathematical Software · Computer Science 2022-01-02 Erdal Mutlu , Ruiqin Tian , Bin Ren , Sriram Krishnamoorthy , Roberto Gioiosa , Jacques Pienaar , Gokcen Kestor

Humans are able to rapidly understand scenes by utilizing concepts extracted from prior experience. Such concepts are diverse, and include global scene descriptors, such as the weather or lighting, as well as local scene descriptors, such…

Computer Vision and Pattern Recognition · Computer Science 2021-11-05 Yilun Du , Shuang Li , Yash Sharma , Joshua B. Tenenbaum , Igor Mordatch

Generating intermediate steps, or Chain of Thought (CoT), is an effective way to significantly improve language models' (LM) multi-step reasoning capability. However, the CoT lengths can grow rapidly with the problem complexity, easily…

Computation and Language · Computer Science 2023-06-13 Soochan Lee , Gunhee Kim

Coupled multiphysics simulations for high-dimensional, large-scale problems can be prohibitively expensive due to their computational demands. This article presents a novel framework integrating a deep operator network (DeepONet) with the…

Computational Engineering, Finance, and Science · Computer Science 2025-09-03 Fouad M. Amin , Diab W. Abueidda , Panos Pantidis , Mostafa E. Mobasher

While large models pre-trained on high-quality data exhibit excellent performance on mathematical reasoning (e.g., GSM8k, MultiArith), it remains challenging to specialize smaller models for these tasks. Common approaches to address this…

Computation and Language · Computer Science 2026-03-19 Neeraj Gangwar , Suma P Bhat , Nickvash Kani

Due to the rapid advancements in multimodal large language models, evaluating their multimodal mathematical capabilities continues to receive wide attention. Despite the datasets like MathVista proposed benchmarks for assessing mathematical…

Computation and Language · Computer Science 2024-07-18 Zhong-Zhi Li , Ming-Liang Zhang , Fei Yin , Zhi-Long Ji , Jin-Feng Bai , Zhen-Ru Pan , Fan-Hu Zeng , Jian Xu , Jia-Xin Zhang , Cheng-Lin Liu

Model-based reinforcement learning is an appealing framework for creating agents that learn, plan, and act in sequential environments. Model-based algorithms typically involve learning a transition model that takes a state and an action and…

Machine Learning · Computer Science 2019-06-03 Kavosh Asadi , Dipendra Misra , Seungchan Kim , Michel L. Littman

Large language models handle single-turn generation well, but multi-turn interactions still require the model to reconstruct user intent and task state from an expanding token history because internal representations do not persist across…

Computation and Language · Computer Science 2025-12-11 Vishwas Hegde , Vindhya Shigehalli

Metagenomics offers a way to analyze biotopes at the genomic level and to reach functional and taxonomical conclusions. The bio-analyzes of large metagenomic projects face critical limitations: complex metagenomes cannot be assembled and…

Genomics · Quantitative Biology 2015-11-30 Maillet Nicolas , Collet Guillaume , Vanier Thomas , Lavenier Dominique , Pierre Peterlongo

Interleaved image-text generation has emerged as a crucial multimodal task, aiming at creating sequences of interleaved visual and textual content given a query. Despite notable advancements in recent multimodal large language models…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Wei Chen , Lin Li , Yongqi Yang , Bin Wen , Fan Yang , Tingting Gao , Yu Wu , Long Chen

Multi-step reasoning ability of large language models is crucial in tasks such as math and tool utilization. Current researches predominantly focus on enhancing model performance in these multi-step reasoning tasks through fine-tuning with…

Computation and Language · Computer Science 2024-10-23 Yuli Qiu , Jiashu Yao , Heyan Huang , Yuhang Guo

The sparse Mixture-of-Experts (Sparse-MoE) framework efficiently scales up model capacity in various domains, such as natural language processing and vision. Sparse-MoEs select a subset of the "experts" (thus, only a portion of the overall…

Machine Learning · Computer Science 2023-06-06 Shibal Ibrahim , Wenyu Chen , Hussein Hazimeh , Natalia Ponomareva , Zhe Zhao , Rahul Mazumder

Education systems are dynamically changing to accommodate technological advances, industrial and societal needs, and to enhance students' learning journeys. Curriculum specialists and educators constantly revise taught subjects across…

Computers and Society · Computer Science 2024-03-12 Tamador Alkhidir , Edmond Awad , Aamena Alshamsi

By extending the advantage of chain-of-thought (CoT) reasoning in human-like step-by-step processes to multimodal contexts, multimodal CoT (MCoT) reasoning has recently garnered significant research attention, especially in the integration…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Yaoting Wang , Shengqiong Wu , Yuecheng Zhang , Shuicheng Yan , Ziwei Liu , Jiebo Luo , Hao Fei

Large Language Models (LLMs) have demonstrated remarkable performance across multiple tasks through in-context learning. For complex reasoning tasks that require step-by-step thinking, Chain-of-Thought (CoT) prompting has given impressive…

Computation and Language · Computer Science 2024-10-10 Armel Zebaze , Benoît Sagot , Rachel Bawden

While previous multimodal slow-thinking methods have demonstrated remarkable success in single-image understanding scenarios, their effectiveness becomes fundamentally constrained when extended to more complex multi-image comprehension…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Guanghao Zhang , Tao Zhong , Yan Xia , Mushui Liu , Zhelun Yu , Haoyuan Li , Wanggui He , Fangxun Shu , Dong She , Yi Wang , Hao Jiang

Lack of methodical support, low level of teachers' awareness of existing effective teaching technologies such as computer modeling does not allow students to form their own individual trajectory for development as well as their competence…

Physics Education · Physics 2020-05-18 Svitlana H. Lytvynova

Processing cores and the accompanying main memory working in tandem enable the modern processors. Dissipating heat produced from computation, memory access remains a significant problem for processors. Therefore, processor thermal…

Hardware Architecture · Computer Science 2022-03-18 Lokesh Siddhu , Rajesh Kedia , Shailja Pandey , Martin Rapp , Anuj Pathania , Jörg Henkel , Preeti Ranjan Panda

Chain-of-Thought (CoT) reasoning empowers Large Language Models (LLMs) with remarkable capabilities but typically requires prohibitive parameter scales. CoT distillation has emerged as a promising paradigm to transfer reasoning prowess into…

Computation and Language · Computer Science 2026-05-19 Jin Cui , Jiaqi Guo , Ruixuan Yang , Jiayi Lu , Jiepeng Zhou , Jiajun Xu , Jiangcheng Song , Boran Zhao , Pengju Ren