Related papers: In memoriam Maurice Gross
Since the invention of computers, communication through natural language (actual human language) has been a dream technology. However, natural language is extremely difficult to mathematically formulate, making it difficult to realize as an…
James Lee Fergason (1934 - 2008) focused his research on the liquid crystals. His studies correspond to a relevant part of the history of soft matter science and technology of liquid crystals. Here a discussion of some of his researches.
Leo Breiman was a unique character. There will not be another like him. I consider it one of my great fortunes in life to have know and worked with him. Along with John Tukey, Leo had the greatest influence on shaping my approach to…
Language Models (LMs) have achieved impressive performance on various linguistic tasks, but their relationship to human language processing in the brain remains unclear. This paper examines the gaps and overlaps between LMs and the brain at…
Computer scientists working on natural language processing, native speakers of endangered languages, and field linguists to discuss ways to harness Automatic Speech Recognition, especially neural networks, to automate annotation, speech…
This paper presents a self-supervised learning framework, named MGF, for general-purpose speech representation learning. In the design of MGF, speech hierarchy is taken into consideration. Specifically, we propose to use generative learning…
Large language models (LLMs) have demonstrated impressive capabilities in general scenarios, exhibiting a level of aptitude that approaches, in some aspects even surpasses, human-level intelligence. Among their numerous skills, the…
Large language models (LLMs) have demonstrated exceptional performance in reasoning tasks such as mathematics and coding, matching or surpassing human capabilities. However, these impressive reasoning abilities face significant challenges…
This memorial article for Mark Sapir provides a brief overview of his life and career. Among his many contributions we highlight two of his most celebrated achievements: his groundbreaking solutions to Burnside-type problems for semigroups…
James Earl Baumgartner (March 23, 1943 - December 28, 2011) came of age mathematically during the emergence of forcing as a fundamental technique of set theory, and his seminal research changed the way set theory is done. He made…
Dedication to my untimely departed friends, Dmitry Igorevich Diakonov, Viktor Yur'evich Petrov and Maxim Vladimirovich Polyakov.
The topic of this paper is, on the one hand to introduce algebraic analysis results of \'Etienne B\'ezout (1730- 1783) not as we know them today but as he found them in his time, and on the other hand to emphasize his innovating viewpoints.…
About Conway's surreal numbers: A letter to a friend (written in French). In memoriam John Horton Conway.
Language models (LMs) have introduced a major paradigm shift in Natural Language Processing (NLP) modeling where large pre-trained LMs became integral to most of the NLP tasks. The LMs are intelligent enough to find useful and relevant…
Recent advances in neural network-based generative modeling have reignited the hopes in having computer systems capable of seamlessly conversing with humans and able to understand natural language. Neural architectures have been employed to…
The figure of Raoul Gatto, who died in 2017, is remembered here, with an illustration of his career and the main results of his research, along with the personal memories of some of those who worked with him.
A pioneering rule-based mechanical translation system (precursor of modern RBMTs) was first presented in December 1929 by its inventor, Federico Pucci, who later published the full method in a book titled "Il traduttore meccanico ed il…
Under the lens of Marr's levels of analysis, we critique and extend two claims about language models (LMs) and language processing: first, that predicting upcoming linguistic information based on context is central to language processing,…
2023 year marks the hundredth birth anniversary of prominent Russian mathematician and thinker Igor Rostislavovich Shafarevich (1923-2017). The article presents a selection of quotations from various works of him, devoted to the future of…
Professor Sir Karl Popper (1902-1994) was one of the most influential philosophers of science of the twentieth century, best known for his doctrine of falsifiability. His axiomatic formulation of probability, however, is unknown to current…