In a recent publication from the Brain Language Laboratory at Freie Universität Berlin, cutting-edge neural network research is critically reviewed in light of the question, how such models can help us understand the material brain-internal basis of cognitive and language processing. Powerful popular network models, such as autoencoders or generalized pretrained transformers, are successful in solving classification and completion problems, but do not address this issue. Their great dissimilarities, at multiple levels, with brain structure and function make their results difficult to relate to real neurobiological processes. A different strategy is brain-constrained neural modelling, whereby multi-level similarities between brain and network are implemented so that tentative conclusions on the material mechanistic basis of human cognition become possible. The just published article reviews recent advances in understanding the brain basis of symbol representation, meaning acquisition and verbal working memory along with neurobiologically founded models of different symbol types, including proper names, category terms, concrete concepts and abstract words. A general chapter contrasting the current main stream approach of big data neural networks research with a brain-based modelling strategy rounds up the paper.

 

Neurobiological mechanisms for language, symbols and concepts; Clues from brain-constrained deep neural networks

By Friedemann Pulvermüller
Progress in Neurobiology, in press
https://doi.org/10.1016/j.pneurobio.2023.102511
https://www.fu-berlin.de/matco