Meta researches: how does our brain process text and language?
29. April 2022Meta researches: how does our brain process text and language?
San Francisco, 4/29/2022
Meta AI has launched a long-term research project to clarify how the human brain processes text and language and then develop an AI that can process and learn language as efficiently as humans.
The initiative is a collaboration between Meta and neuroimaging lab NeuroSpin and Inria, the French National Institute for Research in Digital Science and Technology.
Meta and its collaborators have already conducted some research and published two scientific papers on their findings:
The first showed that AI language models resemble human brain activity when the model is trying to find the next word in a sentence.
A second paper found that AI models can be improved by copying the way the brain recognizes words and ideas in advance.
For example, when an AI system hears the words „Once upon a time…“ it might predict the next word as „time,“ but a human can also associate the phrase with ideas such as narratives, putting it several steps ahead of the AI.
Getting algorithms to make predictions further into the future could help them learn more efficiently, said Jean-Rémi King, Meta AI senior research scientist.
