(Zhang, Han, Worth, Liu, 2020. Nature Communications, 11:1877)
In the brain, the semantic system is thought to store concepts. However, little is known about how it connects different concepts and infers semantic relations. To address this question, we collected hours of functional magnetic resonance imaging data from human subjects listening to natural stories. We developed a predictive model of the voxel-wise response and further applied it to thousands of new words. Our results suggest that both semantic categories and relations are represented by spatially overlapping cortical patterns, instead of anatomically segregated regions. Semantic relations that reflect conceptual progression from concreteness to abstractness are represented by cortical patterns of activation in the default mode network and deactivation in the frontoparietal attention network. We conclude that the human brain uses distributed networks to encode not only concepts but also relationships between concepts. In particular, the default mode network plays a central role in semantic processing for abstraction of concepts.
Deep Predictive Coding Network with Local Recurrent Processing
(Han, Wen, Zhang, Fu, Culurciello, Liu. NeurIPS, 2018)
Deep Predictive Coding Network for Object Recognition
(Wen, Han, Shi, Zhang, Culurciello, Liu. ICML, 2018)
Variational auto-encoder: an unsupervised model for encoding and decoding fMRI activity in visual cortex
(Han, Wen, Shi, Lu, Zhang, Di, Liu, NeuroImage, 2019)
Deep recurrent neural net reveals a hierarchy of process memory
(Shi, Wen, Zhang, Han, Liu. Human Brain Mapping, 2018)
Deep residual networks reveals a nested hierarchy of cortical category representation.
Wen, Shi, Chen, Liu. NeuroImage (2018)
Deep residual network predicts cortical representation and organization of visual features for rapid categorization.
(Wen, Shi, Chen, Liu. Scientific Reports (2018))
Neural encoding and decoding with deep learning during dynamic natural vision
(Wen, Shi, Zhang, Lu, Cao, Liu. Cerebral Cortex (2017) doi: 10.1093/cercor/bhx268)