Predictive Coding for Deep Neural Networks
Predictive Coding is a popular framework in neuroscience
for explaining cortical function. In this model, higher-level cortical areas
try to predict lower-level neural activity and prediction errors are passed
back to higher layers. Deep Neural Networks (DNN) , which use brain-
inspired architecture, could be augmented with such a model, providing
robustness and a better understanding of spatio-temporal dependencies.
We investigate research in this direction and give a quick review on tasks
in which Predictive Coding (PC) for DNN has demonstrated its interest,
with a strong emphasis on vision-related tasks.
Deep Neural Networks
2022