Neural architecture is largely modular in many higher order organisms, like most mammals. I think Modular Neural nets, https://en.wikipedia.org/wiki/Modular_neural_network, with some sort of dynamic topological intermediary will probably be a better approach to more complex, hierarchical problems, and might be a decent shot at AGI, what do you think? Does anyone have further reading about this? I also read Professor Hinton's work about Capsnets and neural module nets, which are somewhat related.I'm working on using them for disease outbreak forecasting.