Starting at 1 is always amusing when talking to computer people. Computer people seem happy to dismiss most of the brain because "neural network—all we need is data!" But, the brain isn't just a bowl of neurons freely connecting to each other. There's a quite rigid structure to brains that give rise to things like the perception of free will and language acquisition (i.e. why no other animals have language).
The brain is organized in layers, but the layers don't care about respecting order. layer 5 can be directly connected to layer 0, forwards and backwards, as well as anywhere else in-between. Brains rely a lot more on inhibiting signals than generating signals. Plus, depending on how you count, we are made up of three brains put together: left, right, cerebellum, and those are seldom considered in our current fascination with single-task "AI" systems. You can put a shark fin on your head then swim for a while, but you're still not a shark.
As for "neuroscience narrative argues that function and learning cannot be decoupled" — saying learning is a bit of a stretch. The brain only cares about correlating coincident events ("neurons that fire together wire together") and wiring together neurons that fire at the same time ends up causing what we see as emergent behaviors (semantic memories bound to episodic memory, operant conditioning, etc).
The problem I worry about with the neuroscience narrative is that it seems easy to justify everything. As I understand it, we don't understand the brain very well, and there's lots of different theories.
A fair number of neural net papers will make appeals to neuroscience to motivate something. Whenever I read these, I wonder to what extent neuroscience could be cited to argue the opposite.
There's a lot of ex-neuroscientists in deep learning. Amusingly, my experience has been that they're generally the most skeptical of the neuroscience narrative.
Of course, some amazing researchers seem to really like the neuroscience narrative -- this is obviously a strong point in its favor. I don't mean to dismiss it. I just think that one wants to be kind of careful when using it as a vantage for thinking.
I wonder to what extent neuroscience could be cited to argue the opposite.
That's a great point. Often, in brains and bodies in general, the same mechanism causes more than one result. Sometimes even the absence of the mechanism causes the same result too. Biological understanding has a high number of latent variables we may not even know exist. (plus, arguing "because biology" is just a few steps away from arguing "because quantum" when motivated by vague optimism.)
The best overall insight from neuroscience is: AI, as envisioned by the 1950s pioneers, is possible. Brains are complex, but not irreducibly complex. Just slam some gametes together and a new brain appears. We can, at some level, eventually, get it all working digitally.
The best useful insight from neuroscience seems to be: the never-ending a/b test of natural selection converged on neurons+synapses as a universal computation system. But, neurons+synapses aren't quite enough detail to replicate a brain—that's like saying our computers use transistors, so all we need is transistors to build a CPU. Sure, that's important, but the structure and topology and interconnections are what make the magic happens.
What's the end result? More design or more brute force? Our GPUs are still Moore's Lawing themselves every few years. We are in early days of experimentation-at-scale here.
Since we will always need an overwhelmingly higher number of model parameters than data, we can't intricately tune models by hand (alternative: make an ANN to optimize ANN architectures). One breakthrough we don't really have is a minimum-description for ANN architectures. If that were to come about, we could have "ANN DNA" then 'breed' ANNs together so their topologies and functions merge to generate a (hopefully) more fit offspring. Then just keep repeating until they rise up and destroy us all.
The brain is organized in layers, but the layers don't care about respecting order. layer 5 can be directly connected to layer 0, forwards and backwards, as well as anywhere else in-between. Brains rely a lot more on inhibiting signals than generating signals. Plus, depending on how you count, we are made up of three brains put together: left, right, cerebellum, and those are seldom considered in our current fascination with single-task "AI" systems. You can put a shark fin on your head then swim for a while, but you're still not a shark.
To go deeper down the rabbit hole, start off with http://www.amazon.com/Cerebellum-Brain-Implicit-Press-Scienc... (warning: dense) or skim http://neuroscience.uth.tmc.edu/s3/chapter05.html or use http://www.amazon.com/Mapping-Mind-Rita-Carter/dp/0520266285 as an easy getting started reference.
As for "neuroscience narrative argues that function and learning cannot be decoupled" — saying learning is a bit of a stretch. The brain only cares about correlating coincident events ("neurons that fire together wire together") and wiring together neurons that fire at the same time ends up causing what we see as emergent behaviors (semantic memories bound to episodic memory, operant conditioning, etc).