Change the simulation unit from neurons to dendrites. Miss different kinds of gate and nonlinear activations.

Which is what's being done lately, but then we know next to nothing about the topology of real neural nets nor electrochemical communication inside a neuron.