I don't think it ever stops. If I had to venture an answer as to why, I'd say "fewer interruptions" - most interactions are asynchronous (email, IRC in my case but slack just as much). The only times I need to have synchronous discussions are either our "watercoolers" (social face-to-face over google hangouts) or the eventual meeting.
Note: the companies I've worked for in this setup are all committed to 100% remoteness, and understand that keeping meetings to a minimum is a good thing (note, not abolish - but make sure "meetings" are only called for when actually needed).
Distractions are indeed costly, and productivity (as in technical throughput) i can see increase quite a lot. That might end up keeping one happy for quite a long time - i noticed my happiness for a day depends a lot on how much stuff i got done that day.
