What about it exactly is challenging? How is doing computer science research (probably what many people here would do; I don't know what your research field is) with a team of remote individuals harder than doing software development with a team of remote individuals?
remote software development is very challenging, and when it works well, it's due to super-clear specs and project management. by its very nature, research isn't as amenable to crystal-clear specs.
I haven't worked in industry so far. So, cannot comment on that.
In academia however you can possibly build connections with your peers (other labs) and lab colleagues through your work. One can attend on-campus seminars and exchange ideas with potential collaborators. Being remote voids these options. Opportunities to work on interesting projects (other than research. For instance, contributing to student organizations) will be lost as well.
Edit: Regarding my research area.
On most occasions, students will have to register for classes (not all classes are offered online). Once you complete classes, it is potentially viable to work remotely. However, it again depends on the funding scenario. How a student is supported etc. If I'm a Teaching Assistant, I'm expected to be on campus and available to students. Being a Research Assistant gives the flexibility to work remotely (if advisor agrees however not all universities might allow that).