Yep, referencing signals vs ground is the big flaw in RS-232. That's why a lot of industrial machinery uses RS-422/RS-485 which is sent as a differential pair. 422 gives you the same serial interface, the same signaling, but with a better physical layer that lets you send the signal on much longer runs.