The security critical programs I've worked on, nobody would even think of randomly upgrading the compiler just because a new version happens to be available.
But take OpenSSL as an example of a critical security program. Nothing in the usage practice suggests not upgrading the compiler, or even going to the next version of libc.
Many open-source programs can be security-critical (any network-facing daemon, for instance), and there's nothing which ties them to a specific compiler.
I usually hear the latter type of system described as "safety-critical" or "life-critical". You're right that it's an entirely different world, though.