Actually I've struggled with bipolar disorder for two decades so I'm rather well acquainted with suffering caused by distorted perceptions of reality. Maybe that's why it's less daunting of a proposition to me :)
But yes you're completely right, the actual odds of an adverse psychologic reaction are much lower. My point was moreso that dealing with terminal illness can lead to its own kind of detachment from reality and all sorts of stress.