> Have any of the leading models been trained on that kind of corpus?

Does such a corpus even exist? Maybe a bunch of Mathematics papers, and even then...

To build a corpus like that would mean trusting the human gatekeepers or curators, which just shifts the problem, because humans are also prone to this sort of mistake.