> Foundation LLMs are generative models trained to produce text similar to the text on which they were trained (or for the pedantic: minimize perplexity).

They are not trained to output facts or truths or any other specific kind of text

but we can just patch the truth in with RLHF! /s