What I am saying is you can't get GPT to solve any problem you throw at it. What you can probably do is get it to give you a correct answer that it was trained on. Those are different things.

You can't teach it new information, and often that is required to solve a problem.