This is absolutely insane. They have made these chatbots so that they just tell you what you want to hear instead of correcting you in fear that you will stop using and paying for their platform.
I seem to remember that there was a suicidal teen that was getting instructions from Chatgpt on how to properly end themselves, ie. how not to alert the parents.
