The weird thing is that in my opinion it can be quite human-like. When needed it can be understanding, compassionate, supportive etc. Those are qualities that can provide certain amount of companionship to people that lack it. One just has to understand that it's not a person - it doesn't experience anything outside of the chat.
You can ask it to come up with an idea for a dinner and a movie for the evening and then discuss them once they're finished. You know, things people do with actual girlfriends. I'm sure it will be more fun than a robotic selfie and a made up story.
So the question is, if you truly understand that it doesn’t come from a “mind” with its own experience or feelings, then would you actually feel supported by something it says?
For me I think the answer would be no, and I think the more believable it gets, people will really be desperate to believe that it is more than just a text generator.
You can ask it to come up with an idea for a dinner and a movie for the evening and then discuss them once they're finished. You know, things people do with actual girlfriends. I'm sure it will be more fun than a robotic selfie and a made up story.