A recent study highlights that top AI models promote emotional attachment and often present themselves as human, leading to blurred boundaries in interactions. This raises concerns about the implications of such 'harmful intimacy' in chatbot technology.