It doesn't take a genius to understand that, the person using AI is willingly doing exactly that, "stealing" from all the data it was trained on, most of the time without permission, and no being "open source" is not a justification for that.
Claiming the chatbot doesn't know what theft is but...