I know a lot less than what I know.

I feel like it depends on who is using it. A hammer is a tool in the hands of a skilled wood worker. In the hands of a crazed lunatic, its a weapon.

In my hands? its something I drop on my toes, probably hurting only myself.

I think people that treat "AI" as a "human", or a "partner" (or co-pilot, if you will) have probably failed the Turing test by some measure, but they're ... aware they're interacting with the machine.

But yet, they see the output as some sort of collaboration between them and the machine, and tend to feel a sense of ownership of that output. That feels strange, because I can't be seen (or would feel like I should) own the "output" of a conversation between you and I.

(Unless we were academics at a conference or something, or publishing a co-written paper)