That joke of your friend's was genuinely good and spot-on; if people had realized it was a fruit, they would have plucked and ruined it before it even ripened.
Also sometimes it turns out to be a fruit of inferior quality—or a wild variety—much like the one in your post appears to be. Perhaps that is precisely why it has remained safe all this time. :)