I think in this joke, this thief was so dumb he forgot that many stores have security cameras.

And (on a more serious note) you're right that he shouldn't take what doesn't belong to him.