I didn't want to remove it because I was hoping it would attract butterflies. Instead, it attracted a wasp.

Wasps are also very useful pollinators.

I was surprised that they also like flower nectar.

In general wasps love feeding on nectar (and also honey if you provide it).
They animals they hunt serve as precious protein source for their larvae.