but the perfume designed for men has a strong touch in the background that catches me instantly

This does not surprise me. I "fall" for gentle women's perfumes. I guess that's how they design them. That the smell of a woman's perfume attracts a man, and the smell of a man's perfume attracts a woman 🙂