And for me there are only 2 ways to a relationship, either a full yes or a full no. ...

Also when things do not go along well in a relationship, I believe in working on them and not giving up on them.

Count me in on this one. I often hear those fuzzy-wuzzy phrases and explanations such as "but it has to flow", "we're not aligned", "it doesn't have to be hard", "no compromises", etc. Well, good luck finding the 100% piece you seemingly miss in your "outside" puzzle. Few are willing to put in the work both inside and outside.