My wife and I have been on the hunt for a house for a while now, several years. We picked a few towns over the years and got down to visiting them and checking out houses. Then a hurricane DECIMATED one completely, the others ended up unaffordable and now we are back to square one lol. In that time though we've done a lot of other things that are better for us such as spend the time and money to fix my wife's health issues, although not completely gone, they are much better now than if we were stressing out about a bigger house payment than what we've got now.
We know that when the time comes, it will be the right choice. It just takes time to get there!
You'll find the right place, and there isn't a huge rush so that's good.