Our preference of happiness depends on each individual perspective of the concept. Truly happiness is from within just like you have mentioned and the reason why most people attach it to material things is not because that is all they care about. They believe as long as they don't have to worry about certain things, then their chances of being happy increases. Happiness is tricky it is a feeling that doesn't have a constant source.