The problem with privacy coins is that they have very low acceptance when it comes to paying for goods and services. Developing countries + Japan have cash as king and there are many countries where there is no infrastructure to even implement a nation wide CBDC system. Sweden on the other hand is in the worst case scenario where cash usage is mostly eliminated.
Overall I do think it will be possible to avoid CBDC without going full Amish as long as there is willingness to move and relocate when necessary.