Some will say that taxes have a purpose and there is no doubt about it, but if you live in a country that is highly corrupt and where you can't do anything without bribing someone, you wonder what all these taxes are and where that money goes.
My point is, one layer tax is okay, like, tax my salary, no problem but why do you tax food, electronics and all other staff? It's like, you work, pay taxes but you go at the store and you pay taxes on store products with money that you've been taxed on. At the same time, the store owner always pays taxes on his income. Does this look fair? Logically, if I pay tax on my income and store owner pays taxes on his income, I shouldn't be buying food, electronics, clothes or anything with additional taxes. That's why I think that it's morally acceptable to avoid taxes if you can.
What I want to say is that the state doesn't really care how you survive, so let's say the governor of my central bank who has a salary of almost 7000 EUR publicly gives advice to people to buy items on discount since they have a minimum wage of maybe 500-600 EUR.
That's not actually true in some European countries but overall, you are right. They'll knock on your door if you don't pay taxes but they never knock on your door when you left are without income.