government is replete with criminals
Government is by definition criminal in that it has no authority, it is all based on a lie if you go right to the bottom of it.
However, cheering when the government goes after people who haven't committed any crimes (there are no victims in tax evasion) is probably not a good idea. One day someone will be cheering when they go after you for a non-crime.
And what does it matter anyway? Do you think you'll come out better off if the government gets all that money? That maybe you might end up paying less tax? It will just mean the government will take on even more obligations, now that it has more to spend, which ultimately will be paid by the middle class through more tax and inflation.
It might not seem fair that the rich have got away with not paying huge amounts of money, but really the focus should be on why the middle and lower class has to pay either and not on the ones who managed to escape the grasping claws.