You're bypassing the very channels the government uses to track finances. If they can't track or observe the money, they can't impose their rules and regulations on it, which is a threat to their tax base. One person doing this isn't an issue, but if everyone started to do this, there would be trouble, to say the least.
While I personally think what you're doing is great, I would also advise you to stay diligent in using caution.
I think the only reason I'm bypassing the usual channels is simply because of obscurity and novelty of bitcoin today. If and when it becomes significant, it will also be regulated. I will most likely keep using it. Those who embraced bitcoin with the hope of avoiding taxation or fighting the government will move on to something else. In my opinion they should really stop trying to solve their problem by running away from it.