The problem is not Gavin or someone else stopping working on Bitcoin software. The problem is what to do if devs are secretly forced by government to include some kind of timebomb in software and when majority upgrades then kaboom! and network is broken and the user trust with it.
That would be sad.
A vocal minority is enough to influence the majority. Also, some people would do this on a regular basis anyway, not because they are paranoid, but that they are worried new code may break compatibility/have other issues, it's your money, after all! There is no general restriction on who can contribute to the code as well, and many dozens of random internet dudes have become developers, and actively follow the development process.
I do it because I'm paranoid. But also for fun. Somebody (if not me than someone else) would notice it and they'd go down in flames.
