Otherwise, it's so easy - at least for now - to keep it a secret that there's no reason to worry.
And here's when we're touching theory vs practice. Theoretically court can order you to do almost anything. They can take property, put you into debt, search your house, take all your personal belongings even the ones that don't belong to you but someone else like friends and family, they can take your freedom they can make you work for them they can even take your voting rights. This is their ability but to execute is another thing. We all know they can't take your money if they can't find it. They can't put you in jail if they can't catch you, so if you don't give them your private key they won't get it.