Maybe I'm not understanding it fully....
Oh, that does make sense.
I see why they wouldn't put it in the client though, accidentally deleting the wrong addys would be expensive. There should be a hide this addy button though. I'm sure with a little knowhow you could modify the wallet file to forget them.
Is there really a need to do anything but hide them?