I don't get this attitude. You might need to prove a chain of custody some day. It's no hassle to keep the private keys.
Pardon my ignorance, but in what situation would this be useful? In the tax example above, you either paid the appropriate taxes and filed as such or you didn't. How would showing control of a private key play into this scenario?
Here's the correct answer. This data isn't important as of today, but someday if you have to comply with some AML or KYC regulation, it may be useful to prove the origin of your funds.
How does exhibiting control over an address prove the origin of the funds, unless the funds were generated through mining? Multiple people can have access to a single private key, and control over said address doesn't prove anything about where the funds
came from.