If by "control" you mean you don't want them per block, then yes mine somewhere else.
I'd like to know how other people deal with this. To avoid crumbs and the fees associated with spending them I have been receiving payments into my localbitcoins wallet and letting them accumulate for a few days before withdrawing to Bitcoin core. Is there a better way to do this without using a third party service?
(There used to be old-school techniques for consolidating dust/crumbs with old coins to create low-fee high-priority transactions but they don't seem to work anymore.)
I use a Trezor and use separate accounts for mining. Once I have a accumulated some number of mining transactions I consolidate by transferring from my mining account to my main one.
I do this mainly because the Trezor has a slow processor. It does all the signing and the private keys never leave the device. Signing transactions with lots of inputs can take time.
Sometimes this consolidation can take several minutes, depending on the number of inputs. I have to chose a time to consolidate when I don't care how long it takes. But the result is quick spending from the main account when I need to.
This method doesn't avoid fees. Obviously when I consolidate it's done by spending, which means I'm paying for the transaction. But it's worth it to me for the security and piece of mind that I get with the Trezor.
All of my bitcoins, even my smallish payments from the pool, are always under my direct control. They're never in a service where I don't control the keys.