I'm using Ledger Hardware Wallet and have no problems sending them within 15mins. - 1hrs.
You need to raise it too 400sat/byte for the transaction. To add few dollars to the mining fee cost.
Theirs a lot of people who don't know about hot to increase it, or don't want to pay the fee to confirm it any faster.
Anyone else using Hardware wallet?
setting fees manually is the wrong approach. dynamic fees are the correct way to do it.