you should change your wallet to bitcoin core if you can run a full node or you can choose an SPV wallet like electrum. these wallets give a better suggestion for fee and your problem will be solved.
I am using Electrum but not that much i use my phone alot (ios) Was planning to open a Bitpay wallet. Thought maybe that will help
i wasn't even aware that Bitpay had a wallet! i thought they were only a payment processor for businesses like Valve.
i find out new things every day
in any case i believe your problem is with the fees you are paying, nothing serious. you just need to figure out the right amount. and i usually suggest electum since i use it myself and it is quite user friendly about fees.
you can also take a look at this site for current fees: https://bitcoinfees.21.co/