Since you've used your current wallet as a hot wallet, there's really no way to make more secure than it is right now. The only thing you can do is create a more secure wallet, and keep it more secure in perpetuity. If you have regular payments to an old wallet that you don't want to change, you can monitor it until the balance is more than you care to risk, and move it to a more secure wallet. Still more hassle, but the added security is worth it.
I rarely use my wallet for sending balance. I use it to save all my funds from signature earnings and investment from my salary. I have a hardware wallet though but I only sent funds in there once I’m sure that I will not gonna spend it because it’s on my safe at my home which is away from me.
For the mean time, I only hide the application on my desktop view.