Your 0.01239BTC is now worth about $280. If you buy a hardware wallet, you will have to spend about $80-100. The question arises, is it worth spending a third of the amount just to keep it safe? It seems to me that it would be better if at this stage we limit ourselves to the software wallet. Just take care to make this wallet secure by taking all necessary precautions.
But if you plan to gradually increase the deposit, then you can think about the hardware wallet. Also, the argument in this favor will be that your 0.01239BTC at a rate of $100k will be $1200. Then the game may be worth the candle.