My "hardware wallet" is an old laptop or an old phone.
If your phone is old enough not to have any gyroscope sensors on board, that's fine, otherwise, the fingerprint of your way of walking (which is as individual as the retina of the eye) is for a long time in the databases of numerous watching agencies so that your physical identity is linked to that mobile.
If you're using a phone as a hardware wallet, it's probably air gapped, so any identity linked to that particular phone will tend to be useless. All they'll see is it got factory reset then suddenly stopped being used months or years ago.
If you're not air gapping your cold storage or at least one of the signatures for a multisig, then it's not cold storage.
I was moving BTC while waiting. Guard came to get me just as I was checking to see if it confirmed. Did the polite "Happy new year. how is everyone?" thing and I just dropped the phone in the security basket and walked in. Same way I have done it dozens of times before. Just didn't hit the power button.
It's good to be proactive and move the coins after that incident, but guards normally don't really care about anything except that which they were assigned to protect, which in this case, is the records room.
What I would think about, maybe not immediately, but some time later, is how much do I know about these guards, or how much do they know about me, are they generally good people ... reset the phone wallet because it's your protocol for breaking your own protocol, when following someone else's physical protocol, without assuming the morality or integrity of the person you left it with.
I lot of the guards I have dealt with tend to return items I have left (either by accident or intentionally). Phones, wallets, bags, firearms ... but that was back when bitcoin wasn't very well known.