Is there any handheld device that would make sense to use to do this transaction that doesn't stand out? Like one of these hardware wallets, that screams "punch this guy to get free BTC".
Is there any safe device that looks like a phone that runs Linux or something? I just don't know how one would do this, unless you resort to a regular Android phone. In this case, you are already trusting some flawed hardware and software. I don't need to make a big transaction, so I guess that would be ok, however im concerned from a privacy pov. I would mix the coins at home before transacting with the person using the Android wallet. In this case, what would you do? You need to stream the transaction somehow, so you are going to need internet, and let's say there's no public wifi.. so you are going to need a phone nonetheless.
Maybe having the phone as a router to connect wireless to this handheld device to make the transaction, and broadcast it through the internet data phone connection.. but how do you do this privately?
I don't see how I would do this. I would like how people do this.
According to the red text above, you are reluctant to use an android phone, because of privacy.
As oeleo stated above, connecting to your own node will fix this issue.
However, the best answer in my opinion is the one by BitMaxz.
Sign the tx beforehand from your home. Take the tx id with you in any form you wish (android, paper, usb, sd card). There, you can broadcast the tx, or you can even give it to them to broadcast it. The broadcasting of a signed tx is a feature available in almost every wallet software.