Binance is recently kissing regulator asses much more than ever before, and it's safe to assume they are recording and reporting all addresses and transactions from safepal wallet.
They could in theory even stop or block access to safepal app and you won't be able to use wallet anymore if they connect you with any blacklisted or ''tainted'' addresses.
I would not trust seed phrase generated by safepal and I would send all coins to other wallet asap, but I could just be little paranoid about this.
I don't think you're being too paranoid. Safepal, and therefore Binance aren't exactly covering themselves in glory here. Although, unfortunately this is how they make money, and I suspect far more exchanges, and wallet software is indeed doing exactly the same.