Passphrases are great tool for everyone to use. If your seed phrase is backed up on paper (as it should be), then if that paper is stolen then so are all your funds. An attacker with access to your seed phrase can clear out all your coins in a matter of minutes. If you use a passphrase in addition to your seed phrase, then an attacker with your seed phrase has to then also brute-force your passphrase. If your passphrase is long and random enough this is essentially impossible, meaning an attacker with your seed phrase can do nothing and your coins remain safe. You should also back your passphrase up on paper but separately to your seed phrase, so an attacker finding one doesn't immediately find the other.
You can use as many different passphrases as you like with a single seed phrase, allowing you to create unlimited numbers of "hidden" wallets. This also provides protection against physical attacks on your person in the form of plausible deniability.
Further, since you are using a Trezor, due to the vulnerabilities of the device anyone who has physical access to it is able to extract your seed phrase. If you are not using a passphrase, then as above, your coins can be quickly stolen.
I would highly recommend everyone use a passphrase. Just remember to back it up, as if you forget it, your coins will be lost.