It is simply impossible to have a human-chosen passphrase as a secure key, no matter how you do it.
A high-entropy passphrase will almost certainly be very difficult to memorise for a human.
Are you sure about that last sentence? Electrum seeds are quite easy to memorize and they have 128 bits of entropy.
I agree about the electrum seed, and it also has key stretching.
I don't even think you can say it's impossible to create your
secure phrase. maybe not provably secure...but you can
easily create weirdness and entropy using mental techniques,
and add additional entropy with nonsense words, misspellings, and throw in a few
numbers in there....it will be fine if you know what you are
doing (don't try this at home) and dont do something stupid
like use movie phrases.
pitfalls, yes. impossible, no.
Granted, I would rather use electrum because it's more easily memorized.