This is probably not a good idea, because the space of possible seeds is 2^132 if you have 12 word seeds with 2048 possible words, while RSA uses 2048 or 4096-bit keys. You can only map 1 seed to 1 key deterministically, so if your algorithm is known to attacker, their attack against your RSA key will be more optimized than against a truly random key.
Good point
12 seed words would have 2^128 entropy
24 seed words would have 2^256 entropy
RSA has 2^2048 entropy
RSA would be more secure than Bitcoin seed words
However Bitcoin seed words, which secure vast amount of wealth, are difficult enough to brute force.
Shouldn’t 256 bits of entropy (even 128 bits) be enough to derive a secure enough RSA key pair, secure enough for encrypting emails?