A password could be grapes, apples, oranges and pineapples. A fruit salad is any combination of grapes, apples, oranges and pineapples. You don't care what order it's in, because it's just a fruit salad! Now, should everyone's fruit salad be able to open your wallet? That would be cause for concern. Order matters.
If any combination of words can be valid - then it makes it harder for brute force your wallet by scanning text files in your hard drive.
Then perhaps I fail to understand your concern properly.
If you remove the order, you reduce the complexity and it becomes easier to cracker your passphrase.
