Well, the labor of some jobs will never happen, some Bitcoin Hodlers have companies and businesses apart from Bitcoin, although Bitcoin represents a great fortune for them, in the same way they must keep track of the price, some sell a part of their bitcoins, others panic and sell, some buy bitcoin to keep increasing their wealth.
World productivity does not decrease, because not all people own bitcoin, some have only fractions of Bitcoin and others want to acquire it but due to the increase in price it becomes more and more difficult for them, when compared to other currencies it is obvious that it is higher, because Bitcoin is the King currency, everything is in the comparison with the FIAT currency, dollar, euro, local currencies of some countries, also in comparison with gold it is very valid, in fact Powell has already named a similar issue, so even the Fed is aware of this.
The idea that bitcoin making people richer would destroy the working force is the problem with the rich people in the world (and people who love rich people). Just because everyone is rich doesn't mean that work force will have to be eradicated, there will always be people who work, and the humanity will be much better if nobody has to work, you know why? Because we could finally have a world where everyone does what they want to do and not what they are forced to do, which will help the humanity grow at a much faster speed in tech and art and medicine and basically many many different things.
So at the end of the day, you need workers? Go build an android, not like we wouldn't be able to if we had everyone free to do what they want, it will become easier. Which is why bitcoin helping everyone to get richer is a great way to improve all of humanity.