They fucked all of their current customers who likely didn't buy the device they thought they did, i.e., one from which the private keys couldn't be extracted without the owner's consent. Now that they've disclosed that it can be done, I think they've also fucked themselves as a company--but time will tell. One thing is for sure: I'm going to be following this drama very closely.
My personal suspicion is that Ledger is being pressured by government agencies to implement this service, or at least to announce that key exfiltration is possible so as to circumvent whatever illegal surveillance law they'd be violating if they got Ledger to seize users' funds for whatever reason. I didn't come up with that theory, of course, but I believe it fully.
Just think about what happens to trust towards CEXes after another big one goes down: Short dent, people look for alternatives (DEXes, storing their corns locally etc.) and after a while the majority is back using CEXes.
So yeah, for some period of time it will leave a mark, then a new generation of hardware-wallet-users comes along and everything is back to usual business.
I hope I am wrong, but not too optimistic.
That being said, regarding the real reason why Ledger does this shit... Maybe government pressure, maybe some inside folks are already working for the government, maybe some CEO is best-buddy with an intelligence-exec... who knows.
What I personally hope to see are many more open-source hardware wallet solutions, where some of them manage to become the new industry standards.