So 2000 diff requires 8 589 934 592 000 hashes and 100 diff requires 429 496 729 600 - which is exactly 20 times less.
So if you're mining with let's say 100 Mh/s, you're doing 100 million combinations (hashes) every second to find a block.
So it would take exactly a day with 2000 difficulty and 100 Mh/s to find a block (again, ignoring variance) and 20 times less with the difficulty being 100.
Difficulty is decided based on how fast blocks are being found on a network so it gets adjusted to slow or speed up how fast blocks are being found to following the block target (e.g. 60 seconds).
Higher difficulty only means more people are mining and higher diff shouldn't be rewarded more because then we wouldn't know the inflation rate of a coin in advance.
Thank you for the explanation. This answer some of the questions I had been have been looking for