It's not literally half, but according to data for 2023, even around 35% of the world's population does not have access to the internet at all, while it is questionable how many people have a permanent and high-quality connection to the internet. Many members of this forum from some African countries have exactly this problem, their internet actually depends on whether they have electricity, and this makes their activities much more difficult - although this is not something specific only to Africa.
But even if we take the 2/3 who have access to the internet, looking at it as a whole, all researchers say that less than 5% of the world's population is in some way involved in cryptocurrencies, and of that number there are certainly many who have invested only in altcoins.
When you draw a line under all that information, then your question cannot get any kind of positive answer, regardless of which aspect of the problem you are talking about (if the problem exists at all).
You're exactly correct. People need to realize that access to internet isn't the only hurdle. Even if people have access to internet, poverty levels within the immediate area are what matters. If internet serves as a luxury and food/water/shelter take priority, it isn't reasonable to expect these people to adopt a digital currency that has volatility in its value.
Crypto is mostly designed for the first world. Trying to make Bitcoin palatable to under developed countries is a challenge.