And if you pay attention to those "great stories" of people starting from nothing and inventing something truly amazing... Well, actually in most cases they grew up in families that had no big issues with money and that had enough to allow them go to school. Even if they chose to drop school, they had financial means to go. And that makes a huge difference!
I strongly support this view. It is a big deal and it does look exactly that, at least to me. The way you are raised determines your future and your success or failure in life, end of story. And even if you are well aware of your bad habits and behaviors that you acquired when you were a child due to parents neglect or otherwise, they will be hard to get rid of. That will require a lot of effort on your part, an effort which can be spent on something else, something more productive, while the feeling of a wasted childhood or youth will never truly leave you.