It is easy to get disappointed in God when things don't go the way we want them to.
And it is easy to give god credit when things are going swell.
It's called confirmation bias.
But take a look around, things go badly for the "godly" and things go well for the "godly".
Things go poorly for the "un-godly" and things go swell for the "un-godly"
Look at it objectively - don't use the good times as "evidence" of his providence and then come up with pat answers when they take a turn to shit.
That's the fallacy of confirmation bias, making excuses for the evidence to fit your pre-formed conclusion.
But back to what he was saying - where was God when he wasn't employed?
Where was the damn church? That at least is real. Were they willing to help him, or only if he got on knees and prayed where they could see him to affirm their own faith?
The church is full of people who only care about themselves, and use God as an excuse for their selfishness.
