That is not a fair argument. There are millions of football fans around the world, who want to watch the world cup matches in person rather than on television. And conducting the tournament in three countries instead of one complicates things for them. The last time world cup was co-hosted was in 2002, when the matches were staged in Japan and South Korea. Even then, the distance between venues were manageable. But that is not the case with USA and Canada. Boston to San Francisco is close to 5,000 km and even by air it will take 6-7 hours. And then there are visa requirements to travel in the US. Getting a US visa can be very difficult.
So there's no need to worry about permits and visa requirements because of course FIFA will also prepare easy access for spectators to enjoy this world cup event which is being held in 3 countries at once.
It's not that easy mate because it will be too dangerous for the host countries if they will just give an easy access to all the spectators just because they are holding World Cup games, especially America as this country is probably #1 on the enemy's hitlist because this country has done so much unreasonable damage during the times of war.
And let's not rule out that there will be some attempt by the enemies in the guise of being a spectator of the games, hence, it will be the opposite thing of what you're thinking as these countries will not hold back on their country's security to ensure a safe environment for all the players, organizers, spectators and of course, their own citizens. It is safe to assume that everybody else will be thoroughly searched including their soul if it's possible before they can step on these hosts land.