I'm not buying it.
What is stopping you from boycotting goods produced literally with modern slave labor in stead of buying items that pay people a decent living wage? Chances are you buy the cheapest product like most people, and because it is socially acceptable, you too support modern slavery. Now if someone might not be completely aware of this dynamic, this individual changing their behavior in favor of support of human rights is now suddenly not commendable because they once enjoyed a higher standard of living at the expense of others? I argue that you yourself are doing the very same thing right now, only with a lot less awareness of how your habits cause human suffering. You should probably check your judgment lest ye be judged. IMO some one doing wrong, admitting it, and changing their behavior shows a lot more strength than the person that pretends they aren't perpetrators (you).
It is good for the poor country to have companies that invest money in the country and employ people that would have done a worse job instead and can now better support their family