I think it's a good idea to put your address if you want to receive payments from cryptocurrency and to confirm it, you can ask for proof of transaction hash from consumers who transact with you, because from transaction hash you can check the payment he made (date, time and amount), so you don't need to worry if he cheats you and if he enters the wrong address for payment, then I think it's his fault.
If something goes wrong, it is the responsibility of the buyer, not the seller. It's like when someone sends the wrong money to an unknown account number, not according to the destination account.
If you don't want to make it difficult, then you can use a Payment Gateway that has been provided by several Gateway platforms which makes it easier for sellers to arrange payments to be received and buyers will also make it very easy. One of the faster and cheaper payments is using Bitcoin Lightning.