That's typical standard libertarian reasoning, which unfortunately fails to that in order for you to work, you need energy which ultimately comes from the sun and the earth which was here long before humans roamed it and started calling it "theirs". Also, according to that statement, a libertarian would be perfectly fine with a father raping his daughter, because he is merely "enjoying his property"
This observation is essentially the same that I came up to myself, though from an entirely different starting point. I was asking myself about what can actually be called mine in a true, absolute sense of the word. If something can be taken from me (by force or whatever), can it truly be called my property? A human body is made up of atoms (and whatever makes up them), but do they really belong to the mind (or soul) that dwells in this body?
And what is left then when we thus strip an individual of his claimed "possessions"?