A right is something that is given to you. It can be taken away from you at a whim.
This is false. What you are describing is a privilege.
A right cannot be taken away... only violated. The enumeration in the U.S. Constitution does not create, grant, or define the rights of the people. It merely
observes a few important ones (not to imply that all of the infinite unobserved rights are unimportant).
Alexander Hamilton was very much against the inclusion of the Bill of Rights, fearing the exact perspective quoted above—the implication that any right not observed is surrendered, or that the Constitution is defining The People's only protections, when in reality the Constitution places no limitations on The People, and explicitly defines the only powers the government shall ever have, because only people (not organizations) can have rights.
I go further, and affirm, that Bills of Rights, in the sense and to the extent in which they are contended for, are not only unnecessary in the proposed Constitution, but would even be dangerous. They would contain various exceptions to powers not granted; and on this very account, would afford a colorable pretext to claim more than were granted. For why declare that things shall not be done which there is no power to do?