Your worries are ill-founded in respect to nVidia. nVidia makes GPUs which have been used in the past for mining Bitcoin but not so much nowadays as they cannot keep up with special-purpose mining chips. Other cryptocurrencies beside Bitcoin still utilize GPU mining.
Your primary worry with any cryptocurrency (and especially Bitcoin) is the security of your
private key. In practical terms, "private key" is usually synonymous with "a wallet". "A wallet" is distinct from your "wallet software" - the wallet software can manage many wallets. Each wallet can contain Bitcoins and you want to keep any wallet with a non-zero balance secure.
If you are putting a lot of money into Bitcoin, I would recommend that you first start with a very small amount, like, $100. Choose and download a
wallet app and buy an initial amount of Bitcoin. Taking care to thoroughly read all instructions and asking for help if needed, practice exporting your wallet to a file and then importing it back into the wallet software. Once you are confident in how to do this, you are ready to manually manage a wallet.
If you are concerned about theft of your private key from your consumer PC (a perfectly valid concern, by the way), there are a variety of options available. If you trust hardware wallets, you can buy one of those. Another option is to use a dedicated PC for generating the private key for your "cold wallet", that is, the wallet you will be putting into cold-storage (private key not stored on any digital file, for example, on paper or in
steel). It's difficult to give exact parameters on what sort of OS/hardware you should use because it just depends on your level of paranoia. One way you could go would be to use a Tails Linux desktop with no Wifi or wired networking to generate the private key for your wallet, use it to sign a transaction to that wallet address, save the wallet to cold-storage, move the transaction over an air gap to a networked PC and execute it, and then power off the desktop, wiping the key from the system. For very large amounts of money (say $100k+), I would use no less security than this.
Hope that helps. Bitcoin is like cash - lose it and it's gone. Do your homework. Start small and work your way up. Be safe.