Dabs... I don't like to admit it but I used to do alot of shit back in the day. Simply put, I don't think you are safe. Started using a stripped down distro of linux and go cold. Welcome to the future, Welcome to Bitcoin. Now information are not only worth money, They ARE money!
I was a script kiddie once, then ... eventually worked my way to become a network security consultant for a small ISP (after rooting all their servers with their knowledge and permission.)
But I'll not admit to whatever shit I used to do back in the day. heheh.
Anyway, what are the possible attack vectors for my scenario? It's a computer. It has just the OS and Bitcoin-Qt. It is behind a typical home router.
For OS, there are 3 popular ones: Windows, Mac OS, and Linux.
I have what I consider a "safe" version of Windows XP SP3 because I keep an updated ISO from MSDN and slipstream the updates into the .iso and then burn that, and then use that to install on new production computers with a valid and legal volume license. I do this because I don't yet want to put Win7 or Win8 on them, they don't need it. I might even migrate them to Linux later on as that has everything they need (LibreOffice) except print drivers. (It's for work, so ... stuck with Windows for now.) And my graphic artist needs to work in Photoshop and CorelDraw, dunno if they have Linux versions or if our license covers those, and don't want to pay twice. I haven't check it out though. It seems they don't run natively and I don't want to install a different OS then run them through emulators.
For Linux, I could just grab maybe Ubuntu or Mint or OpenWall? Or one of those security hardened versions.
For Mac OS, (-X), I have no idea, I just don't use them, but it is my understanding they are now similar to Linux OS. I did jailbreak a few ipads and ipods and installed VLC on them.