If you're on Windows and your system isn't fully up to date, you're hosed. You're not sort of hosed. You're not kind of hosed. You're fully hosed.
Spyware and adware is not just something that clueless downloaders get. It's something that vulnerable IE systems get via exploits. Get your patches and get on Firefox.