I have been having a LOT of freezing issues with the IE 32 bit on Vista 64. I have temporarily switched to IE 64 as I don't have the freeze issues, although, this has hindered my experience on the web massively, due solely to the fact that Adobe still hasn't completed their 64bit version of the Flash player.
Needless to say, I am browsing without Flash, and it really isn't that bad (until I want to view YouTube, or other heavily based flash sites).