Visual Studio, what are you doing. Visual Studio, stahp.
So I tried to install NuGet into VS2010. Let's just say it seems not to be going too well...
Answer: I previously had administrator privileges on my laptop, but those were removed at the beginning of the new year. For some reason, when these programs use credentials that are not in the administrator group, they recursively call themselves instead of failing, timing out or reporting access denied, etc.
Please ensure that your attempting to update after launching VS as an Administrator.