I've been seeing similar behaviour, running MC17's server on a Win2k8 Server box (not virtual). I can't isolate it, because I thought it was one of those things...
Any tips on how to isolate this? I find that when I do have the problem, even amidst many Retry Loading Library commands, I can still telnet into the server:port.