I tried everything I could think of to fix this issue on Windows 10. Latencymon was showing very high DPC numbers with a couple of drivers. I played with registry settings, changed network driver to default microsoft, etc but it did not work. Very annoying because it worked well until recently. My server is brand new with Xeon E3-1245v3, supermicro x11ssh-l4nf, 16gb ECC DDR4 etc. Sound was streamed to an XMOS USB Audio 2.0 box (Breeze DU-U8).
So, I gave up on Windows 10 and installed Ubuntu and Debian on an ancient 16 year old desktop. It's a pentium 4 520! No more skipping problems! XMOS USB does not need a driver since it is included in linux. I am learning linux as a middle age man
After this problem, I believe that any music server should be on a linux box, period....