Playing native DSD does not take a lot of CPU power. Converting DSD to PCM for playback does require a good CPU. I am playing 2x DSD with an old Netbook, JMark of about 460, which might be the slowing machine currently in use. My DAC does not support 4x so I cannot try that.
The fact that it takes 20 seconds to glitch makes it seem more like a buffering issue than a conversion issue. You can use Windows Resource Monitor to see if any system activity coincides with the glitch.
You might try playing with the buffering. Try setting it down low, rather than at its maximum.
I had occasional buffering problems with playing from memory using the decode before loading option, but have not had an issue with the newer decode on playback option. Do you see any difference between the two options?
Are you sending native DSD or are you using DoP. If DoP, are you using WASAPI or ASIO?
What is the DAC?
Unfortunately, lots of questions but no obvious solution.