Just because its not the driver itself but something in MC still indicates that its something related to the entire process, so changing settings might make a difference somehow.
However, considering we're not seeing widespread reports of this, it seems a bit weird. The memory also doesn't seem to be "lost" but just piles up somewhere where MC still knows it exists and frees it when asked to.