Some visualization style VST plugins refresh only when data is added to them instead of continuously on their own schedule.
So for these effects, if something causes large data blocks to be processed at once (like convolution) the refresh rate will be slow.
Sorry, but I don't know any way around this.
If it helps, the built-in Analyzer should remain smooth regardless.