Hmmmm...maybe it is the resampler? Annoyingly enough, it will take a week before I can make any tests. But why would it then make this noise when switching between two albums with the same sample rate?
For me it doesn't seem to make noise when switching between two albums with the same sample rate (but see below, I forgot to test one possibility). To be perfectly clear about what's happening on my end:
Resampler in output format set to resample everything to 44.1 (except 44.1, which is set to "no change"), convolution enabled with 44.1KHz filter (about 10k taps, if it matters). I got the following results last night:
Convolution and resampling on:
Play movie with source sampling rate 48KHz, then play music with source sampling rate 44.1KHz; result: slight pop at start of playback.
Play album with 44.1KHz source sampling rate, then play a second album with source sampling rate 44.1; result: no pop.
Resampling off, Convolution on:
No pops with any scenario, but 48Khz material fails to playback (playback appears to start and progress, but no sound comes out). That's probably to be expected as my convolution filter was made for 44.1 (although I keep reading that JRiver is supposed to auto resample convolution filters, but it never has for me)
Convolution off, Resampling on:
Could not reproduce pops.
So it looks like (in my case) it's an interaction between the resampler and the convolver. I've gotten slightly weird results when combining resampling and convolution in the past too. It may not pop in between albums for me because technically the resampler isn't doing anything on my 44.1 files (which 99.5% of my collection is). I didn't think to test whether stopping playback in between would change anything, or whether switching between two 48KHz albums would still pop.
Trumpetguy, you said you resample everything to 96KHz? So I assume you have output format set to "do nothing" for 96KHz files? Try switching between two 96KHz albums and see if it still pops. If so, we may have a different problem, if not, we're getting closer to something reproducible.
Also (not that I think it should matter), but what software do you use to create your convolution filters? I use RePhase.