Ah multi-channel, that explains it. It crossed a certain memory requirement with memory playback, and in stereo that would be around 16 minutes at those rates (unless my math failed), but with multi-channel thats of course going to be less.
Basically, when you cross 2GB for an individual decoded track, it was causing issues.
Hopefully the changes I made will prevent those crashes in the future.