That X2 isn't the zippiest CPU on the block. It was a decidedly low-end part with zero MB of L3 cache (and that AMD architecture really needed its L3 cache).
It also suffers from the notorious AMD C1E bug, so hopefully your motherboard manufacturer fixed support for that in the BIOS (or you should disable Cool-N-Quiet in your BIOS).
But, we're talking about a chip that is the rough equal of an old Intel Pentium Dual Core E5300 (not even quite that good in most tests). That's one of those "Pentium" branded low-end chips from the Core 2 Duo era. So, it would be somewhere south of performance of a 2.8GHz or so Core2Duo.
As I said, I've long-since pulled my old Core2Quad Q9550 out of service, but it couldn't quite handle full quality BluRay rips in ROHQ back then. The situation is different now, so it may not compare, but the Q9550 (which I also had overclocked to high-heaven) was a substantially more powerful CPU than that X2. I'd wouldn't be
surprised if that CPU just can't handle full quality BluRay decode in software without working hardware acceleration, perhaps even in ROST. That
is from an era where low-end chips just couldn't quite push 1080p playback. The behavior (again, in ROHQ on the Q9550) was much as you described. In "slow" scenes (dialog with not much happening on screen, etc) it would play fine. But if stuff started zipping around the screen like an action sequence, it would drop frames and stutter with reckless abandon. It was unwatchable.
Still, you also mentioned slow pans. These are also difficult to compress, so are a pain point with underperforming hardware. However, it can also indicate you might be seeing the effects of
refresh rate judder. In fact, that was my initial instinct, but then I read your specs and...
I'm not so sure that can do ROST. Especially if data rates from disk are limited, perhaps. But, it could be judder, or something broken.