I have a late 2019 MacBook Pro with a Radeon Pro 5500m, an i9, an 16GB of RAM, and it's pretty laggy when scrolling, and especially in Retina mode.
https://youtu.be/u2NPGDP3o4c
That's pretty much normal right now, and pretty sure it's known (I reported this after the first native screen rendering build). If you use any view that displays stacked cover art that way (e.g. Artists or Albums), especially in Retina Mode, scrolling will definitely lag.
I have over 1,000 artists/bands in my library, and over 9000 (lol) albums in my library so scrolling gets pretty laggy when scrolling (much worse than what's displayed in your video) through the list with all those stacked cover art images displayed, which Retina Mode makes worse, which is to be expected. But even though it still chugs pretty badly when scrolling down a list like that, it actually scrolls faster than the old builds before native screen drawing landed. The old drawing method was worse performing than this, so I'm calling it progress!