I did quite a bit of experimenting trying to achieve the layout shown in the WMP screenshots you referenced, and I'm fairly confident when I say it is not possible for MC to display thumbnails in this manner.
It is already possible to group by artist, or any tag field for that matter, but "display groups" are only shown in the bottom half of the main content area, which is where MC displays the media files themselves. These can be shown in several different ways, but none of them mimic anything close to what you're looking for.
If you simply want to isolate album thumbnails for a selected artist(s) (filtering out everything else except for the selected items), that can be achieved in a number of ways. The most efficient way is to use the Panes view style. Using panes will also allow you to simultaneously filter on genre, or decade, or any tag field you desire to filter on.
Below is my Panes layout - maybe something similar to this would work for you? The first screenshot shows my full library with nothing filtered. The seven column groups along the top represent the tags I chose to quickly filter what is shown. The second screenshot is after I filtered on genre jazz(sub-style fusion) for the decade 2000 to 2009.
If you are interested in using my layout as a starting point, I could save it off and upload it to wherever J River stores user custom views. I know that is possible, but I confess I've never actually done it. Anyway, I hope this helps in some way.