I havent checked Alexs link, but heres 2 ways - both operate on the (listed) library files in the current view, so make sure you have all your audio files in the view.
1. Probably the easiest. In the action window choose file properties/statistics/Artist-Album. Right click in the statistics window or click on the drop down arrow (top left of stats window) and choose print. This prints a list in the form 'Artist - Album'
or
2. In the action window, choose print/print file list. The printout will contain all the columns currently in your view. If you just choose to view artist and album columns, you will get a duplicate for each track in each album. but you could create a smartlist which showed one track from each album once, and get the same effect. The menu File/Print brings up the same print action window.
Hope this helps. Tested in MC11.0.221.
[EDIT: changed an 'each' to 'one': I had some kind of ~nodup or limt smartlist in mind]