To get you going, the custom view you'll create will use the folders as the basis for Album and Artist. This is so that you don't have to immediately tag your cover art (I believe the views mentioned in AlexB's great posts will require this, but I haven't read them all, yet, too many for today!)
1. Right-click Audio, and Add Library View...
2. Select Empty View and name it something like: Artists, Albums, w/Cover art
3. Leave View As as Panes
4. Under Settings > Included files, deselect Use parent scheme rules for file display
5. Under Settings > Included files, select Set rules for file display... and press the Import/Export button and paste:
[Media Type]=[Audio],[Image] [Filename (path)]=[M:\Music\" ~sort=[Dimensions]-d,[Track #]
but change the part in red to the path to your own music folder (mine audio is under M:\Music\)
6. Under Show categories in this order, select Add and add select Expression. Set the Name to Artist, and add the expression:
FileFolder(,1)
7. Add another expression category, same as (6), but this time name it Album, and set the expression to:
FileFolder(,0)
At this point, your view will now have two pane columns, one for Artist and one for Albums. The file list below will be grouped by Album by default. You can leave this if you want, and just double click an entry under the Artist or Album column in the pane. This will start playback of the files in the list. Since the artwork is sorted first (because we're sorting by Dimensions which Images have, but Audio does not), the artwork is queued (to the default Images zone) and then the remaining audio tracks (sorted in track order) are now queued to the current zone.
Now, if you tag your cover art images with the same tags you use for the audio (e.g. Album, Artist, Album Artist, Date), then you'll be able to use views based off the metadata rather than the folder structure as we've done here. You can customize any view to include these images, and exclude cover art from your Images views (by ensuring Filename (path) does not start with the path to your audio (similar to, but the inverse of, what was done above).
Also, you can use the same expression we've used above in the views for album and artist to help quickly tag your cover art. You can select one or more cover art images (easiest if you sort the file list by file type), and enter the corresponding expression above, appending an = character, into the Artist or Album tag. You can edit directly in the file list column, or use Action Window > Tag. For example:
In the Artist tag, enter:
=FileFolder(,1)
In the Album tag, enter:
=FileFolder(,0)