Sorry, I meant in Windows Explorer. Artist cover art is located in that folder, and is added/deleted manually by you.
I'm not sure I follow you by boxed set cover art in an Artist view; you mean at the Album level, right? For multi-disc sets where all the discs have the same name, only a single cover art thumbnail is presented - it comes from the first artwork found.