My preference is to try to use the primary view only for each media type, so I understand the issue—but I don't see the point of the suggestion. If using search lists or some similar technique for filtering files, it doesn't make any difference. Set Rules for file display to include all files that might be needed in the view, then filter the view to include whatever subset is desired. A search list pane, for example, can include 'Audio only', 'Audio with Images' and 'Images only'—along with the rest.
I draw the line at mixing media types, but the same issue applies within a media type. For example, I don't want to use a different view for my audio media which is not music, so I filter them out in the view rather than excluding them from the view. On the other hand, I have no interest at all in Christmas music out of season, so I exclude it from my primary view until the holiday season. If there's any difficulty in this, it's in making up my mind which way I'd rather do it. Once I've done that, having a second technique for doing the same thing is only going to invite confusion (e.g., by excluding something from the view when I've already got a filter that does so).