This is not really a bug. If you want Albums split by artist, you can setup the view that feeds JRemote to do just that.
The view logic is pretty generic, if you set it to group by Field X, then all entries with the same value in that field will get grouped there. Thats what its told to do. So if its told to group by Album, then it'll do that, no questions asked. It does not know, nor care, if some files may want to be a separate entry. As long as the value in the Album field is identical, thats all it looks at.
If you want it to account for more then one field, then you need to tell it to do that. ie. Album and Artist, instead of just Album. Either by adding another layer above or below that, ie. so that you navigate Artist -> Album, or Album -> Artist, or simply by adding the Artist name into the album title (as part of the view config, not changing the album name in the database), so that Albums are listed like "Album - Artist" in the view, so that unique albums are actually given a unique identifier.
This solution was mentioned in a few posts above in this thread already.