If you use JRemote this exact interface is provided. However, if you check the Remotes forum, you'll see my thread bemoaning the fact that not every letter of the index alphabet actually works to send you to that section of the library. Someone has hypothesized that, even though the alphabet is displayed as a vertical linear list of 26 letters at the right, it actually works as does texting on keys 2-9 of a phone, so to get to the B section you have to tap A twice. If you tap B, or S, you zoom back to the top of the library (in my case, albums whose names start with numerals, even before the A section). I have not yet tested this to see if it's true. I don't use a phone for JRemote, but an iPad Air2.
So if the JRemote developers can fix this behavior so it works as the interface signals that it should, you'll have exactly what you (and I) want in what is otherwise a terrific and elegant remote product, especially on a hi-res tablet.