When you hover over an image thumbnail, you should see a magnifying glass type of icon appear in the top left corner of the thumbnail. Click that. Is that what you are referring to?
Also, recently new, simply double clicking the image should open it in that same viewer. Does that help at all?