I figured out why this was happening.
I frequently use RDP to remote control my HTPC from another room. After using RDP the shutdown from JRemote will prompt with the yes/no pop-up. If I reboot my HTPC then JRemote will shutdown properly.
I have added a scheduled task to reboot my HTPC overnight so this should resolve this for me.