What skin do you use?
I found that this behavior is a bit different from skin to another.
For example, Aruba uses a mouseover image for the close button in Action Window, but Noire doesn't.
Does anyone know if the Options, DSP Studio, Library Manager and similar floating windows allow a mouseover feature for the top right corner button(s)?