Yep, you can do a library backup in Windows and restore that library backup in macOS. However... the differences in Windows and macOS paths are going to cause you issues, but you may be able to use the Rename, Move, and Copy Files tool after restoring a library backup on macOS. One thing to keep in mind, don't have folders or files that begin with periods, or else macOS (and Linux) treat those as hidden folders, and MC won't import those files, because they're "hidden".
I'd try experimenting with a few at first before attempting the full library. However, if you don't have things like ratings and stuff like that saved in the library, you *could* remove all the files in your library and re-import them from the new path(s) in macOS.
Paths are much different on Windows versus Mac (and Linux for that matter).