All of MC is file based. If a folder is empty, then there is no record in the MC Library to use to search for that folder.
Even the "Drive & Devices > Explorer" tool works on files and not folders, including when it isn't set to "Show Only Files in Library" and therefore shows all files on a drive or in a folder, it does so by temporarily importing all files into MC just for Explorer. It does show an empty folder in the drive tree in the navigation pane, but there is no way to search for such a folder.
So the only way to search for an empty folder is to use Windows Explorer or equivalent.
However, if the folder has at least one file in it, and that file has been imported into MC, then you can search for the folder name in any View, as MC will look at the [Filename (path)] field and find the folder name. Same thing when using Explorer under "Drive & Devices", except that the file doesn't have to be in the Library if the "Show Only Files in Library" box is unticked.
