Audiochecker seems to work great. Took some effort to find it but I did a test with 150 songs, mixture of lossless and lossy files and converted them to flac. Audiochecker had a 100% score on that batch. Gives me enough confidence to use it to remove the mp3 versions of some double albums I have.
Thanks guys!