In a file list view, sort by the little thumbnail icon by clicking on its column header. Non-existent tracks will have a X icon. Select those tracks, and hit the Delete key.
Alternatively, you can create a Smartlist that uses an expression IsMissing() to fill its contents.
Or search via the expression:
[=ismissing()]=1