INTERACT FORUM

Please login or register.

Login with username, password and session length
Advanced search  
Pages: [1]   Go Down

Author Topic: Getting rid of duplicates  (Read 3571 times)

icanrule

  • World Citizen
  • ***
  • Posts: 107
Getting rid of duplicates
« on: March 02, 2020, 03:13:26 am »

There are many circumstances where I have duplicate songs.  You burn an artists cd and you have the music, then you burn a compilation and it has the same song that was on the original cd.  Then you burn another compilation and same thing happens.  Is there some way to join these so they are only stored on the hard drive once? 

This would solve 2 problems for me.  1.  It will save hard drive space for me.  2.  If I rate the song, classify a genre, get lyrics or do anything with the song it would be reflected in all the places where the file is located. 

Is there a solution to my problem that is built into jrivers?  Perhaps a way to create virtual shortcuts of files?  If there is a way then obviously this shortcut would also need to have it's only file properties for parameter like track #, Disk #, ect. 
Logged

JimH

  • Administrator
  • Citizen of the Universe
  • *****
  • Posts: 71333
  • Where did I put my teeth?
Re: Getting rid of duplicates
« Reply #1 on: March 02, 2020, 06:43:23 am »

There is a smartlist that shows duplicates.
Logged

JimH

  • Administrator
  • Citizen of the Universe
  • *****
  • Posts: 71333
  • Where did I put my teeth?
Re: Getting rid of duplicates
« Reply #2 on: March 02, 2020, 06:59:43 am »

Google is a good place to ask.  Try searching for duplicates jriver.
Logged

pfm555

  • World Citizen
  • ***
  • Posts: 223
Re: Getting rid of duplicates
« Reply #3 on: March 02, 2020, 09:58:02 am »

The smartlist that Jim is referencing is the easiest way to find your duplicates. Removing them, from my experience has to be done manually. If you have three copies of one song and your copies are in 24-96, 16-44 and mp3, JRiver has no way of knowing which copy you want to keep. Keep in mind that if you do delete songs, the albums will be incomplete meaning if you remove two songs from one album and they were #2 and 9 the album will reflect that those numbers are missing. I have a large collection over 2 TB of music. i  considered removing the duplicates but i collect music and one of the things i do in my collection is i  like to have entire discographies of artist(s). Removing duplicates is not an option for me. This option does not save you space on your hard drive but i use playlists and smarlists extensively. there are options in both to remove duplicates from these lists. They are removed from the list but not completely deleted from your database.
Logged

blgentry

  • Regular Member
  • Citizen of the Universe
  • *****
  • Posts: 8009
Re: Getting rid of duplicates
« Reply #4 on: March 02, 2020, 12:38:35 pm »

Duplicates, duplicate detection, and duplicate handling are more complex than it might appear.  The short answer to your question is:  I do not believe MC includes any ability to use "shortcuts" as you describe.  MC includes a minimal duplicate detection smartlist, which can get you started if you want to try to find them on your own.   Dealing with them, once you find them, is kinda the hard part.

The screen shot I've attached here is from my custom Duplicate Finder view that I built.  This is a representative sample of my collection, which shows numerous duplicates.... except most of them really aren't duplicates.  Let's look at some examples:

1.  Primary:  This is on two different albums.  The run time (3rd to last column) is only 5 seconds different.  But the dynamic range (next column over) is very different.  Indicating different mixes, which really are different songs.  Which makes sense because these songs are on an original album and a remastered one.

2.  Brothers in Arms (near the bottom of the list):  I have 3 copies of this.  The first two are within 1 second of run time, but again have different dynamic ranges.  Different mixes.  The 3rd copy is entirely different.  It's more than 2 minutes shorter than the others.  A very different song.

3.  I Can't Go For That:  This is on two different compilation albums.  One that's just Hall and Oates, the other on an 80s comp.  Run times are identical.  Dynamic Range is identical.  These are likely to be true duplicates.  But I won't delete either one because they are on different albums.

More importantly for me, these files are small.  Even though these are FLACs directly ripped from my CDs, "Can't Go For That" is only 23MB.  Disk space is cheap and getting cheaper.  No need for me to try to optimize anything in this way.  If I had two full copies of the same album, I'd delete one of them.  But songs from different albums that are *probably* the same?  No way.  I can't go for that.  (See what I did there?)

Notice that my duplicate finder has a Pane up above for file type.  This way, if you find two copies of the same album, but in different FORMATS, you can choose one or the other, examine them, and then delete one of them if you want. 

You can build a lot of functionality into a view like this if you want.  I've used it successfully to eliminate many, many real duplicates from a larger collection (not mine).  It can be useful if your collection is not well curated.  This is part of the power of MC:  You can build and use tools like this to really take control of your collection and become your own master digital librarian.

Good luck.

Brian.
Logged

RoderickGI

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 8186
Re: Getting rid of duplicates
« Reply #5 on: March 02, 2020, 06:27:30 pm »

Once you have dealt with any real duplicates, I have to ask...

You burn an artists cd and you have the music, then you burn a compilation and it has the same song that was on the original cd.  Then you burn another compilation and same thing happens.

...why are compilations you burn (to a CD I assume) appearing in MC? You shouldn't be importing CDs that you have burned into the MC Library. Check and fix your Auto Import settings if you are. Also, don't show CDA files in your Views, if that is what you are seeing. CDA files do exist in the Library CD Database as a result of MC having seen a CD at some stage, but they shouldn't be appearing in normal Audio Views.


Build compilations in MC using Playlists. Just play those playlists if you want to listen to the compilation while using MC.
If you want to burn the compilation to a CD to play elsewhere, then use the MC function to bur a CD, but don't import that CD into MC.

Maybe I am misunderstanding how you are creating duplicates, what what you have described doesn't seem right. Or normal.


PS: Brian, I like you inclusion of the Dynamic Range column in your duplicates View. That adds a lot to the decision process.  8)
Logged
What specific version of MC you are running:MC27.0.27 @ Oct 27, 2020 and updating regularly Jim!                        MC Release Notes: https://wiki.jriver.com/index.php/Release_Notes
What OS(s) and Version you are running:     Windows 10 Pro 64bit Version 2004 (OS Build 19041.572).
The JRMark score of the PC with an issue:    JRMark (version 26.0.52 64 bit): 3419
Important relevant info about your environment:     
  Using the HTPC as a MC Server & a Workstation as a MC Client plus some DLNA clients.
  Running JRiver for Android, JRemote2, Gizmo, & MO 4Media on a Sony Xperia XZ Premium Android 9.
  Playing video out to a Sony 65" TV connected via HDMI, playing digital audio out via motherboard sound card, PCIe TV tuner

JimH

  • Administrator
  • Citizen of the Universe
  • *****
  • Posts: 71333
  • Where did I put my teeth?
Re: Getting rid of duplicates
« Reply #6 on: March 02, 2020, 06:32:14 pm »

I think he means rip, not burn.
Logged

RoderickGI

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 8186
Re: Getting rid of duplicates
« Reply #7 on: March 02, 2020, 07:24:47 pm »

Probably, but while I try to guess what people mean, rather than take what they write literally, that doesn't always work.

I guess English is a second language for many users. But it doesn't hurt, or shouldn't, to ask for clarification.
Logged
What specific version of MC you are running:MC27.0.27 @ Oct 27, 2020 and updating regularly Jim!                        MC Release Notes: https://wiki.jriver.com/index.php/Release_Notes
What OS(s) and Version you are running:     Windows 10 Pro 64bit Version 2004 (OS Build 19041.572).
The JRMark score of the PC with an issue:    JRMark (version 26.0.52 64 bit): 3419
Important relevant info about your environment:     
  Using the HTPC as a MC Server & a Workstation as a MC Client plus some DLNA clients.
  Running JRiver for Android, JRemote2, Gizmo, & MO 4Media on a Sony Xperia XZ Premium Android 9.
  Playing video out to a Sony 65" TV connected via HDMI, playing digital audio out via motherboard sound card, PCIe TV tuner

blgentry

  • Regular Member
  • Citizen of the Universe
  • *****
  • Posts: 8009
Re: Getting rid of duplicates
« Reply #8 on: March 03, 2020, 08:47:21 am »

PS: Brian, I like you inclusion of the Dynamic Range column in your duplicates View. That adds a lot to the decision process.  8)

Thanks.  Notice that view also includes a column called "not duplicate".  If you find songs that you do not consider to be duplicates, just check that column.  There's a pane up top that has "hide" as an option and it hides all "not duplicate songs".  This way you can go though dozens or hundreds of songs, mark the ones that you don't consider to be a problem and you won't have to see them in the list any more.

Brian.
Logged

icanrule

  • World Citizen
  • ***
  • Posts: 107
Re: Getting rid of duplicates
« Reply #9 on: March 03, 2020, 08:55:56 am »

He is right. I did mean rip.

Blgentry:. Your answer gets to the heart of my problem.  It's true that hard drive space getting cheaper but in my heart I don't like wasted space. Additionally there is still this overarching issue of the rating system and to rate one song would require the rating of all the same songs.

Thank you for all your help.
Logged

jmrdc

  • World Citizen
  • ***
  • Posts: 143
Re: Getting rid of duplicates
« Reply #10 on: April 05, 2024, 12:15:04 am »

I have a samartlist with 105,000 + duplicates.  How can I delete this smartly while still keeping a 9 to 5?
Logged
Pages: [1]   Go Up