Right, this will take a little while to work through. Yes, it is confusing. But there is some good stuff here, that can fix and improve TV in MC.
Sorry for not looking into this sooner. Do you still have this issue?
I still have
an issue. But not the Doctor Who one, because the season has finished. I still have the issue with the "ABC News" recording. But it is a strange one, and different to the Doctor Who issue. I'll deal with that in a second post.
But first...
Another related question you previously asked was "when does 'Get Movie & TV Info' happen" after a show is recorded. I told you I would look into it. I am however still confused. I can swear I have not done any coding myself about it, and I can not find any code (that other people did) that does it either. So as far as I am concerned, automatic execution of "Get Movie & TV Info" does not happen. ? ? ? ?
This does not surprise me. But it is supposed to happen as part of the recording process, isn't it? I haven't looked up when I asked that question, or what I said around the issue then, but I have pretty much concluded that it doesn't happen until Auto Import detects the new program, and runs it then. The trouble with that is that the TV recording process creates a record in the MC Library, and so Auto Import may not immediately detect that it is a new program. Some of my recordings seem to never get a run of "Get Movie & TV Info..." against them, until I do it manually.
I have also noticed that when I record a new Series, or the first Episode of a new Season of a Series, that Cover Art isn't immediately collected for the Series and/or Season. I often have to run the manual process to get it. But I have seen that is can take quite a while to get the Cover Art when I import a whole new season, or multiple seasons, of a series into MC from other sources. So maybe the TV recording process isn't doing that either, and Auto Import takes a day or more to get around to collecting it. Not sure.
Anyway, I haven't done a controlled experiment on new TV recordings, with the "Get Movie & TV Info..." function turned off in Auto Import, or the whole function turned off to check exactly what gets down with a recording, because no-one else seems to be commenting on this issue.
I am quite confused. As far as I can tell, [TheTVDB Series ID] is not available in all EPG modes. It is available in some XMLTV data. If so, we do save the data in the corresponding EPG entry. PercData, on the other hand, does not provide this, or at least the way my parsing code does, it does not.
I am using XMLTV data source OTA using EPG Collector, which also enhances the EPG data with metadata from TheTVDB. Theoretically my EPG could include the TheTVDB ID for programs which find a match. But I just checked, and I don't have the data in my current EPG, nor could I find evidence that it has been in the past. But I have deleted old data from when I looked into Doctor Who, for example. I think I can assume though that my EPG data will not have TheTVDB ID in it, and if it does, it will have the correct value, in which case writing it to the recording record, which will then update all other Episodes in the Series, would be fine. The problem occurs when the [TheTVDB Series ID] is empty in the EPG.
When a show is recorded, we copy field values from the EPG entry to the recorded file only if the field is not empty. That therefore should not have emptied the field for existing recordings.
Could that have happened when an EPG entry is updated? I suppose it could. If the EPG data for a show does not have [TheTVDB Series ID], we do clear it. This is done for all fields because it is possible that a TV station may replace a show with an entirely different show, and leaving any old data would cause confusion.
The text in
blue should mean that the [TheTVDB Series ID] tag on the specific recording for a Series isn't emptied if the EPG data for the new Episode recording doesn't have it. But what does the code that handles Relational fields, such as the [TheTVDB Series ID] tag, do if the tag does not exist? Does it treat the record the same way as it does if the tag exists, but is empty? Because if the library record for an Episode of a [Series] is saved with an empty [TheTVDB Series ID] tag, all records for that [Series] have the [TheTVDB Series ID] tag emptied.
This could have been what I was seeing for Doctor Who. I think the problem started around the time of discussion around new programs getting data from old programs, which is why you started clearing the EPG data fields for new programs, as per the
red text above, I think.
However this is happening, it breaks the "Glynor Method" of defining the [TheTVDB Series ID] tag once for a Series, as long as the EPG name and the name in MC match. i.e. EPG="Doctor Who", TheTVDB="Doctor Who (2005)", MC=Doctor Who". In that case, a lookup of TheTVDB will match on TheTVDB ID, and not on the program name.
Even though PercData does not provide [TheTVDB Series ID], I do find some of my EPG entries carry this data. Most of the shows that do carry this ID seem to be those that I have recorded in the past. Maybe that explains something? Maybe auto execution of "Get Movie & TV Info" does happen? And such execution puts TheTVDB ID into the recorded shows? And then they spread into even the new EPG entries with the same series names? However, more confusingly I found a few movies (not TV series) that carry this ID too ("Money Talks" and "Shanghai Noon" both have the ID 97618, and "Tyler Perry's Madea Goes to Jail" has 72368).
Are you suggesting that the EPG data gets updated with the [TheTVDB Series ID] if there are already recordings for the Series in MC? Or could this just be a coincidence?
I'm now quite sure that the "Get Movie & TV Info..." function does not happen for new Episode recordings. I just checked recordings I am still doing for three Series that are easily and accurately found on TheTVDB using the "Get Movie & TV Info..." function; "The Simpsons", "NCIS", and "NCIS: New Orleans". None of the Episodes for any of those Series have anything in the [TheTVDB Series ID] tag. The tag is empty for every Episode. As I know that the at least the NCIS programs had a value in the tag previously, it is obvious that something has cleared them. In fact, early Episodes of NCIS and The Simpsons have the correct Cover Art for their Epsiodes, so they would have had a manual run of the "Get Movie & TV Info..." function to populate those. Dates below show which Episodes have the correct Cover Art.
NCIS Correct Cover Art up to 2 June 2015. Video frame grabs from 2 February 2016 onwards. Latest 13 June 2017.
NCIS: New Orleans All Episodes have video frame grabs, from 24 August 2015 to 30 July 2017.
The Simpsons Correct Cover Art up to 23 May 2016. Video frame grabs from 17 September 2016 onwards. Latest 24 May 2017.
I just did a "Get Movie & TV Info..." lookup on just one Episode for each of those Series, and every Episode was updated with the correct TheTVDB ID, as expected.
Note that each of those Series is a favourite of mine, and so have my custom Relational tag [FavouriteTV] set to one (check mark) for all existing Episodes, and every new episode has picked up that value as it was recorded, the most recent only four days ago. So it would seem that the clearing of the [TheTVDB Series ID] tag is probably related to the EPG data, and clearing the tag by one means or another, as per the above discussion.
Note that as the EPG data would never have my Custom Relational tag, so it would not exist in the EPG data rather than be empty, it would appear that the problem is that the [TheTVDB Series ID] is being emptied, rather than being deleted from the EPG data. Or at least the tag is being saved for the new recording while empty, rather than not being saved with it at all.
I think that is enough for now. I will have another look at the issue I have with the ABC News program, and come back to describe it. I hope I haven't confused you more, and perhaps helped clarify the situation. Thanks for looking at this.