INTERACT FORUM
More => Old Versions => Media Center 17 => Topic started by: JustinChase on November 07, 2011, 06:22:16 pm
-
Okay, so I’ve spent the last few weeks fine-tuning this, and I think I have it all working just the way I want now. I thought others might benefit from this, so I’m putting together a guide on how I did it, and will try to answer questions from others if necessary.
The RESULTS:
When I play any recorded TV program in WMC, or JRMC17 they both automatically skip commercials for me. Neither requires any manual input from me for any part of this ;D
The TOOLS: These are the latest, and currently working versions...
MC-TVConverter 2.1.0 - http://mctvconverter.vivolum.net - homepage for the project, but you need the beta from the beta board (password is Beta) - http://mctvconverter.userboard.org/closed-beta-discussion-f2/tvconverter-beta-t6.html
**This is still a Beta, so if it's not perfect for your needs, he's been very receptive to my requests :)
- Grab the version in the first post, we'll "update" it later, using some updated files not yet integrated into the beta version - http://dl.dropbox.com/u/16359903/MC-TVConverter_comskipXML.zip
DVRMSToolbox – http://babgvant.com/files/folders/20437/download.aspx
DTBAddin - http://babgvant.com/files/folders/20021/download.aspx
We really only need the DTBAddin, but I’m not sure how to set the .xml save location without the full Toolbox being installed. I haven’t tested this after totally removing the Toolbox, but don’t think it would work. My only reason for wanting to uninstall it is that it installs lots of filters I don't need/want on my system, and I'd rather not deal with them. However, they do no harm, so ;)
Files needed to update MC-TVConverter:
Comskip.ini (this will give you the correct output files, but the accuracy of the algorithm is not tweaked yet, meaning the commercials it finds are only about 90% accurate)
Config.ini (this tells MC-TV Converter to move the .xml commercial file to the place you specify)
Updated MC-TVConverter.exe (this version uses the config.ini above to move the .xml file for you)
The SETUP:
Windows Media Center records ONLY to a local drive, in my case E:\Recorded TV
JRiver MC17 may or may not be allowed/able to reliably record to a network/shared/mapped drive, but since WMC can’t, I just set MC17 to record to the same place.
MC-TVConverter sees when a recording has finished, and either ‘converts’ the recorded .wtv or .ts file to a .ts file in another directory, now on the network. (It really just rips the streams and puts it in a .ts container; no transcoding takes place)
Converted files go into V:\TV\Delete\{show_name}\{episodes go here} (we need to set this up in 2 different places)
I put them here because I usually delete the converted files, but occasionally I will clean up the commercials and keep the episode. Putting them in a folder for each show makes it really easy to delete the stuff I know I’ll never save (wife’s programs :-X)
After the file is converted to a .ts file, it then runs comskip on the new .ts file, and puts the .edl file next to the converted file in the folder above.
Additionally, it puts an .xml file in V:\TV\DVR\commercials, which WMC will use to skip commercials using the DTBAddin from babgvant.
Finally, it will move the original file to V:\TV\DVR\
I have WMC set to find/use both E:\Recorded TV and V:\TV\DVR\ for recorded TV, so it always presents me the shows from both locations, no matter where they are in the process.
I don’t have to do anything other than delete the converted files occasionally.
-
The DETAILS:
Install MC-TVConverter
Install DVRMSToolbox
Install DTBAddin
Copy the config.ini to C:\Users\{you}\AppData\Roaming\MC-TVConverter
(http://www.pix01.com/gallery/B6318F5F-4769-4385-B3CA-EE27B9BD15F9/Commercial_Skipping/376072608_orig1.jpg)
Open this config.ini with notepad++ (or similar) and edit line 281 to reflect where you want your commercial .xml files to be stored. I put them in a separate folder because I just don’t want to manage them. They are 1KB each, so I’m not worried about leaving them for months/years. It should look like this
comskipXMLOutputDir=V:\TV\DVR\commercials
Copy the comskip.ini to C:\Program Files (x86)\MC-TVConverter\tools\comskip
(http://www.pix01.com/gallery/B6318F5F-4769-4385-B3CA-EE27B9BD15F9/Commercial_Skipping/376072608_orig0.jpg)
- This will overwrite the comskip.ini already in there. This is fine. I have cleaned this one up, and included the line needed to make this work. If your comskip is already working fine for you, you can just add this line somewhere instead.
output_dvrmstb=1 ; set to 1 if you want DTBAddin chapter cutlist output (XML)
If you want a commercial file for VideoReDo, add this.
output_videoredo=1 ; enable VPrj output for use in VideoReDo
You can just drop this file onto the VideoReDo icon on your desktop, or in a folder, and it'll open the video file and mark the cuts for you, ready for you to edit, or cut the file.
Copy the MC-TVConverter.exe to C:\Program Files (x86)\MC-TVConverter\
(http://www.pix01.com/gallery/B6318F5F-4769-4385-B3CA-EE27B9BD15F9/Commercial_Skipping/376072608_orig6.jpg)
- This will overwrite the existing file. This is fine. I’ve been working with the developer over the last few weeks to tweak this process to get this all working correctly for this purpose. This .exe is what makes this all work.
Launch MC-TVConverter.
If you click the gear on the top right, it will open the settings dialog.
(http://www.pix01.com/gallery/B6318F5F-4769-4385-B3CA-EE27B9BD15F9/Commercial_Skipping/376072608_orig7.jpg)
The spot circled above will drop down the window to let you watch it work, if you want to see what it's doing.
Here are my settings; you can adjust to your needs.
(http://www.pix01.com/gallery/B6318F5F-4769-4385-B3CA-EE27B9BD15F9/Commercial_Skipping/376072608_orig8.jpg)
If you want it to watch a subfolder, go to the "Watch folder" tab, otherwise, skip it
(http://www.pix01.com/gallery/B6318F5F-4769-4385-B3CA-EE27B9BD15F9/Commercial_Skipping/376072608_orig10.jpg)
Notice how I have {t}\{t} - {st} - ({m}_{d}_{y})-{h}h{mi} - This puts each episode into a folder with the series name. Also notice that I have the hours and minutes as well as the date. the date just helps me know when I review. the time is useful if you record a show that doesn't have "unique" information in your new name. If you just do this, for example, {t} - {st} - ({m}_{d}_{y}) You would expect a unique name for this recording, since the {st} (episode name) would differ. However, if it's missing, 2 shows on the same day will throw a wrench in your scheme (TRUST ME) :( MC17 can ignore this for you later, so it does no harm in having it, IMHO.
(http://www.pix01.com/gallery/B6318F5F-4769-4385-B3CA-EE27B9BD15F9/Commercial_Skipping/376072608_orig11.jpg)
I don't want it converting anything. LAV + MC +MVR handle the raw streams fine. Add subtitles if you want. It will keep the Closed Captioning.
(http://www.pix01.com/gallery/B6318F5F-4769-4385-B3CA-EE27B9BD15F9/Commercial_Skipping/376072608_orig9.jpg)
Add a shortcut to the shell if you want, it comes in handy ;)
(http://www.pix01.com/gallery/B6318F5F-4769-4385-B3CA-EE27B9BD15F9/Commercial_Skipping/376072608_orig12.jpg)
Make sure you tell it to delete the intermediate files or you get a mess.
The history is a list of all the names it's used during conversion, so it doesn't re-attempt if you're not moving the files. If you are testing, and want to force it to re-scan, find all versions in this list (use the search). If you follow this exactly, you'll have 3 files to delete to start clean again. Original, converted/temp, renamed
Once that’s all setup, SAVE your changes and restart the program to effect the changes.
Only one more to go :)
-
Great report! Thanks!
And thanks to babgvant for making it possible.
-
Almost done...
Install DVRMSToolbox. I accepted all defaults.
Install DTBAddin, accept the default settings.
Run DVRMStoMPEGsettings from the DVRMSToolbox program group on the Start menu.
Here are my settings; you can adjust to your needs.
(http://www.pix01.com/gallery/B6318F5F-4769-4385-B3CA-EE27B9BD15F9/Commercial_Skipping/376072608_orig4.jpg)
Make sure you set to comskip, or it will download and install ShowAnalyzer. We're not using either with this program, so it doesn't matter.
(http://www.pix01.com/gallery/B6318F5F-4769-4385-B3CA-EE27B9BD15F9/Commercial_Skipping/376072608_orig3.jpg)
Make sure you turn off folder watching, you don't want any conflicts.
(http://www.pix01.com/gallery/B6318F5F-4769-4385-B3CA-EE27B9BD15F9/Commercial_Skipping/376072608_orig5.jpg)
Make sure you have it set to skip commercials (or what's the point?), and "Handle Keys" enables the stuff below it, which I don't use.
(http://www.pix01.com/gallery/B6318F5F-4769-4385-B3CA-EE27B9BD15F9/Commercial_Skipping/376072608_orig2.jpg)
Set the location where you want it to put the commercial files for you. Tell it to auto-skip for you (you have better things to do with your time), and "skip back disable" is good, but I can't remember why :P
You’re all setup now.
Launch MC-TVConverter, make sure it’s set to convert to .ts, select the folder it should watch, check the box, hit the big green play button and it should minimize to your taskbar and start watching your folder. (If you put it in your Startup folder, you never have to touch it again) If you drop something into that watched folder, or record something to there, it will launch the process after 5 seconds of inactivity for that file.
A 30 minute SD show takes ~1-2 minutes to ‘convert’ to a .ts file, and another ~4-8 minutes to scan for commercials.
A 60 minutes HD show takes ~5-8 minutes to ‘convert’ and another ~10-15 minutes to scan for commercials.
You can watch what’s happening if you click on the taskbar icon and expand MC-TVConverter, then click the thickish black bar along the bottom with the triangles (circled in red above), it will open a window below and show you the progress of what it’s doing.
Once that’s done, you’re done.
Play the Original (moved) file in Windows Media Center, and it'll read the commercials file, and stop when the show's over.
Play the converted file (from V:\TV\Delete\{show_name}\{episodes go here}) in MC17 and it too should playback and auto-skip commercials now, and you won’t have to touch anything else, until you want to delete the converted files, if you didn’t already do that in the setup.
Enjoy 8)
-
Great report! Thanks!
And thanks to babgvant for making it possible.
Thanks! I hope others find it helpful.
Thank you to babgvant and to hudl for making these 2 programs, but also to the people that created the software that they utilize, including erik for creating comskip and being super helpful with user requests for help in tweaking it.
tuning guide can be found here - http://www.kaashoek.com/comskip/
help in his forum is here - http://www.kaashoek.com/comskip/viewforum.php?f=2
Thank you also to the authors of all the conversion tools they include for doing other types of conversions, I'm not sure who many of them are, but I still appreciate their work.
-
Justin, this is great!
But while I may be able to follow it and get things working as they should, the "beginners" out there would look at that and go :o, then run like hell!
Surely there has to be a way to get this process integrated...
-
Hehe, yeah, don't I know it!
Okay, so I’ve spent the last few weeks fine-tuning this, and I think I have it all working just the way I want now.
The beauty of this is that you can just set WMC to record your programs, and a short while after it finishes, MC17 will see a new .ts file and matching .edl file, but if your wife doesn't want to use MC, she still watches the original file without commercials.
I would think JRiver could call the comskip.exe when it finished recording and generate the .edl, but that's a line they may not want to deal with?
Regardless, this really is pretty easy to do, now that the pieces are in place. Plus, it's lossless, therefore, fast ;D
Anyway, I'm curious to know if it works for anyone else. I just got it 'finished' yesterday, but so far, it really is 'hands-free'
-
Justin,
Thanks very much for putting this all together - it's been quite a project for you and I know many will appreciate it.
Here's our problem. We don't use WMC nor do we want to. We want everything done in MC17. But with our Hauppauge HDPVR tuner thus far MC can only record to their .jtv format, not a .ts file. Comskip cannot read .jtv files. So for those of us with an HDPVR we still can't do commercial skipping in MC. I imagine that it would be the same issue with the Hauppauge Colossus tuner.
Rod
-
yeah, I'm not a big fan of WMC either, but for now, it's what we're using. I'm not sure if there is an easy way to convert the .jtv files to .ts files, but if you could do that, this would then work for you.
Alternatively, you could see if the dev for MC-TVConverter can manage to convert a .jtv file also, but I'm not holding my breath for that to be possible; but still, maybe. I think JRiver used to offer the ability to convert from .jtv to .mkv, so there is some ability to convert. I don't have any, or I'd jut try to convert one for you. I'll try to set up a recording to .jtv for later today and try when I get home tonight.
The last option I can suggest is that you just use WMC to record the shows for you, never use it beyond setting it up to record, and then this will convert those .wtv files to .ts file with a commercial file for you. Then you can just have MC import the converted folder, and you'll just get your shows as .ts files with commercials identified about 15-30 minutes after they are done recording. You can even have MC-TVConverter delete the original files for you if you want.
Sorry, it's not ideal in your case, but hopefully there will be a solution to the .jtv situation you now face.
-
I saw your post on AVSForum. How about also posting in the JRiver Owners thread here:
http://www.avsforum.com/avs-vb/showthread.php?t=1352282
Thanks.
-
I saw your post on AVSForum. How about also posting in the JRiver Owners thread here:
http://www.avsforum.com/avs-vb/showthread.php?t=1352282
Thanks.
Good idea Jim. I was actually going to create a new post for AVS, but maybe I'll just put it in that thread instead. Or maybe I'll like to it, but either way, I'll make sure this information is there by the end of the day :)
I'm still curious to know if anyone has tried this and had any success? If not, I'm still very happy with how it works for me :) :)
**EDIT: it's here now - http://www.avsforum.com/avs-vb/showthread.php?t=1371736
-
Thanks!
Please offer Erik a license. He could e-mail me at jimh at jriver if he wants one.
-
I just read this thread and the linked thread at AVS. It's late in the day and my head hurts! I'm very impressed that you were able to work all this out, but must admit it's a little boggling to me on first pass. As imugli posted out above a beginner would take one look and head for the hills.
I'm wondering for those that only want to record and playback ts files in MC if things could be simplified very much? Might there be some of the steps that could be done with the later MC versions?
Any ideas would sure be appreciated.
Thanks.
Rod
-
Sorry. I've seen so many 'tutorials' that left out critical/important steps that I really wanted to make sure I covered everything completely.
I will try to condense it to just processing .ts files recorded with JRiver. That should clean it up significantly. Maybe this evening, but likely tomorrow.
However, if you try just walking thru it, step by step, I think you'll be pleasantly surprised. Once you install and open the tools, it makes more sense :)
Either way, I'll post a condensed version soon :)
-
Hi Justin,
Thanks very much for wanting to try to simplify the procedure - really appreciate that!
Rod
-
In reviewing this for the update, I'm happy to report much of this is not needed any longer, especially for only the .ts files. For just creating .edl files for TV recordings created by JRiver, this should be all you need...
Download and install MC-TVConverter 2.1.0 Official release - http://mctvconverter.vivolum.net/content/site/en/download/index.html?SWS=71b86fa15f054cf9f472d24f7dad6271
Open the comskip.ini file from C:\Program Files (x86)\MC-TVConverter\tools\comskip with a text editor (Notepad++ is free) - navigation is shown below
(http://www.pix01.com/gallery/B6318F5F-4769-4385-B3CA-EE27B9BD15F9/Commercial_Skipping/376072608_orig0.jpg)
Make sure that you have output_edl=1 (it's on line 55, but a search for "edl" will locate it for you also). That should create an .edl file which MC will read and use to skip commercials for you. It should put this file right next to the video file, and any changes made to the name of the video file WITH JRiver Media Center will rename this file automatically also.
Launch MC-TVConverter. Here is where you enter the folder it will watch and the file type you want in the end.
When you turn on folder watching MC-TVConverter sees when a recording has finished and gets to work. It can either convert the recorded .ts file to another container (like .mpg, which offers better seeking functionality on playback) or if you don't want to convert the .ts file, set .ts as the output type and it will not do any conversion at all.
If you click the gear on the top right, it will open the settings dialog.
(http://www.pix01.com/gallery/B6318F5F-4769-4385-B3CA-EE27B9BD15F9/Commercial_Skipping/376072608_orig7.jpg)
The spot circled above will drop down the window to let you watch it work, if you want to see what it's doing.
I've highlighted all the areas I changed, adjust to your needs.
(http://www.pix01.com/gallery/B6318F5F-4769-4385-B3CA-EE27B9BD15F9/Commercial_Skipping/376072608_orig8.jpg)
If you want it to watch a subfolder, go to the "Watch folder" tab, otherwise, skip it
(http://www.pix01.com/gallery/B6318F5F-4769-4385-B3CA-EE27B9BD15F9/Commercial_Skipping/376072608_orig10.jpg)
Notice how I have {t}\{t} - {st} - ({om}_{od}_{oy})-{h}h{mi} - This puts each episode into a folder with the series name. Also notice that I have the hours and minutes as well as the date. The date is the Original recording date info. The time is useful if you record a show that doesn't have "unique" information in your new name. MC17 can ignore this for you later, so it does no harm in having it, IMHO.
I don't want it converting anything. LAV + MC +MVR handle the raw streams fine. Add subtitles if you want. It will keep the Closed Captioning.
(http://www.pix01.com/gallery/B6318F5F-4769-4385-B3CA-EE27B9BD15F9/Commercial_Skipping/376072608_orig11.jpg)
Add a shortcut to the shell if you want, I haven't used it for some time ;)
(http://www.pix01.com/gallery/B6318F5F-4769-4385-B3CA-EE27B9BD15F9/Commercial_Skipping/376072608_orig9.jpg)
Make sure you tell it to delete the intermediate files or you get a mess.
(http://www.pix01.com/gallery/B6318F5F-4769-4385-B3CA-EE27B9BD15F9/Commercial_Skipping/376072608_orig12.jpg)
I record shows to E:\Recorded TV
I have it set so that converted files go into V:\TV\Delete\{show_name}\{episodes go here}
I put them here because I usually delete the converted files, but occasionally I will clean up the commercials and keep the episode. Putting them in a folder for each show makes it really easy to delete the stuff I know I’ll never save (wife’s programs :-X)
Once the file converted (or not) it then automatically runs comskip on the resultant file, and puts the .edl file next to the video file once finished. Then, optionally, it can/will move the original recorded file to anywhere you set (I put mine in V:\TV\DVR\), or it can delete the original if you prefer (assuming you did convert to another type).
Once that’s all setup, SAVE your changes and restart the program to effect the changes.
Let me know if you get stuck, I didn't double-check everything when I amended it.
-
Hi Justin,
Thanks very much for so promptly revising and simplifying this procedure. I wont get a chance to try it until later but on just a quick look through I'm wondering if it couldn't be simplified even more for some uses. In our case I don't think we need to do any 'Converting'. If we start with .ts files created by MC we should only need it to start Comskip. We also then shouldn't need the step of deleting the Converted files.
Further if we are willing to accept the default MC scheme of not putting shows in separate folders then those steps could be eliminated.
Perhaps we can end up with something quite simple that could be done by most anyone and would accomplish the big goal of generating the .edl files so commercials can be skipped in MC. Or am I misunderstanding something here?
The MC-TVConverter program looks very helpful and flexible for fulfilling a variety of functions. Thanks for bringing it to our attention.
Rod
-
If you set it to "convert" to .ts format, it won't actually do any conversion, it will just launch comskip immediately. If you set the output folder to the same place as the watch folder, it won't move anything either. You can also tell it to include subfolders, if necessary.
There's probalby a way to just get comskip to automatically launch without using this other program, but I've never looked into it, bucause I still record with WMC, so I have to convert the wtv files it generates.
I've inquired a few times as to how others are generating the edl files for use in MC, but I've not seen any responses.
Let me know if you have any questions after you get a chance to try the revised guide.
-
JustinChase,
Thanks for your further explanations. I think it's now down to a reasonable procedure.
I just made a post in this thread http://yabb.jriver.com/interact/index.php?topic=71482.msg482629#msg482629 (http://yabb.jriver.com/interact/index.php?topic=71482.msg482629#msg482629) in which gvanbrunt is asking for tasks that could be automated using Scripting. I suggested that creating Comskip edl files would be one of interest.
I too am interested in how others are doing it.
Thanks again.
Rod
-
I got some time to work on this and have MC-TV installed and running. Tried a couple of 1/2 hour shows and the edl (or xml?) files are not being generated.
Watching at the bottom of their GUI I can see that it starts looking at the show when the show starts and that it does the callFunc: "findCommercials". I suspect that the problem is related to where Comskip puts it's output. In your simplified procedure you mention opening the Comskip ini file, but not what to do with it. In your full procedure you say "edit line 281 to reflect where you want your commercial .xml files to be stored."
When I open the ini file in Notepad or Wordpad I don't see any line numbers. I also don't see any entries that direct where the output should go. So perhaps the files are being generated but going to some unknown place. BTW I'm looking at the ini at this location: Program Files/MC-TVConverter/Tools/Comskip/Comskip.ini
I installed Version 2.1.0 of MC-TVConverter. I do have another version of Comskip running in conjunction with Sage, but that's in a different folder so doubt it's causing this problem.
I think that if I can tell it where to direct the Comskip output that this should work and be a fairly simple install/setup procedure.
Any ideas would sure be appreciated.
Thanks,
Rod
-
When I discuss changing the comskip.ini file to set the output location for the .xml file that is the file that Windows Media Center needs to skip commercials. You don't need that for MC. You only need the edl file.
I must have deleted the explanation of what to do when you open the comskip.ini file with notepad++ when I was editing. I'll fix that right now, but in the meantime, you need to verify that you have output_edl=1 in that file. (You can/should also set output_dvrmstb=0 which will tell it to NOT output the .xml file that you don't need)
If you're using Notepad++. it will show line numbers along the very left side of the window. This setting is on line 55. If you don't see the line numbers do a search for edl, and that should find it.
I will amend the shortened instructions now to correct this. Let me know if that did not fix you up, or if you still have trouble.
*I finished amending the shortened instructions, please let me know if anything is still unclear, or is not working.
Thanks!
-
When I discuss changing the comskip.ini file to set the output location for the .xml file that is the file that Windows Media Center needs to skip commercials. You don't need that for MC. You only need the edl file.
I must have deleted the explanation of what to do when you open the comskip.ini file with notepad++ when I was editing. I'll fix that right now, but in the meantime, you need to verify that you have output_edl=1 in that file. (You can/should also set output_dvrmstb=0 which will tell it to NOT output the .xml file that you don't need)
If you're using Notepad++. it will show line numbers along the very left side of the window. This setting is on line 55. If you don't see the line numbers do a search for edl, and that should find it.
I will amend the shortened instructions now to correct this. Let me know if that did not fix you up, or if you still have trouble.
*I finished amending the shortened instructions, please let me know if anything is still unclear, or is not working.
Thanks!
Hi Justin,
Thanks for amending your procedure and for the further explanations.
Unfortunately it's still not generating the edl file. I downloaded Notepad++ so I could see the line numbers. Output_edl was at 1. I also set output_dvrmstb=0.
It is giving the Call "find commercials". As it's working it says it's converting a jts file to a ts file. Not sure what that is about. It also creates a folder that it puts its temp stuff into and then deletes it.
Here are Screensaves of my settings. Sorry the first is so tiny. I was able to view it in my browser by doing Control+ several times to zoom in. If you can't read it let me know and I'll figure another way.
Comskip ini file.
(http://i1013.photobucket.com/albums/af253/nwboater/Comskip%20Settings%20Screensaves%20April%2015%202012/ScreensaveComskipini2012-04-15_132636.jpg)
The MC-TVConverter settings:
(http://i1013.photobucket.com/albums/af253/nwboater/Comskip%20Settings%20Screensaves%20April%2015%202012/MC-TVSettings1Screenshot-15_04_201212_56_15PM.jpg)
(http://i1013.photobucket.com/albums/af253/nwboater/Comskip%20Settings%20Screensaves%20April%2015%202012/MC-TVSettings2Screenshot-15_04_201212_58_39PM.jpg)
(http://i1013.photobucket.com/albums/af253/nwboater/Comskip%20Settings%20Screensaves%20April%2015%202012/MC-TVSettings3Screenshot-15_04_201212_59_24PM.jpg)
(http://i1013.photobucket.com/albums/af253/nwboater/Comskip%20Settings%20Screensaves%20April%2015%202012/MC-TVSettings4Screenshot-15_04_20121_00_20PM.jpg)
(http://i1013.photobucket.com/albums/af253/nwboater/Comskip%20Settings%20Screensaves%20April%2015%202012/MC-TVSettings5Screenshot-15_04_20121_02_12PM.jpg)
(http://i1013.photobucket.com/albums/af253/nwboater/Comskip%20Settings%20Screensaves%20April%2015%202012/MC-TVSettings6Screenshot-15_04_20121_03_55PM.jpg)
It's really odd that it's not working for me. Perhaps you can spot something wrong in my settings.
Have you noticed that there have been 1050 views of this thread? There is obviously a lot of interest in using Comskip in MC!
I'm wondering if there may be someone else that has tried this and has it working - or doesn't. Would sure appreciate some reports.
Thanks,
Rod
-
I don't see anything obviously wrong with your setup. I do see that you have MC-TVConverter set to keep a log file. Have you checked that to see if it tells you anything useful? Can you please post the results of that log file, and I'll take a look to see if I see anything obvious?
I uninstalled all the programs/files from my desktop machine the other night to re-install everything from scratch to write the update, but have not tried processing any files with the new setup yet.
I'll try to test myself in a little bit, and post back if I come up with anything I think might also help, or any more corrections I encounter.
I posted these instructions on AVS forums also, and have asked for feedback several times, but no one has posted that it did or didn't work, so I have no idea if anyone else has had any success; sorry. I wish I had some feedback to share with you about this.
Also, I still haven't seen anyone on these forums post as to how they are generating the edl files, so I wonder is there is some reason no one wishes to share ?
I'll write back later, after I've had a chance to test again, and once we get you working, I'll see if the instructions need further tweaking.
I really do want other people to be able to enjoy the benefits of commercial free TV, since it's awesome! :)
-
I have followed this thread with interest. I have also tried the procedure above and not getting any edl file generated either. I have the same set-up as Rod and is getting the same result. A converted file but no edl file. I have searched the entire computer for it, without success.
I am glad to know about this program, because it is giving me a very nice conversion tool for my wtv files. Be able to skip commercials would be great.
TLS
-
JustinChase - I just sent you a PM about the Log. Thanks so much for making such an effort to get this working.
tls62dk - Thanks very much for posting here. Sorry to hear that you are also unsuccessful. But also glad to have another on this 'project'. With perseverance I'm sure we'll get it going.
I have used Comskip in SageTV for a few years. Although not 100% accurate it took TV to a whole new level. It really is great!
If there are others that have tried this we sure would like to have you respond here.
Thanks,
Rod
-
I just tried, and it's working, in that it's running comskip like it should, but then it's deleting the edl file when it's done, but I'm not sure why. :( I've always moved the file to a new location, so the fact that it's not being moved might be the issue, but I'm trying something else now, so maybe I'll have good news soon.
If not, I'll try with it being moved to a new location, and see if that helps get it working at least, then we can figure out the problem with not moving the file.
Okay. that didn't quite work. I tried changing the output edlx=1, and it did create an edlx file, but it's useless.
I'm now trying again with "delete intermediate files" turned off, and we'll see what happens.
I noticed in my testing that it's not finding any commercials, but that's not surprising to me, since I'm testing with a file recorded from PBS, so there aren't any "commercials" in the file, other than the front and end of the file, which I think get ignored. I'm trying this file again, with the "delete intermediate files" turned off, but I'm also copying a show from network TV to the test location to test, but it's a large file and the test will take some time.
the other test will be done soon, and hopefully this will work. if not, I'll test the larger/network TV file and report back later this evening.
If I can't get it to work, I'll file a bug report with the creator of MC-TVConverter and see if he can get it working for us. hopefully, this will be working soon.
Last thing; if you want to try again, but tell it to put the converted file in a new location, that will almost certainly work. i don't think that's ideal for your current setup, but if you just tell MC to record to a different location, one that isn't watched by Auto Import, then it will convert and move to the current location you are using, and I bet it works.
-
Okay, that worked, but it leaves the .log and .txt files behind also, which is not ideal. I verified that the .edl file is blank (no commercials), but it is there now, so it is working.
One more thing to try now.
-
Just got your PM Justin - thanks. I'll hold off for now sending you my log file since we are all getting the same results and we are making some setting changes.
It really looks like you are on the right track. Odd that it would create the edl and then delete it. But perhaps it expects the new stuff to get moved. I just started a new 1/2 hour recording and have it set to move the files to another folder. The way the setting is named it sounds like the 'original' file will get moved. Is that the way you see it?
Will post back here when the recording is done.
Re the edl file when there are no commercials: Sage works that way too. As long as Comskip is asked to look at the file it creates an edl.
Glad you will contact the developer about this issue. Will be very interested in his response.
Thanks again.
Rod
-
There are 2 places to set MC-TVConverter to move the file. On the General tab, you can set "Output folder" and it will put the 'converted' file there, and will leave the original file alone. I believe this will actually give you 2 files, so it's probably not what you want, unless you also select the option below, to "move original file to folder" > recycle bin or another folder you can just delete occasionally.
The other method is to use the renaming rules to put it in a subfolder, but I'm not sure it will move the edl file for you (haven't tried yet).
I have also posted a question to the developer in his forum, here...
http://mctvconverter.userboard.org/tvconverter-english-discussion-f7/tvconverter-deleting-the-edl-files-but-shouldn-t15.html
He usually takes a day or 2 to respond, and that was 6 months ago, so I'm not sure how long it may take him to reply.
Hopefully one of the methods above will work for you, and we don't need to wait for his response, but when he does respond, I'll let you know if there's a fix to do it as you've been trying.
I just turned on file renaming, to see if that alone will "fix" this. :-\
Sorry this didn't work the way you (and I) expected, but I do have faith it will work soon :)
-
Your post just came in but I'm going to let this go even though they are out of order. Also did you get my second PM?
The short show just finished and still no edl file. I now have one copy of the show in the regular recording location and it's size is 2,201,008 and it has a time of 5:31 PM. The second copy with the same name is in the new folder. It's size is 2,192,980 and it has a time of 5:34 PM.
Interesting that they have slightly different sizes.
So I'm inclined to hold off on more testing until you hear back from the developer. Although if there is something you would like me to try please let me know.
Thanks,
Rod
-
Justin, thanks for your great effort here. I am seeing the same thing as Rod, even after disabling the "delete intermidiate file". Examining the log file after the conversation reveals that there is no files to delete in comparison to the log you posted on the MC-TV Converter board. See below.
16-04-2012, 12:07:46: currentFile: Manuel optagelse_TV3+ HD_2011_10_10_22_00_00.wtv
16-04-2012, 12:07:46: converting from wtv to ts
16-04-2012, 12:07:46: callFunc: "convert_wtv2ts"
16-04-2012, 12:07:46: callFunc: "convertTo_wtv2ts"
16-04-2012, 12:07:46: callFunc: "checkStream"
16-04-2012, 12:07:46: run (get streamInfo): "C:\Program Files (x86)\MC-TVConverter\tools\ffmpeg\ffmpeg.exe" -i "D:\Video convert temp\Manuel optagelse_TV3+ HD_2011_10_10_22_00_00.wtv"
16-04-2012, 12:07:46: streamInfo: stream has no MPEG2 video
16-04-2012, 12:07:46: streamInfo: stream has no AAC LATM audio
16-04-2012, 12:07:46: streamInfo: stream has no E-AC3 audio
16-04-2012, 12:07:46: streamInfo: stream has AC3 audio
16-04-2012, 12:07:46: user settings: convertAacLatm - , convertEac3
- , convertWithFfmpeg
16-04-2012, 12:07:46: Convert WTV using remuxTool
16-04-2012, 12:07:46: callFunc: "convertTo_wtv2tsRemuxTool"
16-04-2012, 12:07:46: run: "C:\Program Files\Java\jre6\bin\java.exe" -cp "C:\Program Files (x86)\MC-TVConverter\tools\remuxTool\remuxTool.jar" util.WtvToMpeg -i "D:\Video convert temp\Manuel optagelse_TV3+ HD_2011_10_10_22_00_00.wtv" -o "D:\Film\Manuel optagelse_TV3+ HD_2011_10_10_22_00_00.wtv.ts"
04/16/2012 12:07:48.452 INFO [util.WtvToMpeg] +0x2a AVC High-4.0 1920x1080i fps: 25
04/16/2012 12:07:48.452 INFO [util.WtvToMpeg] +0x29 (dan) AC3 2.0 48000 Hz 192 kb/s
-------------------------------------------------------------------------------
04/16/2012 12:09:50.605 INFO [util.WtvToMpeg] Finished
16-04-2012, 12:09:50: ---- file successfully converted: "D:\Film\Manuel optagelse_TV3+ HD_2011_10_10_22_00_00.wtv.ts"
16-04-2012, 12:09:50: callFunc: "findCommercials"
16-04-2012, 12:09:50: callFunc: "checkStream"
16-04-2012, 12:09:50: run (get streamInfo): "C:\Program Files (x86)\MC-TVConverter\tools\ffmpeg\ffmpeg.exe" -i "D:\Film\Manuel optagelse_TV3+ HD_2011_10_10_22_00_00.wtv.ts"
16-04-2012, 12:09:50: streamInfo: stream has no MPEG2 video
16-04-2012, 12:09:50: streamInfo: stream has no AAC LATM audio
16-04-2012, 12:09:50: streamInfo: stream has no E-AC3 audio
16-04-2012, 12:09:50: streamInfo: stream has AC3 audio
16-04-2012, 12:09:50: rename file to: "D:\Film\Manuel optagelse_TV3+ HD_2011_10_10_22_00_00.ts"
16-04-2012, 12:09:50: renameFile - old filename: "D:\Film\Manuel optagelse_TV3+ HD_2011_10_10_22_00_00.wtv.ts"
16-04-2012, 12:09:50: renameFile - new filename: "D:\Film\Manuel optagelse_TV3+ HD_2011_10_10_22_00_00.ts"
16-04-2012, 12:09:50: get orig file created date: 20120416114448
16-04-2012, 12:09:50: set converted file created date to: 20120416114448 - "D:\Film\Manuel optagelse_TV3+ HD_2011_10_10_22_00_00.ts"
16-04-2012, 12:09:50:
16-04-2012, 12:09:50: -------- conversion finished
It looks like it calls Comskip, but I don't see the actual run command I see in your log file. This would explain why no intermidiate files is generated. Are we missing a part of the setup here?
Rod, is your log file showing the same thing?
TLS
-
Ok. Did som more testing. The recording in the previous reply was from one of my HD channels. Below is output from MediaInfo.
Video
Format : AVC
Format/Info : Advanced Video Codec
Format profile : High@L4.0
Format settings, CABAC : Yes
Format settings, ReFrames : 4 frames
Width : 1 920 pixels
Height : 1 080 pixels
Display aspect ratio : 16:9
Frame rate : 25.000 fps
Color space : YUV
Chroma subsampling : 4:2:0
Bit depth : 8 bits
Scan type : MBAFF
Scan order : Top Field First
Color primaries : BT.709-5, BT.1361, IEC 61966-2-4, SMPTE RP177
Transfer characteristics : BT.709-5, BT.1361
Matrix coefficients : BT.709-5, BT.1361, IEC 61966-2-4 709, SMPTE RP177
After this I tried using MC-TVConverter on another recording from the samme channel but from when it was a SD channel. Below is the output from Mediainfo.
Video
Format : MPEG Video
Format version : Version 2
Format profile : Main@Main
Format settings, BVOP : Yes
Format settings, Matrix : Custom
Format settings, GOP : M=3, N=12
Bit rate mode : Variable
Maximum bit rate : 15.0 Mbps
Width : 720 pixels
Height : 576 pixels
Display aspect ratio : 16:9
Active Format Description : Full frame 16:9 image
Frame rate : 25.000 fps
Standard : PAL
Color space : YUV
Chroma subsampling : 4:2:0
Bit depth : 8 bits
Scan type : Interlaced
Scan order : Top Field First
Compression mode : Lossy
This time MC-TVConverter was succesful in generating the edl file, even with the "delete intermidiate file" enabled. So I wonder if the format in the wtv file is making the difference here? Will it not be able to seach for commercials when the format is AVC?
Although the edl file was generated and contains information it did not skip the commercial in the file when playing it back through MC, but this may be more relevant for another thread. I think I will play a little with "cut detected commercials" and see where that brings me.
TLS
-
Hi tls,
Thanks for doing all the testing. Looks like you are gathering some useful information. Very interesting your results between SD & HD.
No, my log file does not show it running Comskip at all.
Are you recording in MC17? I'm wondering about the wtv files that you have. Mine are all ts, although for some reason the log says "converting from jts to ts".
Rod
-
No, all my recordings are in wtv format from WMC. I did try running one of the wtv files converted to ts through MC-TVConverter again with the same result. Besides the AVC format in the files not generating an edl file, I can see that they also all contain an AC3 audio stream, so I cannot be absolutely sure which may be causing the problem if any of them.
TLS
-
I think that JustinChase's full procedure at the beginning of the thread might be needed when recording in WMC and playing back in MC. Not sure why though as I haven't looked that closely at it.
What I'm trying to do, and what he wrote the simplified procedure for is to do a ts recording in MC, have it create the edl file and then playback the ts file in MC.
Rod
-
I think we are trying to do the same thing, just with two different file formats. Justins simplified procedure does work on some of my wtv files. I end up with a ts file and an edl file with the same name. Exactly as it is suppoed to do.
I am just wondering if you could be running into the same problem as me, having some recordings not supported by Comskip? I assume that MC is recording the stream from your tv card just like WMC does, which could result if different content in you recordings depending on what the TV provider is sending.
We may need a expert on Comskip to offer a little clarification what it can and cannot do.
TLS
-
Ding, ding! You may have just rung a bell. In Sage Comskip runs on all recordings as best I can tell and with fairly good success. But I vaguely recall having to use the 'Donators Version' of comskip and I believe it's because our Tuner is an Hauppauge HDPVR. It's possible that the donators version allowed access to a beta and that whatever was in it is now in the regular version. But I'm wondering about the version used by MC-TVConverter? Have others used it successfully with the HDPVR or Colossus?
Yes I think it would be very helpful to have a Comskip expert pipe in here. At the moment there are 1185 views of this thread. Hopefully out of all the people following this thread someone knows Comskip well, or at least better than we do.
And if anyone else is testing this we'd sure appreciate your piping in here.
Rod
-
JustinChase,
Do you think it might be worthwhile to try to get the MC-TVConverter developer to look at, and hopfully participate in, this thread? If we can get this working it might bring in a lot more users of his program.
Rod
-
I think the AVC video file is the problem with the WTV recordings. I don't think any brodcasters in the US broadcast in AVC, so I've never run into this; but I could be wrong. However, the original procedure is what I would suggest you use for converting from WTV files (since it will convert TO a usable file type). That process can also be shortened, now that MC-TVConverter is out of beta, but it's still the "right" choice for this process, as it will give you commercial files that work with WTV, and also commercial files that work with MC. I will work on updating the full procedure soon, so it's less overwhelming.
I also just verified that Comskip can operate on 3 types of files. The first file type is an MPEG file. The extension must be mpg, mpeg (for mpeg Program Streams), ts (for mpeg Transport Streams) or dvr-ms for DVR-MS). Maximum resolution is 2000 by 1200 and the content must be MPEG2 video and MPEG2 or AC3 audio as recorded by most mpeg encoders.
Regarding the original issue, here is the response from the developer of MC-TVConverter to my post/question. I thought that nwboater reported that he did actually have commercials in his files, but maybe not...
If you look at the line above your marked ones, it states that it didn't find any commecials. I delete all created files in this case because there is no need for them. Or do you want to keep the files also if there are no commercials in the video? Of course you could select to keep the intermediate files in settings but then all other conversions and helper files will be kept too...
I will need to copy a network show with commercials to test again, but when testing on my desktop, over wifi, it takes a LONG time to copy the file, then to run the test, so I'll have to wait until I can use the HTPC, which is much faster, since it's an ethernet connection.
However, the point is that as long as there are actually commercials, this should work. Can you please try testing again with a file that definitely has commercials?
-
Thanks Justin
Comskip can operate on 3 types of files. The first file type is an MPEG file. The extension must be mpg, mpeg (for mpeg Program Streams), ts (for mpeg Transport Streams) or dvr-ms for DVR-MS). Maximum resolution is 2000 by 1200 and the content must be MPEG2 video and MPEG2 or AC3 audio as recorded by most mpeg encoders.
I was afraid of that. All my HD channels is recorded with an AVC stream, so for now I cannot use Comskip with those.
I did however confirm that Justins simplified procedure does work (even with wtv files) as long as the video stream inside the container is mpeg. That is good to know and means that I can use this procedure for all my SD channels. On top of that, I was introduced to an excellent little free converter for my wtv files.
Thanks guys! Let me know if I can help with anything going forward.
TLS
-
Good to hear! If you use the full/original procedure (without having to replace any of the files, as it's now unnecessary), it will convert the WTV files with the AVC video to either .ts or .mpg files, and comskip will run on the converted files, and you will get the edl file for the converted file AND a .xml file that Windows Media Center will use for the original WTV files. I've used it for months, and it's glorious. Any place I watch a recorded TV show I don't have to watch commercials.
The best news though, is that this seems to be working as designed. I guess nwboater is just trying on shows with no commercials, but we'll wait for their response, or for me to test later this evening.
Let me know if you have any trouble with the full procedure, and I'll do what I can to help :)
-
Sounds Good! I will definately try the full procedure then. Thanks again!
TLS
-
Great. Please let me know if you have any issues, or feedback on the "procedure" I wrote up.
As for the original 'it's not creating an edl file' situation; I came home for lunch, copied a show with commercials to my Desktop (using a thumb drive), ran the program, and it did create the .edl file, just as it should.
I suspect it's just shows with no commercials that threw us off. I will consider this 'resolved' now, until/unless I get feedback that there's still a problem.
Have fun!! :)
-
Justin - Sorry about the show with no commercials - didn't realize that was the case. I thought they were commercial channels. Yesterday was crazy - I was trying to sandwich the recordings between important stuff Sandra had set to record in Sage, writing a bunch of posts and .........
Anyway I just started two sequential half hour recordings of shows that I believe have commercials. I will certainly confirm that before posting here again. So in a couple of hours I should have some news here, hopefully of the good kind.
Thanks again for all your efforts. And very glad to know that it worked for you.
Rod
-
No worries, nothing to appoligize for. I know just what you mean by 'trying to work around someone else's important stuff' :)
I hope it works fine for you. The log file does say if commercials were found or not, so you may look there before posting, if you still have issues.
I'll try to amend the original/full procedure later this evening to make it easier to follow, and hopefully will get some more feedback :)
-
Okay I recorded two 1/2 hour shows: The first is Van Buren Boys and has commercials. The second Quake Me When It's Over doesn't have commercials but ended up being a cartoon so we may want to disregard it.
No edl files generated. I can see in the log when it said to find commercials, but I don't see anything saying it did or did not find them.
Justin, I wonder if it would be easier for you if I joined his Forum and posted my problem directly there? You don't need to spend your time as a middle man here. And it also wouldn't litter the JR Forum with all these logs and stuff.
Thanks again for all your help.
Rod
15/04/2012, 11:11:39 AM: --- PROGRAM STARTED ---16/04/2012, 11:01:56 AM: --- PROGRAM CLOSED ---
16/04/2012, 11:02:02 AM: --- PROGRAM STARTED ---
16/04/2012, 11:02:02 AM: check for java: user set dir "C:\Program Files\Java\jre6\bin\"
16/04/2012, 11:02:02 AM: showErrorOnJavaFault: 1
16/04/2012, 11:02:02 AM: outputDir: F:\MC TV Recordings Starting Apr 14 2012\Completed With Comskip From MC-TVConverter
16/04/2012, 11:02:02 AM: deleteIntermediateFile: 1
16/04/2012, 11:02:02 AM: showConverterProgress: 0
16/04/2012, 11:02:02 AM: ============================================================
16/04/2012, 11:02:02 AM: -------- watching folder started
16/04/2012, 11:02:02 AM: callFunc: "watchFolder"
16/04/2012, 11:02:02 AM: watching folder started for directory: "F:\MC TV Recordings Starting Apr 14 2012\"
16/04/2012, 11:05:18 AM: currentFile: F:\MC TV Recordings Starting Apr 14 2012\Hauppauge HD PVR Capture Device 2012-04-16 11-5\Hauppauge HD PVR Capture Device 2012-04-16 11-5.jts
16/04/2012, 11:05:18 AM: converting from jts to ts
16/04/2012, 11:05:18 AM: callFunc: "convert_jts2ts"
16/04/2012, 11:06:17 AM: currentFile: F:\MC TV Recordings Starting Apr 14 2012\The Van Buren Boys 2012-04-16\The Van Buren Boys 2012-04-16.jts
16/04/2012, 11:06:17 AM: converting from jts to ts
16/04/2012, 11:06:17 AM: callFunc: "convert_jts2ts"
16/04/2012, 11:31:07 AM: currentFile: F:\MC TV Recordings Starting Apr 14 2012\The Van Buren Boys 2012-04-16.ts
16/04/2012, 11:31:07 AM: converting from ts to ts
16/04/2012, 11:31:07 AM: callFunc: "convert_ts2ts"
16/04/2012, 11:31:07 AM: callFunc: "checkStream"
16/04/2012, 11:31:07 AM: run (get streamInfo): "C:\Program Files\MC-TVConverter\tools\ffmpeg\ffmpeg.exe" -i "F:\MC TV Recordings Starting Apr 14 2012\The Van Buren Boys 2012-04-16.ts"
16/04/2012, 11:31:09 AM: streamInfo: stream has no MPEG2 video
16/04/2012, 11:31:09 AM: streamInfo: stream has no AAC LATM audio
16/04/2012, 11:31:09 AM: streamInfo: stream has no E-AC3 audio
16/04/2012, 11:31:09 AM: streamInfo: stream has AC3 audio
16/04/2012, 11:31:09 AM: callFunc: "convertTo_tsmuxer"
16/04/2012, 11:31:09 AM: run: "C:\Program Files\MC-TVConverter\tools\tsmuxer\tsMuxerEasyCMD.exe" i="F:\MC TV Recordings Starting Apr 14 2012\The Van Buren Boys 2012-04-16.ts" o="F:\MC TV Recordings Starting Apr 14 2012\Completed With Comskip From MC-TVConverter\The Van Buren Boys 2012-04-16.ts.ts" m="F:\MC TV Recordings Starting Apr 14 2012\Completed With Comskip From MC-TVConverter\The Van Buren Boys 2012-04-16.ts.meta" mdel=y
16/04/2012, 11:32:50 AM: ---- file successfully converted: "F:\MC TV Recordings Starting Apr 14 2012\Completed With Comskip From MC-TVConverter\The Van Buren Boys 2012-04-16.ts.ts"
16/04/2012, 11:32:50 AM: callFunc: "findCommercials"
16/04/2012, 11:32:50 AM: callFunc: "checkStream"
16/04/2012, 11:32:50 AM: run (get streamInfo): "C:\Program Files\MC-TVConverter\tools\ffmpeg\ffmpeg.exe" -i "F:\MC TV Recordings Starting Apr 14 2012\Completed With Comskip From MC-TVConverter\The Van Buren Boys 2012-04-16.ts.ts"
16/04/2012, 11:32:51 AM: streamInfo: stream has no MPEG2 video
16/04/2012, 11:32:51 AM: streamInfo: stream has no AAC LATM audio
16/04/2012, 11:32:51 AM: streamInfo: stream has no E-AC3 audio
16/04/2012, 11:32:51 AM: streamInfo: stream has AC3 audio
16/04/2012, 11:32:51 AM: rename file to: "F:\MC TV Recordings Starting Apr 14 2012\Completed With Comskip From MC-TVConverter\The Van Buren Boys 2012-04-16.ts"
16/04/2012, 11:32:51 AM: renameFile - old filename: "F:\MC TV Recordings Starting Apr 14 2012\Completed With Comskip From MC-TVConverter\The Van Buren Boys 2012-04-16.ts.ts"
16/04/2012, 11:32:51 AM: renameFile - new filename: "F:\MC TV Recordings Starting Apr 14 2012\Completed With Comskip From MC-TVConverter\The Van Buren Boys 2012-04-16.ts"
16/04/2012, 11:32:51 AM: get orig file created date: 20120416110618
16/04/2012, 11:32:51 AM: set converted file created date to: 20120416110618 - "F:\MC TV Recordings Starting Apr 14 2012\Completed With Comskip From MC-TVConverter\The Van Buren Boys 2012-04-16.ts"
16/04/2012, 11:32:51 AM: move original file: "F:\MC TV Recordings Starting Apr 14 2012\The Van Buren Boys 2012-04-16.ts" - to - "F:\MC TV Recordings Starting Apr 14 2012\Completed With Comskip From MC-TVConverter\The Van Buren Boys 2012-04-16.ts"
16/04/2012, 11:32:51 AM: can't move original file to target - file already exists
16/04/2012, 11:32:51 AM:
16/04/2012, 11:34:01 AM: currentFile: F:\MC TV Recordings Starting Apr 14 2012\Quake Me When It's Over 2012-04-16\Quake Me When It's Over 2012-04-16.jts
16/04/2012, 11:34:01 AM: converting from jts to ts
16/04/2012, 11:34:01 AM: callFunc: "convert_jts2ts"
16/04/2012, 12:01:04 PM: currentFile: F:\MC TV Recordings Starting Apr 14 2012\Quake Me When It's Over 2012-04-16.ts
16/04/2012, 12:01:05 PM: converting from ts to ts
16/04/2012, 12:01:05 PM: callFunc: "convert_ts2ts"
16/04/2012, 12:01:05 PM: callFunc: "checkStream"
16/04/2012, 12:01:05 PM: run (get streamInfo): "C:\Program Files\MC-TVConverter\tools\ffmpeg\ffmpeg.exe" -i "F:\MC TV Recordings Starting Apr 14 2012\Quake Me When It's Over 2012-04-16.ts"
16/04/2012, 12:01:06 PM: streamInfo: stream has no MPEG2 video
16/04/2012, 12:01:06 PM: streamInfo: stream has no AAC LATM audio
16/04/2012, 12:01:06 PM: streamInfo: stream has no E-AC3 audio
16/04/2012, 12:01:06 PM: streamInfo: stream has AC3 audio
16/04/2012, 12:01:06 PM: callFunc: "convertTo_tsmuxer"
16/04/2012, 12:01:06 PM: run: "C:\Program Files\MC-TVConverter\tools\tsmuxer\tsMuxerEasyCMD.exe" i="F:\MC TV Recordings Starting Apr 14 2012\Quake Me When It's Over 2012-04-16.ts" o="F:\MC TV Recordings Starting Apr 14 2012\Completed With Comskip From MC-TVConverter\Quake Me When It's Over 2012-04-16.ts.ts" m="F:\MC TV Recordings Starting Apr 14 2012\Completed With Comskip From MC-TVConverter\Quake Me When It's Over 2012-04-16.ts.meta" mdel=y
16/04/2012, 12:01:17 PM: ---- ERROR in conversion: filesize is 0 bytes
16/04/2012, 12:01:17 PM: callFunc: "findCommercials"
16/04/2012, 12:01:17 PM: callFunc: "checkStream"
16/04/2012, 12:01:17 PM: run (get streamInfo): "C:\Program Files\MC-TVConverter\tools\ffmpeg\ffmpeg.exe" -i "F:\MC TV Recordings Starting Apr 14 2012\Completed With Comskip From MC-TVConverter\Quake Me When It's Over 2012-04-16.ts.ts"
16/04/2012, 12:01:18 PM: streamInfo: stream has no MPEG2 video
16/04/2012, 12:01:18 PM: streamInfo: stream has no AAC LATM audio
16/04/2012, 12:01:18 PM: streamInfo: stream has no E-AC3 audio
16/04/2012, 12:01:18 PM: streamInfo: stream has no AC3 audio
16/04/2012, 12:01:18 PM: rename file to: "F:\MC TV Recordings Starting Apr 14 2012\Completed With Comskip From MC-TVConverter\Quake Me When It's Over 2012-04-16.ts"
16/04/2012, 12:01:18 PM: renameFile - old filename: "F:\MC TV Recordings Starting Apr 14 2012\Completed With Comskip From MC-TVConverter\Quake Me When It's Over 2012-04-16.ts.ts"
16/04/2012, 12:01:18 PM: renameFile - new filename: "F:\MC TV Recordings Starting Apr 14 2012\Completed With Comskip From MC-TVConverter\Quake Me When It's Over 2012-04-16.ts"
16/04/2012, 12:01:18 PM: get orig file created date: 20120416113300
16/04/2012, 12:01:18 PM: set converted file created date to: 20120416113300 - "F:\MC TV Recordings Starting Apr 14 2012\Completed With Comskip From MC-TVConverter\Quake Me When It's Over 2012-04-16.ts"
16/04/2012, 12:01:18 PM:
16/04/2012, 12:54:58 PM: set watchFolder to false during wait loop
16/04/2012, 12:54:58 PM: -------- watching folder stopped
-
I'm not sure, but I suspect you're having the same issue as tls62dk, which is that the 'converted' file is still not in a format that comskip recognizes. From your log...
16/04/2012, 11:31:09 AM: streamInfo: stream has no MPEG2 video
I suspect that if you check the MediaInfo, you'll find the video stream is AVC, which comskip doesn't recognize. Maybe not, since I think you're recording it with JRiver, but I'm not sure what codecs it writes when recording. The conversion should have converted this to a format that comskip recognizes, but maybe that's not happening properly. tls62dk was recording with WMC, which is different than your situation.
I also see that you're trying to either move or rename the file, which should not be necessary.
16/04/2012, 11:32:51 AM: can't move original file to target - file already exists
I know that I suggested you try this yesterday, but now that I know it should work, I don't think this is necessary, and I'd suggest you go back to what you originally tried, which was just to leave the file alone, and convert and process in place.
I linked earlier to the other forum where I reported the issue, and where he responded (here it is again)
http://mctvconverter.userboard.org/tvconverter-english-discussion-f7/tvconverter-deleting-the-edl-files-but-shouldn-t15.html
If you want to register there, and ask for help from there, it might be faster and easier, since he knows better than I what is or is not supposed to happen. However, I'm still happy to continue trying to help, as it will benefit others once we find the solution to your issues. Obviously, others are/will have similar issues.
Once it's all resolved, I'll probalby just create a new post with just the shortened instructions, just to keep it clean. Maybe I'll add it to the Wiki, if I can figure out how to include photos, or just with instructions, and point back to this thread for more detail. We'll see.
-
Justin - Sorry about the show with no commercials - didn't realize that was the case. I thought they were commercial channels. Yesterday was crazy - I was trying to sandwich the recordings between important stuff Sandra had set to record in Sage, writing a bunch of posts and .........
Anyway I just started two sequential half hour recordings of shows that I believe have commercials. I will certainly confirm that before posting here again. So in a couple of hours I should have some news here, hopefully of the good kind.
Thanks again for all your efforts. And very glad to know that it worked for you.
Rod
Justin I just looked closer at your post on the MC-TVConverter forum. The Show with no commercials is "Windsor Arrow Back Chairs" which is not one of mine. Is it your show?
Rod
-
yes. it's the one I was testing, that doesn't have any commercials.
-
I'm not sure, but I suspect you're having the same issue as tls62dk, which is that the 'converted' file is still not in a format that comskip recognizes. From your log...
16/04/2012, 11:31:09 AM: streamInfo: stream has no MPEG2 video
I suspect that if you check the MediaInfo, you'll find the video stream is AVC, which comskip doesn't recognize. Maybe not, since I think you're recording it with JRiver, but I'm not sure what codecs it writes when recording. The conversion should have converted this to a format that comskip recognizes, but maybe that's not happening properly. tls62dk was recording with WMC, which is different than your situation.
I also see that you're trying to either move or rename the file, which should not be necessary.
16/04/2012, 11:32:51 AM: can't move original file to target - file already exists
I know that I suggested you try this yesterday, but now that I know it should work, I don't think this is necessary, and I'd suggest you go back to what you originally tried, which was just to leave the file alone, and convert and process in place.
I linked earlier to the other forum where I reported the issue, and where he responded (here it is again)
http://mctvconverter.userboard.org/tvconverter-english-discussion-f7/tvconverter-deleting-the-edl-files-but-shouldn-t15.html
If you want to register there, and ask for help from there, it might be faster and easier, since he knows better than I what is or is not supposed to happen. However, I'm still happy to continue trying to help, as it will benefit others once we find the solution to your issues. Obviously, others are/will have similar issues.
Once it's all resolved, I'll probalby just create a new post with just the shortened instructions, just to keep it clean. Maybe I'll add it to the Wiki, if I can figure out how to include photos, or just with instructions, and point back to this thread for more detail. We'll see.
Justin - Thanks for all the explanations.
I just checked the file with Media Info and sure enough the Video is AVC. Actually it says that it's an MPEG-TS with one AVC video stream and one AC3 audio stream. So that AVC may just be the problem.
In Sage, which has Comskip working fine for me it records it as an h.264 file. You need the Donators Version of Comskip to work on the h.264 files and that's what I have.
I'm going to hold off for a bit posting on the MC-TVConverter Forum. I think we should first try to get our ducks in order here to see how to best approach this for everyone involved.
It really looks like the AVC is the problem.
Since "Comskip can operate on 3 types of files. The first file type is an MPEG file. The extension must be mpg, mpeg (for mpeg Program Streams), ts (for mpeg Transport Streams) or dvr-ms for DVR-MS). Maximum resolution is 2000 by 1200 and the content must be MPEG2 video and MPEG2 or AC3 audio as recorded by most mpeg encoders."
What I'm reading into the above is that although what I have is ts (for mpeg Transport Streams), I don't have MPEG2 Video but instead have AVC.
It then seems that we need to either:
1. See if JRiver can record in MPEG2 or h.264 (as SageTV does,).
Or
2. Se if MC-TVConverter can convert from AVC to MPEG2.
I would certainly prefer 1 because it would avoid a big video conversion job for each recording that takes time and possibly could affect the video quality (?). The only difficulty might be (other than for JRiver) is that if it's an h.264 file the Donators Version of Comskip would be required inside MC-TVConverter.
Rod
-
It really looks like the AVC is the problem.
It then seems that we need to either:
1. See if JRiver can record in MPEG2 or h.264 (as SageTV does,).
I agree, and would suggest/hope that mpeg2 be the preferred solution, since it doesn't require the paid Comskip.
Or
2. See if MC-TVConverter can convert from AVC to MPEG2.
I would certainly prefer 1 because it would avoid a big video conversion job for each recording that takes time and possibly could affect the video quality
I think this conversion is possible, but as you say, it would be another encode, which would ideally be avoided. MC-TVConverter does have an option to use an alternative (ffmpeg) for conversion, in case you need this.
I don't have any files with AVC video, so I can't test; sorry :(
If you find/create any other recordings that are not AVC video, and have commercials, you can/should test them, just to make sure that the process is working for you, when given the "right" input files. I'm sure it will :)
Sorry it doesn't work for you; yet :(
-
Justin,
You deserve a lot of credit for taking this on and sticking with it. Thank you.
Jim
-
Well earlier I almost said that I know just enough about formats and this terminology to be dangerous. So now I will. I am!
I just found out that AVC and h.264 are basically the same thing. Here's from Wikipedia:
"H.264/MPEG-4 Part 10 or AVC (Advanced Video Coding) is a standard for video compression, and is currently one of the most commonly used formats for the recording, compression, and distribution of high definition video. The final drafting work on the first version of the standard was completed in May 2003.
"H.264/MPEG-4 AVC is a block-oriented motion-compensation-based codec standard developed by the ITU-T Video Coding Experts Group (VCEG) together with the International Organization for Standardization (ISO)/International Electrotechnical Commission (IEC) joint working group, the Moving Picture Experts Group (MPEG). The product of this partnership effort is known as the Joint Video Team (JVT). The ITU-T H.264 standard and the ISO/IEC MPEG-4 AVC standard (formally, ISO/IEC 14496-10 – MPEG-4 Part 10, Advanced Video Coding) are jointly maintained so that they have identical technical content.
H.264 is perhaps best known as being one of the codec standards for Blu-ray Discs; all Blu-ray Disc players must be able to decode H.264. It is also widely used by streaming internet sources, such as videos from Vimeo, YouTube, and the iTunes Store, web software such as the Adobe Flash Player and Microsoft Silverlight, and also various HDTV broadcasts over terrestrial (ATSC, SBTVD, DVB-T or DVB-T2), cable (DVB-C) and satellite (DVB-S and DVB-S2)."
So the problem comes down to what I mentioned earlier: For Comskip to work with h.264/AVC the 'Donators Version' of Comskip has to be used. I'm pretty sure that is not what MC-TVConverter is using. And I don't know how he could include that for free with his program since the Comskip developer wants a 'Donation' for it.
But possibly he could make a 'Call' to an external Donators Version of Comskip that people like me would have installed on our PC after we make our Donation. That's basically how it presently works with SageTV.
Added on Edit: I forgot to mention that I used Media Info to check SageTV Recordings. They show the exact same info as the ones recorded in MC17. And again, the edl files are being created in Sage because I have the Donators version on Comskip.
Thoughts?
Rod
-
You could try renaming AVC to MPG or similar. Something like that might work.
-
You could try renaming AVC to MPG or similar. Something like that might work.
Thanks for the idea Jim, but not sure how we could do it. The file name that MC, Comskip, etc sees has the extension .ts. I believe that ts (Transport Stream) is a 'Container' kind of like mkv is. So we could change that file extension (but don't want to) but I don't see how we could get access to change the name of the codec (AVC) which is inside the Container like AC3 for the audio is. Also I wonder if it wouldn't mess up something else that needs to know what actual codec is being used.
Rod
-
Justin,
You deserve a lot of credit for taking this on and sticking with it. Thank you.
Jim
Thanks Jim. I'm just trying to pay back some of the help I've received over the years. :)
...For Comskip to work with h.264/AVC the 'Donators Version' of Comskip has to be used. I'm pretty sure that is not what MC-TVConverter is using. And I don't know how he could include that for free with his program since the Comskip developer wants a 'Donation' for it.
But possibly he could make a 'Call' to an external Donators Version of Comskip that people like me would have installed on our PC after we make our Donation. That's basically how it presently works with SageTV.
Added on Edit: I forgot to mention that I used Media Info to check SageTV Recordings. They show the exact same info as the ones recorded in MC17. And again, the edl files are being created in Sage because I have the Donators version on Comskip.
Well, that's good news, I think. The fact that it works with SageTV means that it should work for us too.
Now, I'm not sure how the Donators version works yet (I need to donate myself soon, so I'll find out), but I imagine you either get a special comskip.exe, or some kind of key. Either way, I suspect that you could copy it/them to the location that MC-TVConverter calls to launch comskip, which is located at C:\Program Files (x86)\MC-TVConverter\tools\comskip, shown here...
(http://www.pix01.com/gallery/B6318F5F-4769-4385-B3CA-EE27B9BD15F9/Commercial_Skipping/376072608_orig0.jpg)
That image highlights the comskip.ini, but they are all in the same folder. I would try replacing those versions with your Donator version(s) and try again. I'm guessing that will work. If not, let me know and I'll look into it.
I'm going to donate now, so I should know more about how it works soon, and will report back if I see an obvious error/change to what I just wrote.
FYI, I believe the donate version of comskip also reads wtv files directly now; for anyone interested it that.
-
Yep, it looks like it's just a newer/updated comskip.exe, based on his site...
Comskip Early Access
After donating 10$ or more you will receive a personalized access code to the Comskip Early Access download area where bugfixes and improvements will be first available. The Comskip version available in the Early Access download area is able to process HD MPEG2 recordings at double speed, Decode h.264 and WTV. Sending the access code for the early access area is a manual process,be patient.
I'm currently using version 80.042, which I believe is the most recent "public" version. I expect I'll get my access code in the next few days, but I don't have any files with AVC/h.264 to test with, so let me know if you still have problems.
I'll probably write up the new procedure tomorrow, and now I know to make notes about all this for others :)
-
Hi Justin
I had the same thought as you, so I will also sign up for the paid version and try it on my wtv files with tha AVC stream.
I will report back here when I have done some testing.
TLS
-
Thanks Justin for your suggestion of trying to use the donators version within MC-TVConverter. I'll try it out later and post the results. Hopefully everything of Comskip is within the Comskip folder and that it doesn't have stuff in the Registry or anywhere else that may be different in the two versions. Will be great if it works.
Rod
-
I just got my link to the donators version, and it's basically the same as the public release, just newer/updated. Another benefit is that it's supposed to run twice as fast, which will be very nice!
I'm now pretty sure that just copying everything in that zip file to the location I mentioned above will work fine.
-
Justin- Hate to rain on our parade, but.......
I installed the donators version of comskip in place of the regular one. Ran a half hour show that has commercials and no edl file generated.
I think the problem now is that MC-TVConverter says in it's log file "streamInfo: stream has no MPEG2 video". So without that I don' think it's running comskip. I believe it's looking for a format that it thinks is acceptable to comskip and doesn't know that I have the Donators Version installed.
If my take on it it valid I think there could be two fixes, both requiring program mods by the developer.
1. He adds AVC as acceptable to start Comskip. We replace his version of Comskip with the Donators Version as I just did for the test. A lot more people could use it and way less chance of messing up his program.
OR
2. We purchase the donators version and install it in a separate Comskip Folder. (This is what we do for Sage) He has a setup checkbox that allows for an entry stating that we have the Comskip Donators Version. When the program starts it sends a call to the donators version of comskip.
I like #2 because the techie level required to implement is much less. Also no messing with his program files.
Rod
-
That stinks! I didn't think of that :(
I have posted a new reqeust to their forum, at the link above. I'm copying it here, in case you wish to add anything to it there...
I was able to do some more testing, and can confirm that it is working, as long as there are commercials in the file. I still think it might be better to create/keep the edl file even if blank, just so a user knows that it ran comskip, but it's not a big deal, so I'm not too worried about it, if you don't want to bother making the change
Unfortunately, that was only one of the issues the user has run into. He lives in a country that broadcasts TV with the AVC/h.264 video codec, which the "regular" version of Comskip cannot process. However, the Donator version of Comskip is able to process these files. I suggested they put the donator version in the tools\comskip folder that you use, but it still didn't work. I see from the log that you are checking for mpeg video, and apparently not running comskip if there is no mpeg video. This certainly makes sense, but is causing the videos to not be processed.
Is there any way you can allow the user to use the Donator version if they have it? Either by allowing a custom path to Comskip, or by you not making this check for mpeg video, and just letting Comskip fail if it's unable to process the file? Or maybe with some other solution I'm not thinking of?
Thanks again for all your prompt help with issues, I really appreciate it!
-
That stinks! I didn't think of that :(
I have posted a new reqeust to their forum, at the link above. I'm copying it here, in case you wish to add anything to it there...
I just registered for their Forum and made this post:
Hi,
I'm the "User" that JustinChase was talking about in his last post. I would like to clarify the issue a bit.
I live in Canada, but I don't believe that the Cable broadcast we receive are AVC files. The issue arises because we use an Hauppauge HDPVR 'Tuner'. It is the one that puts out the files in AVC/h.264 for the video. I believe the Hauppauge Collosus would do the same. Both are popular tuners.
I have been using SageTV for several years and am now trying to switch to JRiver Media Center 17. Comskip has been working fine in SageTV but to use it with the HDPVR one has to have the Donators Version of comskip. It is installed in a separate Comskip folder in Program files. The Comskip 'Detector' plugin for Sage uses that version of Comskip.
So if there would be a way to use the Donators Version of Comskip with your program we could then be commerical free in JRiver MC. That would be wonderful!
And speaking of wonderful your program is. Thanks very much for creating it and sharing it.
Best Regards,
Rod
I'll look forward to his response.
Rod
-
Not good news. Here is the response from the developer of MC-TVConverter:
"Hi and welcome!
I'm glad the GUI is of help for you!
Unfortunately I currently don't have plans to include the possibility to use the donation version of comskip. It would mean to much changes in the code - indeed I would have to change all profiles which is the most time consuming part in development.
Anyhow, I collect all user requests and if I feel the app is stable enough and has all basic features working fine (currently I rework audio processing), I will concentrate on these additional features. So, don't expect it too soon, but not all hope ist lost... ;)
PS: the next version will also process h264 encoded streams with comskip but will convert it to mpeg2 first - so, it will work, but it will have disadvantages."
So looks like those of us that have 'Tuners' that output high quality AVC/h.264 are out of luck for now trying to use Comskip with MC17.
I have no idea how difficult the process might be to do some kind of script that would start Comskip (donators version) and tell it where to put it's edl file. Off the top of my uninformed head it wouldn't seem that difficult for someone who knows scripting. Or is this perhaps something that Babgvant could do with his DVRMSToolbox?
Rod
-
I may have found a solution for running Comskip on AVC/h.264 files as well as regular MPEG2 files. There is a small program called Comskip Monitor. It was written by a person on the SageTV Forum and it was intended to work with Sage. However it's completely separate from Sage. It monitors a folder for the appropriate video file and when one is found it starts Comskip.
The Donators Version of Comskip is required to work with the AVC/h.264 files. I just installed it over the Comskip program files that come with Comskip Monitor.
I just had it create an edl file for a program recorded in Media Center. Hurah!!!
The program is available on the SageTV Forum at http://forums.sagetv.com/forums/showthread.php?t=20358&highlight=comskip+monitor The Download link is at the bottom of the first post. On the Download page are also the installation instructions.
I had to do a bit of stuff to get it going and am not finished. For some reason it wouldn't start Comskip when I told it the folder the files are in. But when I pointed it to the file it worked.
I plan on spending more time on this in the next day or two and hope to be able to do a write-up on it. I'm just posting this now to let people know there is some hope, and for those so inclined to go ahead and experiment with it.
Rod
-
Not good news. Here is the response from the developer of MC-TVConverter:
So looks like those of us that have 'Tuners' that output high quality AVC/h.264 are out of luck for now trying to use Comskip with MC17.
I have no idea how difficult the process might be to do some kind of script that would start Comskip (donators version) and tell it where to put it's edl file. Off the top of my uninformed head it wouldn't seem that difficult for someone who knows scripting. Or is this perhaps something that Babgvant could do with his DVRMSToolbox?
I believe he started the thread about top 20 scripting ideas here on the main board. Yep, here it is...
http://yabb.jriver.com/interact/index.php?topic=71482.0
For what you're wanting to do, I have to imagine it would be pretty easy for a script to just call comskip.exe. I just don't have any knowledge of how to do it. I believe all the settings you need can be set in the comskip.ini.
In fact, MC-TVConverter is probably not the right tool to use anyway. It was designed to convert from wtv to something else, and call other programs to do other types of conversion; none of which you need. You ONLY need to start comskip when TV is done recording. I'm sure there are other/better/easier ways to do just that 1 action.
I see a file called PostProcessing.bat, which one can use to call different profiles for different channels (which I need to set up one day!), and i remember seeing something about how to use it, but don't remember the details.
One thing I did find while looking I wanted to being to your attention though...
WARNING: When processing h.264 you may have to set volume_slip=150 if no or little commercials are found
I may have found a solution for running Comskip on AVC/h.264 files as well as regular MPEG2 files. There is a small program called Comskip Monitor.
I had to do a bit of stuff to get it going and am not finished. For some reason it wouldn't start Comskip when I told it the folder the files are in. But when I pointed it to the file it worked.
Sounds promising! I know the time it takes to get it working just right ;)
I plan on spending more time on this in the next day or two and hope to be able to do a write-up on it. I'm just posting this now to let people know there is some hope, and for those so inclined to go ahead and experiment with it.
good luck :D
-
I believe he started the thread about top 20 scripting ideas here on the main board. Yep, here it is...
http://yabb.jriver.com/interact/index.php?topic=71482.0
For what you're wanting to do, I have to imagine it would be pretty easy for a script to just call comskip.exe. I just don't have any knowledge of how to do it. I believe all the settings you need can be set in the comskip.ini.
I made a post early in that thread about Comskip and was hoping he might bite - but........
One thing I did find while looking I wanted to being to your attention though...
WARNING: When processing h.264 you may have to set volume_slip=150 if no or little commercials are found
good luck :D
Thanks for that setting. I'll experiment with it later.
Well I finally have Comskip generating the .edl files for my HDPVR files recorded in MC17. I was about to make a post here explaining how to do it but thought I best run one or two of the programs in MC to confirm they actually skip. They don't! No idea what's wrong at this point since I'm using the same Donators Version of Comskip that is working so well in Sage. I will check into the volume_slip=150 setting.
I'll keep working on this - just wanted to post that I hadn't forgotten about it.
Rod
-
Well I finally have Comskip generating the .edl files for my HDPVR files recorded in MC17. I was about to make a post here explaining how to do it but thought I best run one or two of the programs in MC to confirm they actually skip. They don't! No idea what's wrong at this point since I'm using the same Donators Version of Comskip that is working so well in Sage. I will check into the volume_slip=150 setting.
You can open the .edl file with Notepad++ and it will be a simple list of time codes. You should be able to tell if they look like they would skip commercials, or if they are short skips, or none.
I suspect the setting above might help, but that's a guess.
Also, the edl files must have the EXACT name as the show, other than .edl, or it wont work.
good luck :)
-
JustinChase,
Thanks for the tips. It was actually skipping commercials, just not all of them. I finally compared a program recorded in MC17 that used my new procedure to generate the edl file to one that SageTV had recorded. The results were very similar.
I have started a new thread for those that may want to try using Comskip on AVC/h.264 MPEG4 recordings. It is located here http://yabb.jriver.com/interact/index.php?topic=71634.0
Thanks again for all your good help JustinChase.
Rod