Print

Please login or register.
1 Hour 1 Day 1 Week 1 Month Forever
Login with username, password and session length

[jmone]

 

FYI - reuploaded the test build using "-f null dummy"

[jmone]

....could not help myself and I tried a whole bunch of various seeking methods but they all produced odd results on different files (or no results at all).  So I've reuploaded a build that starts at the beginning of the file and runs till the 30sec mark (instead of 4 sec) before taking the values.  Seems to work for me but I've a couple of ideas:
1) Let users select how long to scan the files in Seconds
2) Instead of just taking the values at the end of the scan time, take the MAX width / height? (but this could be odd if there is a mix of letterbox and pillar box) - not sure about this one....

I figure at the 30sec mark we should be past any intros on most videos.  Even if it hits a 80/20 rule it should be OK.  You can always change the values for any "odd" results manually in MC.

I also removed the "crop=" text so it is just the 4 values.

Anyway, have a play with the new test build and see how it works.

[JimH]

You're coming up on the 5 year mark for SWOT.  Congratulations!  Impressive!

[jmone]

  - Impressive is staring with Wood Stoves!  How long as it been?

[JimH]

Keystone Construction began in 1970.

Ironwood Stove Co. began in 1976.

James River Group began in 1981.

Name changed to J.  River about 1993.

Name changed to JRiver about 2010.

Acquired by SOT in 2025.

[lepa]

Code: [Select]

ffmpeg -ss 300 -i "input.mkv" -t 15 -vf cropdetect -f null -Giving a little more input data (like 15 seconds) seems to give me reasonable results even with starting from 5 min timestamp. Making same kind of analysis  starting from different timestamps would probably give even more assurance that cropping value is indeed reliable.

[HTPC Videophile]

Hi Jmone can you update your mediainfo tool to handle this : https://yabb.jriver.com/interact/index.php/topic,129459.0.html

[lepa]

For Matroska at least there is Audio Track Count field under General section of MediaInfo which can be read if MediaInfo is executed with parameter which shows all the fields.

I don't know the purpose of Number of tracks field but you can get number of audio tracks also by creating e.g. library fields
[Audio Track IDs] = string, populated by SoT
[Audio Track Count] = calculate field: rule ListCount([Audio Track IDs])

Configure SoT MediaInfo:
Enter the Field MC to Update: Audio Track IDs
Enter MediaInfo Data Field to  collect: ID
Enter MediaInfo Section to restrict to: Audio

[jmone]

Code: [Select]

ffmpeg -ss 300 -i "input.mkv" -t 15 -vf cropdetect -f null -Giving a little more input data (like 15 seconds) seems to give me reasonable results even with starting from 5 min timestamp. Making same kind of analysis  starting from different timestamps would probably give even more assurance that cropping value is indeed reliable.

Oh dear.... it was me.     I was running -ss over my test files..... but many of them are very short = getting either 0 or negative values

Anyway, I've updated the build with -ss 300 and -t 5 and it seems to work well (on files that are longer than 6min anyway!)

I'll need to add some logic for short files (say under 10min) then just run from the start, but for now the updated build is in the same post https://yabb.jriver.com/interact/index.php/topic,106802.msg898333.html#msg898333

[HTPC Videophile]

For Matroska at least there is Audio Track Count field under General section of MediaInfo which can be read if MediaInfo is executed with parameter which shows all the fields.

I don't know the purpose of Number of tracks field but you can get number of audio tracks also by creating e.g. library fields
[Audio Track IDs] = string, populated by SoT
[Audio Track Count] = calculate field: rule ListCount([Audio Track IDs])

Configure SoT MediaInfo:
Enter the Field MC to Update: Audio Track IDs
Enter MediaInfo Data Field to  collect: ID
Enter MediaInfo Section to restrict to: Audio

Thanks Lepa for ur elaborate tips. i will try that and report back.

[jmone]

Test Build: 17 May 2021 Build 2 - More tuning of the Crop Detect (Using a single run of "ffmpeg.exe -ss 120 -i "%MC_FileNameExt%" -t 10 -vf cropdetect -f null dummy")
- Should work on Files, DVD, and Bluray (largest VOB and M2TS respectivly)
- Will not work (or give odd results) if the video is under a few minutes in length (will address later)
- You will need to run SOT --> Configuration --> Save Configuration and it will add a new Field called "Crop"
- Run SOT --> MediaInfo and it will download a copy of FFmpeg and then it will run over the selected files
- At this stage there is no way to "turn it off" so it will run regardless if you want that data or not

Let me know how this build goes, but it seems to work pretty well over 100+ files so far and is pretty quick.  I'm interested in what % of readings look wrong (trying to avoid the time penalty of do multiple measurements on one file).

NOTE: If the ffmpeg build is not downloading and extracting correctly into your [SOT]\ffmpeg folder (blocked by Windows Defender etc), then you can just download the this ffmpeg build manually and extract it to the [SOT Folder]\ffmpeg folder.

[jmone]

Keystone Construction began in 1970.

Ironwood Stove Co. began in 1976.

James River Group began in 1981.

Name changed to J.  River about 1993.

Name changed to JRiver about 2010.

Retired SOT in 2025 as MC32 does it all!

There... Fixed it!

[zybex]

Fortunately the forum's autocorrect is not too smart, or it would look like:

JRiver began in 1970.
JRiver began in 1976.
JRiver began in 1981.
Name changed to JRiver about 1993.
Name changed to JRiver about 2010.
Acquired by [warning! mentioning competitor products is not allowed and may get you banned!] in 2025.

[lepa]

new crop detect seem to work very nicely! 
for short set of test files I was getting close enough values to be able to set correct aspect ratio icon

[lello]

And to put it into practice, what needs to be done? How should I set SOT so that the correct value appears in the "aspect ratio calculated" tag?

[lello]

Ok, I was able to use SOT. He created the "crop" tag for me and the data of the selected file appears there.

I wanted this data to appear in the Aspect Ratio tag, but I couldn't - is this normal?

But even if I succeeded, the fact that it appears to me, for example, 3840: 1600: 0: 280 is not good as it should only be the first 2 and also it should be 1620 and not 1600: is that what you were talking about?

[jmone]

I'm just storing the data as it is reported from ffmpeg into the "crop" field.  Lepa is then using that data to make a "calculated" MC Field with the aspect ratio.  I'm no expert on how to do this in MC, though it looks like lepa may be able to help.

[lepa]

Code: [Select]

Save(If(And(Compare(ListItem([Dimensions],0,/ x/ ),=,ListItem([Crop],0,:)),Compare(ListItem([Dimensions],1,/ x/ ),=,ListItem([Crop],1,:)),Compare(ListItem([Crop],2,:),=,0),Compare(ListItem([Crop],3,:),=,0)),0,1),v_IsCropped)/

Save(Replace(Math(ListItem([Aspect Ratio],0,:) / ListItem([Aspect Ratio],1,:)),/,,.), v_ARDecimal)/
Save(Math((ListItem([Crop],0,:) / [v_ARDecimal]) / (ListItem([Crop],1,:) / [v_ARDecimal])),v_ARCalculated)/

If([v_IsCropped]/
    ,Save(Replace(Math(ListItem([Aspect Ratio],0,:) / ListItem([Aspect Ratio],1,:)),/,,.), v_ARDecimal)/
     Save(Math((ListItem([Crop],0,:) / [v_ARDecimal]) / (ListItem([Crop],1,:) / [v_ARDecimal])),v_ARCalculated)/
    ,Save(Replace(Math(Replace([Aspect Ratio],:,//)),/,,.),v_ARCalculated)/
)/

IfCase([v_ARCalculated], 3, 1, empty, 1.38, 1.33, 1.69, 1.66, 1.80, 1.78, 1.88, 1.85, 2.37, 2.35, 2.45, 2.39)Haven't check the math from anywhere so probably not right but anyway this is what I'm using. If there is no cropping then just use Aspect Ratio got from MediaInfo, otherwise try to calculate it.

@jmone: If you could add configuration for -ss and -t values it would be great. Current values work for most but not all the time

[zybex]

Problems there:
- lines 3/4 calculate an ARCalculated based on [Aspect Ratio], but the if/else on lines 5-8 will always overwrite it (lines 3/4 are the same as 7/8)
- line 8 is doing (A/B)/(C/B), which is the same as just (A/C). So v_ARDecimal is not used.

The expression seems to be the same as this one then:

Code: [Select]

Save(not(isequal([crop], Replace([dimensions],/ x/ ,:):0:0)), v_IsCropped)/

If([v_IsCropped]/
    ,Save(Math(ListItem([Crop],0,:) / ListItem([Crop],1,:)),v_ARCalculated)/
    ,Save(Math(Replace([Aspect Ratio],:,//)),v_ARCalculated)/
)/

IfCase(Replace([v_ARCalculated],/,,.), 3, 1, empty, 1.38, 1.33, 1.69, 1.66, 1.80, 1.78, 1.88, 1.85, 2.37, 2.35, 2.45, 2.39)


[jmone]

Thanks both of you for posting the info on the Calculated Fields (I hope this works for lello).

@lepa.  Good idea.  I'll need to:
- Integrate the code into SOT properly (just stubbed in)
- Add options for -SS and -T values (that will be then saved as the defaults)
- Add a check that the -SS and -T values are not longer than the length of the video and auto reduce them if they are

I may not get to the above for a week with what I've currently got on however.

[lepa]

zybex expression is cleaned up version so that one is better. Math is still not correct if video is anamorphic and have something to crop

[lello]

Thanks guys, a really great job! I used the zibex expression, and everything works fine.

The only problem I have with movies with variable AR as sometimes I consider them 16: 9 and other times 2:35: was that what lepa refers to?

For me it is not a problem as they are few, and I manage them manually considering them all 2:35

[lello]

Why didn't you also foresee the 2:20 aspect ratio? Yet it is quite used especially for TV series.

In these cases, in the AR-Calculated tag it appears 2:35 but it is not correct.

I tried to add it manually, but I'm too ignorant about it so it didn't work.

I also tried searching for the logo on the web, but I couldn't find it

[lepa]

just modify the if case eg like this
IfCase(Replace([v_ARCalculated],/,,.), 3, 1, empty, 1.38, 1.33, 1.69, 1.66, 1.80, 1.78, 1.88, 1.85, 2.25, 2.20, 2.37, 2.35, 2.45, 2.39)

so if v_ARCalculated value is smaller than 2.25 then output 2.20
so whole deal is
if smaller than 1 output "empty"
if smaller than 1.38 output 1.33 (Note also 1.37 ratio is missing as I didn't bother to find / create icon)
if smaller than 1.69 then output 1.66
etc etc

[lello]

Perfect, now I have to find the Aspect Ratio 2.20 icon

[lello]

I made the 2.20 icon myself, but I couldn't create the transparency: which free program should I use? Or where can I find the icon?

[arcspin]

Hi,
I use the webpage
https://www.designevo.com/

to make my own icons

[zybex]

I like Paint.Net, and Krita for more complex stuff.
Remember to save as PNG as JPG doesn't support transparency.

2.20:1 seems a relatively obscure format... It seems to have been exclusively used by Todd-AO company - maybe you'll want to use their logo:
https://en.wikipedia.org/wiki/Todd-AO

Otherwise, it's best to draw a set of icons for all formats using a common layout.

[jmone]

Test Version: 210612
- Added the ability to enter in the desired point in the video to start measuring the Crop Factor
- Simple check (and warning in the log) if the desired point in the video to start measuring the Crop Factor is greater than the duration of the video itself (and SOT will instead measure from 1 sec so processing over lots of files can continue)
- Your preferred value will be remembered between runs (stored in the INI file)
- If the value is blank or 0 then the Crop Factor will not run (so as to not slow down those who just want the Media Info meta data but don't want to check for the crop info)

As usual, let me know what I broke!

[lello]

I always get this error:

Error - 500  Processed Failed (see details below)
http://127.0.0.1:52199/MCWS/v1/File/SetInfo?File=1896&FileType=Key&Field=Language&Value=Italian;English; Italian; English
<?xml version="1.0" encoding="UTF-8" standalone="yes" ?>
<Response Status="Failure"/>

[jmone]

Hi Lello, Can you please check "Turn on Verbose Logging of MCWS Calls" and post the entire log as it seems to be working here for me.
Thanks
Nathan

[lello]

Here it is

[jmone]

The MCWS Response Status does not say why, just that it failed.  By any chance do you already have "Korean" and "English" in the "Language" field in MC?  ... if so...

I see you are running MC26 and from memory, there was a change in how MCWS reported failures and now gives more information.  A "500 error" gets generated when SOT tries to do an update that is not needed but the latest versions of MC also returns an Information line such as "<Response Status="Failure" Information="No changes."/>"  SOT looks for this and in the log places a msg "--- MC already has the same information for the above results ---" to let you know that a change was not made (or required) as supresses the error msg (unless you are in Verbose mode where you see all the calls and results).

[zybex]

It's likely the duplicated values in the URL, with spaces. MC doesn't like duplicates, you may need to Trim and de-duplicate:

&Field=Language&Value=Italian;English; Italian; English

[jmone]

Yeah I saw that but.... it is fine with my testing (and has been that way for ages).  At some point MCWS intoduced a 500 error if there was no update to do (was reported earlier in this thread).

[jmone]

As suggested by Zybex, cleaned up the code around updating the "Language field" which may also fix lello's issue..

Test Version: 210614
- Added the ability to enter in the desired point in the video to start measuring the Crop Factor
- Simple check (and warning in the log) if the desired point in the video to start measuring the Crop Factor is greater than the duration of the video itself (and SOT will instead measure from 1 sec so processing over lots of files can continue)
- Your preferred value will be remembered between runs (stored in the INI file)
- If the value is blank or 0 then the Crop Factor will not run (so as to not slow down those who just want the Media Info meta data but don't want to check for the crop info)
- Changed the Language parsing to remove duplicates, padding + it will not call MCWS if there is nothing to change

As usual, let me know what I broke!

[Matt]

Yeah I saw that but.... it is fine with my testing (and has been that way for ages).  At some point MCWS intoduced a 500 error if there was no update to do (was reported earlier in this thread).

We now return this if there are no changes:
<Response Status="Failure" Information="No changes."/>

That seems reasonable to me, but let me know if you have a better proposal.  Thanks.

[lello]

I don't have the "Korean" field and I'm doing the tests with SOT on the laptop where I have MC26: should I do them on the htpc where I have MC27?

I am attaching the .txt file after trying the latest version

[jmone]

We now return this if there are no changes:
<Response Status="Failure" Information="No changes."/>

That seems reasonable to me, but let me know if you have a better proposal.  Thanks.

Hi Matt, It works really well for me, I like the "Information Part" instead of just Failure

[jmone]

I don't have the "Korean" field and I'm doing the tests with SOT on the laptop where I have MC26: should I do them on the htpc where I have MC27?

I am attaching the .txt file after trying the latest version

The error is different this time, as you can see it is saying Information="Field not found."  Looking at the call you are trying to populate a field called "Audio Track Count RAW" with a Value of "2; 3" but MC is reporting there is no field called "Audio Track Count RAW" in the library.  Have you created it?

[lello]

You're right, I had entered the same parameters as the htpc but on the laptop I don't have all those fields.

But I tried with a simple thing by entering: Subtitles - Language - Text and this is the result:

Error - 500  Processed Failed (see details below)
http://127.0.0.1:52199/MCWS/v1/File/SetInfo?File=387&FileType=Key&Field=Subtitles&Value=Italian%3B%20English
<?xml version="1.0" encoding="UTF-8" standalone="yes" ?>
<Response Status="Failure"/>

Created Extra file for "C:\Users\Babbo\Videos\Assassinio sull'orient express\Assassinio.sull'Orient.Express.2017_MediaInfo.txt"
Commenced - Please wait....


But if it's okay with you, and not me, obviously it is I who am wrong something but I am not up to understanding what

[jmone]

So in this case SOT is trying to update the Field "Subtitles" but it is still failing (but does not give us a clue).  I take it that "Subtitles" exists in your MC Library as we don't get the "Field not Found" info.

Another idea, is if it is working on your Desktop but not your Laptop you may want to compare the MC Authentication Settings under Tools --> Options --> Media Network??  then in SOT run the Configure again?

[lello]

The subtitle field is there and is populated.

On the htpc I still haven't tried the new version, for fear of not being able to go back to the previous one, but if you want I can do these tests later.

I redid the configuration on the laptop and it was successful, but I have the same error as before

[jmone]

Right.  I suspect the newer version from yesterday will work (I was wondering why there is still a space in the data that this newer version removes).  Also there is no problem rolling back, just move the "old" SOT.exe to a sub folder with a date and delete when you are happy the newer version is working. 

[lello]

Everything works perfectly on the htpc. 

Sorry if I wasted your time

[jmone]

No probs - we all go around in circles at times + It made me clean up a bit of code.

[arcspin]

Hi,
I've been following this recent development with great interest and would very much appreciate if someone could make an short summary of the steps needed to be able to measure the crop factor.



Cheers and have a great weekend!

//arcspin

[lello]

Do you need to know just how to measure the crop factor or how to configure all SOT?

[arcspin]

Hi lello and thanx for responding,
I use SOT and have used it for a long time so basically the rundown what is need to get correct crop factors as:
What library field and calculated data is advisable to create
What is the correct expression field to create in the file info panel.

I currently use a crop factor expression but I think doing a direct measure on the actually movie will more correct identify the correct crop factor.


This is what I currently use

AR-calculated Library Field:

Code: [Select]

Save(Math(Trunc(Replace([Aspect Ratio], :, // ) + .005, 2)), gAR)
ifcase([gAR], 3, 1, empty, 1.38, 1.33, 1.68, 1.66, 1.80, 1.78, 1.87, 1.85, 2.36, 2.35, 2.40, 2.39)
Expression in File infor view:

Code: [Select]

<font face="ToolTip01" size="160" color="#9496a3">Save(Math(Trunc(Replace([Aspect Ratio], :, // ) + .005, 2)), gAR)IfElse(Compare(Load(gAR), <, 1), , Compare(Load(gAR), <, 1.38), M, Compare(Load(gAR), <, 1.68), N,Compare(Load(gAR), <, 1.80), O,Compare(Load(gAR), <, 1.87), P,Compare(Load(gAR), <, 2.36), Q,Compare(Load(gAR), <, 2.40), R)<//font>/

[jmone]

From a SOT perspective, here is the field you need to create in MC that will then be populated with the data measured using FFMpeg.

This post from Zybex transforms the data - https://yabb.jriver.com/interact/index.php/topic,106802.msg898662.html#msg898662 from the "Crop" field into whatever field you use. (I think!)