Print

Please login or register.
1 Hour 1 Day 1 Week 1 Month Forever
Login with username, password and session length

[FenceFurniture]

So what this whole project has been about is cross-referencing where various musicians and instruments appear. In the attached screenshot I am displaying the "Instruments" view, and if I select "Balafon" I can see that it appears on 10 different albums by 6 different artists. The field that is being edited (white) is the Musicians field which supplied the data for the Muso Name and Instrum used fields. It shows who plays what (this was the data gathered from the internet in all it's various forms, and that had to be massaged into shape).

I have another view for Muso Name which shows me that (e.g.) Vinnie Colaiuta appears on 41 albums by 26 artists (or something like that).

However, there is something wrong with the data because there used to be over 4000 musos and I know that there are about 350 instruments used. I'll have to look into that tomorrow - today has been "rather long".

[jmone]

Wow - looks great!   

[jmone]

I want to see what "Bagpipes" has

[FenceFurniture]

There are more occurrences of Uilleann Pipes than Bagpipes, but then I haven't done the enormous Rock section, which includes AC/DC...

[jmone]

Damn... I was hoping to see ACDC "It's a long way to the top"

[FenceFurniture]

Is it necessary to keep the Swag of Tools.ini file that has been placed on my Desktop? (I think not)

[jmone]

There is a Swag of Tools.ini file that is created on the first run and it sits next to the Swag of Tools.exe file.  It holds the settings (Hashed Username, Hashed Password, Connection details and any preferences that have been set).  If you now run SOT from some other folder, then yes you can delete the one on your desktop (maybe it was created when you ran it from inside the ZIP file?). 

[jmone]

Test Build - DataFiddler:  The code for converting MC's data for use in an editor like Excel was.... ordinary.  I'd written it based on my 1980's Com Sci experience of writing a parser.  Turns out that nifty XML stuff lets you do stuff much quicker, easier and with a lot less code!  So this is a TEST build with a XML based parser for the following Options:
- Export the Entire MC Library (Creates a TXT File)
- Export the Selected Items Only from the MC Library (Creates a TXT File)
- Convert a MC MPL Playlist File (Creates a TXT File)

Other changes:
- Progress Counter shows how many lines are processed (both for creating TXT files and Updating MC)

Also, here are some updated instructions to be clearer on the best way of importing these TXT Files into Excel. 
- I've updated the First Page with the attached pic shows the "best" way of importing the TXT file into Excel and clearer description
- (for now) The "Export Library to TXT file" will replace any Line Feeds it finds in a MC Field with a text {LF} place holder in the TXT File
- The {LF} place holder in the TXT file will be converted back to a real Line Feed when using the "Update MC from TXT File". 

I just can not work out the combination required to keep Excel happy with both a Tab Delimited UTF TXT file using "Text" as the import setting AND having Fields with internal LF (even the using Text Qualifier option).  I previously also used this technique with other "special" characters like {TAB}, {CR} but I'm not sure these are needed anymore as I could find no example of "Tabs" (they now seem to all be spaces) or "Carriage Returns" in my library (maybe the MC Library has changed at some point since I wrote the original code 5 years ago). 

Testing:  I'd appreciate any feedback on what works or does not, especially, could I ask that you try a "Export the Entire MC Library (Create TXT File)" and import it into Excel let me know of:
- Speed and Stability: It takes be about 2min to "Export the Entire MC Library (Create TXT File)" with 33K items, and all the operations are in memory.... so I don't know how it will go with super big libraries or with limited RAM
- In Excel does the table "look correct"
- Are Unicode Chars look OK
- Any other weirdness ?

Still to do:
- Update the routine used for "Update MC from TXT file"

Thanks
Nathan

[FenceFurniture]

There is a Swag of Tools.ini file that is created on the first run and it sits next to the Swag of Tools.exe file.  It holds the settings (Hashed Username, Hashed Password, Connection details and any preferences that have been set).

Ah, I see. That would explain why I had to re-enter the user/psw when I ran it after I moved the .exe from the desktop to another folder, without moving the .ini as well.

I have now automated the process of producing the Unicode .txt file and auto-saving it. That was mainly so that when I come to do this again in some weeks time I don't have to try and remember each step in the process (there are quite a few actually).

That also means that I have now .....I think (I've said this a few times before)..... finished folders 4. FUSION & JAZZ and 5. W-C-F-A-B (World, Chill, Flamenco, Acoustic, Bluegrass - a kinda miscellaneous folder).

No more Bagpipes turned up! 

Now I move into the huge Rock section, but this is right from the start of the process - actually manually splitting up the stored web data into something sensible, without spelling mistakes and 3 different versions of Buzzy no Buzz no Howard Feiten (which gives false reads). I have a number of macros to assist with this but it's a very manual process to massage it all into shape. However, in the Rock sections there are nowhere near the amount of special characters (although, I guess Bon Scott was a special character), and nowhere near the spider-web of musicians playing with gawd-knows how many people (you know - up to 70 or more musos on one album, creating table entries for one person playing on ONE track). Also means many repetitions of the same bunch of musos from album to album, so Copy & Paste, Next, C&P, Next...

As an indicator, the very worst, most arduous albums to get the data right were David Sanborn's - up to 30 minutes per album sorting all the data out.

Anyhoo, I'll see you in "some weeks time"....with an increased list of Bagpipes. 

[FenceFurniture]

Test Build - DataFiddler:  The code for converting MC's data for use in an editor like Excel was.... ordinary.  I'd written it based on my 1980's Com Sci experience of writing a parser.  Turns out that nifty XML stuff lets you do stuff much quicker, easier and with a lot less code!  So this is a TEST build with a XML based parser for the following Options:
- Export the Entire MC Library (Creates a TXT File)
- Export the Selected Items Only from the MC Library (Creates a TXT File)
- Convert a MC MPL Playlist File (Creates a TXT File)

Other changes:
- Progress Counter shows how many lines are processed (both for creating TXT files and Updating MC)

Also, here are some updated instructions to be clearer on the best way of importing these TXT Files into Excel. 
- I've updated the First Page with the attached pic shows the "best" way of importing the TXT file into Excel and clearer description
- (for now) The "Export Library to TXT file" will replace any Line Feeds it finds in a MC Field with a text {LF} place holder in the TXT File
- The {LF} place holder in the TXT file will be converted back to a real Line Feed when using the "Update MC from TXT File". 

I just can not work out the combination required to keep Excel happy with both a Tab Delimited UTF TXT file using "Text" as the import setting AND having Fields with internal LF (even the using Text Qualifier option).  I previously also used this technique with other "special" characters like {TAB}, {CR} but I'm not sure these are needed anymore as I could find no example of "Tabs" (they now seem to all be spaces) or "Carriage Returns" in my library (maybe the MC Library has changed at some point since I wrote the original code 5 years ago). 

Testing:  I'd appreciate any feedback on what works or does not, especially, could I ask that you try a "Export the Entire MC Library (Create TXT File)" and import it into Excel let me know of:
- Speed and Stability: It takes be about 2min to "Export the Entire MC Library (Create TXT File)" with 33K items, and all the operations are in memory.... so I don't know how it will go with super big libraries or with limited RAM
- In Excel does the table "look correct"
- Are Unicode Chars look OK
- Any other weirdness ?

Still to do:
- Update the routine used for "Update MC from TXT file"

Thanks
Nathan

Possibly tomorrow.

On the first screen (for import to Excel) I have always checked "My data has headers"

[jmone]

Wow - big project!  That is going to keep you busy.

Possibly tomorrow.

On the first screen (for import to Excel) I have always checked "My data has headers"

No rush, and from what I can tell, "My data has headers" on or off makes no difference on importing these sort of files... but who knows!?!?

[FenceFurniture]

Currently doing the first request - Exporting the entire library.

I have nothing but music files - many are high-res.

35,633 files

The first 10,000 or so were quicker than the rest. 26,000 so far has taken 7 minutes.

Toshiba laptop with i7 Quad core 2.8GHz processor, 16GB RAM, SSD internal drive, but the files are stored on an external SSD.
Win 10 64 bit.

Ok, finished now, and took 12 minutes to create a 326MB txt file. It would probably be useful if the item count remained in the Log, as well as the elapsed time (then I wouldn't have to use a stop watch and sit here watching it  )

[jmone]

Wow you really do have a lot of Meta Data, my 33K items only created a 43MB file!  So 12min for 326MB vs 2min for 43MB is probably about right.

I should be able to add a timer and leave the count as well (the Update to MC leaves the final count of how many were successfully updated) but it would be good to have both.

[FenceFurniture]

Yeah, in the Musicians tag it can be anything from nothing to

John Abercrombie – Guitar
Jan Hammer – Keyboards
Jack DeJohnette – Drums

to the 167 musicians on Natalie Cole's Unforgettable:

Original copied Personnel
Murray Adler – Violin
Monty Alexander – Piano
Israel Baker – Violin
Marilyn Baker – Violin
Rick Baptist – Trumpet
Arnold Belnick – Violin
Pete Beltran – Trombone
Dixie Blackstone – Violin
Samuel Boghossian – Viola
George Bohanon – Trombone
Tom Boyd – Oboe
Jacqueline Brand – Violin
Oscar Brashear – Trumpet
Alan Broadbent – Celeste, Piano
Ray Brown – arranger, Bass
Dennis Budimir – Guitar
Denyse Buffum – Viola
Larry Bunker – Percussion
Jodi Burnett – Cello
Ralph Burns – arranger
Kenneth Burward-hoy – Viola
Darius Campo – Violin
Conte Candoli – Trumpet
Stuart Canin – Violin
Lily Ho Chen – Violin
John Chiodini – Guitar
Pete Christlieb – Saxophone–Tenor, Saxophone, Woodwind
Gene Cipriano – Woodwinds (& Oboe)
John Clayton – Bass, string Bass
Pat Coil – Keyboards (Synthesizer)
Brad Cole – Piano
Ike Cole – Piano
Natalie Cole – arranger, vocal arrangement, Vocals
John Collins – Guitar
Antony Cooke – Cello
Ronald Cooper – Cello
Gail Cruz – Violin
Isabelle Daskoff – Violin
Donna Davidson – Background Vocals
Charlie Davis – Trumpet
Vincent DeRosa – Horn–French
Chuck Domanico – Bass, string Bass
Bonnie Douglas – Violin
Assa Drori – Violin
David Duke – Horn–French
Bruce Dukov – Violin
Bob Efford – Saxophone–Baritone
Stephen Erdody – Cello
Pavel Farkas – Violin
Henry Ferber – Violin
Michael Ferril – Violin
Chuck Findley – Trumpet
Clare Fischer – arranger, Piano, rhythm arrangements
Ronald Folsom – Violin
Gary Foster – Saxophone–Alto, Flute
Armen Garabedian – Violin
Berj Garabedian – Violin
Tom Garvin – Synthesizer
James Getzoff – Violin
Julie Gigante – Violin
Harris Goldman – Violin
Pamela Goldsmith – Viola
Endre Granat – Violin
Gary Grant – Trumpet
Thurman Green – Trombone
Susan Greenberg – Flute
Ralph Grierson – Synthesizer
Sol Gubin – Drums
Debbie Hall – Background Vocals
Larry Hall – Trumpet
Diana Halprin – Violin
Jeff Hamilton – Drums
Clayton Haslop – Violin
Daniel Higgins – Saxophone–Alto, Soprano Saxophone
Paula Hochhalter – Cello
Bill Holman – arranger
Steve Huffsteter – Trumpet
Jim Hughart – Bass
John Johnson – tuba
John Thomas Johnson – tuba
Marilyn L. Johnson – Horn–French
Thomas "Snake" Johnson – Trombone
Harold Jones – Drums
Karen Jones – Violin
Nathan Kaproff – Violin
Anne Karam – Cello
Dennis Karmazyn – Cello
Armand Karpoff – Cello
Roland Kato – Viola
Kerry Katz – Background Vocals
Randy Kerber – Synthesizer
Myra Kestenbaum – Viola
Katie Kirkpatrick – harp
Ezra Kliger – Violin
Armen Ksadjikian – Cello
Steve Kujala – Woodwind
Bernard Kundell – Violin
Michael Lang – Piano
Ronnie Lang – Woodwind
Ronald Langinger – Flute
Michel Legrand – arranger, orchestral arrangements
Kathleen Lenski – Violin
Brian Leonard – Violin
Gayle Levant – harp
Rich Logan – Background Vocals
Charles Loper – Trombone
Warren Luening – Trumpet
Arthur Maebe – Horn–French
Rene Mandel – Violin
Edith Markman – Violin
Michael Markman – Violin
Yoko Matsuda – Violin
Donald McInnes – Viola
Mike Melvoin – Keyboards (Piano)
Don Menza – Saxophone–Tenor
Gene Merlino – Background Vocals
Richard Mitchell – Saxophone–Tenor
Rick Mitchell – Saxophone–Tenor
Lanny Morgan – Saxophone–Alto
Ralph Morrison III – Violin
Carole Mukogawa – Viola
Richard Taylor "Dick" Nash – Trombone
Buell Neidlinger – string Bass
Dan Neufeld – Viola
Irma Neumann – Violin
David "Fathead" Newman – guest artist, Saxophone–Tenor
Jack Nimitz – Saxophone–Baritone, Woodwind
Mike Nowack – Viola
Brian O'Connor – Horn–French
Nils Oliver – Cello
Sid Page – Violin
Marty Paich – arranger, orchestral arrangements, rhythm arrangements
John Patitucci – Bass
Bruce Paulson – Trombone
Bill Perkins – Saxophone–Alto
John Pisano – Guitar
Kazi Pitelka – Viola
Stanley Plummer – Violin
Barbara Porter – Violin
Jack Redmond – Trombone
Bill Reichenbach Jr. – Trombone
Dorothy Remsen – harp
Anatoly Rosinsky – Violin
Daniel Rothmuller – Cello
Joe Sample – guest artist, Piano
Myron Sandler – Viola
Frederick SeyKora – Cello
Sid Sharp – Violin
Don Shelton – Background Vocals
Harry Shirinian – Viola
Haim Shtrum – Violin
Paul Shure – Violin
Andrew Simpkins – Bass
Nolan Andrew Smith – Trumpet
Valerie Smith – linguist
Sally Stevens – Background Vocals
Susan Stevens – Background Vocals
David Stockhammer – Viola
Sheridon Stokes – Woodwind
Robert Stone – string Bass
Margaret Storer – string Bass
Frank Szabo – Trumpet
James Thatcher – Horn–French
Milton Thomas – Viola
Raymond Tischer – Viola, Violin
Richard Todd – Horn–French
Alexander Treger – Violin
Bob Tricarico – Saxophone–Baritone
Mari Tsumura-botnick – Violin
Louise di Tullio – Flute, Woodwind
Jo Ann Turovsky – harp
Alan de Veritch – Viola
Gerald Vinci – Violin
Al Viola – Guitar
Dorothy Wade – Violin
Brad Wanaar – Horn–French
Miwako Watanabe – Violin
Dave Weckl – Drums
Ken Yerke – Violin

which I have trimmed down to:

Natalie Cole – Vocals

GUITARISTS:
Dennis Budimir
John Chiodini
John Collins
John Pisano
Al Viola

PIANISTS:
Monty Alexander
Alan Broadbent (+ Celeste)
Brad Cole
Ike Cole
Clare Fischer
Michael Lang
Mike Melvoin
Joe Sample

SYNTHESIZERS:
Pat Coil
Tom Garvin
Ralph Grierson
Randy Kerber

TRUMPETS:
Rick Baptist
Oscar Brashear
Conte Candoli
Charlie Davis
Chuck Findley
Gary Grant
Larry Hall
Steve Huffsteter
Warren Luening
Nolan Andrew Smith
Frank Szabo

TROMBONES:
Pete Beltran
George Bohanon
Thurman Green
Thomas Johnson
Charles Loper
Bruce Paulson
Jack Redmond
Bill Reichenbach
Richard Taylor Nash

SAXOPHONES:
Pete Christlieb – Saxophone–Tenor, Woodwind
Bob Efford – Saxophone–Baritone
Gary Foster – Saxophone–Alto, Flute
Daniel Higgins – Saxophone–Alto, Saxophone–Soprano
Don Menza – Saxophone–Tenor
Richard Mitchell – Saxophone–Tenor
Rick Mitchell – Saxophone–Tenor
Lanny Morgan – Saxophone–Alto
David Newman – Saxophone–Tenor
Jack Nimitz – Saxophone–Baritone, Woodwind
Bill Perkins – Saxophone–Alto
Bob Tricarico – Saxophone–Baritone

WOODWINDS:
Tom Boyd – Oboe
Gene Cipriano – Woodwinds (& Oboe)
Susan Greenberg – Flute
Steve Kujala – Woodwind
Ronnie Lang – Woodwind
Ronald Langinger – Flute
Sheridon Stokes – Woodwind
Louise di Tullio – Flute, Woodwind

FRENCH HORNS:
Vincent DeRosa
David Duke
Marilyn L. Johnson
Arthur Maebe
Brian O'Connor
James Thatcher
Richard Todd
Brad Wanaar

TUBAS:
Thommy Johnson

BASS PLAYERS:
Ray Brown
John Clayton
Chuck Domanico
Jim Hughart
Buell Neidlinger
John Patitucci
Andrew Simpkins
Robert Stone
Margaret Storer

DRUMMERS:
Sol Gubin
Jeff Hamilton
Harold Jones
Dave Weckl
Larry Bunker – Percussion

HARPISTS:
Katie Kirkpatrick
Gayle Levant
Dorothy Remsen
Jo Ann Turovsky

Michel Legrand – Arranger, Orchestral arrangements
Marty Paich – Arranger, Orchestral arrangements, Rhythm arrangements

*NOTE:  there are also 70 String
 players - full list in Album Notes



and the problem is that it has to be a relational one field per album so it gets repeated 22 times for 22 tracks!

[jmone]

Thankfully storage, and processing power is cheap! 

[FenceFurniture]

Just for you.

[jmone]

Nice!  Bon did like the Bagpipes 

[FenceFurniture]

Is 1.1.32.0 the most recent version? (I may have confused myself...)

[FenceFurniture]

Nice!  Bon did like the Bagpipes 

I had to search to find out who played them on IaLWTTT. I'm still not quite sure, but I know that Kevin Conlon gave Bon enough lessons so that he could look like he knew what he was doing in the video. Maybe he played them on the recording too, but the info wasn't definitive. For a little while they tried to play them in concerts, but gave up due to "too many mishaps". A difficult instrument, by all accounts - 12 months learning just to play a tune.

[jmone]

That's alright, you had me confused as well!  I just use the Data for the Version #, eg v2021.01.20 is the latest on Github.  If you run SOT you will see the Version in the "About" page where you will see something like "Version: 20 Jan 2021".  The latest with the new parser is "23 Jan 2021 - Test Build". 

I think you are referring to the Right Click Properties --> Details on "Swag of Tools.exe" and it shows the version of the Compiler used (1.2.32.0) to turn the script into an exe.

[jmone]

Apart from the Music Video of IaLWTTT there is this Bandstand version ... but I'm not sure one way or the other if he really is playing 

Edit and here is an Audio only version from '76 where the bagpipe is just playing a single note.

[FenceFurniture]

Apart from the Music Video of IaLWTTT there is this Bandstand version ... but I'm not sure one way or the other if he really is playing

I would say without a doubt...not playing them... for a few reasons:
1. Bag not inflated as I would expect
2. Not playing into the microphone on far too many occasions
3. He couldn't play them....

But none of that means the cheeky bugger didn't like them!

[mirskid]

Update: 02 May 2020 - Latest files in the First Post of this thread
- Updated: the "Read Blu-ray MPLS" code to the latest I'd published earlier this year
- Updated: Media Info to use V20.03 (you will need to delete or rename the MediaInfo sub folder to get the new version)
- Fixed (Media Info): the bug where it kept adding values that were already in the list
- New (Media Info): You can now enter a delimited list of Fields for updating MC from Media Info (see pic)
- New (Media Info): Field values will be remembered
- New: MCWS Username and Password will now be hashed in the INI File instead of being in Clear Text (note: you will need to reenter your User Name and Password in the Configuration Box).

Hi
I am new with this tool but is really impressive.
I have been working with some of the features but still cannot select a specific field that I want for a column in MC.
I was wondering if here someone can provide some guidance.
I need to display just the Audio [i]Bit rate[/i] but I still keep getting the Bit rate mode info in the column.
I created my custom column _Bit Rate_ to host the value
In the Swag of Tools, Mediainfo section I enter _Bit Rate_ (in the MC field section) then Bit rate (in Mediainfo section) and Audio (in the last section)
I have tried Audio;Bit rate (in Mediainfo sections) but it does not work.
How can I restrict the field to a specific cathegory and sub cathegory of the video information?

Regards,

[jmone]

Hi mirskid,

Looks like SOT is finding the value "Constant; 225 kb;s" from MediaInfo and updating the MC "_Bit Rate_" field with it.  Can you please:
- Save and Post the MediaInfo.txt file that is created here so I can have a look at it.
- Advise what string from within the MediaInfo.TXT file that you want SOT to be finding (eg is it just "225")?

Thanks
Nathan

[mirskid]

Hi mirskid,

Looks like SOT is finding the value "Constant; 225 kb;s" from MediaInfo and updating the MC "_Bit Rate_" field with it.  Can you please:
- Save and Post the MediaInfo.txt file that is created here so I can have a look at it.
- Advise what string from within the MediaInfo.TXT file that you want SOT to be finding (eg is it just "225")?

Thanks
Nathan

Hi Nathan
Thank you for your reply.
Please find attached the file.
And yes I just need to be visible in the column the 225 info.

[jmone]

It looks like what you want to do is "clean" the input that is being read.  I'm not very experienced with MC's Expression Fields so hopefully someone else will chip in but:

=Number([_Bit Rate_]) (see https://wiki.jriver.com/index.php/Miscellaneous_Functions#Number)

...will do what you want to the raw MediaInfo data once in MC.  It turns "Constant; 225 kb;s" into "225"

So, it would be a 2 step process
1) you would run SOT and it would get all the raw data and put it into a MC Field, then
2) you would select all your data in MC and on the first "_Bit Rate_" change it to "=Number([_Bit Rate_])" (without the quotes) and all the data will be converted to values.

There may also be a way of setting it up under "Manage Library Fields".  I tried changing "_Bit Rate_" from "User Data" to "Calculated data" and adding "=Number([_Bit Rate_])" but that did not seem to work.

[zybex]

Nathan, isn't that a bug? It's capturing 2 lines when he only requested "Bit rate":

Code: [Select]

Bit rate mode                            : Constant
Bit rate                                 : 225 kb/s

I would expect "bit rate" to capture only the 2nd value, and "bit rate mode" to capture the first.
Also, why is it replacing the fwd-slash with semicolon? MC doesn't care about them in strings, only in Expressions.

[jmone]

Yeah, you are right - I'll need to look into both of these bugs.... but for mirskid he wants to pull out the #'s from the string, so it will need to post process regardless.  "=Number" will do what he needs and will work both now and when I fix the bugs.

[zybex]

Here's an idea for a feature on that MediaInfo page - add a box for "post process Expression", where the user can enter an MC Expression to mangle the value.

The expression would take a special $value arg that you just replace with the actual value; otherwise it's a regular MC Expression.
To evaluate it, you would call /MCWS/v1/GetFilledTemplate (documentation on http://localhost:52199/MCWS/v1/)
The Expression arg to the function would need to be URL-escaped, and fwd-slashes in the $value would need to be doubled (/ -> //) so that they don't take a special meaning.

For this case, mirskid would use "Number($value)"

[jmone]

I also thought about allowing adding Regex expressions for similar processing.... but then figured it may be something very few people would ever actually use, and there is so many potential combinations!  Given MC can do this, I figured the job of SOT is to get the data into MC, and MC can do the rest.  Still I need to look at the 2 bugs to make it cleaner.

[mirskid]

It looks like what you want to do is "clean" the input that is being read.  I'm not very experienced with MC's Expression Fields so hopefully someone else will chip in but:

=Number([_Bit Rate_]) (see https://wiki.jriver.com/index.php/Miscellaneous_Functions#Number)

...will do what you want to the raw MediaInfo data once in MC.  It turns "Constant; 225 kb;s" into "225"

So, it would be a 2 step process
1) you would run SOT and it would get all the raw data and put it into a MC Field, then
2) you would select all your data in MC and on the first "_Bit Rate_" change it to "=Number([_Bit Rate_])" (without the quotes) and all the data will be converted to values.

There may also be a way of setting it up under "Manage Library Fields".  I tried changing "_Bit Rate_" from "User Data" to "Calculated data" and adding "=Number([_Bit Rate_])" but that did not seem to work.

Thank you it worked. Altho if there is a space after a number it cuts it. So the audio that has "1 536 kbps" it only shows the number "1"

[mirskid]

Nathan, isn't that a bug? It's capturing 2 lines when he only requested "Bit rate":

Code: [Select]

Bit rate mode                            : Constant
Bit rate                                 : 225 kb/s

I would expect "bit rate" to capture only the 2nd value, and "bit rate mode" to capture the first.
Also, why is it replacing the fwd-slash with semicolon? MC doesn't care about them in strings, only in Expressions.

Thank you again for the help and advice.
I was thinking, with the MC's Expression Fields is there a way that I can say just display one of the options or fields in the string.
Once the info is captured into a column in MC is separated by ";" is there a comand to indicate just to select a spacific field?
Example:
This is a test field I created. "AAC LC; Advanced Audio Codec Low Complexity" can only "AAC LC" or the last part be displayed?
That could solve the just dispaying number issue.

[jmone]

Yeah, that MC function just finds and returns the first #.  I'm equally poor at Regex, but a quick google shows this should work in stripping all non numeric characters in MC instead of the "=Number(...)"

Code: [Select]

Regex.Replace(s, "[^0-9.]", "")
....but I've no idea how to use that in MC - https://wiki.jriver.com/index.php/String_Manipulation_Functions#Regex

[jmone]

If I fix my SOT bug so it only finds "225 kb/s" would that work (you would still get the "kb/s" part)?

[wer]

If you don't mind, jmone, I'll offer something...

This issue can be worked around, guys.

This is a longstanding problem in Mediainfo.  But the mediainfo developer will not address it, nor will he respect the language defaults on the computer running mediainfo.

So, workarounds...

You can have mediainfo additionally output raw unformatted numbers, but this may complicate your parsing because there will be lines with duplicate labels.  You can do this with

Code: [Select]

mediainfo -f
Alternatively, you can force mediainfo to output the numbers in the format you desire by specifying a language file.  Read this link for more:
https://mediaarea.net/en/MediaInfo/Support/FAQ#ThousandSeparator

Alternatively, and what I think is the easiest, you can disable language processing with

Code: [Select]

mediainfo --language=rawThis makes mediainfo output numbers as just, you know, numbers.

Anyway, I hope this helps.  Carry on...

[mirskid]

If I fix my SOT bug so it only finds "225 kb/s" would that work (you would still get the "kb/s" part)?

That should work, the Kb/s is not that relevant because that is the standard measure for this unit.
If SOT captures the full number then should be fine.

Thanks

[mirskid]

If you don't mind, jmone, I'll offer something...

This issue can be worked around, guys.

This is a longstanding problem in Mediainfo.  But the mediainfo developer will not address it, nor will he respect the language defaults on the computer running mediainfo.

So, workarounds...

You can have mediainfo additionally output raw unformatted numbers, but this may complicate your parsing because there will be lines with duplicate labels.  You can do this with

Code: [Select]

mediainfo -f
Alternatively, you can force mediainfo to output the numbers in the format you desire by specifying a language file.  Read this link for more:
https://mediaarea.net/en/MediaInfo/Support/FAQ#ThousandSeparator

Alternatively, and what I think is the easiest, you can disable language processing with

Code: [Select]

mediainfo --language=rawThis makes mediainfo output numbers as just, you know, numbers.

Anyway, I hope this helps.  Carry on...

Apologies in advance for my lack of knowledge in this area, slowly I am learning.
Can you please let me kow where will I use this code "mediainfo --language=raw". Will it be in SOT mediainfo section? or is it in MC Calculated Data part?

Regards,

[jmone]

@wer - For all it's fault, I like the human readable TXT file and layout for parsing but I'll have a look at it later (edit - the formats are pretty similar).  For now I'm cleaning up the two bugs.

Test Build: Anyway, here is a test build that should for MediaInfo:
- Only find an exact match
- Keep "/" and ":" in the string if they exist (rather than replacing them with ";").  I'm guessing this was an old part of the code prior to upgrading the MCWS calls that was better at escaping these characters. 

Anyone, attached is a Test Build - and any feedback would be great!

[jmone]

Apologies in advance for my lack of knowledge in this area, slowly I am learning.
Can you please let me kow where will I use this code "mediainfo --language=raw". Will it be in SOT mediainfo section? or is it in MC Calculated Data part?

Regards,

Don't worry about that for now.  It is something I would need to look into more as it would be on my side to use this option and then change how I parse it.

[jmone]

cross post from your other thread on Post Processing the raw data.
===========================
I think this will work better:

=removecharacters([Raw Rate]," kb//s")

removes the kb/s and also the space between "1 552 kb/s" so you should get "1552"

[mirskid]

@wer - For all it's fault, I like the human readable TXT file and layout for parsing but I'll have a look at it later.  For now I'm cleaning up the two bugs.

Test Build: Anyway, here is a test build that should for MediaInfo:
- Only find an exact match
- Keep "/" and ":" in the string if they exist (rather than replacing them with ";").  I'm guessing this was an old part of the code prior to upgrading the MCWS calls that was better at escaping these characters. 

Anyone, attached is a Test Build - and any feedback would be great!

Thank you very much.
Great work
Is working without an issue now!!

[mirskid]

Thank you very much.
Great work
Is working without an issue now!!

Thanks that work perfectly!!

[jmone]

Great to hear!

Thanks that work perfectly!!

Did you mean that the following also works?

=removecharacters([Raw Rate]," kb//s")

[mirskid]

Great to hear!

Did you mean that the following also works?

=removecharacters([Raw Rate]," kb//s")

Actually it worked only on the PCM sources, the AAC does not work

[jmone]

What does not work on the AAC, SOT or the "removecharacters"?  What does the AAC source look like?
Thanks
Nathan

[jmone]

FYI - I ran SOT over my test clips and found that MediaInfo does not report the Audio Bit Rate for a subset (about a 20%).... and neither does ffprobe.  Looking into it further, it seems the issue is that some muxers simply don't actually update the metadata for Bitrate so there is nothing to report back on. 

Here is a HandBrake thread about it, and how some users are remuxing their files so the metadata gets updated.

[mirskid]

What does not work on the AAC, SOT or the "removecharacters"?  What does the AAC source look like?
Thanks
Nathan

I am not sure where is the issue.
It was working, then I renamed the columns in MC to make them shorter and it stopped working. And SOT was showing and error string.
Now I created 2 new fields for columns with the same parameters and is workign again.
Please see below all the screens with the error message and the new columns working fine.
Maybe something between SOT and previous columns I created was just not updating after I rename them.
Seems fine now with new columns I created.

Regards,

[mirskid]

FYI - I ran SOT over my test clips and found that MediaInfo does not report the Audio Bit Rate for a subset (about a 20%).... and neither does ffprobe.  Looking into it further, it seems the issue is that some muxers simply don't actually update the metadata for Bitrate so there is nothing to report back on. 

Here is a HandBrake thread about it, and how some users are remuxing their files so the metadata gets updated.

I noticed that too with some old videos, need to review that.

Thank you very much for all the work with this and the updates and amendments.
Really appreciated.

[jmone]

As long as it is working again, I'm happy!  .... & good to see some AccaDacca

[lepa]

Hi jmone,
Found possible bug with handling "&" character

SoT log:
MC Extras updated with Isolated Music & Effects Track; Audio Commentary with Writer-Director Steve Kloves and Film Historians Julie Kirgo and Nick Redman; Audio Commentary with Director of Photography Michael Ballhaus

Extras field in MC:
"Isolated Music "