Topic: A very special task ( for MrC? :-) ) (Read 22260 times)

Arindelle · « **Reply #50 on:** August 07, 2013, 12:12:39 pm »

having a bit of a problem running perl .. I downloaded the 64bit version -- would this pose any issues?

MrC · « **Reply #51 on:** August 07, 2013, 12:13:09 pm »

Nope, not if you have a 64-bit Windows. I have the 64-bit version too. What's the issue?

MrC · « **Reply #52 on:** August 07, 2013, 12:14:50 pm »

[edit: see post 60 for the latest version and changes]

Attached is Version 1.5.

Changes:
   - New: option --rating allows selecting format of AMG rating (d=0-9, f=0.0-5.0)
   - New: localized numeric output for rating value (i.e. when --rating=f)
   - Fix: problem when using --excludes

If you want ratings to range from 0.0 to 5.0 (i.e. includes half points), use --rating f. Otherwise, --rating d is the default.

vagskal · « **Reply #53 on:** August 30, 2013, 10:51:20 am »

I am getting these error messages now:

Quote

*** Use of uninitialized value $tracklisting in substitution (s///) at amg.pl li
ne 234.

*** Use of uninitialized value $tracklisting in split at amg.pl line 235.

AMG HTML has changed. amg.pl needs to be updated for the new format.
Stopped at amg.pl line 280.
Tryck ned valfri tangent för att fortsätta...

http://www.allmusic.com/album/dig-thy-savage-soul-mw0002557546

Is there anything that can be done?

MrC · « **Reply #54 on:** August 30, 2013, 10:59:52 am »

What is the full command line you are using (so I can replicate your usage)?

That page only includes a review, so you'll need to specify one of --fileregex or --sequence.

vagskal · « **Reply #55 on:** August 30, 2013, 11:06:05 am »

It is a .bat file with this, as you taught me:
@echo off
perl amg.pl perl amg.pl -s -i moods,themes,styles,credits,review,rating -A --append --rating f
pause

MrC · « **Reply #56 on:** August 30, 2013, 11:11:42 am »

Ok, this is a case I hadn't encountered before. There are no tracks listed on the main page. I'll have to work around this. Be back later...

MrC · « **Reply #57 on:** August 30, 2013, 11:45:00 am »

I sent you a private update in email. Let me know how it works out.

MrC · « **Reply #58 on:** August 30, 2013, 12:09:37 pm »

[edit: see post 60 for the latest version and changes]

Attached is Version 1.6.

Changes:
- Fix: resolved problem with options being case-insensitve
- Fix: handle entries where no track listings exist, to allow grabbing review, etc. only

vagskal · « **Reply #59 on:** August 30, 2013, 02:01:39 pm »

Thanks! All is good.

MrC · « **Reply #60 on:** September 03, 2013, 12:15:09 pm »

[edit: see post 62 for the latest version and changes]

Attached is Version 1.7:

Changes:
- Fix: support fields w/embedded newlines (e.g. lyrics)
- New: output command line w/debug enabled

MrC · « **Reply #61 on:** September 05, 2013, 03:34:16 pm »

MC 19.0.36 changed the format of the data on the clipboard. I've updated the script to accommodate this, but want to wait for tonight's build as there may be one additional change. If anyone needs it, let me know.

MrC · « **Reply #62 on:** September 06, 2013, 05:40:08 pm »

[edit: see post 71 for the latest version and changes]

Attached is Version 1.8:

Changes:
- New: support MC 19.0.36's RFC 4180 clipboard text

Note: this version requires installing an additional perl module (used to handle the new RFC 4180 format of the clipboard). Install it from a Windows command shell by entering:

ppm install Text-CSV

Version 1.8 will auto-detect the format of the clipboard, so it is safe to use with any MC version.

vagskal · « **Reply #63 on:** September 07, 2013, 11:38:51 am »

Thanks. It is working great.

I suppose there is no way to display in a pane the persons in the AMG Credits without their role on the respective albums, so that I can get all albums credited to Artist X irrespective of if he is playing guitar on one album and harmonica on another (until we get global RegEx search)?

MrC · « **Reply #64 on:** September 07, 2013, 11:59:24 am »

Would you like an option to not include their roles?

vagskal · « **Reply #65 on:** September 07, 2013, 12:08:08 pm »

Quote from: MrC on September 07, 2013, 11:59:24 am

Would you like an option to not include their roles?

Thanks for the offer, but I do not think so. It is of course of importance if an artist plays guitar or harmonica on an album, and I like to gather all metadata available and not cripple what is there. I would like the ability to not _display_ their role in a pane, but I guess this is impossible until a global RegEx option is introduced.

MrC · « **Reply #66 on:** September 07, 2013, 12:29:13 pm »

You could replace the " [" with \ and remove the ] characters to create a hierarchical list (effectively hiding the roles):

removecharacters(replace([AMG Credits], / /[, \), /])&datatype=[list]

We could also create a separate mapping of AMG Credits (no roles), so you could get both.

vagskal · « **Reply #67 on:** September 07, 2013, 12:38:33 pm »

Thanks for the tip. I forgot about that. I do not use nested lists in panes because I need scroll by typing to work reliably there (which it is not).

Maybe a second custom field ([AMG Credits (only name)]) with just the artist name for the pane would be ideal for the time being.

MrC · « **Reply #68 on:** September 07, 2013, 03:21:52 pm »

I've sent you a private release.

MrC · « **Reply #69 on:** September 14, 2013, 01:50:37 pm »

[edit: see post 71 for the latest version and changes]

Attached is Version 1.9:

Changes:
   - Fix: problem with RE used to detect and split rows of track data.
   - New: include new field mapping: credits_nr ==> "AMG Credits (only name)" which is the same as 'credits',
   sans the per-person bracketed credits.
   - New: Awards page parsing. Keys 'awards_bba', 'awards_bbs', and 'awards_gra' map to
   Fields: "Billboard Albums", "Billboard Singles", and "Grammy Awards", respectively.
   Use "-e awards_bba,awards_bbs,awards_gra" if you don't want these fields (avoids extra page pulling).
   - New: Releases page parsing. Key 'releases' maps to Field: "Releases".
   Use "-e releases" if you don't want this field (avoids extra page pulling).
   - Fix: some reviews don't have author attributions.
   - Fix: handle existing HTML entities better in Credits.
   - Change: add space after list delimiter in Credits.
   - Change: -c is now -C (to specify a clipfile)
   - New: program will read some values from a config file specified with -c or --configfile. See the sample
   config file that accompanies this release.
   - New: Credits mapping to selectively map credits to other MC fields, or ignore certain credits. See the
   sample config file.

Thanks vagskal for your testing.

I'm considering adding an option to use MCWS to update the tracks, so that the manual MPL import won't be necessary. The code is working, but it makes a lot of calls as each field, for each track, requires a connection, and I was hoping to use a method that does bulk updates for a given track. If this would be of interest, chime in.

Also, I've written code to pull data from Discogs and may incorporate this as well.

Arindelle · « **Reply #70 on:** September 15, 2013, 02:16:41 am »

Although I've been way too busy lately to test this, just wanted to let you know, Mr. C, that there are more of us out there that appreciate your effort on this

Thanks much for taking so much time on this script ...

MrC · « **Reply #71 on:** September 15, 2013, 12:23:01 pm »

[edit: see post 80 for the latest version and changes]

Attached is Version 1.9.1:

Changes:
- Fix: the same track data was being output for each track
- Fix: remove extraneous newlines / line feeds from clipboard data

SkGe · « **Reply #72 on:** October 02, 2013, 01:49:57 pm »

I have a little problem with the script
"C:\Users\...\Desktop>perl amg.pl -u http://www.allmusic.com/album/once-i-was-a
n-eagle-mw0002524684 > import.mpl
Failed to open \Users\Spiva\Desktop\import.mpl: Permission denied
Stopped at amg.pl line 795."
Any idea?

MrC · « **Reply #73 on:** October 02, 2013, 02:46:21 pm »

With the current version, you don't need to do the redirection. Just use:

perl amg.pl -u http://www.allmusic.com/album/once-i-was-an-eagle-mw0002524684

The file will be created for you. Otherwise, use the -o option to specify an output file:

perl amg.pl -u http://www.allmusic.com/album/once-i-was-an-eagle-mw0002524684 -o import.mpl

SkGe · « **Reply #74 on:** October 02, 2013, 03:23:57 pm »

Thank for the reply MrC, and i have a few question to add
My album review/credits are large value and if i edit this type the script will not working, any idea how to fix it?
And i see that album rating is 0-10 and i use 0 to 5 (with .5) can this be change it on this way?
And thanks again for the support

SkGe · « **Reply #75 on:** October 02, 2013, 03:46:41 pm »

My mistake, i did change the wrong field in the script, now is working as intended but the date is geting only year and not the exact date, ofc if it have it.

MrC · « **Reply #76 on:** October 02, 2013, 03:47:12 pm »

Which version of MC are you using?

Prior to 19, you can't have the large value (newline embedded) columns in the view and use Copy to clipboard. MC19 allows supports what the script needs to correctly interpret the values on the clipboard. So if you're using MC18, remove those columns from the view.

There are two ratings supported by the script: MC's 0-5 value, as key 'ratingsmc' and 'rating'.

Since version 1.5:

- New: option --rating allows selecting format of AMG rating (d=0-9, f=0.0-5.0)

so you can get 0-9 or 0.0 - 5.0 ratings for the AMG rating (keyword 'rating'). Use --rating f to get floating point 0.0 - 5.0.

The Rating field will be scaled to fit MC's 0-5 integer scale (keyword ratingmc).

MrC · « **Reply #77 on:** October 02, 2013, 03:49:27 pm »

Quote from: sirgeo on October 02, 2013, 03:46:41 pm

My mistake, i did change the wrong field in the script, now is working as intended but the date is geting only year and not the exact date, ofc if it have it.

See the new config file. You can set your field names there, so you don't need to modify the script any longer.

I'm only setting the Date as the Year value. I can probably change it to accommodate the full date. Would that be helpful?

SkGe · « **Reply #78 on:** October 02, 2013, 03:58:07 pm »

I tried today this script, (i know you did a great job) don't have the time to test it so today was good to start.
So far from what i read and tested works splendid, but i have some other things to fix it to be perfect or almost
I use ver 19 and it will be great if you get as date full not only year (when is possible)
And btw can i add more things to get like, review of songs or album release (label) or if an album is a pick.
Thanks.

MrC · « **Reply #79 on:** October 02, 2013, 04:04:03 pm »

I'll take a look at the full date pulling.

As far as album review, etc., please take a look at the sample config file. The script can pull more than the original posting indicates, and you can see from the config which key/MC Fields are available.

I really should start a new post in the 3rd party tools, and keep the main posting updated with the full description.

MrC · « **Reply #80 on:** October 02, 2013, 05:22:08 pm »

[edit: see post 91 for the latest information]

Attached is Version 1.10:

Changes:
   - Fix: problem reading MC19's new clipboard format on Mac OS X.
   - New: support full dates in Date value.
   - New: option --yearonly or -y specifies Date values should be year-only

SkGe · « **Reply #81 on:** October 03, 2013, 06:20:12 am »

The script work nice and thank you for the help.
But i have a few question about this script.
Is possible to add some fields to fill it with info or do i need to code it myself?! (if so i'm zero skill there) why i ask this? is because i desire to get a few info from album page (like album pick, song review, performer and reviewer of song and album) when is possible ofc. .
And for releases field is possible to get only the label and nothing more? there you get year/album name and label.

MrC · « **Reply #82 on:** October 03, 2013, 11:39:03 am »

Am I correct that you have not yet looked at the config file, because, as I've mentioned the script already pulls:

Album Pick
Album Review (there is no song review)
Album Reviewer
Track Composer
Track Performer

I grab everything on the main page (Overview), and also the Credits, Awards, and Releases pages, and make it available to you.

As for the Releases, you just want a list of labels, from all formats (that seems ambiguous)? See attached:

SkGe · « **Reply #83 on:** October 03, 2013, 12:49:35 pm »

I looked on the config file and searched on the script a way of what i asked, and i catch my eyes with all code and i don't know how to use it (yet, maybe one day i will).
As for the second thing, yes some album have on the track review (usual older one) and for the release, yes only the title of label, because when i get info from album i take where it is album discography.
The review link move you to another page and there you find what i talk about.
http://www.allmusic.com/album/play-mw0000243891

MrC · « **Reply #84 on:** October 03, 2013, 12:56:54 pm »

I've never seen that!

I'll look into the song review, seems easy enough. Should this override the album review field (e.g. AMG Review) for just that track, or should it be a separate field (e.g. AMG Track Review)?

For releases, I can provide a way to get just the list of the labels. Maybe it will be like credits_nr, which are the credits without the role included (i.e. just people).

SkGe · « **Reply #85 on:** October 03, 2013, 01:07:15 pm »

Separate if it is possible.
And one more thing! Some albums have album pick like track pick, can be this also added?
Thank you!

MrC · « **Reply #86 on:** October 03, 2013, 01:12:51 pm »

Ah, I see that also on the Moby album. So much to learn.

I'll add it as AMG Album Pick.

SkGe · « **Reply #87 on:** October 03, 2013, 01:30:43 pm »

On the album view is a field called "performer" can this be added also? (only the names)

MrC · « **Reply #88 on:** October 03, 2013, 01:41:00 pm »

Performer is Artist, which is captured.

btw. AMG Album Pick is done.

SkGe · « **Reply #89 on:** October 03, 2013, 01:57:12 pm »

Quote from: MrC on October 03, 2013, 01:41:00 pm

Performer is Artist, which is captured.

btw. AMG Album Pick is done.

Performer as artist don't do nothing on that field, remain empty after the import. Can this performer be different from artist field?
Ex: Artist Album Moby; Artist Moby (feat Moby) as picture show uphead
Performer field: Moby/Moby ?
My mistake, i did change the artist to my field (performer) and is working, but without anything else, not additional info.

MrC · « **Reply #90 on:** October 03, 2013, 04:58:43 pm »

Please send me a PM with your email so that I can send you an update to test out.

Here's what's coming up (already done):

Version 1.11
- New: AMG Album Pick field: key 'apick'.
- Change: AMG Track Pick key 'pick' is now 'tpick'.
- New: AMG Track Review: key 'treview'.
- New: AMG Track URL field: key 'turl'.
- New: format and values included in Releases is controlled by a template. See the sample config file.
- New: Lyrics included with key 'lyrics'.

MrC · « **Reply #91 on:** October 09, 2013, 08:56:52 pm »

Let's consider this current thread closed, and henceforth use the new thread in the link below.

Version 1.11
- New: AMG Album Pick field: key 'apick'.
- Change: AMG Track Pick key 'pick' is now 'tpick'.
- New: AMG Track Review: key 'treview'.
- New: AMG Track URL field: key 'turl'.
- New: format and values included in Releases is controlled by a template. See the sample config file.
- New: field Lyrics included with key 'lyrics'.
- New: add version number to mpl attribute.
- New: field Featuring (featured track artists) included with key 'featuring'.
- Change: removed --htmlfile option
- New: -h available now as shortcut for --help
- Change: config file rename to amg-config.txt (for easier file editing on Windows).
- New: tags can be updated via MCWS instead of importing an MPL file. Use the
option --mcws. See MCWS in the config file for settings and requirements. Other
related options are --password to specify username:password and --server for server:port.

Version 1.11 is now posted here:

http://yabb.jriver.com/interact/index.php?topic=84268.0

INTERACT FORUM

Author Topic: A very special task ( for MrC? :-) ) (Read 22260 times)