INTERACT FORUM

Please login or register.

Login with username, password and session length
Advanced search  
Pages: 1 [2]   Go Down

Author Topic: A very special task ( for MrC? :-) )  (Read 21665 times)

Arindelle

  • Citizen of the Universe
  • *****
  • Posts: 2772
Re: A very special task ( for MrC? :-) )
« Reply #50 on: August 07, 2013, 12:12:39 pm »

having a bit of a problem running perl .. I downloaded the 64bit version -- would this pose any issues?
Logged

MrC

  • Citizen of the Universe
  • *****
  • Posts: 10462
  • Your life is short. Give me your money.
Re: A very special task ( for MrC? :-) )
« Reply #51 on: August 07, 2013, 12:13:09 pm »

Nope, not if you have a 64-bit Windows.  I have the 64-bit version too.  What's the issue?
Logged
The opinions I express represent my own folly.

MrC

  • Citizen of the Universe
  • *****
  • Posts: 10462
  • Your life is short. Give me your money.
Re: A very special task ( for MrC? :-) )
« Reply #52 on: August 07, 2013, 12:14:50 pm »

[edit: see post 60 for the latest version and changes]

Attached is Version 1.5.

Changes:
    - New: option --rating allows selecting format of AMG rating (d=0-9, f=0.0-5.0)
    - New: localized numeric output for rating value (i.e. when --rating=f)
    - Fix: problem when using --excludes

If you want ratings to range from 0.0 to 5.0 (i.e. includes half points), use --rating f.  Otherwise, --rating d is the default.
Logged
The opinions I express represent my own folly.

vagskal

  • Citizen of the Universe
  • *****
  • Posts: 1227
Re: A very special task ( for MrC? :-) )
« Reply #53 on: August 30, 2013, 10:51:20 am »

I am getting these error messages now:

Quote
*** Use of uninitialized value $tracklisting in substitution (s///) at amg.pl li
ne 234.

*** Use of uninitialized value $tracklisting in split at amg.pl line 235.

AMG HTML has changed.  amg.pl needs to be updated for the new format.
Stopped at amg.pl line 280.
Tryck ned valfri tangent för att fortsätta...

http://www.allmusic.com/album/dig-thy-savage-soul-mw0002557546

Is there anything that can be done?
Logged

MrC

  • Citizen of the Universe
  • *****
  • Posts: 10462
  • Your life is short. Give me your money.
Re: A very special task ( for MrC? :-) )
« Reply #54 on: August 30, 2013, 10:59:52 am »

What is the full command line you are using (so I can replicate your usage)?

That page only includes a review, so you'll need to specify one of --fileregex or --sequence.
Logged
The opinions I express represent my own folly.

vagskal

  • Citizen of the Universe
  • *****
  • Posts: 1227
Re: A very special task ( for MrC? :-) )
« Reply #55 on: August 30, 2013, 11:06:05 am »

It is a .bat file with this, as you taught me:
@echo off
perl amg.pl perl  amg.pl  -s  -i moods,themes,styles,credits,review,rating -A --append --rating f
pause
Logged

MrC

  • Citizen of the Universe
  • *****
  • Posts: 10462
  • Your life is short. Give me your money.
Re: A very special task ( for MrC? :-) )
« Reply #56 on: August 30, 2013, 11:11:42 am »

Ok, this is a case I hadn't encountered before.  There are no tracks listed on the main page.  I'll have to work around this.  Be back later...
Logged
The opinions I express represent my own folly.

MrC

  • Citizen of the Universe
  • *****
  • Posts: 10462
  • Your life is short. Give me your money.
Re: A very special task ( for MrC? :-) )
« Reply #57 on: August 30, 2013, 11:45:00 am »

I sent you a private update in email.  Let me know how it works out.
Logged
The opinions I express represent my own folly.

MrC

  • Citizen of the Universe
  • *****
  • Posts: 10462
  • Your life is short. Give me your money.
Re: A very special task ( for MrC? :-) )
« Reply #58 on: August 30, 2013, 12:09:37 pm »

[edit: see post 60 for the latest version and changes]

Attached is Version 1.6.

Changes:
    - Fix: resolved problem with options being case-insensitve
    - Fix: handle entries where no track listings exist, to allow grabbing review, etc. only
Logged
The opinions I express represent my own folly.

vagskal

  • Citizen of the Universe
  • *****
  • Posts: 1227
Re: A very special task ( for MrC? :-) )
« Reply #59 on: August 30, 2013, 02:01:39 pm »

Thanks! All is good.
Logged

MrC

  • Citizen of the Universe
  • *****
  • Posts: 10462
  • Your life is short. Give me your money.
Re: A very special task ( for MrC? :-) )
« Reply #60 on: September 03, 2013, 12:15:09 pm »

[edit: see post 62 for the latest version and changes]

Attached is Version 1.7:

Changes:
    - Fix: support fields w/embedded newlines (e.g. lyrics)
    - New: output command line w/debug enabled
Logged
The opinions I express represent my own folly.

MrC

  • Citizen of the Universe
  • *****
  • Posts: 10462
  • Your life is short. Give me your money.
Re: A very special task ( for MrC? :-) )
« Reply #61 on: September 05, 2013, 03:34:16 pm »

MC 19.0.36 changed the format of the data on the clipboard.  I've updated the script to accommodate this, but want to wait for tonight's build as there may be one additional change.  If anyone needs it, let me know.
Logged
The opinions I express represent my own folly.

MrC

  • Citizen of the Universe
  • *****
  • Posts: 10462
  • Your life is short. Give me your money.
Re: A very special task ( for MrC? :-) )
« Reply #62 on: September 06, 2013, 05:40:08 pm »

[edit: see post 71 for the latest version and changes]

Attached is Version 1.8:

Changes:
    - New: support MC 19.0.36's RFC 4180 clipboard text

Note: this version requires installing an additional perl module (used to handle the new RFC 4180 format of the clipboard).  Install it from a Windows command shell by entering:

   ppm install Text-CSV

Version 1.8 will auto-detect the format of the clipboard, so it is safe to use with any MC version.
Logged
The opinions I express represent my own folly.

vagskal

  • Citizen of the Universe
  • *****
  • Posts: 1227
Re: A very special task ( for MrC? :-) )
« Reply #63 on: September 07, 2013, 11:38:51 am »

Thanks. It is working great.

I suppose there is no way to display in a pane the persons in the AMG Credits without their role on the respective albums, so that I can get all albums credited to Artist X irrespective of if he is playing guitar on one album and harmonica on another (until we get global RegEx search)?
Logged

MrC

  • Citizen of the Universe
  • *****
  • Posts: 10462
  • Your life is short. Give me your money.
Re: A very special task ( for MrC? :-) )
« Reply #64 on: September 07, 2013, 11:59:24 am »

Would you like an option to not include their roles?
Logged
The opinions I express represent my own folly.

vagskal

  • Citizen of the Universe
  • *****
  • Posts: 1227
Re: A very special task ( for MrC? :-) )
« Reply #65 on: September 07, 2013, 12:08:08 pm »

Would you like an option to not include their roles?

Thanks for the offer, but I do not think so. It is of course of importance if an artist plays guitar or harmonica on an album, and I like to gather all metadata available and not cripple what is there. I would like the ability to not _display_ their role in a pane, but I guess this is impossible until a global RegEx option is introduced.
Logged

MrC

  • Citizen of the Universe
  • *****
  • Posts: 10462
  • Your life is short. Give me your money.
Re: A very special task ( for MrC? :-) )
« Reply #66 on: September 07, 2013, 12:29:13 pm »

You could replace the " [" with \ and remove the ] characters to create a hierarchical list (effectively hiding the roles):

   removecharacters(replace([AMG Credits], / /[, \), /])&datatype=[list]

We could also create a separate mapping of AMG Credits (no roles), so you could get both.
Logged
The opinions I express represent my own folly.

vagskal

  • Citizen of the Universe
  • *****
  • Posts: 1227
Re: A very special task ( for MrC? :-) )
« Reply #67 on: September 07, 2013, 12:38:33 pm »

Thanks for the tip. I forgot about that. I do not use nested lists in panes because I need scroll by typing to work reliably there (which it is not).

Maybe a second custom field ([AMG Credits (only name)]) with just the artist name for the pane would be ideal for the time being.
Logged

MrC

  • Citizen of the Universe
  • *****
  • Posts: 10462
  • Your life is short. Give me your money.
Re: A very special task ( for MrC? :-) )
« Reply #68 on: September 07, 2013, 03:21:52 pm »

I've sent you a private release.
Logged
The opinions I express represent my own folly.

MrC

  • Citizen of the Universe
  • *****
  • Posts: 10462
  • Your life is short. Give me your money.
Re: A very special task ( for MrC? :-) )
« Reply #69 on: September 14, 2013, 01:50:37 pm »

[edit: see post 71 for the latest version and changes]

Attached is Version 1.9:

Changes:
    - Fix: problem with RE used to detect and split rows of track data.
    - New: include new field mapping: credits_nr ==> "AMG Credits (only name)" which is the same as 'credits',
      sans the per-person bracketed credits.
    - New: Awards page parsing.  Keys 'awards_bba', 'awards_bbs', and 'awards_gra' map to
      Fields: "Billboard Albums", "Billboard Singles", and "Grammy Awards", respectively.
      Use "-e awards_bba,awards_bbs,awards_gra" if you don't want these fields (avoids extra page pulling).
    - New: Releases page parsing.  Key 'releases' maps to Field: "Releases".
      Use "-e releases" if you don't want this field (avoids extra page pulling).
    - Fix: some reviews don't have author attributions.
    - Fix: handle existing HTML entities better in Credits.
    - Change: add space after list delimiter in Credits.
    - Change: -c is now -C (to specify a clipfile)
    - New: program will read some values from a config file specified with -c or --configfile.  See the sample
      config file that accompanies this release.
    - New: Credits mapping to selectively map credits to other MC fields, or ignore certain credits.  See the
      sample config file.

Thanks vagskal for your testing.

I'm considering adding an option to use MCWS to update the tracks, so that the manual MPL import won't be necessary.  The code is working, but it makes a lot of calls as each field, for each track, requires a connection, and I was hoping to use a method that does bulk updates for a given track.  If this would be of interest, chime in.

Also, I've written code to pull data from Discogs and may incorporate this as well.
Logged
The opinions I express represent my own folly.

Arindelle

  • Citizen of the Universe
  • *****
  • Posts: 2772
Re: A very special task ( for MrC? :-) )
« Reply #70 on: September 15, 2013, 02:16:41 am »

Although I've been way too busy lately to test this, just wanted to let you know, Mr. C, that there are more of us out there that appreciate your effort on this

Thanks much for taking so much time on this script ...
Logged

MrC

  • Citizen of the Universe
  • *****
  • Posts: 10462
  • Your life is short. Give me your money.
Re: A very special task ( for MrC? :-) )
« Reply #71 on: September 15, 2013, 12:23:01 pm »

[edit: see post 80 for the latest version and changes]

Attached is Version 1.9.1:

Changes:
    - Fix: the same track data was being output for each track
    - Fix: remove extraneous newlines / line feeds from clipboard data
Logged
The opinions I express represent my own folly.

SkGe

  • Galactic Citizen
  • ****
  • Posts: 433
Re: A very special task ( for MrC? :-) )
« Reply #72 on: October 02, 2013, 01:49:57 pm »

I have a little problem with the script
"C:\Users\...\Desktop>perl amg.pl -u http://www.allmusic.com/album/once-i-was-a
n-eagle-mw0002524684 > import.mpl
Failed to open \Users\Spiva\Desktop\import.mpl: Permission denied
Stopped at amg.pl line 795."
Any idea?
Logged

MrC

  • Citizen of the Universe
  • *****
  • Posts: 10462
  • Your life is short. Give me your money.
Re: A very special task ( for MrC? :-) )
« Reply #73 on: October 02, 2013, 02:46:21 pm »

With the current version, you don't need to do the redirection.  Just use:

   perl amg.pl -u http://www.allmusic.com/album/once-i-was-an-eagle-mw0002524684

The file will be created for you.  Otherwise, use the -o option to specify an output file:

   perl amg.pl -u http://www.allmusic.com/album/once-i-was-an-eagle-mw0002524684 -o import.mpl

   
Logged
The opinions I express represent my own folly.

SkGe

  • Galactic Citizen
  • ****
  • Posts: 433
Re: A very special task ( for MrC? :-) )
« Reply #74 on: October 02, 2013, 03:23:57 pm »

Thank for the reply MrC, and i have a few question to add
My album review/credits are large value and if i edit this type the script will not working, any idea how to fix it?
And i see that album rating is 0-10 and i use 0 to 5 (with .5) can this be change it on this way?
And thanks again for the support
Logged

SkGe

  • Galactic Citizen
  • ****
  • Posts: 433
Re: A very special task ( for MrC? :-) )
« Reply #75 on: October 02, 2013, 03:46:41 pm »

My mistake, i did change the wrong field in the script, now is working as intended but the date is geting only year and not the exact date, ofc if it have it.
Logged

MrC

  • Citizen of the Universe
  • *****
  • Posts: 10462
  • Your life is short. Give me your money.
Re: A very special task ( for MrC? :-) )
« Reply #76 on: October 02, 2013, 03:47:12 pm »

Which version of MC are you using?

Prior to 19, you can't have the large value (newline embedded) columns in the view and use Copy to clipboard.  MC19 allows supports what the script needs to correctly interpret the values on the clipboard.  So if you're using MC18, remove those columns from the view.

There are two ratings supported by the script: MC's 0-5 value, as key 'ratingsmc' and 'rating'.

Since version 1.5:

    - New: option --rating allows selecting format of AMG rating (d=0-9, f=0.0-5.0)

so you can get 0-9 or 0.0 - 5.0 ratings for the AMG rating (keyword 'rating').  Use --rating f to get floating point 0.0 - 5.0.

The Rating field will be scaled to fit MC's 0-5 integer scale (keyword ratingmc).
Logged
The opinions I express represent my own folly.

MrC

  • Citizen of the Universe
  • *****
  • Posts: 10462
  • Your life is short. Give me your money.
Re: A very special task ( for MrC? :-) )
« Reply #77 on: October 02, 2013, 03:49:27 pm »

My mistake, i did change the wrong field in the script, now is working as intended but the date is geting only year and not the exact date, ofc if it have it.

See the new config file.  You can set your field names there, so you don't need to modify the script any longer.

I'm only setting the Date as the Year value.  I can probably change it to accommodate the full date.  Would that be helpful?
Logged
The opinions I express represent my own folly.

SkGe

  • Galactic Citizen
  • ****
  • Posts: 433
Re: A very special task ( for MrC? :-) )
« Reply #78 on: October 02, 2013, 03:58:07 pm »

I tried today this script, (i know you did a great job) don't have the time to test it so today was good to start.
So far from what i read and tested works splendid, but i have some other things to fix it to be perfect or almost
I use ver 19 and it will be great if you get as date full not only year (when is possible)
And btw can i add more things to get like, review of songs or album release (label) or if an album is a pick.
Thanks.
Logged

MrC

  • Citizen of the Universe
  • *****
  • Posts: 10462
  • Your life is short. Give me your money.
Re: A very special task ( for MrC? :-) )
« Reply #79 on: October 02, 2013, 04:04:03 pm »

I'll take a look at the full date pulling.

As far as album review, etc., please take a look at the sample config file.  The script can pull more than the original posting indicates, and you can see from the config which key/MC Fields are available.

I really should start a new post in the 3rd party tools, and keep the main posting updated with the full description.
Logged
The opinions I express represent my own folly.

MrC

  • Citizen of the Universe
  • *****
  • Posts: 10462
  • Your life is short. Give me your money.
Re: A very special task ( for MrC? :-) )
« Reply #80 on: October 02, 2013, 05:22:08 pm »

[edit: see post 91 for the latest information]

Attached is Version 1.10:

Changes:
    - Fix: problem reading MC19's new clipboard format on Mac OS X.
    - New: support full dates in Date value.
    - New: option --yearonly or -y specifies Date values should be year-only
Logged
The opinions I express represent my own folly.

SkGe

  • Galactic Citizen
  • ****
  • Posts: 433
Re: A very special task ( for MrC? :-) )
« Reply #81 on: October 03, 2013, 06:20:12 am »

The script work nice and thank you for the help.
But i have a few question about this script.
Is possible to add some fields to fill it with info or do i need to code it myself?! (if so i'm zero skill there) why i ask this? is because i desire to get a few info from album page (like album pick, song review, performer and reviewer of song and album) when is possible ofc. .
And for releases field is possible to get only the label and nothing more? there you get year/album name and label.
Logged

MrC

  • Citizen of the Universe
  • *****
  • Posts: 10462
  • Your life is short. Give me your money.
Re: A very special task ( for MrC? :-) )
« Reply #82 on: October 03, 2013, 11:39:03 am »

Am I correct that you have not yet looked at the config file, because, as I've mentioned the script already pulls:

   Album Pick
   Album Review (there is no song review)
   Album Reviewer
   Track Composer
   Track Performer

I grab everything on the main page (Overview), and also the Credits, Awards, and Releases pages, and make it available to you.

As for the Releases, you just want a list of labels, from all formats (that seems ambiguous)?  See attached:

Logged
The opinions I express represent my own folly.

SkGe

  • Galactic Citizen
  • ****
  • Posts: 433
Re: A very special task ( for MrC? :-) )
« Reply #83 on: October 03, 2013, 12:49:35 pm »

I looked on the config file and searched on the script a way of what i asked, and i catch my eyes with all code and i don't know how to use it (yet, maybe one day i will).
As for the second thing, yes some album have on the track review (usual older one) and for the release, yes only the title of label, because when i get info from album i take where it is album discography.
The review link move you to another page and there you find what i talk about.
http://www.allmusic.com/album/play-mw0000243891
Logged

MrC

  • Citizen of the Universe
  • *****
  • Posts: 10462
  • Your life is short. Give me your money.
Re: A very special task ( for MrC? :-) )
« Reply #84 on: October 03, 2013, 12:56:54 pm »

I've never seen that!

I'll look into the song review, seems easy enough.  Should this override the album review field (e.g. AMG Review) for just that track, or should it be a separate field (e.g. AMG Track Review)?

For releases, I can provide a way to get just the list of the labels.  Maybe it will be like credits_nr, which are the credits without the role included (i.e. just people).
Logged
The opinions I express represent my own folly.

SkGe

  • Galactic Citizen
  • ****
  • Posts: 433
Re: A very special task ( for MrC? :-) )
« Reply #85 on: October 03, 2013, 01:07:15 pm »

Separate if it is possible.
And one more thing! Some albums have album pick like track pick, can be this also added?
Thank you!
Logged

MrC

  • Citizen of the Universe
  • *****
  • Posts: 10462
  • Your life is short. Give me your money.
Re: A very special task ( for MrC? :-) )
« Reply #86 on: October 03, 2013, 01:12:51 pm »

Ah, I see that also on the Moby album.  So much to learn.

I'll add it as AMG Album Pick.
Logged
The opinions I express represent my own folly.

SkGe

  • Galactic Citizen
  • ****
  • Posts: 433
Re: A very special task ( for MrC? :-) )
« Reply #87 on: October 03, 2013, 01:30:43 pm »

On the album view is a field called "performer" can this be added also? (only the names)
Logged

MrC

  • Citizen of the Universe
  • *****
  • Posts: 10462
  • Your life is short. Give me your money.
Re: A very special task ( for MrC? :-) )
« Reply #88 on: October 03, 2013, 01:41:00 pm »

Performer is Artist, which is captured.

btw. AMG Album Pick is done.
Logged
The opinions I express represent my own folly.

SkGe

  • Galactic Citizen
  • ****
  • Posts: 433
Re: A very special task ( for MrC? :-) )
« Reply #89 on: October 03, 2013, 01:57:12 pm »

Performer is Artist, which is captured.

btw. AMG Album Pick is done.

Performer as artist don't do nothing on that field, remain empty after the import. Can this performer be different from artist field?
Ex: Artist Album Moby; Artist Moby (feat Moby) as picture show uphead
Performer field: Moby/Moby ?

My mistake, i did change the artist to my field (performer) and is working, but without anything else, not additional info.
Logged

MrC

  • Citizen of the Universe
  • *****
  • Posts: 10462
  • Your life is short. Give me your money.
Re: A very special task ( for MrC? :-) )
« Reply #90 on: October 03, 2013, 04:58:43 pm »

Please send me a PM with your email so that I can send you an update to test out.

Here's what's coming up (already done):

Version 1.11
    - New: AMG Album Pick field: key 'apick'.
    - Change: AMG Track Pick key 'pick' is now 'tpick'.
    - New: AMG Track Review: key 'treview'.
    - New: AMG Track URL field: key 'turl'.
    - New: format and values included in Releases is controlled by a template.  See the sample config file.
    - New: Lyrics included with key 'lyrics'.
Logged
The opinions I express represent my own folly.

MrC

  • Citizen of the Universe
  • *****
  • Posts: 10462
  • Your life is short. Give me your money.
Re: A very special task ( for MrC? :-) )
« Reply #91 on: October 09, 2013, 08:56:52 pm »

Let's consider this current thread closed, and henceforth use the new thread in the link below.

Version 1.11
    - New: AMG Album Pick field: key 'apick'.
    - Change: AMG Track Pick key 'pick' is now 'tpick'.
    - New: AMG Track Review: key 'treview'.
    - New: AMG Track URL field: key 'turl'.
    - New: format and values included in Releases is controlled by a template.  See the sample config file.
    - New: field Lyrics included with key 'lyrics'.
    - New: add version number to mpl attribute.
    - New: field Featuring (featured track artists) included with key 'featuring'.
    - Change: removed --htmlfile option
    - New: -h available now as shortcut for --help
    - Change: config file rename to amg-config.txt (for easier file editing on Windows).
    - New: tags can be updated via MCWS instead of importing an MPL file.  Use the
      option --mcws.  See MCWS in the config file for settings and requirements. Other
      related options are --password to specify username:password and --server for server:port.

Version 1.11 is now posted here:

   http://yabb.jriver.com/interact/index.php?topic=84268.0
Logged
The opinions I express represent my own folly.
Pages: 1 [2]   Go Up