INTERACT FORUM

Please login or register.

Login with username, password and session length
Advanced search  
Pages: [1]   Go Down

Author Topic: Otto has a little sister named Tella -- New Recommendation System in 12.0.462  (Read 8808 times)

JimH

  • Administrator
  • Citizen of the Universe
  • *****
  • Posts: 72477
  • Where did I put my teeth?

I don't know what we'll call her when she's finished, but she's a blabbermouth if you let her be.

Under Tools/Options/General, there is a new option called "Submit song ratings to recommendation system".  If you check it, MC will start updating our database with anonymous information (you're just a number to us) that tells us which tracks you like.  It reports skips, plays, and ratings to our database.

WE NEED some DATA to make it do anything.  If a couple of hundred people checked the box, we'd have it in a few days.

We hope to have the other side running in a build later this week.  It will have a new section under Services in the tree that shows you tracks it thinks you'll like.

Thanks to JohnT for cooking this up.  More to come.
Logged

edbro

  • Regular Member
  • Citizen of the Universe
  • *****
  • Posts: 734

How does it work in the other direction? Are the ratings applied to music on CD lookup? Can they be rejected?

Sounds interesting but I keep thinking that my 5 star rating might be somebody else's two.
Logged

jgreen

  • Citizen of the Universe
  • *****
  • Posts: 2419

I can just hear Marlon Brando calling up the stairs:

"TELLA!"
Logged

AoXoMoXoA

  • Regular Member
  • Citizen of the Universe
  • *****
  • Posts: 1551
  • I am a kangaroo . . . . no, really!

So, I guess someone who uses album ratings rather than track ratings, and plays whole albums in track order without skipping would be useless to you?   ;D


Actually this sounds like a great feature and I cannot wait to see it in aciton.
Logged
. . . the game is rigged

tombert

  • Galactic Citizen
  • ****
  • Posts: 449

hmmm ... enabled it ... but I'am not always online ... so I think MC regularly tries to transmitt?
Logged

Vulcan

  • Junior Woodchuck
  • **
  • Posts: 64

Sounds interesting... Can you give us some more info on how this will work?
Logged

Dutch Peter

  • Regular Member
  • Citizen of the Universe
  • *****
  • Posts: 618
  • Carpe Diem

If "Submit song ratings to recommendation system" is renamed to "Enable online metadata (lookup and submit)" i have got it checked.
Otherwise I can not find it!?
Logged
Stupid questions do not exist, only stupid answers.

JohnT

  • Citizen of the Universe
  • *****
  • Posts: 4627

Quote
If "Submit song ratings to recommendation system" is renamed to "Enable online metadata (loopup and submit)" i have got it checked.
Otherwise I can not find it!?
No that's not it. Look in Tools/Options/General/Online Metadata

Quote
hmmm ... enabled it ... but I'am not always online ... so I think MC regularly tries to transmitt?
Currently (and this may change) MC checks at program startup to see if a submission has been done within the last 24 hours. If not, it submits new or changed track usage data (maximum 1000 tracks per daily submission) and downloads the latest set of recommended tracks. The latest version also has a button to submit tracks more often, however it won't get a fresh set of recommendations more than once per day (this will probably change).

Quote
So, I guess someone who uses album ratings rather than track ratings, and plays whole albums in track order without skipping would be useless to you?
No, you should still get decent recommendations when we have enough data. We also plan to improve the system over time to make broader recommendations (artists, albums, styles, users with similar tastes, etc.). Right now, we don't have enough data to make great recommendations, but that will hopefully change with your input.

Quote
How does it work in the other direction? Are the ratings applied to music on CD lookup? Can they be rejected?
The ratings that you submit are yours only. The recommendations that you get back are tracks that you don't have in your library, the ratings on them are what our system deduces for you. These aren't real tracks that you get back of course, they're just metadata pointing to a track that you could potentially buy at Amazon, or download through a subscription service, or buy on a CD, etc.  We'd like to add the functionality to hear previews of these and provide links to purchase and download.
Logged
John Thompson, JRiver Media Center

eba

  • Galactic Citizen
  • ****
  • Posts: 351

As I currently haven't rated anything at all, I think in order to get anything out of this I could do with something that automatically rates my songs.  Based on my listening tendencies, I think the best way to do this would be based on volume at beginning of track compared to volume by the end.  No change = 3 star, 20% increases or decreases would gain or remove stars.  Feature request? ;)
(Naturally it would have to be linked to my stereo system somehow as I rarely use MC's internal volume...)

Baron Samedi

  • Recent member
  • *
  • Posts: 36

I'm not using Rating either, is the number plays sufficient to benefit of the recommendation system?
Logged

Dutch Peter

  • Regular Member
  • Citizen of the Universe
  • *****
  • Posts: 618
  • Carpe Diem

Quote
Quote
If "Submit song ratings to recommendation system" is renamed to "Enable online metadata (loopup and submit)" i have got it checked.
Otherwise I can not find it!?
No that's not it. Look in Tools/Options/General/Online Metadata

I am in!!!
Logged
Stupid questions do not exist, only stupid answers.

JohnT

  • Citizen of the Universe
  • *****
  • Posts: 4627

I'm not using Rating either, is the number plays sufficient to benefit of the recommendation system?
Yes it is. Since the rating field is often unused, we go mainly off of the number of times the track has been played and skipped. Playcount increases the rating, skip count decreases it. If the rating field is filled in, we use it to augment the playcount and skipcount.
Logged
John Thompson, JRiver Media Center

Vulcan

  • Junior Woodchuck
  • **
  • Posts: 64

Did you guys consider basing this information off of something like last.fm?  I feel like that would at least give you a good starting point for relative number of plays.
Logged

JohnT

  • Citizen of the Universe
  • *****
  • Posts: 4627

Did you guys consider basing this information off of something like last.fm?  I feel like that would at least give you a good starting point for relative number of plays.
They made their data unavailable several years ago. You can get data about your own listening habits, or the top 10 artists, albums, etc., but you can't get at the full data.
Logged
John Thompson, JRiver Media Center

Vulcan

  • Junior Woodchuck
  • **
  • Posts: 64

They made their data unavailable several years ago. You can get data about your own listening habits, or the top 10 artists, albums, etc., but you can't get at the full data.
Didn't realize that.
Logged

tombert

  • Galactic Citizen
  • ****
  • Posts: 449

... number of times the track has been played and skipped. ...

I'am interested in: how long do I have to play a song till its counted as "played"? 90 %, 80 % or really play it till the end to be counted as "played"?

thx
tom
Logged

mark_h

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 1854

Yes it is. Since the rating field is often unused, we go mainly off of the number of times the track has been played and skipped. Playcount increases the rating, skip count decreases it. If the rating field is filled in, we use it to augment the playcount and skipcount.

Counting skips for me will have the wrong effect - I listen to a lot of long tracks which I enjoy but which kind of fizzle out in the last 30 seconds or so so I often hit skip to avoid waiting for the fade down - this will be picked up by the system as me disliking a track when that is not the case...

Unless perhaps skipping is only counted if it's during the first certain % of a track?

Mark
Logged

mark_h

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 1854

Will there be some way to feedback that the suggestion is poor or good?

Mark
Logged

llafriel

  • World Citizen
  • ***
  • Posts: 230

I agree with mark_h here. I often skip tracks because I don't want to listen to it at that moment. The track may still be a great one. A system like last.fm with a like or dislike button would be better I think.
Logged

JohnT

  • Citizen of the Universe
  • *****
  • Posts: 4627

Quote
Will there be some way to feedback that the suggestion is poor or good?
That's a good idea.

Quote
Counting skips for me will have the wrong effect - I listen to a lot of long tracks which I enjoy but which kind of fizzle out in the last 30 seconds or so so I often hit skip to avoid waiting for the fade down - this will be picked up by the system as me disliking a track when that is not the case...
Unless perhaps skipping is only counted if it's during the first certain % of a track?
Skip count is only incremented if you skip during the first half of the content. Otherwise it's added to number of plays.

I agree with mark_h here. I often skip tracks because I don't want to listen to it at that moment. The track may still be a great one. A system like last.fm with a like or dislike button would be better I think.
You can use the ratings field for that - mark it 4 or 5 stars for "like" and 1 or 2 stars for "dislike". We'll probably add an options dialog at some point that would allow you turn off skip counting.

Thanks guys. Keep the ideas (and data) coming. We're getting more and more data and I would expect the system may start spitting out some accurate and useful suggestions by the end of the week.
Logged
John Thompson, JRiver Media Center

mark_h

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 1854

Quote
That's a good idea.

And if fact a way to say "don't recommend again" - eg in the case where the recommendation is good but that you don't want it to be recommended again for whatever reason... perhaps you've ordered the CD for instance...

Mark
Logged

Dutch Peter

  • Regular Member
  • Citizen of the Universe
  • *****
  • Posts: 618
  • Carpe Diem

Is there a way to look at the collected data?

I am very curious how you are presenting the suggestions ........?
Is this via MC, a playlist, a website ?? Email??
Logged
Stupid questions do not exist, only stupid answers.

JohnT

  • Citizen of the Universe
  • *****
  • Posts: 4627

Is there a way to look at the collected data?

I am very curious how you are presenting the suggestions ........?
Is this via MC, a playlist, a website ?? Email??
Currently it's a very plain "track" listing you can get to from "Services & Plug-ins" / Suggestions. You can't do much with it right now, but that will change. We hope to add lots of interactivity over time. Amazon links and previews, Wiki links, MC user groups, etc.
Logged
John Thompson, JRiver Media Center

Dutch Peter

  • Regular Member
  • Citizen of the Universe
  • *****
  • Posts: 618
  • Carpe Diem

Currently it's a very plain "track" listing you can get to from "Services & Plug-ins" / Suggestions. You can't do much with it right now, but that will change. We hope to add lots of interactivity over time. Amazon links and previews, Wiki links, MC user groups, etc.

John,
I do not see anything under Services & Plug-ins / Music Suggestions!!!?
I have the option 'submit songs rating to recommandation system' checked.
I am currently not playing any song.
Logged
Stupid questions do not exist, only stupid answers.

JohnT

  • Citizen of the Universe
  • *****
  • Posts: 4627

The list of suggested tracks was first implemented in build 464. What build are you running?
Logged
John Thompson, JRiver Media Center

Dutch Peter

  • Regular Member
  • Citizen of the Universe
  • *****
  • Posts: 618
  • Carpe Diem

The list of suggested tracks was first implemented in build 464. What build are you running?

465, so I should be ok.

Maybe no suggestions were made based on what I have been playing?
Logged
Stupid questions do not exist, only stupid answers.

eba

  • Galactic Citizen
  • ****
  • Posts: 351

To begin with I got a load of recommendations.
Then the next time I looked they had all disappeared and for a couple of days there were none there.
And then they appeared again, and have been there since.

datdude

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 2226

That's a good idea.
Skip count is only incremented if you skip during the first half of the content. Otherwise it's added to number of plays.
You can use the ratings field for that - mark it 4 or 5 stars for "like" and 1 or 2 stars for "dislike". We'll probably add an options dialog at some point that would allow you turn off skip counting.

Thanks guys. Keep the ideas (and data) coming. We're getting more and more data and I would expect the system may start spitting out some accurate and useful suggestions by the end of the week.
Yeah hopefully the preview can be built in to the MC playback engine, or at least a miniature pop up of the song auto playing from amazon, but I don't want ot open up a large page and have to find the song to play.
Logged
"You are not a beautiful or unique snowflake." -  Just a very big snowball

Dutch Peter

  • Regular Member
  • Citizen of the Universe
  • *****
  • Posts: 618
  • Carpe Diem

To begin with I got a load of recommendations.
Then the next time I looked they had all disappeared and for a couple of days there were none there.
And then they appeared again, and have been there since.

I still have an empty list in front of me. Also after restart of MC.
Logged
Stupid questions do not exist, only stupid answers.

Dutch Peter

  • Regular Member
  • Citizen of the Universe
  • *****
  • Posts: 618
  • Carpe Diem

I still have an empty list in front of me. Also after restart of MC.

Just checked on my laptop. There I do have suggestions.
Laptop is XP, desktop is Vista .....?
Logged
Stupid questions do not exist, only stupid answers.

JohnT

  • Citizen of the Universe
  • *****
  • Posts: 4627

Quote
Yeah hopefully the preview can be built in to the MC playback engine, or at least a miniature pop up of the song auto playing from amazon, but I don't want to open up a large page and have to find the song to play.
Unfortunately, Amazon does not currently allow preview playback outside of their web pages. Hopefully that will change.
Logged
John Thompson, JRiver Media Center

JohnT

  • Citizen of the Universe
  • *****
  • Posts: 4627

Quote
Laptop is XP, desktop is Vista .....?
I'll check into that today.

Quote
I still have an empty list in front of me. Also after restart of MC.
Quote
Maybe no suggestions were made based on what I have been playing?
It's possible there was not enough correlation with other users to make recommendations. Our data set is only a week old but it's growing fast. How many songs are in your MC library? What are the most common entries in your genre column?

Quote
To begin with I got a load of recommendations.
Then the next time I looked they had all disappeared and for a couple of days there were none there.
And then they appeared again, and have been there since.
That sounds right. The first couple of days, the system was just sending out random tracks to test the functionality. Then it started doing "real" recommendations but since the database was so tiny at first, many users didn't have enough correlation to get any recommendations.
Logged
John Thompson, JRiver Media Center

eba

  • Galactic Citizen
  • ****
  • Posts: 351

The first couple of days, the system was just sending out random tracks to test the functionality.

Thank FSM for that.  I thought it actually thought I'd like Robbie Williams.

Dutch Peter

  • Regular Member
  • Citizen of the Universe
  • *****
  • Posts: 618
  • Carpe Diem

Quote
It's possible there was not enough correlation with other users to make recommendations. Our data set is only a week old but it's growing fast. How many songs are in your MC library? What are the most common entries in your genre column?
I play basically the same on my desktop as on my laptop.
I have 10.000+ songs in my Library.
Most common genres are: pop, easy listening, party, album.
Album needs some explanation:
Let's say i buy a new album because I like a song I heard on the radio.
That song would be genre 'pop', or maybe 'easy listening' or sometimes 'party'.
The rest of the songs will be labeled on genre Album. Some tracks stay there forever, some change once I know what it should be.
I use this a lot when using Smartlists.

I do not use rock, rock/pop, indie, etc etc .....
Logged
Stupid questions do not exist, only stupid answers.

Dutch Peter

  • Regular Member
  • Citizen of the Universe
  • *****
  • Posts: 618
  • Carpe Diem

I checked my desktop again.
No suggestions in the list.
After that i unchecked the 'subimt ratings ..' option.
Immediately the list was filled with 20 files.
After that I rechecked the option again.
Logged
Stupid questions do not exist, only stupid answers.

raldo

  • Citizen of the Universe
  • *****
  • Posts: 1102

The ratings that you submit are yours only. The recommendations that you get back are tracks that you don't have in your library, the ratings on them are what our system deduces for you. These aren't real tracks that you get back of course, they're just metadata pointing to a track that you could potentially buy at Amazon, or download through a subscription service, or buy on a CD, etc.  We'd like to add the functionality to hear previews of these and provide links to purchase and download.

Is it possible to also include tracks *in your own* collection which have never been played?

I.e. "You have the song but you never realized ..."
Logged

Dutch Peter

  • Regular Member
  • Citizen of the Universe
  • *****
  • Posts: 618
  • Carpe Diem

Is it possible to also include tracks *in your own* collection which have never been played?

I.e. "You have the song but you never realized that they were great"

I like that idea. Maybe it could be an option. Matching with the library should be configurable: some people would like Genre and Album  included, some not.
Logged
Stupid questions do not exist, only stupid answers.

p7389

  • World Citizen
  • ***
  • Posts: 171

I activated this. Probably won't use it, but no harm in being a number in the database.
Logged
[img width= height= alt=My Top Albums]http://lastfm.obsessive-media.de/3month/7x1/p7389.jpeg[/img]

JohnT

  • Citizen of the Universe
  • *****
  • Posts: 4627

Is it possible to also include tracks *in your own* collection which have never been played?

I.e. "You have the song but you never realized ..."
Interesting idea for people with large collections. It sounds like something we could build into the MC smartlist system.
Logged
John Thompson, JRiver Media Center

raldo

  • Citizen of the Universe
  • *****
  • Posts: 1102

This is probably far fetched, and from a software probably a quite different challenge, but...

Could this mechanism be expanded to also include movies?

I'm currently using http://movielens.umn.edu/main for this purpose, and I find the hits which this site produces extremely accurate.

I have rated all the movies in my collection both in Movielens and in MC...
Logged

JohnT

  • Citizen of the Universe
  • *****
  • Posts: 4627

This is probably far fetched, and from a software probably a quite different challenge, but...

Could this mechanism be expanded to also include movies?

I'm currently using http://movielens.umn.edu/main for this purpose, and I find the hits which this site produces extremely accurate.

I have rated all the movies in my collection both in Movielens and in MC...
We plan to extend this to all media at some point, but for now it's music only.
Logged
John Thompson, JRiver Media Center

raldo

  • Citizen of the Universe
  • *****
  • Posts: 1102

We plan to extend this to all media at some point, but for now it's music only.

I think you're on the right track. This is definitely value added for the user.

(Make sure you include cross media recommendations!)
Logged

Dutch Peter

  • Regular Member
  • Citizen of the Universe
  • *****
  • Posts: 618
  • Carpe Diem

When do the suggestion change?
It seems to be static over the last few days.
What triggers a change?
Should I be able to refresh the suggestions?
Should I be able to exclude suggestions? Based on artist, genre, .....
Logged
Stupid questions do not exist, only stupid answers.

MusicHawk

  • Citizen of the Universe
  • *****
  • Posts: 796

Sounds potentially eye-opening, given the gigantic universe of music that might be involved. Of course, we don't want GIGO...

I wonder if a user-entered Rating, if there is one for a song, should override number of plays to determine the user's opinion of the track. The number of plays can be incremented for reasons that don't necessarily indicate a superior track (random mode, for instance, or radio mode, or the listener is not sitting at MC ready to skip every "weak" track). In contrast, a terrific song might be played rarely but still have a very high Rating that could help others discover the song. This is especially likely with the large/huge libraries some users seem to have -- even the best music can't all be played frequently. If someone has made the effort to add a Rating, it's probably the most important determinant of the song's value to that person, isn't it?

>> MC checks at program startup to see if a submission has been done within the last 24 hours.

Is this the only time it runs, or does it run daily, or on a configurable schedule? Other than to install an update, my MC doesn't get stopped/restarted. Even if it's not being used by me, it's the server for other computers in the house. With the size of my library, even at 1000 tracks EVERY day it would take many months to send it all to you.

Also, I actually have multiple libraries (no need to plow through Christmas songs except at Christmas, or my old radio shows, or whatever). I presume the submission process only acts on the currently-loaded library. Will it get confused when the user switches between libraries?

Where is the submission option setting stored? I regularly copy my main library from my desktop to a laptop which I use mobile WITHOUT an Internet connection, or sometimes with a very slow connection. Will the option be thereby copied to the laptop? If so, will MC notice there's not a good connection and not keep trying to submit data?
Logged
Managing my media with JRiver since Media Jukebox 8 (maybe earlier), currently use Media Center for Audio/Music and Photos/Videos.
My career in media spans Radio, TV, Print, Photography, Music, Film, Online, Live, Advertising, as producer, director, writer, performer, editor, engineer, executive, owner. An exhausting but amazing ride.

mark_h

  • MC Beta Team
  • Citizen of the Universe
  • *****
  • Posts: 1854

What does the "Submit Ratings" button on the suggestions page actually do?

Mark
Logged

JohnT

  • Citizen of the Universe
  • *****
  • Posts: 4627

What does the "Submit Ratings" button on the suggestions page actually do?

Mark

It scans your library for songs that need to be submitted (new song or playcount changed). It uploads that data and receives a list of recommendations (if available) in the reply from the server.
Logged
John Thompson, JRiver Media Center

JohnT

  • Citizen of the Universe
  • *****
  • Posts: 4627

When do the suggestion change?
It seems to be static over the last few days.
What triggers a change?
Should I be able to refresh the suggestions?
Should I be able to exclude suggestions? Based on artist, genre, .....
Currently it's once a day, but it may have been static for a couple days. If this is still the case, let me know.
Logged
John Thompson, JRiver Media Center

JohnT

  • Citizen of the Universe
  • *****
  • Posts: 4627

I wonder if a user-entered Rating, if there is one for a song, should override number of plays to determine the user's opinion of the track. The number of plays can be incremented for reasons that don't necessarily indicate a superior track (random mode, for instance, or radio mode, or the listener is not sitting at MC ready to skip every "weak" track). In contrast, a terrific song might be played rarely but still have a very high Rating that could help others discover the song. This is especially likely with the large/huge libraries some users seem to have -- even the best music can't all be played frequently. If someone has made the effort to add a Rating, it's probably the most important determinant of the song's value to that person, isn't it?
Currently rating is equally weighted with playcount, but I agree that rating may be more important. We may change the weighting or make it user selectable.

Quote
>> MC checks at program startup to see if a submission has been done within the last 24 hours.

Is this the only time it runs, or does it run daily, or on a configurable schedule? Other than to install an update, my MC doesn't get stopped/restarted. Even if it's not being used by me, it's the server for other computers in the house. With the size of my library, even at 1000 tracks EVERY day it would take many months to send it all to you.
This is another area that may need changes. Maybe base the max submission size off of library size.

Quote
Also, I actually have multiple libraries (no need to plow through Christmas songs except at Christmas, or my old radio shows, or whatever). I presume the submission process only acts on the currently-loaded library. Will it get confused when the user switches between libraries?
No, it just scans tracks in whatever library is currently open.

Quote
Where is the submission option setting stored? I regularly copy my main library from my desktop to a laptop which I use mobile WITHOUT an Internet connection, or sometimes with a very slow connection. Will the option be thereby copied to the laptop? If so, will MC notice there's not a good connection and not keep trying to submit data?
The option setting isn't stored in the database so that won't be a problem.

Thanks for the ideas.
JohnT
Logged
John Thompson, JRiver Media Center
Pages: [1]   Go Up