[Logo] Jaikoz and SongKong Forums
  [Search] Search   [Recent Topics] Recent Topics   [Members]  Member Listing   [Groups] Back to home page 
[Register] Register / 
[Login] Login 
Why Does SongKong Pro Take Longer Than SongKong Standard?  XML
Forum Index -> SongKong Issues
Author Message
GrampsAudio

Pro

Joined: 05/06/2015 23:04:11
Messages: 24
Offline

Hello again Paul,

I am perplexed by the results below.

After watching SongKong Standard slowly trudge through my collection of 4,832 audio files, last night I upgraded to SongKong Pro, in the hope that I would be able to cut the processing time in half, as stated on your website.

I ran SongKong Standard and SongKong Pro on the same exact set of files, using the same exact settings, which were basically the default settings in the downloaded app.

SongKong Standard took just over 97 minutes, so I assumed that SongKong Pro would take a maximum of 50 minutes to process the same files.

Not so. In fact, SongKong Pro took 39 minutes longer than SongKong Standard.

I also don't understand why 1,964 songs were checked by SongKong Standard, while SongKong Pro checked 2,680 files. Does this have anything to do with the fact that SongKong Standard modified some of the files, so 716 more files had to be checked by SongKong Pro?

Why do both reports also say that I cancelled the task, when I did no such thing? I just waited for it to complete on its own and automatically generate its report. In fact, the app seemed to cut in and start generating the report even before everything was done completing in that window with the rolling stats. I noticed that another user mentioned this same issue to you last month.

Oh, one other point: At the time that I ran both SongKong Standard and SongKong Pro, I did not have any CPU-intensive apps running on my machine. Also, there was constantly about 1.5 GB of free RAM available while each version of SongKong ran.

Anyway, I would be interested in hearing your thoughts regarding these issues.

-----

Report #12 using SongKong Standard:

Summary

Selected Folder :/Users/gramps/Musicalia
Base Folder:/Users/gramps/Musicalia
4,832 songs loaded into SongKong
1,964 songs checked against MusicBrainz and Discogs before task cancelled by user
4,062 (100%) songs matched to MusicBrainz release
19 (0%) songs matched to MusicBrainz song only
2,293 (100%) songs matched to Discogs
3,572 (100%) songs matched with Artwork
4,082 songs have had information modified and have been saved

Fix Songs Report 12 finished at Jun 10, 2015 3:12:31 AM
Songs matched in 1 hours 37 minutes 24 seconds

Report #13 using SongKong Pro:

Summary

Selected Folder :/Users/gramps/Musicalia
Base Folder:/Users/gramps/Musicalia
4,832 songs loaded into SongKong
2,680 songs checked against MusicBrainz and Discogs before task cancelled by user
4,062 (100%) songs matched to MusicBrainz release
19 (0%) songs matched to MusicBrainz song only
2,282 (85%) songs matched to Discogs
3,561 (100%) songs matched with Artwork
4,081 songs have had information modified and have been saved

Fix Songs Report 13 finished at Jun 10, 2015 6:29:26 AM
Songs matched in 2 hours 16 minutes 44 seconds
paultaylor

Pro
[Avatar]

Joined: 21/08/2006 09:21:27
Messages: 7298
Offline

Hi, the difference in speed refers to how many queries can be sent to the server, the Pro version allows you to send queries twice as quickly. So the Pro version should be quicker all other things being equal as queries to the server are usually the limiting factor, but it is only one part of the processing. I cannot really say why the Pro version took longer in this case, if you email me your support files (using Help:Create Support Files) I may be able to, however I still think leaving your computer for a couple of hours to fix over 4000 songs is not bad.

I;m more concerned about your point that it says it cancelled even though you did not ask it to, this indicates a bug so please send me your support files so I can investigate.



thanks Paul (Administrator)
GrampsAudio

Pro

Joined: 05/06/2015 23:04:11
Messages: 24
Offline

OOPS . . . Sorry, but I no longer have the support files. I have been doing a lot of testing, and the reports were starting to pile up under that menu, so I've been making it a habit to immediately delete them after reading them, when that becomes necessary.

But the next time that it happens, I will try to remember to zip up those files for you.
paultaylor

Pro
[Avatar]

Joined: 21/08/2006 09:21:27
Messages: 7298
Offline

HI, the reports only comprise part of the support files, there are also log files so I think you may have not deleted them so would be useful if you could run Help:Create Support Files and email me them anyway.

thanks Paul (Administrator)
GrampsAudio

Pro

Joined: 05/06/2015 23:04:11
Messages: 24
Offline

I just emailed you the support files for the last few runs.

BTW, for two or three runs, SongKong reported that it couldn't obtain the audioID -- or whatever it is called -- for one particular song.

Initially, I just assumed that this meant that your databases had no info regarding the song. However, I eventually got curious and had a look at the song.

As it turned out, the audio file was in some way corrupted and wouldn't even play. So I downloaded a fresh copy of the song, and then that particular error message disappeared from the reports.

My point is, if SongKong can't do a particular thing to a file because the file is corrupted, it would be nice if it would say that the file is corrupted, and therefore can't be worked with.

Just an idea.
chillware

Pro

Joined: 17/11/2010 13:13:39
Messages: 99
Offline

In SK 3.15 I'm seeing it quit scanning prematurely as well, it says canceled by user in the report. It seems to happen when I point it to very large folders of 15-20k+ mp3's in one folder.. I think this is a new bug in 3.15 .. it stops after only loading 2-5k songs, doesn't seem to start processing any songs really before it quits.
GrampsAudio

Pro

Joined: 05/06/2015 23:04:11
Messages: 24
Offline

Thanks for posting, chillware. It confirms that I am not the only one who has been experiencing the premature cancellation in 3.15. Hopefully, Paul will figure it out for us.
paultaylor

Pro
[Avatar]

Joined: 21/08/2006 09:21:27
Messages: 7298
Offline

Okay I have looked at your logs and there is a recurring error trying to update iTunes from SongKong for some reason. So could you try running a test on a subfolder with Save changes to iTunes disabled and see if that resolves.

Chillware, are you using iTunes - if so could you try this as well, and perhaps send me your logs files. But I didnt chnage anything in 3.15 for iTunes so if the problem really has just started in 3.25 then Imight be going down the wrong road.

If still fails with iTunes saving disabled could you incease loglevel to Config, try again and send me your support files.

thanks Paul (Administrator)
GrampsAudio

Pro

Joined: 05/06/2015 23:04:11
Messages: 24
Offline

Well, I don't know how helpful it will be to you being as I conducted a test on such a small sample of files. I chose a subfolder inside of my main music folder as my target folder. That folder in turn contains four subfolders, each with a different amount of audio files. Together, they total 41 audio files, or about 1% of my current collection.

Anyway, I will email you the support files in just a minute. This time that "cancelled by user" message does not appear in the report.

However, with that option disabled, doesn't that mean that the iTunes database won't be updated with the new metadata for my songs?
paultaylor

Pro
[Avatar]

Joined: 21/08/2006 09:21:27
Messages: 7298
Offline

Yes it does mean iTunes wont be autoupdated, but you can just select al the files in iTunes and do get Properties and that will update the files info . You shouldnt have any problems as long as you havent renamed them, but this is why I said use a small sample to not cause you unneccessary problems, can you rerun over the same files with the iTunes option re-enabled to see if the error message comes back, because if it doesnt it doesnt really help us.

thanks Paul (Administrator)
chillware

Pro

Joined: 17/11/2010 13:13:39
Messages: 99
Offline

I won't be able to send my logs until Monday.. However, no I not using iTunes, it's not installed on this machine. But the cancellation is consistent when I run sk on large folders of random singd (15-25k songs)

It starts to load several thousand or so, never starts any processing and quits.

I'll get logs on Monday for you.
GrampsAudio

Pro

Joined: 05/06/2015 23:04:11
Messages: 24
Offline

Interesting indeed.

I selected the very same set of 41 songs. As you can see by comparing the two reports below, with the iTunes auto-update option enabled, 29 songs were checked, and then SongKong was supposedly cancelled by me. In contrast, with the iTunes auto-update option disabled, all 41 songs were checked, and SongKong was not cancelled.

So what does this tell you? Is there a problem with a specific song -- whichever song #29 happens to be -- or is it the result of something else?

What I find odd is that despite the fact that only 29 songs were checked in the latest test, nevertheless, BOTH reports state that all 41 songs have been modified and saved.

Do you need the support files again?

Report #25 with iTunes auto-update option disabled in SongKong:


Selected Folder :/Users/gramps/Musicalia/Kirk Franklin
Base Folder:/Users/gramps/Musicalia
41 songs loaded into SongKong
41 songs checked against MusicBrainz and Discogs
41 (100%) songs matched to MusicBrainz release
0 (0%) songs matched to MusicBrainz song only
41 (100%) songs matched to Discogs
39 (95%) songs matched with Artwork
41 songs have had information modified and have been saved


Report #26 with iTunes auto-update option enabled in SongKong:

Selected Folder :/Users/gramps/Musicalia/Kirk Franklin
Base Folder:/Users/gramps/Musicalia
41 songs loaded into SongKong
29 songs checked against MusicBrainz and Discogs before task cancelled by user
41 (100%) songs matched to MusicBrainz release
0 (0%) songs matched to MusicBrainz song only
41 (100%) songs matched to Discogs
39 (100%) songs matched with Artwork
41 songs have had information modified and have been saved

paultaylor

Pro
[Avatar]

Joined: 21/08/2006 09:21:27
Messages: 7298
Offline

What this tells me is that in your case the Cancellation error is indeed cause d the iTunes error. I think it says 41% because all songs have already been matched previously or just a question of timing but the key thing is that Im sure if I can fix the iTunes bug it will fix this issue.

Now the question is why are you getting this iTunes error, i have b
never seen it before, is there anything unusual/complicated about your iTunes setup.

In the meantime, if you do not rename songs or add new songs you can use SongKong without iTunes integration and simply select all your songs in iTunes afterwards and do Get Info to update iTunes with the latest information. Mismatches between your music and iTunes view of your music only really occurs if you start renaming/moving files then iTunes is not always able to find the file any more and ends up with a dead link.

I think Chillwares problem must be differenent.

thanks Paul (Administrator)
GrampsAudio

Pro

Joined: 05/06/2015 23:04:11
Messages: 24
Offline

As far as I know, there is nothing unusual/complicated about my iTunes setup.

All I can say -- and as you can see from the support files -- is that I keep all of my music in a folder called "Musicalia, and I do not allow iTunes to copy the audio files into /Users/gramps/Music/iTunes/iTunes Media/Music/ -- as would normally be the case -- in order to conserve hard drive space. I just don't see the need to have double copies of my audio files on my hard drive.

I normally do not change audio file names, but if I do, it is from within iTunes itself via the "Get Info" option, and not directly via the Finder.

I do delete folders and songs via the Finder, but that is only when I also delete them from the iTunes library at the same time, because I don't like them.
paultaylor

Pro
[Avatar]

Joined: 21/08/2006 09:21:27
Messages: 7298
Offline

GrampsAudio wrote:
I just don't see the need to have double copies of my audio files on my hard drive.
 

I agree, I thinks its a bit silly.

GrampsAudio wrote:

I normally do not change audio file names, but if I do, it is from within iTunes itself via the "Get Info" option, and not directly via the Finder.
 

Right, I mean if using SongKong best not to use the Rename files based on Metadata matched option if you have Save changes to iTunes option disabled to avoid iTunes losing files.

thanks Paul (Administrator)
chillware

Pro

Joined: 17/11/2010 13:13:39
Messages: 99
Offline

logs sent..
GrampsAudio

Pro

Joined: 05/06/2015 23:04:11
Messages: 24
Offline

paultaylor wrote:
Right, I mean if using SongKong best not to use the Rename files based on Metadata matched option if you have Save changes to iTunes option disabled to avoid iTunes losing files. 


Hmmm . . . I am not sure what to do about that one, because some of the audio files I get have long ridiculous names, and I like the way that SongKong trims them and makes them all conform to the same standard within an album folder.
paultaylor

Pro
[Avatar]

Joined: 21/08/2006 09:21:27
Messages: 7298
Offline

Ok, well just be aware if you get a dead link in Itunes that is probbaly the reason, having said that iTunes on OSX is much better than iTunes on Windows of maintaining such links.

thanks Paul (Administrator)
paultaylor

Pro
[Avatar]

Joined: 21/08/2006 09:21:27
Messages: 7298
Offline

GrampsAudio - I have diagnosed the cause of your problems https://jthink.atlassian.net/browse/SONGKONG-864

thanks Paul (Administrator)
GrampsAudio

Pro

Joined: 05/06/2015 23:04:11
Messages: 24
Offline

Great! Now that you know what the problem is, you can work towards a solution.
paultaylor

Pro
[Avatar]

Joined: 21/08/2006 09:21:27
Messages: 7298
Offline

Yes, sub-issues 1 and 2 already done. I hope to have a new release in the next few days but I would like to solve chillwares issue first which is not the same before doing a new release.

thanks Paul (Administrator)
GrampsAudio

Pro

Joined: 05/06/2015 23:04:11
Messages: 24
Offline

No rush here, my friend. Take your time and do it right.
paultaylor

Pro
[Avatar]

Joined: 21/08/2006 09:21:27
Messages: 7298
Offline

SongKong 1.16 released, this will fix your issues GrampsAudio - hopefully it will fix chillwares issues as well.

thanks Paul (Administrator)
GrampsAudio

Pro

Joined: 05/06/2015 23:04:11
Messages: 24
Offline

Thanks Paul. I'll let you know if I have any further issues with it. Thank you for your attentiveness to the problems.
 
Forum Index -> SongKong Issues
Go to:   
Powered by JForum 2.1.6 © JForum Team