Page 1 of 1

[SOLVED] Subfolders missed by LibraryAdditionsCheckerThread

PostPosted: Sun Dec 18, 2011 2:50 pm
by pwhooftman
Hi,

I have Serviio 0.6.0.1. running on a Synology DS111+. It's running great for videos and music, but a lot of my image folders are not imported into the libary.
The path is /volume1/Backup/Slimpie/Documenten/9 Foto's. This path contains around 15 subfolders with images, and there a a few images in the path itself also.

- If i add /volume1/Backup/Slimpie/Documenten/9 Foto's to the folder list in the Webgui, the only folder form this path that is picked up by the [LibraryAdditionsCheckerThread] is 'Oeps'. All other subfoldes are ignored.
- If i add /volume1/Backup/Slimpie/Documenten/9 Foto's/2007 extra to the folder list in the Webgui (in an attempt to force Serviio to read this subfolder) this folder 2007 is not picked up by the [LibraryAdditionsCheckerThread] , instead it's only picked up by [LibraryUpdatesCheckerThread] . But because the contents of this folder where never added, they are also not updated and the update checker quits doing nothing....
- user 'serviio' has read rights in all folders, guest account is enabled.

- The debuglog shows:
  Code:
2011-12-18 15:07:15,022 DEBUG [LibraryAdditionsCheckerThread] Looking for files to share in folder: /volume1/Backup/Slimpie/Documenten/9 Foto's
2011-12-18 15:07:15,024 DEBUG [LibraryAdditionsCheckerThread] Looking for files to share in folder: /volume1/Backup/Slimpie/Documenten/9 Foto's/Oeps
2011-12-18 15:07:15,031 DEBUG [MediaItemDAOImpl] Getting file of media item 446
2011-12-18 15:07:15,034 DEBUG [MetadataDescriptorDAOImpl] Reading MetadataDescriptor for MediaItem (id = 446) and extractor EMBEDDED
2011-12-18 15:07:15,035 DEBUG [MetadataDescriptorDAOImpl] Reading MetadataDescriptor for MediaItem (id = 446) and extractor COVER_IMAGE_IN_FOLDER
2011-12-18 15:07:15,051 DEBUG [LibraryAdditionsCheckerThread] Found file 'P1070175.JPG', checking if it's already in the Library
2011-12-18 15:07:15,052 DEBUG [MediaItemDAOImpl] Checking if DB already contains media item P1070175.JPG
2011-12-18 15:07:15,054 DEBUG [MediaItemDAOImpl] Media item P1070175.JPG already exists in DB
2011-12-18 15:07:15,081 DEBUG [LibraryAdditionsCheckerThread] Found file 'P1070155.JPG', checking if it's already in the Library
2011-12-18 15:07:15,082 DEBUG [MediaItemDAOImpl] Checking if DB already contains media item P1070155.JPG
2011-12-18 15:07:15,084 DEBUG [MediaItemDAOImpl] Media item P1070155.JPG already exists in DB

2011-12-18 15:07:15,091 DEBUG [MediaItemDAOImpl] Getting file of media item 447
2011-12-18 15:07:15,094 DEBUG [MetadataDescriptorDAOImpl] Reading MetadataDescriptor for MediaItem (id = 447) and extractor EMBEDDED
2011-12-18 15:07:15,095 DEBUG [MetadataDescriptorDAOImpl] Reading MetadataDescriptor for MediaItem (id = 447) and extractor COVER_IMAGE_IN_FOLDER
2011-12-18 15:07:15,111 DEBUG [LibraryAdditionsCheckerThread] Found file 'P1070179.JPG', checking if it's already in the Library
2011-12-18 15:07:15,112 DEBUG [MediaItemDAOImpl] Checking if DB already contains media item P1070179.JPG
2011-12-18 15:07:15,114 DEBUG [MediaItemDAOImpl] Media item P1070179.JPG already exists in DB
2011-12-18 15:07:15,141 DEBUG [LibraryAdditionsCheckerThread] Found file 'Marc abces knieholte 3  aug 2006.JPG', checking if it's already in the Library
2011-12-18 15:07:15,141 DEBUG [MediaItemDAOImpl] Checking if DB already contains media item Marc abces knieholte 3  aug 2006.JPG
2011-12-18 15:07:15,144 DEBUG [MediaItemDAOImpl] Media item Marc abces knieholte 3  aug 2006.JPG already exists in DB

<snip, al lot of media items are checked here>


2011-12-18 15:07:32,555 DEBUG [LibraryUpdatesCheckerThread] Looking for removed/updated files in repository: /volume1/Backup/Slimpie/Documenten/9 Foto's/2007
2011-12-18 15:07:32,556 DEBUG [MediaItemDAOImpl] Reading MediaItems for Repository (id = 5)
2011-12-18 15:07:32,557 DEBUG [MediaItemDAOImpl] Reading dirty MediaItems for Repository (id = 1)
2011-12-18 15:07:32,587 DEBUG [RepositoryDAOImpl] Marking Repository 1 as scanned with current timestamp
2011-12-18 15:07:32,590 DEBUG [MediaItemDAOImpl] Reading dirty MediaItems for Repository (id = 2)
2011-12-18 15:07:32,651 DEBUG [RepositoryDAOImpl] Marking Repository 2 as scanned with current timestamp
2011-12-18 15:07:32,664 DEBUG [MediaItemDAOImpl] Reading dirty MediaItems for Repository (id = 3)
2011-12-18 15:07:32,665 DEBUG [RepositoryDAOImpl] Marking Repository 3 as scanned with current timestamp
2011-12-18 15:07:32,668 DEBUG [MediaItemDAOImpl] Reading dirty MediaItems for Repository (id = 4)
2011-12-18 15:07:32,726 DEBUG [RepositoryDAOImpl] Marking Repository 4 as scanned with current timestamp
2011-12-18 15:07:32,730 DEBUG [MediaItemDAOImpl] Reading dirty MediaItems for Repository (id = 5)
2011-12-18 15:07:32,741 DEBUG [RepositoryDAOImpl] Marking Repository 5 as scanned with current timestamp
2011-12-18 15:07:46,833 DEBUG [OnlineRepositoryDAOImpl] Reading all OnlineRepositories



This has me stumped,any ideas welcome.

Re: Some subfolders missed by LibraryAdditionsCheckerThread

PostPosted: Sun Dec 18, 2011 6:41 pm
by zip
I wonder if it's because of the apostrophy

viewtopic.php?f=5&t=4364

Re: Some subfolders missed by LibraryAdditionsCheckerThread

PostPosted: Sun Dec 18, 2011 6:57 pm
by pwhooftman
zip wrote:I wonder if it's because of the apostrophy

viewtopic.php?f=5&t=4364



Yes is was! I changed the name of the folder to "9 Fotos" and now it's recursing through the subfolders fine & filling the library. Thanks!.. Still odd that it did scan one subfolder, but its solved now so no worries anymore :-)

Re: Some subfolders missed by LibraryAdditionsCheckerThread

PostPosted: Mon Dec 19, 2011 7:03 pm
by pwhooftman
pwhooftman wrote:
zip wrote:I wonder if it's because of the apostrophy

viewtopic.php?f=5&t=4364



Yes is was! I changed the name of the folder to "9 Fotos" and now it's recursing through the subfolders fine & filling the library. Thanks!.. Still odd that it did scan one subfolder, but its solved now so no worries anymore :-)


Update: well, it wasn't the apostrophy after all, this time updating folders topped after 4 subfolders out of 15l. The real reason seems lack of memory for the Java process. I had altered serviio.sh so Java started with a maximum of 80Mb memory. Appearently that was too low,stalling the library update process. I have upped the memory limit to 128Mb, and now it continues to update the library longer. Will see if it reaches the end (+20000 images). I did limit the memory because i found memory usage of java creeping up to 90% memory used, which then started breaking streaming movies (intermittent stops in streaming). So if there are any other ways to limit memory usage, that would be swell.

Re: [SOLVED] Subfolders missed by LibraryAdditionsCheckerThr

PostPosted: Mon Dec 19, 2011 7:16 pm
by zip
large images require a lot of memory to be added to the library so while you should be ok with 80mb ram for streaming adding images with 10MPix and above will probably cause you trouble.