Serviio

FreeBSD Jail1 9.1-STABLE FreeBSD 9.1-STABLE #0 r+7f710c8: Fri Jul 12 00:13:32 PDT 2013
serviio-1.3.1_3 , as installed by the freebsd ports collection
2013-10-24 21:22:08,992 INFO [FFMPEGWrapper] Found FFmpeg: ffmpeg version 2.0.2 Copyright (c) 2000-2013 the FFmpeg developers

I've been using serviio happily (the pro registered/paid for version) on this setup for some time, always been rock solid, however as of the latest two minor updates, it runs for a while happily, and then stops. I've cranked up the logging and tried to catch the fault. Could anyone please advise on the below?

Thanks


2013-10-25 01:23:28,177 WARN [LibraryManager] Extractor ONLINE_VIDEO_SOURCES failed to connect to metadata source for file /MountedPool/TV/Love-Hate/Season 04/Love-Hate - s04e02 - Episode 2.mkv, will try again later: Error connecting to thetvdb.com: http://thetvdb.com/api/235C8CA4529142E9 ... 4/2/en.xml
2013-10-25 01:23:28,406 INFO [LibraryUpdatesCheckerThread] Updated 'Love-Hate - s04e02 - Episode 2' (/MountedPool/TV/Love-Hate/Season 04/Love-Hate - s04e02 - Episode 2.mkv) in Library
2013-10-25 02:23:30,380 WARN [LibraryUpdatesCheckerThread] An error occured while scanning for items to be removed or updated, will continue
org.serviio.db.dao.PersistenceException: Cannot read Playlists for Repository with id = 2
at org.serviio.library.dao.PlaylistDAOImpl.getPlaylistsInRepository(PlaylistDAOImpl.java:200)
at org.serviio.library.local.service.PlaylistService.getPlaylistsInRepository(PlaylistService.java:83)
at org.serviio.library.local.metadata.LibraryUpdatesCheckerThread.searchForRemovedPlaylists(LibraryUpdatesCheckerThread.java:221)
at org.serviio.library.local.metadata.LibraryUpdatesCheckerThread.run(LibraryUpdatesCheckerThread.java:98)
Caused by: java.sql.SQLException: Cannot issue commit in a nested connection when there is a pending operation in the parent connection.
at org.apache.derby.impl.jdbc.SQLExceptionFactory40.getSQLException(Unknown Source)
at org.apache.derby.impl.jdbc.Util.generateCsSQLException(Unknown Source)
at org.apache.derby.impl.jdbc.TransactionResourceImpl.wrapInSQLException(Unknown Source)
at org.apache.derby.impl.jdbc.TransactionResourceImpl.handleException(Unknown Source)
at org.apache.derby.impl.jdbc.EmbedConnection.handleException(Unknown Source)
at org.apache.derby.impl.jdbc.EmbedConnection.commitIfNeeded(Unknown Source)
at org.apache.derby.impl.jdbc.ConnectionChild.commitIfNeeded(Unknown Source)
at org.apache.derby.impl.jdbc.EmbedStatement.executeStatement(Unknown Source)
at org.apache.derby.impl.jdbc.EmbedPreparedStatement.executeStatement(Unknown Source)
at org.apache.derby.impl.jdbc.EmbedPreparedStatement.executeQuery(Unknown Source)
at org.serviio.library.dao.PlaylistDAOImpl.getPlaylistsInRepository(PlaylistDAOImpl.java:197)
... 3 more
Caused by: java.sql.SQLException: Cannot issue commit in a nested connection when there is a pending operation in the parent connection.
at org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown Source)
at org.apache.derby.impl.jdbc.SQLExceptionFactory40.wrapArgsForTransportAcrossDRDA(Unknown Source)
... 14 more
Caused by: ERROR X0Y66: Cannot issue commit in a nested connection when there is a pending operation in the parent connection.
at org.apache.derby.iapi.error.StandardException.newException(Unknown Source)
at org.apache.derby.impl.sql.conn.GenericLanguageConnectionContext.doCommit(Unknown Source)
at org.apache.derby.impl.sql.conn.GenericLanguageConnectionContext.userCommit(Unknown Source)
at org.apache.derby.impl.jdbc.TransactionResourceImpl.commit(Unknown Source)
... 9 more
2013-10-25 02:23:31,236 WARN [LibraryUpdatesCheckerThread] An error occured while scanning for items to be removed or updated, will continue
org.serviio.db.dao.PersistenceException: Cannot read Playlists for Repository with id = 3
at org.serviio.library.dao.PlaylistDAOImpl.getPlaylistsInRepository(PlaylistDAOImpl.java:200)
at org.serviio.library.local.service.PlaylistService.getPlaylistsInRepository(PlaylistService.java:83)
at org.serviio.library.local.metadata.LibraryUpdatesCheckerThread.searchForRemovedPlaylists(LibraryUpdatesCheckerThread.java:221)
at org.serviio.library.local.metadata.LibraryUpdatesCheckerThread.run(LibraryUpdatesCheckerThread.java:98)
Caused by: java.sql.SQLException: Cannot issue commit in a nested connection when there is a pending operation in the parent connection.
at org.apache.derby.impl.jdbc.SQLExceptionFactory40.getSQLException(Unknown Source)
at org.apache.derby.impl.jdbc.Util.generateCsSQLException(Unknown Source)
at org.apache.derby.impl.jdbc.TransactionResourceImpl.wrapInSQLException(Unknown Source)
at org.apache.derby.impl.jdbc.TransactionResourceImpl.handleException(Unknown Source)
at org.apache.derby.impl.jdbc.EmbedConnection.handleException(Unknown Source)
at org.apache.derby.impl.jdbc.EmbedConnection.commitIfNeeded(Unknown Source)
at org.apache.derby.impl.jdbc.ConnectionChild.commitIfNeeded(Unknown Source)
at org.apache.derby.impl.jdbc.EmbedStatement.executeStatement(Unknown Source)
at org.apache.derby.impl.jdbc.EmbedPreparedStatement.executeStatement(Unknown Source)
at org.apache.derby.impl.jdbc.EmbedPreparedStatement.executeQuery(Unknown Source)
at org.serviio.library.dao.PlaylistDAOImpl.getPlaylistsInRepository(PlaylistDAOImpl.java:197)
... 3 more
Caused by: java.sql.SQLException: Cannot issue commit in a nested connection when there is a pending operation in the parent connection.
at org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown Source)
at org.apache.derby.impl.jdbc.SQLExceptionFactory40.wrapArgsForTransportAcrossDRDA(Unknown Source)
... 14 more
Caused by: ERROR X0Y66: Cannot issue commit in a nested connection when there is a pending operation in the parent connection.
at org.apache.derby.iapi.error.StandardException.newException(Unknown Source)
at org.apache.derby.impl.sql.conn.GenericLanguageConnectionContext.doCommit(Unknown Source)
at org.apache.derby.impl.sql.conn.GenericLanguageConnectionContext.userCommit(Unknown Source)
at org.apache.derby.impl.jdbc.TransactionResourceImpl.commit(Unknown Source)
... 9 more

I thought my log level was up to debug, but I Must have set it back to info at some point.

It kind of grinds to a halt slowly.

with debug level logging on , I'm getting told I have java memory heap errors - I can't find where on a freebsd system I can change the Xmx and Xms paramaters though -
I can see it's currently getting invoked with this line

/usr/local/openjdk6/bin/java -Xmx512M -Xms20M -XX:+UseParNewGC -XX:MinHeapFreeRatio=10 -XX:MaxHeapFreeRatio=20 -Djava.net.preferIPv4Stack=true

any suggestions where I might look to edit those paramaters?


2013-10-26 13:14:57,428 WARN [LibraryUpdatesCheckerThread] An error occured while scanning for items to be removed or updated, will continue
java.lang.NullPointerException
at org.serviio.library.dao.PlaylistDAOImpl.getPlaylistsInRepository(PlaylistDAOImpl.java:193)
at org.serviio.library.local.service.PlaylistService.getPlaylistsInRepository(PlaylistService.java:83)
at org.serviio.library.local.metadata.LibraryUpdatesCheckerThread.searchForRemovedPlaylists(LibraryUpdatesCheckerThread.java:221)
at org.serviio.library.local.metadata.LibraryUpdatesCheckerThread.run(LibraryUpdatesCheckerThread.java:98)
2013-10-26 13:14:57,428 DEBUG [MediaItemDAOImpl] Reading dirty MediaItems for Repository (id = 2)
2013-10-26 13:15:13,380 WARN [DBConnectionPool] Can't create a new connection for jdbc:derby:db;create=true
java.sql.SQLException: Failed to start database 'db' with class loader sun.misc.Launcher$AppClassLoader@54992725, see the next exception for details.
at org.apache.derby.impl.jdbc.SQLExceptionFactory40.getSQLException(Unknown Source)
at org.apache.derby.impl.jdbc.Util.newEmbedSQLException(Unknown Source)
at org.apache.derby.impl.jdbc.Util.seeNextException(Unknown Source)
at org.apache.derby.impl.jdbc.EmbedConnection.bootDatabase(Unknown Source)
at org.apache.derby.impl.jdbc.EmbedConnection.<init>(Unknown Source)
at org.apache.derby.impl.jdbc.EmbedConnection40.<init>(Unknown Source)
at org.apache.derby.jdbc.Driver40.getNewEmbedConnection(Unknown Source)
at org.apache.derby.jdbc.InternalDriver.connect(Unknown Source)
at org.apache.derby.jdbc.Driver20.connect(Unknown Source)
at org.apache.derby.jdbc.AutoloadedDriver.connect(Unknown Source)
at java.sql.DriverManager.getConnection(DriverManager.java:620)
at java.sql.DriverManager.getConnection(DriverManager.java:222)
at org.serviio.db.DBConnectionPool.newConnection(DBConnetionPool.java:186)
at org.serviio.db.DBConnectionPool.getConnection(DBConnetionPool.java:123)
at org.serviio.db.DBConnectionPool.getConnection(DBConnetionPool.java:149)
at org.serviio.db.DatabaseManager.getConnection(DatabaseManager.java:66)
at org.serviio.db.DatabaseManager.getConnection(DatabaseManager.java:59)
at org.serviio.library.dao.MediaItemDAOImpl.getDirtyMediaItemsInRepository(MediaItemDAOImpl.java:282)
at org.serviio.library.local.service.MediaService.getDirtyMediaItemsInRepository(MediaService.java:82)
at org.serviio.library.local.metadata.LibraryUpdatesCheckerThread.updateMetadata(LibraryUpdatesCheckerThread.java:248)
at org.serviio.library.local.metadata.LibraryUpdatesCheckerThread.run(LibraryUpdatesCheckerThread.java:113)
Caused by: java.sql.SQLException: Failed to start database 'db' with class loader sun.misc.Launcher$AppClassLoader@54992725, see the next exception for details.
at org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown Source)
at org.apache.derby.impl.jdbc.SQLExceptionFactory40.wrapArgsForTransportAcrossDRDA(Unknown Source)
... 21 more
Caused by: java.sql.SQLException: Java exception: 'Java heap space: java.lang.OutOfMemoryError'.
at org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown Source)
at org.apache.derby.impl.jdbc.SQLExceptionFactory40.wrapArgsForTransportAcrossDRDA(Unknown Source)
at org.apache.derby.impl.jdbc.SQLExceptionFactory40.getSQLException(Unknown Source)
at org.apache.derby.impl.jdbc.Util.newEmbedSQLException(Unknown Source)
at org.apache.derby.impl.jdbc.Util.javaException(Unknown Source)
... 18 more
Caused by: java.lang.OutOfMemoryError: Java heap space
2013-10-26 13:15:15,381 WARN [LibraryUpdatesCheckerThread] An error occured while updating metadata, will continue
java.lang.NullPointerException
at org.serviio.library.dao.MediaItemDAOImpl.getDirtyMediaItemsInRepository(MediaItemDAOImpl.java:283)
at org.serviio.library.local.service.MediaService.getDirtyMediaItemsInRepository(MediaService.java:82)
at org.serviio.library.local.metadata.LibraryUpdatesCheckerThread.updateMetadata(LibraryUpdatesCheckerThread.java:248)
at org.serviio.library.local.metadata.LibraryUpdatesCheckerThread.run(LibraryUpdatesCheckerThread.java:113)
2013-10-26 13:15:15,381 DEBUG [MediaItemDAOImpl] Reading dirty MediaItems for Repository (id = 3)
2013-10-26 13:15:30,773 WARN [DBConnectionPool] Can't create a new connection for jdbc:derby:db;create=true
java.sql.SQLException: Failed to start database 'db' with class loader sun.misc.Launcher$AppClassLoader@54992725, see the next exception for details.
at org.apache.derby.impl.jdbc.SQLExceptionFactory40.getSQLException(Unknown Source)
at org.apache.derby.impl.jdbc.Util.newEmbedSQLException(Unknown Source)
at org.apache.derby.impl.jdbc.Util.seeNextException(Unknown Source)
at org.apache.derby.impl.jdbc.EmbedConnection.bootDatabase(Unknown Source)
at org.apache.derby.impl.jdbc.EmbedConnection.<init>(Unknown Source)
at org.apache.derby.impl.jdbc.EmbedConnection40.<init>(Unknown Source)
at org.apache.derby.jdbc.Driver40.getNewEmbedConnection(Unknown Source)
at org.apache.derby.jdbc.InternalDriver.connect(Unknown Source)
at org.apache.derby.jdbc.Driver20.connect(Unknown Source)
at org.apache.derby.jdbc.AutoloadedDriver.connect(Unknown Source)
at java.sql.DriverManager.getConnection(DriverManager.java:620)
at java.sql.DriverManager.getConnection(DriverManager.java:222)
at org.serviio.db.DBConnectionPool.newConnection(DBConnetionPool.java:186)
at org.serviio.db.DBConnectionPool.getConnection(DBConnetionPool.java:123)
at org.serviio.db.DBConnectionPool.getConnection(DBConnetionPool.java:149)
at org.serviio.db.DatabaseManager.getConnection(DatabaseManager.java:66)
at org.serviio.db.DatabaseManager.getConnection(DatabaseManager.java:59)
at org.serviio.library.dao.MediaItemDAOImpl.getDirtyMediaItemsInRepository(MediaItemDAOImpl.java:282)
at org.serviio.library.local.service.MediaService.getDirtyMediaItemsInRepository(MediaService.java:82)
at org.serviio.library.local.metadata.LibraryUpdatesCheckerThread.updateMetadata(LibraryUpdatesCheckerThread.java:248)
at org.serviio.library.local.metadata.LibraryUpdatesCheckerThread.run(LibraryUpdatesCheckerThread.java:113)
Caused by: java.sql.SQLException: Failed to start database 'db' with class loader sun.misc.Launcher$AppClassLoader@54992725, see the next exception for details.
at org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown Source)
at org.apache.derby.impl.jdbc.SQLExceptionFactory40.wrapArgsForTransportAcrossDRDA(Unknown Source)
... 21 more
Caused by: java.sql.SQLException: Java exception: 'Java heap space: java.lang.OutOfMemoryError'.
at org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown Source)
at org.apache.derby.impl.jdbc.SQLExceptionFactory40.wrapArgsForTransportAcrossDRDA(Unknown Source)
at org.apache.derby.impl.jdbc.SQLExceptionFactory40.getSQLException(Unknown Source)
at org.apache.derby.impl.jdbc.Util.newEmbedSQLException(Unknown Source)
at org.apache.derby.impl.jdbc.Util.javaException(Unknown Source)
... 18 more
Caused by: java.lang.OutOfMemoryError: Java heap space
2013-10-26 13:15:32,774 WARN [LibraryUpdatesCheckerThread] An error occured while updating metadata, will continue
java.lang.NullPointerException
at org.serviio.library.dao.MediaItemDAOImpl.getDirtyMediaItemsInRepository(MediaItemDAOImpl.java:283)
at org.serviio.library.local.service.MediaService.getDirtyMediaItemsInRepository(MediaService.java:82)
at org.serviio.library.local.metadata.LibraryUpdatesCheckerThread.updateMetadata(LibraryUpdatesCheckerThread.java:248)
at org.serviio.library.local.metadata.LibraryUpdatesCheckerThread.run(LibraryUpdatesCheckerThread.java:113)
2013-10-26 13:15:32,774 DEBUG [MediaItemDAOImpl] Reading dirty MediaItems for Repository (id = 4)
2013-10-26 13:15:51,428 WARN [DBConnectionPool] Can't create a new connection for jdbc:derby:db;create=true
java.sql.SQLException: Failed to start database 'db' with class loader sun.misc.Launcher$AppClassLoader@54992725, see the next exception for details.
at org.apache.derby.impl.jdbc.SQLExceptionFactory40.getSQLException(Unknown Source)
at org.apache.derby.impl.jdbc.Util.newEmbedSQLException(Unknown Source)
at org.apache.derby.impl.jdbc.Util.seeNextException(Unknown Source)
at org.apache.derby.impl.jdbc.EmbedConnection.bootDatabase(Unknown Source)
at org.apache.derby.impl.jdbc.EmbedConnection.<init>(Unknown Source)
at org.apache.derby.impl.jdbc.EmbedConnection40.<init>(Unknown Source)
at org.apache.derby.jdbc.Driver40.getNewEmbedConnection(Unknown Source)
at org.apache.derby.jdbc.InternalDriver.connect(Unknown Source)
at org.apache.derby.jdbc.Driver20.connect(Unknown Source)
at org.apache.derby.jdbc.AutoloadedDriver.connect(Unknown Source)
at java.sql.DriverManager.getConnection(DriverManager.java:620)
at java.sql.DriverManager.getConnection(DriverManager.java:222)
at org.serviio.db.DBConnectionPool.newConnection(DBConnetionPool.java:186)
at org.serviio.db.DBConnectionPool.getConnection(DBConnetionPool.java:123)
at org.serviio.db.DBConnectionPool.getConnection(DBConnetionPool.java:149)
at org.serviio.db.DatabaseManager.getConnection(DatabaseManager.java:66)
at org.serviio.db.DatabaseManager.getConnection(DatabaseManager.java:59)
at org.serviio.library.dao.MediaItemDAOImpl.getDirtyMediaItemsInRepository(MediaItemDAOImpl.java:282)
at org.serviio.library.local.service.MediaService.getDirtyMediaItemsInRepository(MediaService.java:82)
at org.serviio.library.local.metadata.LibraryUpdatesCheckerThread.updateMetadata(LibraryUpdatesCheckerThread.java:248)
at org.serviio.library.local.metadata.LibraryUpdatesCheckerThread.run(LibraryUpdatesCheckerThread.java:113)
Caused by: java.sql.SQLException: Failed to start database 'db' with class loader sun.misc.Launcher$AppClassLoader@54992725, see the next exception for details.
at org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown Source)
at org.apache.derby.impl.jdbc.SQLExceptionFactory40.wrapArgsForTransportAcrossDRDA(Unknown Source)
... 21 more
Caused by: java.sql.SQLException: Java exception: 'Java heap space: java.lang.OutOfMemoryError'.
at org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown Source)
at org.apache.derby.impl.jdbc.SQLExceptionFactory40.wrapArgsForTransportAcrossDRDA(Unknown Source)
at org.apache.derby.impl.jdbc.SQLExceptionFactory40.getSQLException(Unknown Source)
at org.apache.derby.impl.jdbc.Util.newEmbedSQLException(Unknown Source)
at org.apache.derby.impl.jdbc.Util.javaException(Unknown Source)
... 18 more
Caused by: java.lang.OutOfMemoryError: Java heap space
2013-10-26 13:15:53,430 WARN [LibraryUpdatesCheckerThread] An error occured while updating metadata, will continue
java.lang.NullPointerException
at org.serviio.library.dao.MediaItemDAOImpl.getDirtyMediaItemsInRepository(MediaItemDAOImpl.java:283)
at org.serviio.library.local.service.MediaService.getDirtyMediaItemsInRepository(MediaService.java:82)
at org.serviio.library.local.metadata.LibraryUpdatesCheckerThread.updateMetadata(LibraryUpdatesCheckerThread.java:248)
at org.serviio.library.local.metadata.LibraryUpdatesCheckerThread.run(LibraryUpdatesCheckerThread.java:113)
2013-10-26 13:15:53,430 DEBUG [MediaItemDAOImpl] Reading dirty MediaItems for Repository (id = 5)
2013-10-26 13:16:12,468 WARN [DBConnectionPool] Can't create a new connection for jdbc:derby:db;create=true
java.sql.SQLException: Failed to start database 'db' with class loader sun.misc.Launcher$AppClassLoader@54992725, see the next exception for details.
at org.apache.derby.impl.jdbc.SQLExceptionFactory40.getSQLException(Unknown Source)
at org.apache.derby.impl.jdbc.Util.newEmbedSQLException(Unknown Source)
at org.apache.derby.impl.jdbc.Util.seeNextException(Unknown Source)
at org.apache.derby.impl.jdbc.EmbedConnection.bootDatabase(Unknown Source)
at org.apache.derby.impl.jdbc.EmbedConnection.<init>(Unknown Source)
at org.apache.derby.impl.jdbc.EmbedConnection40.<init>(Unknown Source)
at org.apache.derby.jdbc.Driver40.getNewEmbedConnection(Unknown Source)
at org.apache.derby.jdbc.InternalDriver.connect(Unknown Source)
at org.apache.derby.jdbc.Driver20.connect(Unknown Source)
at org.apache.derby.jdbc.AutoloadedDriver.connect(Unknown Source)
at java.sql.DriverManager.getConnection(DriverManager.java:620)
at java.sql.DriverManager.getConnection(DriverManager.java:222)
at org.serviio.db.DBConnectionPool.newConnection(DBConnetionPool.java:186)
at org.serviio.db.DBConnectionPool.getConnection(DBConnetionPool.java:123)
at org.serviio.db.DBConnectionPool.getConnection(DBConnetionPool.java:149)
at org.serviio.db.DatabaseManager.getConnection(DatabaseManager.java:66)
at org.serviio.db.DatabaseManager.getConnection(DatabaseManager.java:59)
at org.serviio.library.dao.MediaItemDAOImpl.getDirtyMediaItemsInRepository(MediaItemDAOImpl.java:282)
at org.serviio.library.local.service.MediaService.getDirtyMediaItemsInRepository(MediaService.java:82)
at org.serviio.library.local.metadata.LibraryUpdatesCheckerThread.updateMetadata(LibraryUpdatesCheckerThread.java:248)
at org.serviio.library.local.metadata.LibraryUpdatesCheckerThread.run(LibraryUpdatesCheckerThread.java:113)
Caused by: java.sql.SQLException: Failed to start database 'db' with class loader sun.misc.Launcher$AppClassLoader@54992725, see the next exception for details.
at org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown Source)
at org.apache.derby.impl.jdbc.SQLExceptionFactory40.wrapArgsForTransportAcrossDRDA(Unknown Source)
... 21 more
Caused by: java.sql.SQLException: Java exception: 'Java heap space: java.lang.OutOfMemoryError'.
at org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown Source)
at org.apache.derby.impl.jdbc.SQLExceptionFactory40.wrapArgsForTransportAcrossDRDA(Unknown Source)
at org.apache.derby.impl.jdbc.SQLExceptionFactory40.getSQLException(Unknown Source)
at org.apache.derby.impl.jdbc.Util.newEmbedSQLException(Unknown Source)
at org.apache.derby.impl.jdbc.Util.javaException(Unknown Source)
... 18 more
Caused by: java.lang.OutOfMemoryError: Java heap space

What is your Java version?

Hi Zip,

thanks for your response.

my java version is openjdk6-b28_3 - which is the up-to-date version on FreeBSD

I also found on this FreeBSD platform where I can edit the size of the java vm memory allocation pool - near the end of the file /usr/local/sbin/serviiod
the default line states

exec java -Xmx512M -Xms20M -XX:+UseParNewGC -XX:MinHeapFreeRatio=10 -XX:MaxHeapFreeRatio=20 $JAVA_OPTS -classpath "$SERVIIO_CLASS_PATH" org.serviio.MediaServer


I tried changing to -Xmx1024M , but I still run into the java heap space errors - I have a lot of data on my media server (about 5tb) - do a lot of people use serviio with big media archives like this (I guess it's not big by some people's standards?) - I changed my library refresh interval from 5 mins to 10 mins, and removed my entire audio folder to see if that took the pressure off, but I still get the errors. they only started happening since recent updates to java and serviio ports on freebsd - could be coincidence though

here's the latest one I spotted in logs

Exception in thread "WebServer" java.lang.OutOfMemoryError: Java heap space
at org.apache.http.util.ByteArrayBuffer.<init>(ByteArrayBuffer.java:58)
at org.apache.http.impl.io.AbstractSessionOutputBuffer.init(AbstractSessionOutputBuffer.java:96)
at org.apache.http.impl.io.SocketOutputBuffer.<init>(SocketOutputBuffer.java:83)
at org.apache.http.impl.SocketHttpServerConnection.createSessionOutputBuffer(SocketHttpServerConnection.java:140)
at org.apache.http.impl.SocketHttpServerConnection.createHttpDataTransmitter(SocketHttpServerConnection.java:96)
at org.apache.http.impl.SocketHttpServerConnection.bind(SocketHttpServerConnection.java:179)
at org.apache.http.impl.DefaultHttpServerConnection.bind(DefaultHttpServerConnection.java:91)
at org.serviio.upnp.webserver.WebServer$RequestListenerThread.run(WebServer.java:149)
Exception in thread "LibraryAdditionsCheckerThread" java.lang.OutOfMemoryError: Java heap space
at java.io.UnixFileSystem.resolve(UnixFileSystem.java:108)
at java.io.File.<init>(File.java:224)
at java.io.File.listFiles(File.java:1072)
at org.serviio.library.local.metadata.LibraryAdditionsCheckerThread.searchForNewFiles(LibraryAdditionsCheckerThread.java:127)
at org.serviio.library.local.metadata.LibraryAdditionsCheckerThread.searchForNewFiles(LibraryAdditionsCheckerThread.java:134)
at org.serviio.library.local.metadata.LibraryAdditionsCheckerThread.searchForNewFiles(LibraryAdditionsCheckerThread.java:134)
at org.serviio.library.local.metadata.LibraryAdditionsCheckerThread.run(LibraryAdditionsCheckerThread.java:83)
Exception in thread "PluginCompilerThread" java.lang.OutOfMemoryError: Java heap space

Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "PluginCompilerThread"
Exception in thread "ServioThread-2-DiscoverySSDPMessageListener" java.lang.OutOfMemoryError: Java heap space

Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "ServioThread-4-EventDispatcher"
Exception in thread "ServioThread-5-DiscoveryNotifier" java.lang.OutOfMemoryError: Java heap space
Exception in thread "ServioThread-3-SubscriptionExpiryChecker" java.lang.OutOfMemoryError: Java heap space
Exception in thread "FeedUpdaterThread" java.lang.OutOfMemoryError: Java heap space

Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "ServioThread-6-RendererExpirationChecker"
Exception in thread "PlaylistMaintainerThread" java.lang.OutOfMemoryError: Java heap space

Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "Restlet-1583648099"
Exception in thread "IndexedDiskCache-DisposalThread" java.lang.OutOfMemoryError: Java heap space

Do you have a folder with a lot of files? It seems to run out of memory when listing files of a folder.

define "a lot" ?

from the below, looks like 16464 files across 1888 subfolders total, 588 gig of films, 3.5 terabytes of tv shows

(tv and films are currently my only 2 folders, I stopped serviio looking at my audio folder to try and reduce the numbers of files/folders involved as a remedy already)


root@Jail1:/MountedPool # find /TV -ls | awk '{ print $3 }' | cut -c 1 | sort | uniq -c
15060 -
1609 d
root@Jail1:/MountedPool # find /Films -ls | awk '{ print $3 }' | cut -c 1 | sort | uniq -c
1404 -
279 d

root@Jail1:/MountedPool # du -sh Films/
588G Films/
root@Jail1:/MountedPool # du -sh TV
3.5T TV

I mean a folder with a lot of items in one level (not folder structure).

OK, I've figured out a command to give me the top (x) folders that have the most items at their one specific level, like you say.

So, it seems the biggest individual one has 189 items in it (half of which are video files, half of which are small text .nfo files)

folder names just invented for your ease of reading , or something of course not real foldernames ...

# find /MountedPool/TV -type f |awk '{$NF="";a[$0]++}END{for (i in a) print a[i],i }' FS=\/ OFS=\/ |sort -rn|head -10
189//MountedPool/TV/In The Night Garden/Season 01/
93//MountedPool/TV/Beavis.and.ButtHead/Season 04/
90//MountedPool/TV/Glee/Glee Music Videos 720p/
84//MountedPool/TV/Beavis.and.ButtHead/Season 03/
81//MountedPool/TV/Family Guy/Season 04/
78//MountedPool/TV/Storage Wars/Season 03/
78//MountedPool/TV/Futurama/Season 07/
78//MountedPool/TV/Futurama/Season 06/
75//MountedPool/TV/Bones/Season 04/
74//MountedPool/TV/The Big Bang Theory/Season 06/

Anyone?

That looks fine.

Does it happen every time at the same time?

Can you stop Serviio, enable detailed log, remove serviio.log, start Serviio, make it fail and then post the whole log here?

Hello,

Similar issue here, shortly after upgradng to 1.3.1 and Java on a CentOS 6.5 32b ( java.runtime.version=1.6.0_28-b28 ) I'ven noticing that Serviio service does not allow any connection after 24-48hours of being started. Further looking into/opt/serviio/log/derby.log I see the following log:

Database Class Loader started - derby.database.classpath=''
Tue Dec 17 07:55:56 COT 2013 Thread[PlaylistMaintainerThread,2,main] (XID = 94757124), (SESSIONID = 1), (DATABASE = db), (DRDAID = null), Cleanup action starting
Tue Dec 17 07:56:38 COT 2013 Thread[PlaylistMaintainerThread,2,main] (XID = 94757124), (SESSIONID = 1), (DATABASE = db), (DRDAID = null), Failed Statement is: SELECT id, file_types, title, file_path, date_update
d, repository_id,all_items_found FROM playlist ORDER BY id
java.lang.OutOfMemoryError: Java heap space
at sun.util.resources.TimeZoneNames.getContents(TimeZoneNames.java:205)
at sun.util.resources.OpenListResourceBundle.loadLookup(OpenListResourceBundle.java:125)
at sun.util.resources.OpenListResourceBundle.loadLookupTablesIfNecessary(OpenListResourceBundle.java:113)
at sun.util.resources.OpenListResourceBundle.handleGetObject(OpenListResourceBundle.java:74)
at sun.util.resources.TimeZoneNamesBundle.handleGetObject(TimeZoneNamesBundle.java:75)
at java.util.ResourceBundle.getObject(ResourceBundle.java:398)
at java.util.ResourceBundle.getObject(ResourceBundle.java:401)
at java.util.ResourceBundle.getStringArray(ResourceBundle.java:381)
at sun.util.TimeZoneNameUtility.retrieveDisplayNames(TimeZoneNameUtility.java:118)
at sun.util.TimeZoneNameUtility.retrieveDisplayNames(TimeZoneNameUtility.java:99)
at java.util.TimeZone.getDisplayNames(TimeZone.java:423)
at java.util.TimeZone.getDisplayName(TimeZone.java:374)
at java.util.Date.toString(Date.java:1042)
at java.lang.String.valueOf(String.java:2838)
at java.lang.StringBuffer.append(StringBuffer.java:236)
at org.apache.derby.impl.services.stream.BasicGetLogHeader.getHeader(Unknown Source)
at org.apache.derby.iapi.error.ErrorStringBuilder.appendln(Unknown Source)
at org.apache.derby.iapi.services.context.ContextManager.cleanupOnError(Unknown Source)
at org.apache.derby.impl.jdbc.TransactionResourceImpl.cleanupOnError(Unknown Source)
at org.apache.derby.impl.jdbc.TransactionResourceImpl.handleException(Unknown Source)
at org.apache.derby.impl.jdbc.EmbedConnection.handleException(Unknown Source)
at org.apache.derby.impl.jdbc.ConnectionChild.handleException(Unknown Source)
at org.apache.derby.impl.jdbc.EmbedStatement.executeStatement(Unknown Source)
at org.apache.derby.impl.jdbc.EmbedPreparedStatement.executeStatement(Unknown Source)
at org.apache.derby.impl.jdbc.EmbedPreparedStatement.executeQuery(Unknown Source)
at org.serviio.library.dao.PlaylistDAOImpl.findAll(PlaylistDAOImpl.java:240)
at org.serviio.library.local.service.PlaylistService.getAllPlaylists(PlaylistService.java:47)
at org.serviio.library.local.metadata.PlaylistMaintainerThread.run(PlaylistMaintainerThread.java:72)
Cleanup action completed

I do however recall changing the Library refresh interval to 5 minutes and upgrading the Java version to the one shown above. Anyways, I changed the 'library refresh interval' to 10min and went ahead and raised the 'Max Java Heap Size' from 512M to 1024M . This VM I use has 1.5 GB of RAM so 1024M is ok to set as it leaves avail ram for the OS. I made the changes at /opt/serviio/bin/serviio.sh :

#"$JAVA" -Xmx512M -Xms20M -XX:+UseParNewGC -XX:MinHeapFreeRatio=10 -XX:MaxHeapFreeRatio=20 $JAVA_OPTS -classpath "$SERVIIO_CLASS_PATH" org.serviio.MediaServer "$@"
"$JAVA" -Xmx1024M -Xms20M -XX:+UseParNewGC -XX:MinHeapFreeRatio=10 -XX:MaxHeapFreeRatio=20 $JAVA_OPTS -classpath "$SERVIIO_CLASS_PATH" org.serviio.MediaServer "$@"

[root@dlna bin]# ps aux | grep java
serviio 9615 66.6 8.4 1220196 113500 pts/0 Sl 10:49 1:15 java -Xmx1024M -Xms20M -XX:+UseParNewGC -XX:MinHeapFreeRatio=10 -XX:MaxHeapFreeRatio=20 -Djava.net.preferIPv4Stack=true -Djava.awt.headless=true -Dderby.system.home=/opt/serviio/library -Dserviio.home=/opt/serviio -classpath /opt/serviio/lib/*:/opt/serviio/config org.serviio.MediaServer -headless

I will leave it running for a few days and update back if this fixes the prob. Thanks!

Hi,

I have the very same issue with Serviio stopping after about 1 or 2 days with the out of heap memory.

Recently, I have updated to 1.4, before I was running a 1.3.x version and had no issues.

The system is a FreeBSD 8.3 Jail (FreeNAS).
I have also updated the Java package:
openjdk 1.6.0_32
OpenJDK Runtime Environment (build 1.6.0_32-b28)
OpenJDK 64-Bit Server VM (build 23.25-b01, mixed mode)

I tried different refresh intervals (5 - 720 minutes), with and w/o metadata, no online sources,... always hangs after 1 or 2 days.

Please help in resolving this.

Thanks
Marcus



LOG:
...
at java.io.BufferedInputStream.<init>(BufferedInputStream.java:175)
at org.apache.jcs.utils.serialization.StandardSerializer.deSerialize(StandardSerializer.java:67)
at org.apache.jcs.auxiliary.disk.indexed.IndexedDisk.readObject(IndexedDisk.java:115)
at org.apache.jcs.auxiliary.disk.indexed.IndexedDiskCache.readElement(IndexedDiskCache.java:584)
at org.apache.jcs.auxiliary.disk.indexed.IndexedDiskCache.doGet(IndexedDiskCache.java:537)
at org.apache.jcs.auxiliary.disk.AbstractDiskCache.get(AbstractDiskCache.java:292)
at org.apache.jcs.engine.control.CompositeCache.get(CompositeCache.java:516)
at org.apache.jcs.engine.control.CompositeCache.get(CompositeCache.java:423)
at org.apache.jcs.access.CacheAccess.get(CacheAccess.java:190)
at org.serviio.library.online.ThumbnailCacheDecorator.retrieve(ThumbnailCacheDecorator.java:37)
at org.serviio.library.online.ThumbnailCacheDecorator.retrieve(ThumbnailCacheDecorator.java:18)
at org.serviio.library.online.OnlineLibraryManager.findThumbnail(OnlineLibraryManager.java:269)
at org.serviio.library.online.metadata.FeedUpdaterThread.run(FeedUpdaterThread.java:121)
Exception in thread "WebServer" java.lang.OutOfMemoryError: Java heap space
Exception in thread "PlaylistMaintainerThread" org.serviio.db.dao.PersistenceException: Cannot retrieve list of Playlists
at org.serviio.library.dao.PlaylistDAOImpl.findAll(PlaylistDAOImpl.java:243)
at org.serviio.library.local.service.PlaylistService.getAllPlaylists(PlaylistService.java:47)
at org.serviio.library.local.metadata.PlaylistMaintainerThread.run(PlaylistMaintainerThread.java:72)
Caused by: java.sql.SQLException: Java exception: 'Java heap space: java.lang.OutOfMemoryError'.
at org.apache.derby.impl.jdbc.SQLExceptionFactory40.getSQLException(Unknown Source)
at org.apache.derby.impl.jdbc.Util.newEmbedSQLException(Unknown Source)
at org.apache.derby.impl.jdbc.Util.javaException(Unknown Source)
at org.apache.derby.impl.jdbc.TransactionResourceImpl.wrapInSQLException(Unknown Source)
at org.apache.derby.impl.jdbc.TransactionResourceImpl.handleException(Unknown Source)
at org.apache.derby.impl.jdbc.EmbedConnection.handleException(Unknown Source)
at org.apache.derby.impl.jdbc.ConnectionChild.handleException(Unknown Source)
at org.apache.derby.impl.jdbc.EmbedStatement.executeStatement(Unknown Source)
at org.apache.derby.impl.jdbc.EmbedPreparedStatement.executeStatement(Unknown Source)
at org.apache.derby.impl.jdbc.EmbedPreparedStatement.executeQuery(Unknown Source)
at org.serviio.library.dao.PlaylistDAOImpl.findAll(PlaylistDAOImpl.java:240)
... 2 more
Caused by: java.sql.SQLException: Java exception: 'Java heap space: java.lang.OutOfMemoryError'.
at org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown Source)
at org.apache.derby.impl.jdbc.SQLExceptionFactory40.wrapArgsForTransportAcrossDRDA(Unknown Source)
... 13 more
Caused by: java.lang.OutOfMemoryError: Java heap space
Exception in thread "ServioThread-16-SubscriptionExpiryChecker" java.lang.OutOfMemoryError: Java heap space
Exception in thread "ServioThread-15-DiscoverySSDPMessageListener" java.lang.OutOfMemoryError: Java heap space
Exception in thread "Thread-51990" java.lang.OutOfMemoryError: Java heap space
Exception in thread "Thread-52005" java.lang.OutOfMemoryError: Java heap space
Exception in thread "Thread-52010" java.lang.OutOfMemoryError: Java heap space

.....

Exception in thread "Thread-52126" java.lang.OutOfMemoryError: Java heap space
Exception in thread "Thread-52130" java.lang.OutOfMemoryError: Java heap space
Exception in thread "Thread-52134" java.lang.OutOfMemoryError: Java heap space
Exception in thread "Thread-52138" java.lang.OutOfMemoryError: Java heap space
Exception in thread "Thread-52142" java.lang.OutOfMemoryError: Java heap space
Exception in thread "LibraryUpdatesCheckerThread" java.lang.OutOfMemoryError: Java heap space
Exception in thread "ServioThread-18-DiscoveryNotifier" java.lang.OutOfMemoryError: Java heap space
Exception in thread "LibraryAdditionsCheckerThread" java.lang.OutOfMemoryError: Java heap space

Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "ServioThread-14-DiscoveryNotifier"

Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "ServioThread-17-EventDispatcher"

YOu can try to increase the value of Xmx parameter in serviio.sh