Page 1 of 1

Video file size / time length reported on client truncated

PostPosted: Mon Apr 20, 2015 1:29 pm
by stephendhill
I am using Serviio 1.5.2 (although have seen this ever since 1.5.0).
On some of my DLNA clients (e.g. Samsung TV) I see a truncated time length and file size for new video files. The files are copied over Ethernet to the Serviio server storage via Ethernet, and so take sometimes minutes to copy.
If I rename the file on the Serviio server (obviously after the copy has completed) then the problem is rectified (after I disconnect/reconnect via the DLNA client).
I assume this has something to do with the new inotify feature?

Re: Video file size / time length reported on client truncat

PostPosted: Fri Apr 24, 2015 4:01 pm
by zip
Probably. Can you post detailed log of adding that file? It should 'block' while the file is being copied, but it might be OS dependent.

A Force refresh should fix it too, right?

Re: Video file size / time length reported on client truncat

PostPosted: Sat May 23, 2015 1:25 pm
by stephendhill
A force refresh does fix it.

I tried a different file this time, but same behaviour.
My server is Ubuntu 14.04.
I watched the log using "tail -f", while I added the new file. The file was nowhere near complete finishing to copy before the below happened.
The real file size is 1,503,410,669 bytes.

  Code:
2015-05-23 14:10:49,734 DEBUG [VideoDAOImpl] Creating a new Video (title = Brave)
2015-05-23 14:10:49,709 DEBUG [CoverImageDAOImpl] Creating a new ImageCover (length = 5911)
2015-05-23 14:10:49,709 DEBUG [CoverImageService] Image successfully resized
2015-05-23 14:10:49,709 DEBUG [ImageUtils] Returning resized image, size = 5911 bytes
2015-05-23 14:10:49,701 DEBUG [ImageUtils] Starting image resize, size = 18659 bytes
2015-05-23 14:10:49,701 DEBUG [CoverImageService] Resizing and storing cover art image for max resolution of 160x160
2015-05-23 14:10:49,701 DEBUG [CoverImageService] Image successfully resized
2015-05-23 14:10:49,701 DEBUG [ImageUtils] Returning resized image, size = 18659 bytes
2015-05-23 14:10:49,467 DEBUG [ImageUtils] Starting image resize, size = 104578 bytes
2015-05-23 14:10:49,467 DEBUG [CoverImageService] Resizing and storing cover art image for max resolution of 320x320
2015-05-23 14:10:49,466 DEBUG [GenreService] Genre Action found
2015-05-23 14:10:49,465 DEBUG [GenreDAOImpl] Reading a Genre (name = Action)
2015-05-23 14:10:49,460 DEBUG [FolderDAOImpl] Looking for folder hierarchy family_films
2015-05-23 14:10:49,459 DEBUG [VideoService] Adding video into database: Brave
2015-05-23 14:10:49,457 DEBUG [MetadataExtractionCoordinator] Metadata found via extractor ONLINE_VIDEO_SOURCES: VideoMetadata [title=Brave, filePath=null, fileSize=0, audioBitrate=null, audioCodec=null, audioStreamIndex=null, bitrate=null, channels=null, container=null, contentType=MOVIE, duration=null, episodeNumber=null, fps=null, frequency=null, h264Levels={}, h264Profile=null, ftyp=null, height=null, seasonNumber=null, seriesName=null, timestampType=null, videoBitrate=null, videoCodec=null, videoFourCC=null, videoStreamIndex=null, width=null, embeddedSubtitles=[]]
2015-05-23 14:10:49,457 DEBUG [TheMovieDBSourceAdaptor] Retrieved poster: http://image.tmdb.org/t/p/w500/6zMUhU3lEMky62ghhbFXLEsbI6K.jpg
2015-05-23 14:10:48,980 DEBUG [TheMovieDBSourceAdaptor] Retrieving details of movie (movieId = 62177, language = en)
2015-05-23 14:10:48,979 DEBUG [TheMovieDBSourceAdaptor] Found a suitable movie match, id = 62177
2015-05-23 14:10:48,979 DEBUG [TheMovieDBSourceAdaptor] Found 0 matches
2015-05-23 14:10:48,855 DEBUG [TheMovieDBSourceAdaptor] Searching for movie 'family films' 2012 (language: en)
2015-05-23 14:10:48,854 DEBUG [TheMovieDBSourceAdaptor] Found 5 matches
2015-05-23 14:10:48,522 DEBUG [TheMovieDBSourceAdaptor] Searching for movie 'brave' 2012 (language: en)
2015-05-23 14:10:48,506 DEBUG [MetadataExtractionCoordinator] Metadata found via extractor EMBEDDED: VideoMetadata [title=Brave (2012), filePath=/shared_data2/video2/family_films/Brave (2012).mp4, fileSize=37486592, audioBitrate=95, audioCodec=AAC, audioStreamIndex=1, bitrate=47, channels=2, container=MP4, contentType=UNKNOWN, duration=5617, episodeNumber=null, fps=23.976, frequency=48000, h264Levels={RF=4, H=4}, h264Profile=HIGH, ftyp=isom, height=804, seasonNumber=null, seriesName=null, timestampType=null, videoBitrate=2041, videoCodec=H264, videoFourCC=avc1, videoStreamIndex=0, width=1920, embeddedSubtitles=[]]
2015-05-23 14:10:48,463 DEBUG [ProcessExecutor] Starting /usr/local/serviio/serviio-1.5.2/bin/ffmpeg -threads auto -ss 120 -i /shared_data2/video2/family_films/Brave (2012).mp4 -an -frames:v 1 -f image2 pipe:
2015-05-23 14:10:48,463 DEBUG [FFMPEGWrapper] Invoking FFMPEG to retrieve thumbnail for file: /shared_data2/video2/family_films/Brave (2012).mp4
2015-05-23 14:10:48,463 DEBUG [FFmpegMetadataRetriever] File '/shared_data2/video2/family_films/Brave (2012).mp4' has H264 profile HIGH, levels [{RF=4, H=4}] and 5 ref frames
2015-05-23 14:10:48,388 DEBUG [ProcessExecutor] Starting /usr/local/serviio/serviio-1.5.2/bin/ffmpeg -i /shared_data2/video2/family_films/Brave (2012).mp4 -frames:v 1 -c:v copy -f h264 -bsf:v h264_mp4toannexb -an pipe:
2015-05-23 14:10:48,386 DEBUG [FFMPEGWrapper] Invoking FFMPEG to retrieve H264 header for file: /shared_data2/video2/family_films/Brave (2012).mp4
2015-05-23 14:10:48,386 DEBUG [FFmpegMetadataRetriever] Retrieving H264 profile/level for file '/shared_data2/video2/family_films/Brave (2012).mp4'
2015-05-23 14:10:47,514 DEBUG [SearchManager] Committing search index
2015-05-23 14:10:47,439 DEBUG [RendererDAOImpl] Retrieving list of all stored renderers
2015-05-23 14:10:46,521 DEBUG [ProcessExecutor] Starting /usr/local/serviio/serviio-1.5.2/bin/ffmpeg -i /shared_data2/video2/family_films/Brave (2012).mp4
2015-05-23 14:10:46,521 DEBUG [FFMPEGWrapper] Invoking FFMPEG to retrieve media information for file: /shared_data2/video2/family_films/Brave (2012).mp4
2015-05-23 14:10:46,521 DEBUG [VideoExtractionStrategy] Extracting metadata of video file: /shared_data2/video2/family_films/Brave (2012).mp4
2015-05-23 14:10:46,520 DEBUG [LibraryHelper] File is complete with size 32526336
2015-05-23 14:10:44,618 DEBUG [LibraryHelper] Checking if the file is complete using file size
2015-05-23 14:10:44,618 DEBUG [LibraryHelper] Checking if the file is complete using file lock
2015-05-23 14:10:44,617 DEBUG [MediaFileIndexer] File not in Library, will add it
2015-05-23 14:10:44,617 DEBUG [MediaItemDAOImpl] Media item /shared_data2/video2/family_films/Brave (2012).mp4 doesn't exist in DB yet
2015-05-23 14:10:44,616 DEBUG [MediaItemDAOImpl] Looking up a media item for file path: /shared_data2/video2/family_films/Brave (2012).mp4, ignore case: false
2015-05-23 14:10:44,616 DEBUG [MediaItemDAOImpl] Checking if DB already contains media item /shared_data2/video2/family_films/Brave (2012).mp4

Re: Video file size / time length reported on client truncat

PostPosted: Mon May 25, 2015 6:52 pm
by zip
There is a file size check, file is deemed complete if the file size is not changed within roughly half a second. Possibly on your system this might happen?

Re: Video file size / time length reported on client truncat

PostPosted: Tue Jun 02, 2015 6:08 pm
by stephendhill
There is a file size check, file is deemed complete if the file size is not changed within roughly half a second. Possibly on your system this might happen?

Seems unlikely; the file operation runs at 30MBytes/sec and the server is a Core2Duo top whack 3.2GHz on Ubuntu 14.04LTS server. The drive is an external USB2 jobby.

Re: Video file size / time length reported on client truncat

PostPosted: Wed Jun 10, 2015 6:57 pm
by stephendhill
'Googling this kind of thing, it looks like finding out when a file copy has completed in Java is a problem.
Would it be possible to add an option to allow changing the file size timeout period?