Page 1 of 1

Skipping processing metadata for an unsupported file

PostPosted: Thu Jan 21, 2016 10:24 pm
by uzzi
Hello,

I have serviio 1.6 on Centos 6 and not all files are indexed. The log is full of this warning

  Code:
2016-01-21 20:04:02,844 WARN [MetadataExtractionCoordinator] Skipping processing metadata for an unsupported file (/home/3TB/filme/Seriale/Bones/Bones.S09.DVDRip.x264-Mixed/bones.915.dvdrip.x264-ositv.mkv). Message: Unknown video file type.
2016-01-21 20:04:02,781 WARN [MetadataExtractionCoordinator] Skipping processing metadata for an unsupported file (/home/3TB/filme/Seriale/Bones/Bones.S09.DVDRip.x264-Mixed/snow-bones.s09e10.dvdrip.x264.mkv). Message: Unknown video file type.
2016-01-21 20:04:02,712 WARN [MetadataExtractionCoordinator] Skipping processing metadata for an unsupported file (/home/3TB/filme/Seriale/Bones/Bones.S09.DVDRip.x264-Mixed/bones.s09e21.dvdrip.x264-demand.mkv). Message: Unknown video file type.


ffmpeg version:

  Code:
FFmpeg version SVN-r26402, Copyright (c) 2000-2011 the FFmpeg developers
  built on Jan 20 2016 22:56:25 with gcc 4.4.7 20120313 (Red Hat 4.4.7-16)
  configuration:
  libavutil     50.36. 0 / 50.36. 0
  libavcore      0.16. 1 /  0.16. 1
  libavcodec    52.108. 0 / 52.108. 0
  libavformat   52.93. 0 / 52.93. 0
  libavdevice   52. 2. 3 / 52. 2. 3
  libavfilter    1.74. 0 /  1.74. 0
  libswscale     0.12. 0 /  0.12. 0
Hyper fast Audio and Video encoder


ffmpeg -i

  Code:
ffmpeg -i /home/3TB/filme/Seriale/Bones/Bones.S09.DVDRip.x264-Mixed/bones.915.dvdrip.x264-ositv.mkv
FFmpeg version SVN-r26402, Copyright (c) 2000-2011 the FFmpeg developers
  built on Jan 20 2016 22:56:25 with gcc 4.4.7 20120313 (Red Hat 4.4.7-16)
  configuration:
  libavutil     50.36. 0 / 50.36. 0
  libavcore      0.16. 1 /  0.16. 1
  libavcodec    52.108. 0 / 52.108. 0
  libavformat   52.93. 0 / 52.93. 0
  libavdevice   52. 2. 3 / 52. 2. 3
  libavfilter    1.74. 0 /  1.74. 0
  libswscale     0.12. 0 /  0.12. 0
[matroska,webm @ 0x1eb3510] Estimating duration from bitrate, this may be inaccurate

Seems stream 0 codec frame rate differs from container frame rate: 47.95 (48000/1001) -> 24.00 (24/1)
Input #0, matroska,webm, from '/home/3TB/filme/Seriale/Bones/Bones.S09.DVDRip.x264-Mixed/bones.915.dvdrip.x264-ositv.mkv':
  Duration: 00:43:26.10, start: 0.000000, bitrate: N/A
    Stream #0.0: Video: h264, yuv420p, 720x404 [PAR 1:1 DAR 180:101], 23.98 fps, 24 tbr, 1k tbn, 47.95 tbc
    Metadata:
      BPS             : 810554
      BPS-eng         : 810554
      DURATION        : 00:43:26.104000000
      DURATION-eng    : 00:43:26.104000000
      NUMBER_OF_FRAMES: 62484
      NUMBER_OF_FRAMES-eng: 62484
      NUMBER_OF_BYTES : 264048608
      NUMBER_OF_BYTES-eng: 264048608
      _STATISTICS_WRITING_APP: mkvmerge v7.2.0 ('On Every Street') 32bit built on Sep 13 2014 15:42:11
      _STATISTICS_WRITING_APP-eng: mkvmerge v7.2.0 ('On Every Street') 32bit built on Sep 13 2014 15:42:11
      _STATISTICS_WRITING_DATE_UTC: 2014-09-24 19:47:19
      _STATISTICS_WRITING_DATE_UTC-eng: 2014-09-24 19:47:19
      _STATISTICS_TAGS: BPS DURATION NUMBER_OF_FRAMES NUMBER_OF_BYTES
      _STATISTICS_TAGS-eng: BPS DURATION NUMBER_OF_FRAMES NUMBER_OF_BYTES
    Stream #0.1: Audio: aac, 48000 Hz, stereo, s16
    Metadata:
      BPS             : 112749
      BPS-eng         : 112749
      DURATION        : 00:43:26.037000000
      DURATION-eng    : 00:43:26.037000000
      NUMBER_OF_FRAMES: 122158
      NUMBER_OF_FRAMES-eng: 122158
      NUMBER_OF_BYTES : 36728777
      NUMBER_OF_BYTES-eng: 36728777
      _STATISTICS_WRITING_APP: mkvmerge v7.2.0 ('On Every Street') 32bit built on Sep 13 2014 15:42:11
      _STATISTICS_WRITING_APP-eng: mkvmerge v7.2.0 ('On Every Street') 32bit built on Sep 13 2014 15:42:11
      _STATISTICS_WRITING_DATE_UTC: 2014-09-24 19:47:19
      _STATISTICS_WRITING_DATE_UTC-eng: 2014-09-24 19:47:19
      _STATISTICS_TAGS: BPS DURATION NUMBER_OF_FRAMES NUMBER_OF_BYTES
      _STATISTICS_TAGS-eng: BPS DURATION NUMBER_OF_FRAMES NUMBER_OF_BYTES
At least one output file must be specified


Any idea? As far as i see this happens only on some mkv's

Re: Skipping processing metadata for an unsupported file

PostPosted: Thu Jan 21, 2016 11:53 pm
by zip
are you sure Serviio can see your ffmpeg?

Re: Skipping processing metadata for an unsupported file

PostPosted: Fri Jan 22, 2016 3:50 pm
by uzzi
How can i check if serviio can see my ffmpeg? And this happens only for some of my files from the library, not all. Its a 2TB library, on only 10-15 movies are affected

Thank you

Re: Skipping processing metadata for an unsupported file

PostPosted: Sat Jan 23, 2016 11:21 am
by zip
The example that you gave (ffmpeg -i) is not for one of the failed file, if I'm looking right.

Can you do the same for

  Code:
ffmpeg -i /home/3TB/filme/Seriale/Bones/Bones.S09.DVDRip.x264-Mixed/snow-bones.s09e10.dvdrip.x264.mkv

Re: Skipping processing metadata for an unsupported file

PostPosted: Sat Jan 23, 2016 11:54 am
by uzzi
here it is

  Code:
 ffmpeg -i /home/3TB/filme/Seriale/Bones/Bones.S09.DVDRip.x264-Mixed/snow-bones.s09e10.dvdrip.x264.mkv
FFmpeg version SVN-r26402, Copyright (c) 2000-2011 the FFmpeg developers
  built on Jan 20 2016 22:56:25 with gcc 4.4.7 20120313 (Red Hat 4.4.7-16)
  configuration:
  libavutil     50.36. 0 / 50.36. 0
  libavcore      0.16. 1 /  0.16. 1
  libavcodec    52.108. 0 / 52.108. 0
  libavformat   52.93. 0 / 52.93. 0
  libavdevice   52. 2. 3 / 52. 2. 3
  libavfilter    1.74. 0 /  1.74. 0
  libswscale     0.12. 0 /  0.12. 0
[matroska,webm @ 0x1ab9510] Unknown entry 0xF0
    Last message repeated 917 times
[matroska,webm @ 0x1ab9510] Estimating duration from bitrate, this may be inaccurate

Seems stream 0 codec frame rate differs from container frame rate: 47.95 (48000/1001) -> 24.00 (24/1)
Input #0, matroska,webm, from '/home/3TB/filme/Seriale/Bones/Bones.S09.DVDRip.x264-Mixed/snow-bones.s09e10.dvdrip.x264.mkv':
  Duration: 00:43:57.88, start: 0.000000, bitrate: N/A
    Chapter #0.0: start 0.000000, end 336.534000
    Metadata:
      title           : Chapter 01
    Chapter #0.1: start 336.534000, end 468.834000
    Metadata:
      title           : Chapter 02
    Chapter #0.2: start 468.834000, end 611.834000
    Metadata:
      title           : Chapter 03
    Chapter #0.3: start 611.834000, end 858.168000
    Metadata:
      title           : Chapter 04
    Chapter #0.4: start 858.168000, end 1040.036000
    Metadata:
      title           : Chapter 05
    Chapter #0.5: start 1040.036000, end 1213.036000
    Metadata:
      title           : Chapter 06
    Chapter #0.6: start 1213.036000, end 1379.503000
    Metadata:
      title           : Chapter 07
    Chapter #0.7: start 1379.503000, end 1616.670000
    Metadata:
      title           : Chapter 08
    Chapter #0.8: start 1616.670000, end 1797.004000
    Metadata:
      title           : Chapter 09
    Chapter #0.9: start 1797.004000, end 2211.838000
    Metadata:
      title           : Chapter 10
    Chapter #0.10: start 2211.838000, end 2385.505000
    Metadata:
      title           : Chapter 11
    Chapter #0.11: start 2385.505000, end 2635.206000
    Metadata:
      title           : Chapter 12
    Chapter #0.12: start 2635.206000, end 2637.886000
    Metadata:
      title           : Chapter 13
    Stream #0.0(eng): Video: h264, yuv420p, 720x406, PAR 1:1 DAR 360:203, 23.98 fps, 24 tbr, 1k tbn, 47.95 tbc
    Metadata:
      BPS             : 994249
      BPS-eng         : 994249
      DURATION        : 00:43:57.886000000
      DURATION-eng    : 00:43:57.886000000
      NUMBER_OF_FRAMES: 63246
      NUMBER_OF_FRAMES-eng: 63246
      NUMBER_OF_BYTES : 327839557
      NUMBER_OF_BYTES-eng: 327839557
      _STATISTICS_WRITING_APP: mkvmerge v7.1.0 ('Good Love') 64bit built on Jul 27 2014 13:06:55
      _STATISTICS_WRITING_APP-eng: mkvmerge v7.1.0 ('Good Love') 64bit built on Jul 27 2014 13:06:55
      _STATISTICS_WRITING_DATE_UTC: 2014-08-28 02:38:08
      _STATISTICS_WRITING_DATE_UTC-eng: 2014-08-28 02:38:08
      _STATISTICS_TAGS: BPS DURATION NUMBER_OF_FRAMES NUMBER_OF_BYTES
      _STATISTICS_TAGS-eng: BPS DURATION NUMBER_OF_FRAMES NUMBER_OF_BYTES
    Stream #0.1(eng): Audio: aac, 48000 Hz, stereo, s16
    Metadata:
      BPS             : 128019
      BPS-eng         : 128019
      DURATION        : 00:43:57.738000000
      DURATION-eng    : 00:43:57.738000000
      NUMBER_OF_FRAMES: 123644
      NUMBER_OF_FRAMES-eng: 123644
      NUMBER_OF_BYTES : 42210174
      NUMBER_OF_BYTES-eng: 42210174
      _STATISTICS_WRITING_APP: mkvmerge v7.1.0 ('Good Love') 64bit built on Jul 27 2014 13:06:55
      _STATISTICS_WRITING_APP-eng: mkvmerge v7.1.0 ('Good Love') 64bit built on Jul 27 2014 13:06:55
      _STATISTICS_WRITING_DATE_UTC: 2014-08-28 02:38:08
      _STATISTICS_WRITING_DATE_UTC-eng: 2014-08-28 02:38:08
      _STATISTICS_TAGS: BPS DURATION NUMBER_OF_FRAMES NUMBER_OF_BYTES
      _STATISTICS_TAGS-eng: BPS DURATION NUMBER_OF_FRAMES NUMBER_OF_BYTES
At least one output file must be specified

Re: Skipping processing metadata for an unsupported file

PostPosted: Sat Jan 23, 2016 1:00 pm
by zip
Ok, that works in my test.

Just noticed your FFmpeg is very old

  Code:
FFmpeg version SVN-r26402, Copyright (c) 2000-2011 the FFmpeg developers


You could try to upgrade it / build your own from latest sources.

Re: Skipping processing metadata for an unsupported file

PostPosted: Sat Jan 23, 2016 2:17 pm
by uzzi
Ok, updated ffmpeg to the latest version: 2.8.5 from source. It was installed from SVN as can be seen in my initial post

Same errors, same files persists in not indexing :(((

  Code:
ffmpeg
ffmpeg version 2.8.5 Copyright (c) 2000-2016 the FFmpeg developers
  built with gcc 4.4.7 (GCC) 20120313 (Red Hat 4.4.7-16)
  configuration:
  libavutil      54. 31.100 / 54. 31.100
  libavcodec     56. 60.100 / 56. 60.100
  libavformat    56. 40.101 / 56. 40.101
  libavdevice    56.  4.100 / 56.  4.100
  libavfilter     5. 40.101 /  5. 40.101
  libswscale      3.  1.101 /  3.  1.101
  libswresample   1.  2.101 /  1.  2.101
Hyper fast Audio and Video encoder


Any other ideas? Im banging my head against the wall here :)

Re: Skipping processing metadata for an unsupported file

PostPosted: Sat Jan 23, 2016 4:05 pm
by zip
if you enable detailed log, restart serviio and chenck the log. It should give some information about the ffmpeg executable it's using. Is it the one you're expecting?

Re: Skipping processing metadata for an unsupported file

PostPosted: Sun Jan 24, 2016 5:19 pm
by uzzi
I enabled detailed log, restarted serviio but the error message is the same

  Code:
2016-01-24 19:12:33,574 DEBUG [ApplicationInstanceManager] Successfully notified first instance.
2016-01-24 19:13:48,096 WARN  [MetadataExtractionCoordinator] Skipping processing metadata for an unsupported file (/home/3TB/filme/Full HD/Actiune/Chappie.2015.720p.RoSubbed.WEB-DL.AAC2.0.H.264-XSY.mkv). Message: Unknown video file type.


Thank you

Re: Skipping processing metadata for an unsupported file

PostPosted: Sun Jan 24, 2016 7:26 pm
by zip
I wnated you to check the ffmpeg info it prints out at the beggining after startup. Check it's the ffmpeg you compiled.

Re: Skipping processing metadata for an unsupported file

PostPosted: Mon Jan 25, 2016 7:05 pm
by uzzi
Hello,

A more detailed log is below. I can't tell if ffmpeg is the one that i compiled

  Code:
2016-01-25 21:02:52,984 WARN [MetadataExtractionCoordinator] Skipping processing metadata for an unsupported file (/home/3TB/filme/Seriale/Bones/Bones.S09_test/bones.s09e19.dvdrip.x264.mkv). Message: Unknown video file type.
2016-01-25 21:02:52,897 DEBUG [ProcessExecutor] Starting ffmpeg -i /home/3TB/filme/Seriale/Bones/Bones.S09_test/bones.s09e19.dvdrip.x264.mkv
2016-01-25 21:02:52,896 DEBUG [FFMPEGWrapper] Invoking FFMPEG to retrieve media information for file: /home/3TB/filme/Seriale/Bones/Bones.S09_test/bones.s09e19.dvdrip.x264.mkv
2016-01-25 21:02:52,896 DEBUG [VideoExtractionStrategy] Extracting metadata of video file: /home/3TB/filme/Seriale/Bones/Bones.S09_test/bones.s09e19.dvdrip.x264.mkv
2016-01-25 21:02:52,896 DEBUG [LibraryHelper] File is complete with size 306077098
2016-01-25 21:02:52,145 DEBUG [LibraryHelper] Checking if the file is complete using file size
2016-01-25 21:02:52,145 DEBUG [LibraryHelper] Checking if the file is complete using file lock
2016-01-25 21:02:52,145 DEBUG [MediaFileIndexer] File not in Library, will add it
2016-01-25 21:02:52,145 DEBUG [MediaItemDAOImpl] Media item /home/3TB/filme/Seriale/Bones/Bones.S09_test/bones.s09e19.dvdrip.x264.mkv doesn't exist in DB yet
2016-01-25 21:02:52,144 DEBUG [MediaItemDAOImpl] Looking up a media item for file path: /home/3TB/filme/Seriale/Bones/Bones.S09_test/bones.s09e19.dvdrip.x264.mkv, ignore case: false
2016-01-25 21:02:52,144 DEBUG [MediaItemDAOImpl] Checking if DB already contains media item /home/3TB/filme/Seriale/Bones/Bones.S09_test/bones.s09e19.dvdrip.x264.mkv
2016-01-25 21:02:52,144 DEBUG [MediaFileIndexer] Found file 'bones.s09e19.dvdrip.x264.mkv', checking if it's already in the Library
2016-01-25 21:02:52,144 DEBUG [PendingFilesCache] Adding file '/home/3TB/filme/Seriale/Bones/Bones.S09_test/bones.s09e02.dvdrip.x264.mkv' for the pending files cache
2016-01-25 21:02:52,144 WARN [MetadataExtractionCoordinator] Skipping processing metadata for an unsupported file (/home/3TB/filme/Seriale/Bones/Bones.S09_test/bones.s09e02.dvdrip.x264.mkv). Message: Unknown video file type.
2016-01-25 21:02:52,060 DEBUG [ProcessExecutor] Starting ffmpeg -i /home/3TB/filme/Seriale/Bones/Bones.S09_test/bones.s09e02.dvdrip.x264.mkv
2016-01-25 21:02:52,059 DEBUG [FFMPEGWrapper] Invoking FFMPEG to retrieve media information for file: /home/3TB/filme/Seriale/Bones/Bones.S09_test/bones.s09e02.dvdrip.x264.mkv
2016-01-25 21:02:52,059 DEBUG [VideoExtractionStrategy] Extracting metadata of video file: /home/3TB/filme/Seriale/Bones/Bones.S09_test/bones.s09e02.dvdrip.x264.mkv
2016-01-25 21:02:52,059 DEBUG [LibraryHelper] File is complete with size 416583133
2016-01-25 21:02:51,308 DEBUG [LibraryHelper] Checking if the file is complete using file size
2016-01-25 21:02:51,308 DEBUG [LibraryHelper] Checking if the file is complete using file lock
2016-01-25 21:02:51,308 DEBUG [MediaFileIndexer] File not in Library, will add it
2016-01-25 21:02:51,307 DEBUG [MediaItemDAOImpl] Media item /home/3TB/filme/Seriale/Bones/Bones.S09_test/bones.s09e02.dvdrip.x264.mkv doesn't exist in DB yet
2016-01-25 21:02:51,307 DEBUG [MediaItemDAOImpl] Looking up a media item for file path: /home/3TB/filme/Seriale/Bones/Bones.S09_test/bones.s09e02.dvdrip.x264.mkv, ignore case: false
2016-01-25 21:02:51,307 DEBUG [MediaItemDAOImpl] Checking if DB already contains media item /home/3TB/filme/Seriale/Bones/Bones.S09_test/bones.s09e02.dvdrip.x264.mkv
2016-01-25 21:02:51,307 DEBUG [MediaFileIndexer] Found file 'bones.s09e02.dvdrip.x264.mkv', checking if it's already in the Library
2016-01-25 21:02:51,307 DEBUG [PendingFilesCache] Adding file '/home/3TB/filme/Seriale/Bones/Bones.S09_test/bones.s09e18.dvdrip.x264.mkv' for the pending files cache
2016-01-25 21:02:51,307 WARN [MetadataExtractionCoordinator] Skipping processing metadata for an unsupported file (/home/3TB/filme/Seriale/Bones/Bones.S09_test/bones.s09e18.dvdrip.x264.mkv). Message: Unknown video file type.
2016-01-25 21:02:51,219 DEBUG [ProcessExecutor] Starting ffmpeg -i /home/3TB/filme/Seriale/Bones/Bones.S09_test/bones.s09e18.dvdrip.x264.mkv
2016-01-25 21:02:51,218 DEBUG [FFMPEGWrapper] Invoking FFMPEG to retrieve media information for file: /home/3TB/filme/Seriale/Bones/Bones.S09_test/bones.s09e18.dvdrip.x264.mkv
2016-01-25 21:02:51,218 DEBUG [VideoExtractionStrategy] Extracting metadata of video file: /home/3TB/filme/Seriale/Bones/Bones.S09_test/bones.s09e18.dvdrip.x264.mkv
2016-01-25 21:02:51,218 DEBUG [LibraryHelper] File is complete with size 338948113
2016-01-25 21:02:50,467 DEBUG [LibraryHelper] Checking if the file is complete using file size
2016-01-25 21:02:50,467 DEBUG [LibraryHelper] Checking if the file is complete using file lock
2016-01-25 21:02:50,467 DEBUG [MediaFileIndexer] File not in Library, will add it
2016-01-25 21:02:50,467 DEBUG [MediaItemDAOImpl] Media item /home/3TB/filme/Seriale/Bones/Bones.S09_test/bones.s09e18.dvdrip.x264.mkv doesn't exist in DB yet
2016-01-25 21:02:50,466 DEBUG [MediaItemDAOImpl] Looking up a media item for file path: /home/3TB/filme/Seriale/Bones/Bones.S09_test/bones.s09e18.dvdrip.x264.mkv, ignore case: false
2016-01-25 21:02:50,466 DEBUG [MediaItemDAOImpl] Checking if DB already contains media item /home/3TB/filme/Seriale/Bones/Bones.S09_test/bones.s09e18.dvdrip.x264.mkv
2016-01-25 21:02:50,466 DEBUG [MediaFileIndexer] Found file 'bones.s09e18.dvdrip.x264.mkv', checking if it's already in the Library
2016-01-25 21:02:50,466 DEBUG [PendingFilesCache] Adding file '/home/3TB/filme/Seriale/Bones/Bones.S09_test/bones.s09e12.dvdrip.x264.mkv' for the pending files cache
2016-01-25 21:02:50,466 WARN [MetadataExtractionCoordinator] Skipping processing metadata for an unsupported file (/home/3TB/filme/Seriale/Bones/Bones.S09_test/bones.s09e12.dvdrip.x264.mkv). Message: Unknown video file type.

Re: Skipping processing metadata for an unsupported file

PostPosted: Mon Jan 25, 2016 7:14 pm
by uzzi
I think i found the ffmpeg version as seen by serviio in DEBUG mod

  Code:
2016-01-25 21:10:23,048 DEBUG [ProcessExecutor] Starting dcraw
2016-01-25 21:10:23,047 DEBUG [DCRawWrapper] Invoking DCRAW to check if it exists of path dcraw
2016-01-25 21:10:22,926 DEBUG [ConfigEntryDAOImpl] Updating ConfigEntry (name = subtitles_hardsubs_enabled, value = false)
2016-01-25 21:10:22,911 DEBUG [ConfigEntryDAOImpl] Reading a ConfigEntry (name = subtitles_hardsubs_enabled)
2016-01-25 21:10:22,911 WARN [FFMPEGWrapper] FFmpeg is not compiled with libass support, rendering subtitles (hardsubs) will not work.
2016-01-25 21:10:22,911 WARN [FFMPEGWrapper] FFmpeg is not compiled with librtmp support, RTMP streaming will not work.
2016-01-25 21:10:22,911 INFO [FFMPEGWrapper] Found FFmpeg: ffmpeg version 2.8.5 Copyright (c) 2000-2016 the FFmpeg developers
2016-01-25 21:10:22,834 DEBUG [ProcessExecutor] Starting ffmpeg
2016-01-25 21:10:22,816 DEBUG [FFMPEGWrapper] Invoking FFMPEG to check if it exists of path ffmpeg
2016-01-25 21:10:22,779 INFO [UpdateChecker] Checking if a new version is available
2016-01-25 21:10:22,771 INFO [PluginCompilerThread] Started looking for plugins


It looks like its 2.8.5 the one i just installed the other day

Re: Skipping processing metadata for an unsupported file

PostPosted: Mon Jan 25, 2016 7:47 pm
by zip
ok, looks good.

Just for completeness sake, can you post ffmpeg -i for the unsupported file using this ffmpeg 2.8.5 version?

Re: Skipping processing metadata for an unsupported file

PostPosted: Tue Jan 26, 2016 5:52 pm
by uzzi
Last night after a power loss the server rebooted and, believe it or not, the error is gone and all unindexed MKS's by Serviio are now indexed :roll:

The one and only thing i can think of is related to java. Since last java jdk update on this server it was not rebooted in more then 100 days. I dont know if this is the case but maybe this info helps someone in the future

Thank you zip for your support ! Thumbs up for Serviio product and support forum ! 8-)