Context Navigation

← Previous Ticket
Next Ticket →

#757 closed defect (fixed)

Video upload ignored

Reported by:	Beuc	Owned by:
Priority:	major	Milestone:
Component:	programming	Keywords:
Cc:		Parent Tickets:

Description

I tried to upload this video :
http://www.sturm.com.au/resources/stallman-software-freedom-day-low.ogv

The WebUI says the upload is completed, but the video doesn't appear anywhere.

Console output :
2013-08-28 19:09:28,976 DEBUG [mediagoblin.processing.task] Processing <MediaEntry 17: Test1>
2013-08-28 19:09:28,977 INFO [mediagoblin.media_types.video.transcoders] Initializing VideoTranscoder...
2013-08-28 19:09:28,977 INFO [mediagoblin.media_types.video.transcoders] Discovering /usr/src/mediagoblin/user_dev/media/queue/media_entries/34dde58d-58e0-47a5-a212-9f7bcacf7776/stallman-software-freedom-day-low.ogv
2013-08-28 19:09:28,981 CRITICA [mediagoblin.media_types.video.transcoders] Reached gobject timeout
2013-08-28 19:09:29,023 INFO [mediagoblin.media_types.video.transcoders] Terminating MainLoop
2013-08-28 19:09:29,025 DEBUG [mediagoblin.media_types.video.processing] Skipping transcoding
2013-08-28 19:09:29,111 INFO [mediagoblin.media_types.video.transcoders] playbin ready
2013-08-28 19:09:29,111 CRITICA [mediagoblin.media_types.video.transcoders] Could not get any video data from playbin
/usr/src/mediagoblin/mediagoblin/media_types/video/transcoders.py:243: DeprecationWarning: integer argument expected, got float

0)

2013-08-28 19:09:29,151 INFO [mediagoblin.media_types.video.transcoders] Could not seek.
/usr/src/mediagoblin/mediagoblin/media_types/video/transcoders.py:243: DeprecationWarning: integer argument expected, got float

0)

2013-08-28 19:09:29,152 INFO [mediagoblin.media_types.video.transcoders] Could not seek.
/usr/src/mediagoblin/mediagoblin/media_types/video/transcoders.py:243: DeprecationWarning: integer argument expected, got float

0)

2013-08-28 19:09:29,166 INFO [mediagoblin.media_types.video.transcoders] Seek successful, attaching buffer probe
2013-08-28 19:09:29,167 INFO [mediagoblin.media_types.video.transcoders] Attached buffer probes: {'fakesink4': 433L}
2013-08-28 19:09:29,167 INFO [mediagoblin.media_types.video.transcoders] Already processing thumbnail
2013-08-28 19:09:29,167 INFO [mediagoblin.media_types.video.transcoders] Already processing thumbnail
2013-08-28 19:09:29,167 INFO [mediagoblin.media_types.video.transcoders] Already processing thumbnail
2013-08-28 19:09:29,168 INFO [mediagoblin.media_types.video.transcoders] Already processing thumbnail
2013-08-28 19:09:29,168 INFO [mediagoblin.media_types.video.transcoders] Already processing thumbnail
2013-08-28 19:09:29,168 INFO [mediagoblin.media_types.video.transcoders] Already processing thumbnail
2013-08-28 19:09:29,168 INFO [mediagoblin.media_types.video.transcoders] Already processing thumbnail
2013-08-28 19:09:29,168 INFO [mediagoblin.media_types.video.transcoders] Already processing thumbnail
2013-08-28 19:09:29,169 INFO [mediagoblin.media_types.video.transcoders] Already processing thumbnail
2013-08-28 19:09:29,169 ERROR [mediagoblin.media_types.video.transcoders] thumbnail error: [<GError at 0x7fa1f805c130>, 'gsttheoradec.c(1228): theora_handle_data_packet (): /GstPipeline:pipeline4/GstDecodeBin:decodebin14/GstTheoraDec:theoradec5:\nno header sent yet']
2013-08-28 19:09:29,169 ERROR [mediagoblin.media_types.video.transcoders] thumbnail error: [<GError at 0x7fa22402c9b0>, 'gstoggdemux.c(4467): gst_ogg_demux_loop (): /GstPipeline:pipeline4/GstDecodeBin:decodebin14/GstOggDemux:oggdemux5:\nstream stopped, reason error']
2013-08-28 19:09:29,169 ERROR [mediagoblin.media_types.video.transcoders] Thumbnailing failed: [<GError at 0x7fa22402cac0>, 'gsttheoradec.c(1228): theora_handle_data_packet (): /GstPipeline:pipeline4/GstDecodeBin:decodebin14/GstTheoraDec:theoradec5:\nno header sent yet']
2013-08-28 19:09:29,190 ERROR [mediagoblin.media_types.video.transcoders] Thumbnailing failed: [<GError at 0x7fa22402c980>, 'gstoggdemux.c(4467): gst_ogg_demux_loop (): /GstPipeline:pipeline4/GstDecodeBin:decodebin14/GstOggDemux:oggdemux5:\nstream stopped, reason error']
2013-08-28 19:09:29,191 DEBUG [mediagoblin.media_types.video.processing] Saving thumbnail...

Attachments (1)

mediagoblin.patch (669 bytes ) - added by Sergio Durigan Junior 11 years ago.: Workaround to fix the issue

Download all attachments as: .zip

Change History (7)

comment:1 by Beuc, 11 years ago

Oh, and the admin panel says:

17 	Test1 	2013-08-28 19:09 	Copying to public storage failed. 	{u'keyname': u'thumb'}

comment:2 by saul, 11 years ago

What I suspect may be happening is that the usage of videoscale in the Gstreamer pipeline causes every accessed frame to be resized while seeking the thumbnail position in the video stream. On slow CPUs (I'm using a 1GHz 686), this processing is taking too much time and triggers a timeout.

I may be completely off-base in this, but I was able to get past this problem in two separate ways. One was by decreasing wadsworth_position_callback(1) duration from 30% to 5%. The other was by increasing the gobject.timeout_add(2) value from 3000ms to 20000ms.

The second method resulted in the generation of a socket response error and so I have chosen to go with reducing the wadsworth position value.

If my hypothesis about videoscale is correct, a potential remedy might be to remove that operation from the Gstreamer pipeline and perform the thumbnail generation on the returned, full-sized frame.

(1) a method of the VideoThumbnailerMarkII class defined in mediagoblin/media_types/video/transcoders.py

(2) defined at the end of the on_playbin_paused callback in mediagoblin/media_types/video/transcoders.py

Version 0, edited 11 years ago by saul (next)

comment:3 by ciewow, 11 years ago

I am running MediaGoblin on an Intel Atom N2800 and am hit by this problem. Changing wadsworth_position_callback to 5% does not solve the problem for me. My output from celery is slightly different:

2013-10-01 14:38:49,382 INFO    [celery.worker.consumer] Got task from broker: mediagoblin.processing.task.ProcessMedia[44dc6d47-00b6-4373-9683-5ae6be867a65]
2013-10-01 15:09:52,733 WARNING [celery.redirected] /srv/mediagoblin/mediagoblin/local/lib/python2.7/site-packages/SQLAlchemy-0.8.2-py2.7-linux-i686.egg/sqlalchemy/engine/default.py:471: SAWarning: Unicode type received non-unicode bind param value.
  processors[key](compiled_params[key])
2013-10-01 15:09:53,694 WARNING [celery.redirected] /srv/mediagoblin/mediagoblin/mediagoblin/media_types/video/transcoders.py:243: DeprecationWarning: integer argument expected, got float
  0)
2013-10-01 15:09:53,709 WARNING [celery.redirected] /srv/mediagoblin/mediagoblin/mediagoblin/media_types/video/transcoders.py:243: DeprecationWarning: integer argument expected, got float
  0)
2013-10-01 15:09:53,710 WARNING [celery.redirected] /srv/mediagoblin/mediagoblin/mediagoblin/media_types/video/transcoders.py:243: DeprecationWarning: integer argument expected, got float
  0)
2013-10-01 15:09:53,712 WARNING [celery.redirected] /srv/mediagoblin/mediagoblin/mediagoblin/media_types/video/transcoders.py:243: DeprecationWarning: integer argument expected, got float
  0)
2013-10-01 15:09:53,713 WARNING [celery.redirected] /srv/mediagoblin/mediagoblin/mediagoblin/media_types/video/transcoders.py:243: DeprecationWarning: integer argument expected, got float
  0)
2013-10-01 15:09:53,714 WARNING [celery.redirected] /srv/mediagoblin/mediagoblin/mediagoblin/media_types/video/transcoders.py:243: DeprecationWarning: integer argument expected, got float
  0)
2013-10-01 15:09:53,716 WARNING [celery.redirected] /srv/mediagoblin/mediagoblin/mediagoblin/media_types/video/transcoders.py:243: DeprecationWarning: integer argument expected, got float
  0)
2013-10-01 15:09:53,721 WARNING [celery.redirected] /srv/mediagoblin/mediagoblin/mediagoblin/media_types/video/transcoders.py:243: DeprecationWarning: integer argument expected, got float
  0)
2013-10-01 15:09:53,730 WARNING [celery.redirected] /srv/mediagoblin/mediagoblin/mediagoblin/media_types/video/transcoders.py:243: DeprecationWarning: integer argument expected, got float
  0)
2013-10-01 15:09:53,731 WARNING [celery.redirected] /srv/mediagoblin/mediagoblin/mediagoblin/media_types/video/transcoders.py:243: DeprecationWarning: integer argument expected, got float
  0)
2013-10-01 15:09:53,748 WARNING [celery.redirected] /srv/mediagoblin/mediagoblin/mediagoblin/media_types/video/transcoders.py:243: DeprecationWarning: integer argument expected, got float
  0)
2013-10-01 15:09:56,964 INFO    [celery.worker.job] Task mediagoblin.processing.task.ProcessMedia[44dc6d47-00b6-4373-9683-5ae6be867a65] succeeded in 1867.48191595s: None

by Sergio Durigan Junior, 11 years ago

Attachment:	mediagoblin.patch added

Workaround to fix the issue

follow-up: 5 comment:4 by Sergio Durigan Junior, 11 years ago

I hacked MG and created the attached workaround to fix the issue. You can see a better description of it in the following link: http://lists.mediagoblin.org/pipermail/devel/2013-December/000748.html

in reply to: 4 comment:5 by Siddhartha Sahai, 11 years ago

Replying to sergiodj: