Disjoint queries occasionally return the same activity:

​http://pamrel.lu/f244a/

I'm running the latest git 355d062dd4e35409af92e136666baf211161b7cb on an Ubuntu 14.04 server.

Uploading an audio file causes mediagoblin to crash. It appears to be crashing when generating the audiolab PNG. Here's the full stacktrace:

Using paster config: paste_local.ini Using ./bin/paster + export CELERY_ALWAYS_EAGER=true + false + ./bin/paster serve paste_local.ini --server-name=broadcast --reload /home/src/mediagoblin/local/lib/python2.7/site-packages/setuptools-3.3-py2.7.egg/pkg_resources.py:1031: UserWarning: /home/ken/.python-eggs is writable by group/others and vulnerable to attack when used with get_resource_filename. Consider a more secure location (set with .set_extraction_path or the PYTHON_EGG_CACHE environment variable). 2015-12-21 18:22:20,925 INFO [mediagoblin.app] GNU MediaGoblin 0.8.0 main server starting 2015-12-21 18:22:21,317 INFO [mediagoblin.app] Setting up plugins. 2015-12-21 18:22:21,318 INFO [mediagoblin.init.plugins] Importing plugin module: mediagoblin.plugins.geolocation 2015-12-21 18:22:21,318 INFO [mediagoblin.init.plugins] Importing plugin module: mediagoblin.plugins.basic_auth 2015-12-21 18:22:21,318 INFO [mediagoblin.init.plugins] Importing plugin module: mediagoblin.media_types.image 2015-12-21 18:22:21,319 INFO [mediagoblin.init.plugins] Importing plugin module: mediagoblin.media_types.video 2015-12-21 18:22:21,319 INFO [mediagoblin.init.plugins] Importing plugin module: mediagoblin.media_types.audio 2015-12-21 18:22:21,400 INFO [mediagoblin.init.celery] Setting celery configuration from object "mediagoblin.init.celery.dummy_settings_module" /home/src/mediagoblin/local/lib/python2.7/site-packages/SQLAlchemy-0.8.7-py2.7-linux-x86_64.egg/sqlalchemy/engine/default.py:459: SAWarning: Unicode type received non-unicode bind param value. 2015-12-21 18:22:44,656 INFO [mediagoblin.media_types] No plugins handled extension .mp3 2015-12-21 18:22:44,657 INFO [mediagoblin.media_types] No plugins using two-step checking found 2015-12-21 18:22:44,797 DEBUG [mediagoblin.processing.task] Processing <MediaEntry 5: twang> 2015-12-21 18:22:44,798 INFO [mediagoblin.media_types.audio.transcoders] Initializing AudioTranscoder 2015-12-21 18:22:44,800 INFO [mediagoblin.media_types.audio.transcoders] Initializing AudioThumbnailer 2015-12-21 18:22:44,810 INFO [mediagoblin.media_types.audio.transcoders] Transcoding /home/src/mediagoblin/user_dev/media/queue/media_entries/51da0f06-8981-4a27-8c46-972a8ef1477b/08_Twang_64kb.mp3 into /home/src/mediagoblin/user_dev/media/workbench/tmp6Lrm7I/08_Twang_64kb.mp3 2015-12-21 18:22:47,724 INFO [mediagoblin.media_types.audio.transcoders] 100% done... 2015-12-21 18:22:47,725 INFO [mediagoblin.media_types.audio.transcoders] Done 2015-12-21 18:22:47,730 INFO [mediagoblin.media_types.audio.transcoders] Quitting MainLoop gracefully... 2015-12-21 18:22:47,821 INFO [mediagoblin.media_types.audio.processing] Creating OGG source for spectrogram 2015-12-21 18:22:47,822 INFO [mediagoblin.media_types.audio.transcoders] Transcoding /home/src/mediagoblin/user_dev/media/queue/media_entries/51da0f06-8981-4a27-8c46-972a8ef1477b/08_Twang_64kb.mp3 into /home/src/mediagoblin/user_dev/media/workbench/tmp6Lrm7I/08_Twang_64kb.ogg 2015-12-21 18:22:50,582 INFO [mediagoblin.media_types.audio.transcoders] 100% done... 2015-12-21 18:22:50,583 INFO [mediagoblin.media_types.audio.transcoders] Done 2015-12-21 18:22:50,585 INFO [mediagoblin.media_types.audio.transcoders] Quitting MainLoop gracefully... 2015-12-21 18:22:50,811 ERROR [mediagoblin.processing.task] An unhandled exception was raised while processing <MediaEntry 5: twang> 2015-12-21 18:22:50,813 WARNING [mediagoblin.processing] No idea what happened here, but it failed: IndexError('axis 1 out of bounds [0, 1)',) 2015-12-21 18:22:50,829 WARNING [mediagoblin.processing] No idea what happened here, but it failed: IndexError('axis 1 out of bounds [0, 1)',) Error - <type 'exceptions.IndexError'>: axis 1 out of bounds [0, 1) URL: ​http://hub.spaz.org:6543/submit/ File '/home/src/mediagoblin/local/lib/python2.7/site-packages/Paste-1.7.5.1-py2.7.egg/paste/exceptions/errormiddleware.py', line 144 in call

app_iter = self.application(environ, sr_checker)

File '/home/src/mediagoblin/mediagoblin/app.py', line 342 in call

return self.call_backend(environ, start_response)

File '/home/src/mediagoblin/local/lib/python2.7/site-packages/Werkzeug-0.11.3-py2.7.egg/werkzeug/wsgi.py', line 599 in call

return self.app(environ, start_response)

File '/home/src/mediagoblin/mediagoblin/app.py', line 276 in call_backend

return self._finish_call_backend(request, environ, start_response)

File '/home/src/mediagoblin/mediagoblin/app.py', line 318 in _finish_call_backend

response = controller(request)

File '/home/src/mediagoblin/mediagoblin/decorators.py', line 46 in wrapper

return controller(request, *args, kwargs)

File '/home/src/mediagoblin/mediagoblin/decorators.py', line 73 in new_controller_func

return controller(request, *args, kwargs)

File '/home/src/mediagoblin/mediagoblin/decorators.py', line 46 in wrapper

return controller(request, *args, kwargs)

File '/home/src/mediagoblin/mediagoblin/decorators.py', line 73 in new_controller_func

return controller(request, *args, kwargs)

File '/home/src/mediagoblin/mediagoblin/decorators.py', line 102 in wrapper

return controller(request, *args, kwargs)

File '/home/src/mediagoblin/mediagoblin/submit/views.py', line 68 in submit_start

urlgen=request.urlgen)

File '/home/src/mediagoblin/mediagoblin/submit/lib.py', line 208 in submit_media

run_process_media(entry, feed_url)

File '/home/src/mediagoblin/mediagoblin/submit/lib.py', line 257 in run_process_media

task_id=entry.queued_task_id)

File '/home/src/mediagoblin/local/lib/python2.7/site-packages/celery-3.1.19-py2.7.egg/celery/app/task.py', line 552 in apply_async

link=link, link_error=link_error, options)

File '/home/src/mediagoblin/local/lib/python2.7/site-packages/celery-3.1.19-py2.7.egg/celery/app/task.py', line 749 in apply

request=request, propagate=throw)

File '/home/src/mediagoblin/local/lib/python2.7/site-packages/celery-3.1.19-py2.7.egg/celery/app/trace.py', line 355 in eager_trace_task

uuid, args, kwargs, request)

File '/home/src/mediagoblin/local/lib/python2.7/site-packages/celery-3.1.19-py2.7.egg/celery/app/trace.py', line 253 in trace_task

I, R, state, retval = on_error(task_request, exc, uuid)

File '/home/src/mediagoblin/local/lib/python2.7/site-packages/celery-3.1.19-py2.7.egg/celery/app/trace.py', line 240 in trace_task

R = retval = fun(*args, kwargs)

File '/home/src/mediagoblin/mediagoblin/processing/task.py', line 101 in run

processor.process(reprocess_info)

File '/home/src/mediagoblin/mediagoblin/media_types/audio/processing.py', line 260 in process

self.create_spectrogram(max_width=medium_width, fft_size=fft_size)

File '/home/src/mediagoblin/mediagoblin/media_types/audio/processing.py', line 158 in create_spectrogram

fft_size=fft_size)

File '/home/src/mediagoblin/mediagoblin/media_types/audio/transcoders.py', line 76 in spectrogram

seek_point)

File '/home/src/mediagoblin/mediagoblin/media_types/audio/audioprocessing.py', line 180 in spectral_centroid

samples = self.read(seek_point - self.fft_size/2, self.fft_size, True)

File '/home/src/mediagoblin/mediagoblin/media_types/audio/audioprocessing.py', line 168 in read

samples = numpy.concatenate((numpy.zeros(add_to_start), samples), axis=1)

IndexError: axis 1 out of bounds [0, 1)

CGI Variables

CONTENT_LENGTH: '725435' CONTENT_TYPE: 'multipart/form-data; boundary=----WebKitFormBoundaryMwJkoGtaHB3FAnk8' CSRF_TOKEN: u'5878169815720531094' HTTP_ACCEPT: 'text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,*/*;q=0.8' HTTP_ACCEPT_ENCODING: 'gzip,deflate' HTTP_ACCEPT_LANGUAGE: 'en-US,en;q=0.8' HTTP_CACHE_CONTROL: 'max-age=0' HTTP_CONNECTION: 'keep-alive' HTTP_COOKIE: 'mediagoblin_csrftoken=5878169815720531094; PHPSESSID=h1giqmmj8rsu94uln1m4mfeqc1; jsAvailable=1; MGSession=eyJzdGF5X2xvZ2dlZF9pbiI6dHJ1ZSwidXNlcl9pZCI6IjIifQ.CVldEw.cTjLyQFoWW-oR9SEWLdmwN4aCwQ; mediagoblin_csrftoken=5878169815720531094' HTTP_HOST: 'hub.spaz.org:6543' HTTP_ORIGIN: '​http://hub.spaz.org:6543' HTTP_REFERER: '​http://hub.spaz.org:6543/submit/' HTTP_USER_AGENT: 'Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/37.0.2062.120 Safari/537.36' PATH_INFO: '/submit/' REMOTE_ADDR: '50.242.111.198' REQUEST_METHOD: 'POST' SERVER_NAME: '0.0.0.0' SERVER_PORT: '6543' SERVER_PROTOCOL: 'HTTP/1.1'

WSGI Variables

application: <mediagoblin.app.MediaGoblinApp object at 0x7fcf11bbf990> paste.httpserver.thread_pool: <paste.httpserver.ThreadPool object at 0x7fcf023e3510> paste.throw_errors: True werkzeug.request: <Request '​http://hub.spaz.org:6543/submit/' [POST]> wsgi process: 'Multithreaded'

sapienTech and I have been debugging an issue where comments made with an API client don't show up on media pages on recent code. We found that while comments made via the web interface get attached to targets, comments made via API clients do not. See below from my database from core__activities.

 9785 | 23460 | 2015-12-18 05:24:34.267703 | 2015-12-18 00:24:34.276964 | post   | sapientech posted a comment                            |       |         3 |     11256 |           |
 9786 | 23460 | 2015-12-18 05:29:13.226124 | 2015-12-18 00:29:13.239587 | post   | sapientech posted a comment to Oysters for days        |       |         2 |     11257 |     11255 |
 9787 | 23460 | 2015-12-18 05:29:43.556982 | 2015-12-18 00:29:43.569345 | post   | sapientech posted a comment                            |       |         3 |     11258 |           |

Activities 9785 and 9787 came from pypump and have no target_id entries. Activity 9786 came from the web interface and does have a target_id entry.