Given that we don't need mongodb things installed anymore and we're removing the installation instructions from the documentation, it shouldn't be the case that tests fail if you don't have it installed.

These tests should get fixed so that they get skipped if mongodb is either not installed or not running. nose is super duper for this sort of thing.

(M=d2eab local) saturn ~/projects/mediagoblin> ./runtests.sh 
Using ./bin/nosetests
..../home/willkg/projects/mediagoblin/local/lib/python2.7/site-packages/SQLAlchemy-0.7.6-py2.7-linux-i686.egg/sqlalchemy/engine/default.py:461: SAWarning: Unicode type received non-unicode bind param value.
  param.append(processors[key](compiled_params[key]))
................/home/willkg/projects/mediagoblin/mediagoblin/db/sql/open.py:63: SAWarning: At least one scoped session is already present.  configure() can not affect sessions that have already been created.
  Session.configure(bind=engine)
.EEEEEEE..........................................
======================================================================
ERROR: Make sure that if we don't have a migration_status
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/lib/python2.7/dist-packages/nose/case.py", line 381, in setUp
    try_run(self.inst, ('setup', 'setUp'))
  File "/usr/lib/python2.7/dist-packages/nose/util.py", line 478, in try_run
    return func()
  File "/home/willkg/projects/mediagoblin/mediagoblin/tests/test_migrations.py", line 273, in setUp
    self.connection = Connection()
  File "/home/willkg/projects/mediagoblin/local/lib/python2.7/site-packages/pymongo-2.1.1-py2.7-linux-i686.egg/pymongo/connection.py", line 381, in __init__
    self.__find_node()
  File "/home/willkg/projects/mediagoblin/local/lib/python2.7/site-packages/pymongo-2.1.1-py2.7-linux-i686.egg/pymongo/connection.py", line 659, in __find_node
    raise AutoReconnect(', '.join(errors))
AutoReconnect: could not connect to localhost:27017: [Errno 111] Connection refused

======================================================================
ERROR: Make sure that migrations get registered and are sorted right
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/lib/python2.7/dist-packages/nose/case.py", line 381, in setUp
    try_run(self.inst, ('setup', 'setUp'))
  File "/usr/lib/python2.7/dist-packages/nose/util.py", line 478, in try_run
    return func()
  File "/home/willkg/projects/mediagoblin/mediagoblin/tests/test_migrations.py", line 273, in setUp
    self.connection = Connection()
  File "/home/willkg/projects/mediagoblin/local/lib/python2.7/site-packages/pymongo-2.1.1-py2.7-linux-i686.egg/pymongo/connection.py", line 381, in __init__
    self.__find_node()
  File "/home/willkg/projects/mediagoblin/local/lib/python2.7/site-packages/pymongo-2.1.1-py2.7-linux-i686.egg/pymongo/connection.py", line 659, in __find_node
    raise AutoReconnect(', '.join(errors))
AutoReconnect: could not connect to localhost:27017: [Errno 111] Connection refused

======================================================================
ERROR: Make sure we get the right list of migrations to run
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/lib/python2.7/dist-packages/nose/case.py", line 381, in setUp
    try_run(self.inst, ('setup', 'setUp'))
  File "/usr/lib/python2.7/dist-packages/nose/util.py", line 478, in try_run
    return func()
  File "/home/willkg/projects/mediagoblin/mediagoblin/tests/test_migrations.py", line 273, in setUp
    self.connection = Connection()
  File "/home/willkg/projects/mediagoblin/local/lib/python2.7/site-packages/pymongo-2.1.1-py2.7-linux-i686.egg/pymongo/connection.py", line 381, in __init__
    self.__find_node()
  File "/home/willkg/projects/mediagoblin/local/lib/python2.7/site-packages/pymongo-2.1.1-py2.7-linux-i686.egg/pymongo/connection.py", line 659, in __find_node
    raise AutoReconnect(', '.join(errors))
AutoReconnect: could not connect to localhost:27017: [Errno 111] Connection refused

======================================================================
ERROR: If we don't have the current migration set in the database,
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/lib/python2.7/dist-packages/nose/case.py", line 381, in setUp
    try_run(self.inst, ('setup', 'setUp'))
  File "/usr/lib/python2.7/dist-packages/nose/util.py", line 478, in try_run
    return func()
  File "/home/willkg/projects/mediagoblin/mediagoblin/tests/test_migrations.py", line 273, in setUp
    self.connection = Connection()
  File "/home/willkg/projects/mediagoblin/local/lib/python2.7/site-packages/pymongo-2.1.1-py2.7-linux-i686.egg/pymongo/connection.py", line 381, in __init__
    self.__find_node()
  File "/home/willkg/projects/mediagoblin/local/lib/python2.7/site-packages/pymongo-2.1.1-py2.7-linux-i686.egg/pymongo/connection.py", line 659, in __find_node
    raise AutoReconnect(', '.join(errors))
AutoReconnect: could not connect to localhost:27017: [Errno 111] Connection refused

======================================================================
ERROR: Make sure that if we don't have a migration_status
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/lib/python2.7/dist-packages/nose/case.py", line 381, in setUp
    try_run(self.inst, ('setup', 'setUp'))
  File "/usr/lib/python2.7/dist-packages/nose/util.py", line 478, in try_run
    return func()
  File "/home/willkg/projects/mediagoblin/mediagoblin/tests/test_migrations.py", line 273, in setUp
    self.connection = Connection()
  File "/home/willkg/projects/mediagoblin/local/lib/python2.7/site-packages/pymongo-2.1.1-py2.7-linux-i686.egg/pymongo/connection.py", line 381, in __init__
    self.__find_node()
  File "/home/willkg/projects/mediagoblin/local/lib/python2.7/site-packages/pymongo-2.1.1-py2.7-linux-i686.egg/pymongo/connection.py", line 659, in __find_node
    raise AutoReconnect(', '.join(errors))
AutoReconnect: could not connect to localhost:27017: [Errno 111] Connection refused

======================================================================
ERROR: Make sure that running the full migration suite from 0 updates
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/lib/python2.7/dist-packages/nose/case.py", line 381, in setUp
    try_run(self.inst, ('setup', 'setUp'))
  File "/usr/lib/python2.7/dist-packages/nose/util.py", line 478, in try_run
    return func()
  File "/home/willkg/projects/mediagoblin/mediagoblin/tests/test_migrations.py", line 273, in setUp
    self.connection = Connection()
  File "/home/willkg/projects/mediagoblin/local/lib/python2.7/site-packages/pymongo-2.1.1-py2.7-linux-i686.egg/pymongo/connection.py", line 381, in __init__
    self.__find_node()
  File "/home/willkg/projects/mediagoblin/local/lib/python2.7/site-packages/pymongo-2.1.1-py2.7-linux-i686.egg/pymongo/connection.py", line 659, in __find_node
    raise AutoReconnect(', '.join(errors))
AutoReconnect: could not connect to localhost:27017: [Errno 111] Connection refused

======================================================================
ERROR: Make sure that running full migration suite from 3 only runs
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/lib/python2.7/dist-packages/nose/case.py", line 381, in setUp
    try_run(self.inst, ('setup', 'setUp'))
  File "/usr/lib/python2.7/dist-packages/nose/util.py", line 478, in try_run
    return func()
  File "/home/willkg/projects/mediagoblin/mediagoblin/tests/test_migrations.py", line 273, in setUp
    self.connection = Connection()
  File "/home/willkg/projects/mediagoblin/local/lib/python2.7/site-packages/pymongo-2.1.1-py2.7-linux-i686.egg/pymongo/connection.py", line 381, in __init__
    self.__find_node()
  File "/home/willkg/projects/mediagoblin/local/lib/python2.7/site-packages/pymongo-2.1.1-py2.7-linux-i686.egg/pymongo/connection.py", line 659, in __find_node
    raise AutoReconnect(', '.join(errors))
AutoReconnect: could not connect to localhost:27017: [Errno 111] Connection refused

----------------------------------------------------------------------
Ran 70 tests in 86.665s

FAILED (errors=7)

If you run ./bin/gmg wipealldata, but don't have mongodb installed or running, then it kicks up errors.

Given that we're done with mongodb, this should handle the cases when mongodb isn't installed or running.

130 (M=d2eab local) saturn ~/projects/mediagoblin> ./bin/gmg wipealldata
*** WARNING! ***

Running this will destroy your mediagoblin database,
remove all your media files in user_dev/, etc.

ALSO: This command is currently a hack and will only remove
  things properly on the default setup!  If you've customized
  your mediagoblin configs, it won't work (for now).
Are you **SURE** you want to destroy your environment?  (if so, type "yes")> yes
nixing data in mongodb....
Traceback (most recent call last):
  File "./bin/gmg", line 9, in <module>
    load_entry_point('mediagoblin==0.3.0.dev', 'console_scripts', 'gmg')()
  File "/home/willkg/projects/mediagoblin/mediagoblin/gmg_commands/__init__.py", line 100, in main_cli
    args.func(args)
  File "/home/willkg/projects/mediagoblin/mediagoblin/gmg_commands/wipealldata.py", line 50, in wipe
    conn = pymongo.Connection()
  File "/home/willkg/projects/mediagoblin/local/lib/python2.7/site-packages/pymongo-2.1.1-py2.7-linux-i686.egg/pymongo/connection.py", line 381, in __init__
    self.__find_node()
  File "/home/willkg/projects/mediagoblin/local/lib/python2.7/site-packages/pymongo-2.1.1-py2.7-linux-i686.egg/pymongo/connection.py", line 659, in __find_node
    raise AutoReconnect(', '.join(errors))
pymongo.errors.AutoReconnect: could not connect to localhost:27017: [Errno 111] Connection refused

Seems like this should be a blocker, too, since it's referred to in the Hacking HOWTO, but ... I'm going to just make it Critical.

I update my public instance few hours ago and I tried to upload a song

[2012-04-30 22:02:53,579: INFO/MainProcess] Got task from broker: mediagoblin.processing.task.ProcessMedia[9f16205c-ef52-4358-96ad-243057a87338]
[2012-04-30 22:02:53,606: DEBUG/MainProcess] Mediator: Running callback for task: mediagoblin.processing.task.ProcessMedia[9f16205c-ef52-4358-96ad-243057a87338]
[2012-04-30 22:02:53,607: DEBUG/MainProcess] TaskPool: Apply <function execute_and_trace at 0x2e415f0> (args:('mediagoblin.processing.task.ProcessMedia', u'9f16205c-ef52-4358-96ad-243057a87338', [u'62'], {}) kwargs:{'hostname': 'goblinartists.net', 'request': {'retries': 0, 'task': 'mediagoblin.processing.task.ProcessMedia', 'utc': False, 'loglevel': 10, 'delivery_info': {'routing_key': u'celery', 'exchange': u'celery'}, 'args': [u'62'], 'expires': None, 'is_eager': False, 'eta': None, 'hostname': 'goblinartists.net', 'kwargs': {}, 'logfile': 'celeryd.log', 'id': u'9f16205c-ef52-4358-96ad-243057a87338'}})
[2012-04-30 22:02:54,522: DEBUG/MainProcess] Task accepted: mediagoblin.processing.task.ProcessMedia[9f16205c-ef52-4358-96ad-243057a87338] pid:9410
[2012-04-30 22:02:57,176: DEBUG/PoolWorker-3] Processing <mediagoblin.db.sql.models.MediaEntry object at 0x2e44790>
[2012-04-30 22:03:04,645: INFO/PoolWorker-3] Initializing AudioTranscoder
[2012-04-30 22:03:04,912: INFO/PoolWorker-3] Transcoding /srv/http/goblinartists.net/mediagoblin/user_dev/media/queue/media_entries/9f16205c-ef52-4358-96ad-243057a87338/Daft_Punk_-_Voyager_Pista_10.ogg into /tmp/tmpeZZH8B
[2012-04-30 22:03:04,912: INFO/PoolWorker-3] Discovering /srv/http/goblinartists.net/mediagoblin/user_dev/media/queue/media_entries/9f16205c-ef52-4358-96ad-243057a87338/Daft_Punk_-_Voyager_Pista_10.ogg
[2012-04-30 22:03:09,300: ERROR/PoolWorker-3] Could not discover /srv/http/goblinartists.net/mediagoblin/user_dev/media/queue/media_entries/9f16205c-ef52-4358-96ad-243057a87338/Daft_Punk_-_Voyager_Pista_10.ogg
[2012-04-30 22:03:09,300: INFO/PoolWorker-3] Quitting MainLoop gracefully...
[2012-04-30 22:03:09,301: DEBUG/PoolWorker-3] Discovered: {'_timeoutid': 0, 'audiocaps': {}, 'audiodepth': 0, 'videowidth': 0, 'audiofloat': False, 'dbin': <__main__.GstDecodeBin object (decodebin1) at 0x2e37a00>, '_nomorepads': True, 'audiorate': 0, 'audiochannels': 0, 'audiowidth': 0, 'videoheight': 0, 'tags': {'album': u'Discovery', 'nominal-bitrate': 128000, 'encoder-version': 0, 'track-number': 10, 'title': u'Voyager', 'artist': u'Daft Punk', 'encoder': u'Xiph.Org libVorbis I 20101101 (Schaufenugget)', 'genre': u'Electronica & Dance', 'composer': u'Guy-Manuel de Homem-Christo/Thomas Bangalter', 'date': <GstDate: 1/1/2001>, 'album-artist': u'Daft Punk', 'bitrate': 128000, 'container-format': u'Ogg'}, 'bus': <gst.Bus object (bus4) at 0x2e480f0>, 'finished': True, 'typefind': <__main__.GstTypeFindElement object (typefind) at 0x2e480a0>, 'videorate': <gst.Fraction 0/1>, 'src': <__main__.GstFileSrc object (filesrc1) at 0x2e37fa0>, 'mimetype': 'application/ogg', 'audiolength': 0L, 'videolength': 0L, 'otherstreams': [], 'sinknumber': 1, '_max_interleave': 1.0, '_success': False, 'videocaps': {}, '_timeout': 3000, 'is_audio': True, 'is_video': False}
[2012-04-30 22:03:09,301: INFO/PoolWorker-3] Quitting MainLoop gracefully...
[2012-04-30 22:03:10,126: INFO/MainProcess] Task mediagoblin.processing.task.ProcessMedia[9f16205c-ef52-4358-96ad-243057a87338] succeeded in 15.6562681198s: None

this happens to mp3 songs too. for videos the error is different please watch ticket #444 for more information.