GNU MediaGoblin Wiki - User contributions [en]

Deployment

2020-05-11T03:52:38Z

Sturm: /* uwsgi with configs */

This page could use a lot of work. For now, a few smaller deployment tips!

See also: http://docs.mediagoblin.org/deploying.html (some of which may belong here)

= uwsgi =

Possibly a cleaner way to do nginx configuration than the official nginx + fastcgi suggestions!

http://nathanielca.se/fossrit/deploying-mediagoblin-1-fastcgi-vs-uwsgi.html

= uwsgi with configs =

Below there are 3 configs: for nginx, for uwsgi version 1.2.3-debian and for supervisord, used to run celery.

In future, when newer versions of uwsgi appear in debian, supervisor can be removed.

All instructions below are for Debian 7. They should also work with rpm-based systems, but with other paths.

<pre>apt-get install uwsgi uwsgi-plugin-python nginx-full supervisor;</pre>

/etc/nginx/sites-available/mediagoblin:
<pre>
server {
server_name <domain>;

access_log /var/log/nginx/mg.access.log;
error_log /var/log/nginx/mg.error.log error;

#include global/common.conf;

client_max_body_size 100m;
add_header X-Content-Type-Options nosniff;

root /path/to/mediagoblin//user_dev/;

location /mgoblin_static/ {
alias /path/to/mediagoblin/mediagoblin/static/;
}
location /mgoblin_media/ {
alias /path/to/mediagoblin/user_dev/media/public/;
}
location /theme_static/ {
}
location /plugin_static/ {
}
location / {
uwsgi_pass unix:///tmp/mg.uwsgi.sock;
uwsgi_param SCRIPT_NAME "";
include uwsgi_params;
}
}
</pre>

/etc/uwsgi/apps-available/mg.yaml:
<pre>
uwsgi:
uid: mediagoblin
gid: mediagoblin
socket: /tmp/mg.uwsgi.sock
chown-socket: www-data:www-data
plugins: python
home: /path/to/mediagoblin/
chdir: /path/to/mediagoblin/
ini-paste: /path/to/mediagoblin/paste_local.ini
</pre>

/etc/supervisor/conf.d/mediagoblin.conf:
<pre>
[program:celery]
command=/path/to/mediagoblin/bin/celery worker -l debug

; Set PYTHONPATH to the directory containing celeryconfig.py
environment=PYTHONPATH="/path/to/mediagoblin",MEDIAGOBLIN_CONFIG="/path/to/mediagoblin/mediagoblin.ini",CELERY_CONFIG_MODULE="mediagoblin.init.celery.from_celery"

directory=/path/to/mediagoblin/
user=mediagoblin
numprocs=1
; uncomment below to enable logs saving
;stdout_logfile=/some/logs/path/celeryd_stdout.log
;stderr_logfile=/some/logs/path/celeryd_stderr.log
autostart=true
autorestart=false
startsecs=10

; Need to wait for currently executing tasks to finish at shutdown.
; Increase this if you have very long running tasks.
stopwaitsecs = 600
</pre>

After setting all configs do:
<pre>
ln -s /etc/nginx/sites-available/mediagoblin /etc/nginx/sites-enabled/
ln -s /etc/uwsgi/apps-available/mg.yaml /etc/uwsgi/apps-enabled/
</pre>

And don't forget to restart all your daemons:
<pre>
service uwsgi restart;
service nginx restart;
service supervisor stop; sleep 1; service supervisor start # sleep 1 might be needed here because supervisor really stops not at once
</pre>

= FCGI script =

This works great with the apache FCGID config example in the next section :) in which case you should name it "mg.fcgi".

Before use, make sure you replace '/path/to/mediagoblin/bin/python' with a real path on your server, e.g. '/srv/www/myhomepage.com/mediagoblin/bin/python'. Also replace '/path/to/mediagoblin/paste.ini'.

If you encounter problems, try executing executing the script manually, e.g. <pre>./mg.fcgi</pre>

Script:

<pre>#!/path/to/mediagoblin/bin/python

# Written in 2011 by Christopher Allan Webber
#
# To the extent possible under law, the author(s) have dedicated all
# copyright and related and neighboring rights to this software to the
# public domain worldwide. This software is distributed without any
# warranty.
#
# You should have received a copy of the CC0 Public Domain Dedication along
# with this software. If not, see
# <http://creativecommons.org/publicdomain/zero/1.0/>.

from paste.deploy import loadapp
from flup.server.fcgi import WSGIServer

CONFIG_PATH = '/path/to/mediagoblin/paste.ini'

## Uncomment this to run celery in "always eager" mode... ie, you don't have
## to run a separate process, but submissions wait till processing finishes
# import os
# os.environ['CELERY_ALWAYS_EAGER'] = 'true'

def launch_fcgi():
ccengine_wsgi_app = loadapp('config:' + CONFIG_PATH)
WSGIServer(ccengine_wsgi_app).run()

if __name__ == '__main__':
launch_fcgi()</pre>

= Apache 2 Config With fcgid =

Note that the libapache2-mod-fcgi in Debian is in the main section. libapache2-mod-fcgid can be used, but requires a slightly different configuration. For yum-based distributions, you may need to install mod_fcgid.

<VirtualHost *:80>
Options +ExecCGI

# Accept up to 16MB requests
FcgidMaxRequestLen 16777216

ServerName mediagoblin.example.org

Alias /mgoblin_static/ /path/to/mediagoblin/mediagoblin/static/
Alias /mgoblin_media/ /path/to/mediagoblin/user_dev/media/public/

ScriptAlias / /path/to/mediagoblin/mg.fcgi/
</VirtualHost>

= Apache 2 Config With mod_wsgi =

Apache can manage the MediaGoblin application itself with mod_wsgi. It requires slightly more configuration on the Apache side, but cuts out the FastCGI middleware. See their [http://code.google.com/p/modwsgi/wiki/ConfigurationGuidelines configuration guidelines] for advanced configuration.

<VirtualHost *:80>
ServerName mediagoblin.example.org

Alias /mgoblin_static/ /path/to/mediagoblin/mediagoblin/static/
Alias /mgoblin_media/ /path/to/mediagoblin/user_dev/media/public/

WSGIScriptAlias / /path/to/mediagoblin/wsgi.py
# Set user and group to whatever user you used to install mediagoblin (if you used a system account,
# it may have the group 'nogroup' assigned, in that case you can remove the group parameter)
# Remember to change python-path too!
# Replace the python version in the 'python-path' below with the correct one (eg 2.x -> 2.7)
WSGIPassAuthorization On
WSGIDaemonProcess gmg user=mediagoblin group=mediagoblin processes=2 threads=10 \
umask=0007 inactivity-timeout=900 maximum-requests=1000 \
python-path=/path/to/mediagoblin/:/path/to/mediagoblin/lib/python-2.x/site-packages/
WSGIProcessGroup gmg
WSGIApplicationGroup %{GLOBAL}

<Directory "/path/to/mediagoblin/mediagoblin/static/">
Order allow,deny
Allow from all
</Directory>
<Directory "/path/to/mediagoblin/user_dev/media/public">
Order allow,deny
Allow from all
</Directory>
</VirtualHost>

You'll also need to copy this into /path/to/mediagoblin/wsgi.py:

#!/path/to/mediagoblin/bin/python

# Written in 2011 by Christopher Allan Webber
#
# To the extent possible under law, the author(s) have dedicated all
# copyright and related and neighboring rights to this software to the
# public domain worldwide. This software is distributed without any
# warranty.
#
# You should have received a copy of the CC0 Public Domain Dedication along
# with this software. If not, see
# <http://creativecommons.org/publicdomain/zero/1.0/>.

import site
# Replace the python version with the correct one in the line below (eg 2.x -> 2.7)
site.addsitedir('/path/to/mediagoblin/lib/python-2.x/site-packages')

from paste.deploy import loadapp

CONFIG_PATH = '/path/to/mediagoblin/paste.ini'

## Uncomment this to run celery in "always eager" mode... ie, you don't have
## to run a separate process, but submissions wait till processing finishes
#import os
#os.environ['CELERY_ALWAYS_EAGER'] = 'true'

application = loadapp('config:' + CONFIG_PATH)

If you're getting strange errors when trying to upload something, your WSGI setup is probably not starting Celery. You should start it yourself, perhaps with your preferred init system or service supervisor.

= Apache Config Example =
This configuration example uses mod_fastcgi.

To install and enable mod_fastcgi on a Debian/Ubuntu based system:
<pre># apt-get install libapache2-mod-suexec libapache2-mod-fastcgi
# a2enmod suexec
# a2enmod fastcgi</pre>

Sample configuration:
<pre>
<VirtualHost *:80>
ServerName mediagoblin.yourdomain.tld
ServerAdmin webmaster@yourdoimain.tld
DocumentRoot /var/www/
# Custom log files
CustomLog /var/log/apache2/mediagobling_access.log combined
ErrorLog /var/log/apache2/mediagoblin_error.log

# Serve static and media files via alias
Alias /mgoblin_static/ /path/to/mediagoblin/mediagoblin/static/
Alias /mgoblin_media/ /path/to/mediagoblin/user_dev/media/public/

# Rewrite all URLs to fcgi, except for static and media urls
RewriteEngine On
RewriteRule ^(mgoblin_static|mgoblin_media)($|/) - [L]
RewriteCond %{REQUEST_FILENAME} !-f
RewriteRule ^/(.*)$ /mg.fcgi/$1 [QSA,L]

# Allow access to static and media directories
<Directory /path/to/mediagoblin/mediagoblin/static>
Order allow,deny
Allow from all
</Directory>
<Directory /path/to/mediagoblin/mediagoblin/user_dev/media/public>
Order allow,deny
Allow from all
</Directory>

# Connect to fcgi server
FastCGIExternalServer /var/www/mg.fcgi -host 127.0.0.1:26543
</VirtualHost>
</pre>
Then, you need to make sure mediagoblin is running in fcgi mode:
<pre>cd /path/to/mediagoblin
./lazyserver.sh --server-name=fcgi fcgi_host=127.0.0.1 fcgi_port=26543</pre>

Note: there may be several ways to improve this configuration

If it is too slow and you use the deflate module, you could try to use the following option : SetOutputFilter INFLATE

= Lighttpd =

This configuration example uses mod_fastcgi.
Make a symbolic link from <pre>/etc/lighttpd/conf-available/10-fastcgi.conf</pre> to <pre>/etc/lighttpd/conf-enabled/10-fastcgi.conf</pre>

<pre>
ln -s /etc/lighttpd/conf-available/10-fastcgi.conf /etc/lighttpd/conf-enabled/10-fastcgi.conf
</pre>

then edit your /etc/lighttpd/conf-enabled/10-fastcgi.conf file modifying it as below to serve mediagoblin on the /tube/ path of your webserver.

<pre>
## FastCGI programs have the same functionality as CGI programs,
## but are considerably faster through lower interpreter startup
## time and socketed communication
##
## Documentation: /usr/share/doc/lighttpd-doc/fastcgi.txt.gz
## http://www.lighttpd.net/documentation/fastcgi.html

server.modules += ( "mod_fastcgi" )

## Start an FastCGI server for mediagoblin (lazyserver.sh or other deployments scripts should be up and running)
fastcgi.server = (
# url at which the app should be accessible on the server
"/tube" =>
# mnemonical name of the backend
( "mg-local" => (
"host" => "127.0.0.1",
"port" => 6543,
"docroot" => "/path/to/mediagoblin-git-folder/mediagoblin",
"check-local" => "disable"
)
)

)
</pre>

Then open your /etc/lighttpd/lighttpd.conf and add the configuration to serve directly the static/public folders

<pre>
alias.url += (
"/mgoblin_static/" => "/path/to/mediagoblin-git-folder/mediagoblin/static/",
"/mgoblin_media/" => "/path/to/mediagoblin-git-folder/user_dev/media/public/",
"/theme_static/" => "/path/to/mediagoblin-git-folder/user_dev/theme_static/",
"/plugin_static/" => "/path/to/mediagoblin-git-folder/user_dev/plugin_static/"
)

</pre>

Done!

= OpenShift =

Thers's a blogpost saying how to [http://www.sud0.com/gnu-media-goblin-on-openshift.html install mediagoblin on openshift].

= Juju =

There is a juju [https://juju.ubuntu.com/Charms charm] available for deploying mediagoblin into EC2 or on your local box. [https://juju.ubuntu.com/ juju] is available in Ubuntu 11.10 and later, though it is recommended that you pull it from [https://launchpad.net/~juju/+archive/pkgs the juju PPA], which includes backported packages going back to Ubuntu 11.10. To use the juju charm, install juju and configure either the [https://juju.ubuntu.com/docs/provider-configuration-local.html local provider] or one of the cloud API providers, currently the [https://juju.ubuntu.com/docs/provider-configuration-ec2.html EC2 provider] is the best supported and works not only with Amazon Web Services but also OpenStack clouds. There is also a newer native OpenStack API provider which is known to support HP Cloud.
<pre>
# if you have not bootstrapped
juju bootstrap
mkdir ~/charms
bzr init-repo ~/charms/precise
bzr branch lp:~clint-fewbar/charms/precise/mediagoblin/trunk ~/charms/precise/mediagoblin
juju deploy --repository ~/charms local:mediagoblin
juju expose mediagoblin
</pre>

Currently the charm is volatile, deploying from trunk, and deploys a single-server version of MediaGoblin only. It will eventually relate to the existing juju charms for other supported data stores to allow one to scale out their MediaGoblin instance.

= Init scripts =

== Debian init scripts ==

Joar has some scripts for running celery and mediagoblin separately that are designed for Debian.

https://github.com/joar/mediagoblin-init-scripts

== Arch Linux init scripts ==

[http://whird.jpope.org/2012/04/14/mediagoblin-archlinux-rcd-scripts Jeremy Pope has written a nice blogpost] on how to add init scripts to deploy MediaGoblin with both the python paste http server and the celery deployments separated.

If you want a simpler setup and don't want to deploy celery separately, consider either turning CELERY_ALWAYS_EAGER to true in the paste init script described above, or check out [http://chimo.chromic.org/2012/03/01/mediagoblin-init-script-on-archlinux/ Chimo's guide].

== Generic, simple init script ==

This is a super stupidly simple init script that was used for mediagoblin.com... note that this has Celery running in always eager mode.

You will need to adjust the paths appropriately. This could probably be better written!

#! /bin/sh

## Stupidly simple mediagoblin init script.
#
# Written in 2012 by Christopher Allan Webber
#
# To the extent possible under law, the author(s) have dedicated all
# copyright and related and neighboring rights to this software to the
# public domain worldwide. This software is distributed without any
# warranty.
#
# You should have received a copy of the CC0 Public Domain Dedication along
# with this software. If not, see
# <http://creativecommons.org/publicdomain/zero/1.0/>.

PASTER=/srv/mediagoblin.com/bin/paster
PASTE_CONFIG=/srv/mediagoblin.com/paste.ini
OPTIONS="--pid-file=/tmp/mediagoblin.pid \
--log-file=/srv/mediagoblin.com/paster.log \
--server-name=fcgi fcgi_host=127.0.0.1 fcgi_port=26543"

CELERY_ALWAYS_EAGER=true su -pc "$PASTER serve $PASTE_CONFIG $1 $OPTIONS" webadmin

= Running on Dreamhost.com =

===Set up your python virtualenv===

dreamhost.com servers come with python 2.4 and 2.5 installed which is too old for mediagoblin. This means you need to compile and install a newer python (don't worry this is really not difficult on dreamhost servers). In order to be able to install python packages for a local user without touching system files, we need to setup a python ''virtualenv''. Fortunately, this is not too tricky either. If your server has python 2.6 or 2.7 installed already, you can skip the [[#Install a local python|python installation stuff]] and you'll only need to [[#Setup virtualenv to install local python packages|install virtualenv]].

====Install a local python====
# Download the latest python: http://python.org/ftp/python/XXX/Python-XXX.tar.bz2
# Unpack with <pre>tar xvjf Python-XXX.tar.bz2</pre>
# ''cd'' into the directory and compile and install python locally:
<blockquote><pre>./configure --prefix=$HOME/local
make
make install</pre></blockquote>
:This will install python (I used 2.7.3) into /home/<USERNAME>/local/bin/python. You might get warnings about some modules not being able to compile. :It was tcl/tk and bzip2 mainly, but things still worked out overall.
:
:You should now be able to invoke <tt>~/local/bin/python</tt> and fall into a shell of your new python (exit with ctrl-d). Congrats, you have now a new python 2.7 that you can use. However, you will need to be able to install additional packages as a user and this is what virtualenv allows.

====Setup virtualenv to install local python packages====
# Download the latest virtualenv: http://pypi.python.org/packages/source/v/virtualenv/XXX
# Install the virtualenv: <blockquote><pre>~/local/bin/python ~/virtualenv-1.8/virtualenv.py $HOME/local/virtenv</pre></blockquote>
:: You will now have: ~/local/virtenv/bin/python
# In ~/.bash_profile add: <blockquote><pre>PATH=~/local/virtenv/bin:~/local/bin:${PATH}</pre></blockquote>
:: so that your local python will be preferred.
:: Log out, log in again and test python" to see which version will be invoked. It should be the new python. Check "which easy_install" to see if the one in local/virtenv would be executed.
::
:: You have now 1) a local ''python'' installation that you can use, and 2) ''easy_install'' will also work with your local user installation. From now on you can e.g. locally install the nose testing framework (''easy_install nose'') and use it (''python -c "import nose"'').

===Install mediagoblin as a site package===

# Check out mediagoblin from git to e.g. ~/mediagoblin
# Install MediaGoblin and all dependencies for MediaGoblin with easy_install.
:* In the mediagoblin directory issue:
:<blockquote><pre>python setup.py</pre></blockquote>
:* You will also need to: easy_install lxml
:* Python-image was trickier to install: <pre>easy_install --find-links http://www.pythonware.com/products/pil/ Imaging</pre>
::Test by leaving the mediagoblin directory and see if you can import it: <pre>python -c "import mediagoblin"</pre> looking for error messages.

===Set up an WSGI environment on Dreamhost===

# Enable the mod_passenger setting for ruby/python in the domains web panel
# ''cd'' into the domain directory (e.g. ~/media.sspaeth.de for me)
# Copy mediagoblin.ini and paste.ini from the ~/mediagoblin directory here
# Create passenger_wsgi.py in your domain directory (e.g. ~/media.sspaeth.de for me):
<blockquote><pre>import sys, os
INTERP = "/home/<username>/local/virtenv/bin/python"
#INTERP is present twice so that the new python interpreter knows the actual executable path
if sys.executable != INTERP: os.execl(INTERP, INTERP, *sys.argv)

from paste.deploy import loadapp
application = loadapp('config:/home/mediagoblin/media.sspaeth.de/paste.ini')

#If in case of errors, all you get are mysterious error 500, you can set debug=true in paste.ini to see stack traces
# Otherwise, add this:
#from paste.exceptions.errormiddleware import ErrorMiddleware
#application = ErrorMiddleware(application, debug=True)</pre></blockquote>
# Set up the database by issueing: <pre>gmg dbupdate</pre>
# (optional but recommended) Serve the static files directly from the webserver.
:In paste.ini in this section: [composite:routing] comment out the static files:
#/mgoblin_static/ = mediagoblin_static
#/theme_static/ = theme_static
:and symlink the mediagobin/mediagoblin/static directoy to public/mgoblin_static
: and mediagoblin/mediagoblin/themes to public/theme_static
:
:so it is displayed directly. This step might be different depending on your web server configuration. There is no reason that static
:files need to go through all the python indirection when they can be served directly by nginx/apache/...
:
:In case you want to delete your git checkout after the installation (you don't need it, since you installed the mediagoblin package to ~/local/virtenv/lib/python2.7/mediagoblin... you should do the symlinking from there.
===Open Issues===
Please fill in the blanks if you find them out:
* How to enable logging to a file or standard html logs? Console output just disappears.
* How to set up things not using sqlite. What's wrong with mySQL?

===Troubleshooting===
* First of all: invoke <pre>python passenger_wsgi.py</pre> directly from the shell. This will tell you if there are import errors etc. If this command exits without any output on the console, you have already achieved a lot.
* In ''paste.ini'' set debug=true. This will show you python backtraces directly in the web page
* You will need to configure an smtp user/passwd/server in mediagoblin.ini, so you actually get the account creation token mailed out. Hint, the relevant settings are:
<blockquote><pre>email_debug_mode = false
email_sender_address = postmaster@sspaeth.de
email_smtp_host = SMTP.DOMAIN.TLD
email_smtp_user = USERNAME
email_smtp_pass = WEIRDPASSWORD</pre></blockquote>
* In case you can upload media, but it does not appear. You don't have the celery server running. Add <pre>CELERY_ALWAYS_EAGER = true</pre> to the ''[celery]'' section in mediagoblin.ini

=Miscellaneous Hacks=
==Force translation==
There might some conditions under which you would prefer that MediaGoblin always return the same translation. If you are deploying with nginx and fastcgi, you can force MediaGoblin to return a specific translation regardless of browser preferences by passing a specific HTTP_ACCEPT_LANGUAGE fastcgi parameter in your location block. Example last line in location block:
<nowiki>
fastcgi_param HTTP_ACCEPT_LANGUAGE es; #force spanish translation
</nowiki>

==Create an admin user==

To create an admin user, first create the user you need either via the website or the command
<pre>
./bin/gmg adduser
</pre>

Then to turn it into an admin account use

<pre>
./bin/gmg makeadmin your_username
</pre>

Virtual Machine Hosting

2020-05-11T03:52:13Z

Sturm: /* Install MediaGoblin Prerequisites */

{{Needswork}}

= Motivation =

If you want to give MediaGoblin a try, but would prefer to run it on someone else's machine for a while, then you may be interested in spinning up an [http://aws.amazon.com/ec2/ EC2] instance from an [http://aws.amazon.com/amis AMI] pre-loaded with MediaGoblin. The following [http://aws.amazon.com/articles/0155828273219400 recipe] should make a public MediaGoblin AMI. Make your own or skip ahead Martha Stewart style to [https://console.aws.amazon.com/ec2/home?region=us-east-1#launchAmi=ami-3bf33252 ami-3bf33252]

== Get your favorite distribution to fit in less than 10 Gb volume size ==

Ubuntu makes this easy. Start with an official EC2 Ubuntu instance in us-east: [https://console.aws.amazon.com/ec2/home?region=us-east-1#launchAmi=ami-61be7908 ami-61be7908]. Other [http://ubuntutym2.u-toyama.ac.jp/uec-images/lucid/20110719/ official Ubuntu AMIs] are also available

Login to this fresh instance using [http://aws.amazon.com/archives/Amazon-EC2/5673744618146887 EC2 tools]
<pre>me@myhomemachine:~$ ssh -i $(KEY_PATH) ubuntu@ec2-##-##-##-##.compute-1.amazonaws.com</pre>

Once logged in, update the links to package updating materials
<pre>sudo apt-get update</pre>

Then run the package manager to download and install the latest patches
<pre>sudo apt-get -u upgrade</pre>

Reboot from the EC2 instance manager. Then log in and install any remaining upgrades
<pre>sudo apt-get update
sudo apt-get -u upgrade</pre>

== Limit remote access to improve security ==

Disable password-based login by editing /etc/ssh/sshd_config to explicitly disallow it.
<pre>+# Disable password-based login
+PasswordAuthentication no</pre>

Also remove this moot parameter
<pre>-# To enable empty passwords, change to yes (NOT RECOMMENDED)
-PermitEmptyPasswords no</pre>

Reboot the ssh server
<pre>sudo restart ssh</pre>

Disable root login, and specify login by ubuntu only by editing /etc/ssh/sshd_config
<pre>-PermitRootLogin yes
+PermitRootLogin no
+AllowUsers ubuntu</pre>

Reboot the ssh server
<pre>sudo restart ssh</pre>

== Install MediaGoblin Prerequisites ==

Setup directory for mediagoblin source code
<pre>mkdir src
cd src</pre>

The following matches the [[HackingHowto]] except for how mongodb is installed. MongoDB is only at version 1.2.2 in Lucid 10.04, which the original AMI is based on, but MediaGoblin requires v1.3+
<pre>sudo apt-get install git-core python python-dev python-lxml</pre>

[http://www.mongodb.org/display/DOCS/Ubuntu+and+Debian+packages Get the latest mongodb]

First get the gpg key for the 10gen repository
<pre>sudo apt-key adv --keyserver keyserver.ubuntu.com --recv 7F0CEB10</pre>

Add the 10gen repository to the list of apt sources by editing /etc/apt/sources.list
<pre>+deb http://downloads-distro.mongodb.org/repo/ubuntu-upstart dist 10gen</pre>

Install mongodb
<pre>sudo apt-get update
sudo apt-get install mongodb-10gen</pre>

Fetch the mediagoblin code from the git repository, buildout, and test
<pre>git clone git://gitorious.org/mediagoblin/mediagoblin.git
cd mediagoblin
python bootstrap.py && ./bin/buildout
./runtests.sh
###Ran 45 tests in 12.160s ... OK!</pre>

Install sendmail
<pre>sudo apt-get install sendmail</pre>

[[Configure MediaGoblin]]
<pre>cp paste.ini paste_local.ini
cp mediagoblin.example.ini mediagoblin.ini</pre>

Edit paste_local.ini to allow remote connections
<pre>-host = 127.0.0.1
+host = 0.0.0.0</pre>

== Prepare instance for bundling into a public AMI ==

The instance you've built so far is currently configured to accept your private key as a login. Lock yourself out now...or don't, and see if anyone notices. It's your call.

Find and remove your public key
<pre>sudo find / -name "authorized_keys" -print -exec rm {} \;</pre>

Verify you can not log in to the instance anymore
<pre>me@myhomemachine:~$ ssh -i $(KEY_PATH) ubuntu@ec2-##-##-##-##.compute-1.amazonaws.com
##Permission denied (publickey).</pre>

Take a snapshot, convert the snapshot to an AMI, then set the AMI permissions to public.

Configure MediaGoblin

2020-05-11T03:51:08Z

Sturm:

= The config files =

So basically there are two config files (and one meta-config file).

* '''mediagoblin.ini:''' Use this to configure MediaGoblin, the application. Want to use a different storage system? Configure it here!
* '''paste.ini:''' This just actually configures the web server that launches the MediaGoblin application, and some other things (like actually sets up the applications that serve your static files).

And then there's the meta-config file:
* '''mediagoblin/config_spec.ini:''' This sets the defaults for config file options and the type conversion for things in mediagoblin.ini. Developers who add new config options should probably register them and their types here (and set some good defaults, if applicable).

= Changing config files =

So you want to turn on (or off) all the bells and whistles, set up mediagoblin to use a storage system running out of a distributed cluster of Commodore 64s, change your email server configuration, etc. Where do you set all this stuff up?

You should do the following:
<pre>
# copy the config files
$ cp paste.ini paste_local.ini
$ cp mediagoblin.example.ini mediagoblin.ini

lazyserver.sh defaults to using paste_local.ini if it is present; you can also specify a config file like this:

<pre>
./lazyserver.sh -c paste_local.ini
</pre>

Also, all the ./bin/gmg commands have arguments to allow you to pass in the config file. For example:

<pre>
./bin/gmg shell -cf mediagoblin.ini
</pre>

(It's important to note that the ./bin/gmg commands don't care about the paster file, they just care about the mediagoblin config file.)

BTW, all these ./bin/gmg subcommands have help. You can check them like:

<pre>
./bin/gmg shell --help
</pre>

for more info.

= Setting up Cloud Files public storage =

In mediagoblin.ini, add this to the file and edit it to fit your needs.

<pre>
[storage:publicstore]
storage_class = mediagoblin.storage.cloudfiles:CloudFilesStorage
cloudfiles_user = user
cloudfiles_api_key = 1a2b3c4d5e6f7g8h9i
cloudfiles_container = mediagoblin

# Uncomment this and fill it in to set the API endpoint to anything other
# than Rackspace Cloud Files US
# cloudfiles_host = https://example.org/v1.0

# Only applicable if you run MediaGoblin on a Rackspace Cloud Server
# it routes traffic through the internal Rackspace network, this
# means that the bandwith is free.
cloudfiles_use_servicenet = false
</pre>

To make these settings work with OpenStack Object Storage (Swift) you will need to set the API endpoint (<code>cloudfiles_host</code>) to avoid it defaulting to Rackspace Cloud Files US.

*NOTE: cloudfiles_host does not appear to be honored by the cloudfiles plugin of MediaGoblin 0.9.0. It also specifically depends on the Rackspace CDN or at least the CDN endpoint headers returned by Swift. If you wish to use your own Swift cluster and serve the files out of Swift directly, or configure your own CDN endpoint, you'll need to modify this plugin or create a new/derived storage plugin.

= Attachments =

Attachment are arbitrary files that are associated to a media entry.

For example, it could be the GIMP .xcf file for an image, the .blend of a Blender render.

== Hazards ==

Attachments are not filtered or scanned and therefore present a security risk. They can be used to perform XSS attacks or to upload malicious content. Make sure your environment is safe before enabling it.

== Allow attachments ==

To allow attachments, add

allow_attachments = true

to your mediagoblin.ini

= Disable transcoding =

Transcoding means that your video is resized or converted to another format, which usually takes a lot of time and CPU power.

Currently transcoding is disabled for a video only if its mime-type, container, video and audio formats are all explicitly excluded at once in the configuration.

Add this section to your <code>mediagoblin.ini</code> video plugin config to disable transcoding of WebM and Ogg/Theora videos:

<pre>
[plugins]
[[mediagoblin.media_types.video]]
[[[skip_transcode]]]
mime_types = video/webm, video/ogg, application/ogg, application/x-annodex
container_formats = Matroska, Ogg
video_codecs = VP8 video, Theora
audio_codecs = Vorbis,
dimensions_match = false
</pre>

Or to support most of the major formats supported by browsers:
<pre>
[[[skip_transcode]]]
mime_types = video/webm, video/ogg, video/mp4, audio/ogg, application/ogg, application/x-annodex
container_formats = Matroska, Ogg, ISO MP4/M4A
video_codecs = VP8 video, VP9 video, Theora, H.264, H.264 / AVC, MPEG-4 video
audio_codecs = Vorbis, MPEG-4 AAC audio
dimensions_match = false
</pre>

Configure MediaGoblin

2020-05-11T03:50:32Z

Sturm: /* Changing config files */

= The config files =

So basically there are two config files (and one meta-config file).

* '''mediagoblin.ini:''' Use this to configure MediaGoblin, the application. Want to use a different storage system? Configure it here!
* '''paste.ini:''' This just actually configures the web server that launches the MediaGoblin application, and some other things (like actually sets up the applications that serve your static files).

And then there's the meta-config file:
* '''mediagoblin/config_spec.ini:''' This sets the defaults for config file options and the type conversion for things in mediagoblin.ini. Developers who add new config options should probably register them and their types here (and set some good defaults, if applicable).

= Changing config files =

So you want to turn on (or off) all the bells and whistles, set up mediagoblin to use a storage system running out of a distributed cluster of Commodore 64s, change your email server configuration, etc. Where do you set all this stuff up?

You should do the following:
<pre>
# copy the config files
$ cp paste.ini paste_local.ini
$ cp mediagoblin.example.ini mediagoblin.ini

lazyserver.sh defaults to using paste_local.ini if it is present; you can also specify a config file like this:

<pre>
./lazyserver.sh -c paste_local.ini
</pre>

Also, all the ./bin/gmg commands have arguments to allow you to pass in the config file. For example:

<pre>
./bin/gmg shell -cf mediagoblin.ini
</pre>

(It's important to note that the ./bin/gmg commands don't care about the paster file, they just care about the mediagoblin config file.)

BTW, all these ./bin/gmg subcommands have help. You can check them like:

<pre>
./bin/gmg shell --help
</pre>

for more info.

= Setting up Cloud Files public storage =

In mediagoblin.ini (or mediagoblin_local.ini), add this to the file and edit it to fit your needs.

<pre>
[storage:publicstore]
storage_class = mediagoblin.storage.cloudfiles:CloudFilesStorage
cloudfiles_user = user
cloudfiles_api_key = 1a2b3c4d5e6f7g8h9i
cloudfiles_container = mediagoblin

# Uncomment this and fill it in to set the API endpoint to anything other
# than Rackspace Cloud Files US
# cloudfiles_host = https://example.org/v1.0

# Only applicable if you run MediaGoblin on a Rackspace Cloud Server
# it routes traffic through the internal Rackspace network, this
# means that the bandwith is free.
cloudfiles_use_servicenet = false
</pre>

To make these settings work with OpenStack Object Storage (Swift) you will need to set the API endpoint (<code>cloudfiles_host</code>) to avoid it defaulting to Rackspace Cloud Files US.

*NOTE: cloudfiles_host does not appear to be honored by the cloudfiles plugin of MediaGoblin 0.9.0. It also specifically depends on the Rackspace CDN or at least the CDN endpoint headers returned by Swift. If you wish to use your own Swift cluster and serve the files out of Swift directly, or configure your own CDN endpoint, you'll need to modify this plugin or create a new/derived storage plugin.

= Attachments =

Attachment are arbitrary files that are associated to a media entry.

For example, it could be the GIMP .xcf file for an image, the .blend of a Blender render.

== Hazards ==

Attachments are not filtered or scanned and therefore present a security risk. They can be used to perform XSS attacks or to upload malicious content. Make sure your environment is safe before enabling it.

== Allow attachments ==

To allow attachments, add

allow_attachments = true

to your mediagoblin.ini (or mediagoblin_local.ini)

= Disable transcoding =

Transcoding means that your video is resized or converted to another format, which usually takes a lot of time and CPU power.

Currently transcoding is disabled for a video only if its mime-type, container, video and audio formats are all explicitly excluded at once in the configuration.

Add this section to your <code>mediagoblin_local.ini</code> video plugin config to disable transcoding of WebM and Ogg/Theora videos:

<pre>
[plugins]
[[mediagoblin.media_types.video]]
[[[skip_transcode]]]
mime_types = video/webm, video/ogg, application/ogg, application/x-annodex
container_formats = Matroska, Ogg
video_codecs = VP8 video, Theora
audio_codecs = Vorbis,
dimensions_match = false
</pre>

Or to support most of the major formats supported by browsers:
<pre>
[[[skip_transcode]]]
mime_types = video/webm, video/ogg, video/mp4, audio/ogg, application/ogg, application/x-annodex
container_formats = Matroska, Ogg, ISO MP4/M4A
video_codecs = VP8 video, VP9 video, Theora, H.264, H.264 / AVC, MPEG-4 video
audio_codecs = Vorbis, MPEG-4 AAC audio
dimensions_match = false
</pre>

MediaTypeRefactor/DesignDoc

2020-05-11T03:48:39Z

Sturm: /* Installation */

= Media Types Design =

This document is based on requirements/wishes listed in http://wiki.mediagoblin.org/MediaTypeRefactor

*Note*: * Attachments have deliberately been excluded from this document to reduce complexity

= Publishing clients =

These are described optimal behaviours of different types of publishing clients.

== CLI ==

=== Single-file ===

{{{
gmg submit FILE
}}}

=== *n*-file ===

{{{
gmg submit FILE_1 FILE_2 [...] FILE_N
}}}

=== *n*-file with media metadata ===

GStreamer `gst-launch` inspired exclamation-mark-separated "elements" of media entries:

{{{
gmg submit FILE_1 title=TITLE_1 description=DESCRIPTION_1 ! \
FILE_2 title=TITLE_2 ! \
FILE_3 title=TITLE_3 tags=TAGS_3[...]
}}}

== WWW ==

=== *n*-file ===

*Note*: Requires browser [http://www.whatwg.org/specs/web-apps/current-work/multipage/dnd.html#dnd drag and drop] support.

{{{
,-----------------------------------------------.
| S U B M I T F I L E S |
| |
| Drag media from your desktop |
| and drop it here |
| |
`-----------------------------------------------Â´
}}}

*Note*: * What if there's folders in there?
* What about publishing-metadata?

=== Single-file ===

Could be used as fallback for browsers not supporting [http://www.whatwg.org/specs/web-apps/current-work/multipage/dnd.html#dnd drag and drop].

{{{
,-----------------------------------------------.
| S U B M I T F I L E |
| |
| Source file: [ /home/joar/Pictures... Browse] |
| |
| [Submit] |
`-----------------------------------------------Â´
}}}

== API ==

TBD

= Media types =

== Installation ==

{{{
pip install mediagoblin-video
echo "[[mediagoblin.media_types.video]]" >> mediagoblin.ini
gmg dbupdate
}}}

*Note*: * We could build a wrapper around pip that performs the installation steps automatically.
* What about dependencies such as GStreamer and related packages? We could include that in our wrapper, but it'd have to take into account all the different distributions' package managers out there.

== Negotiation ==

Media type negotiation is done per-file by iterating through a registry of enabled media type plugins. Several negotiation mechanisms may exists, such as a cheap file-extension based one and a more expensive file content sniffing negotiation step.

== Output files ==

Some media types such as ASCII art and images might have a very simple data structure:

{{{
This illustrates the output of the ``mediagoblin.media_types.image`` media
type:

ORIGINAL IMAGE -> THUMBNAIL JPEG
MEDIUM SIZED JPEG
}}}

Media types such as `video` and `3D object` might have more complex output files:

{{{
ORIGINAL VIDEO -> THUMBNAIL JPEG
640px-wide WEBM # Displayed on media page
720p WEBM # Displayed in full-screen player
1080p WEBM # Displayed in full-screen player
640px-wide H.264 # Alternate container/stream formats
720p H.264
1080p H.264
}}}

we should therefore allow a lot of flexibility for the files

= Media processing =

Processing takes the original file and creates files of lesser size/quality that The pipeline is as follows:

# The application receives a bytestream, optional byte stream metadata (i.e. filename) and publishing-metadata. The bytestream and bytestream metadata is sourced from the *original file*.
* Possibly we could have "adapters" of some sort that provides this data consistently across publishing clients.
*Note*: Some users have expressed a wish for mediagoblin to simply read a folder with files and create a "web album" from them.

* The media type negotiation mechanism decides one or more suitable media type plugins to handle the conversion of the *original file*, pushes task data to the task broker and creates a *MediaEntry* in the database and populates it with at least the media type.
* The task handler now checks the task broker for a new task when received the task handler looks up the processing method for the selected media type and runs it.
* The media processor converts the *original file* into smaller, displayable media. These media files are then placed in the *public storage*.

*Note*: * Are there cases where we should accept more than one input file?

User privileges

2020-05-11T03:48:14Z

Sturm: /* To change the default set of privileges */

Since 0.6.0, there's a user privileges/permissions system. You can make the user "USERNAME" an admin by doing
<pre>
./bin/gmg makeadmin USERNAME
</pre>

An admin gets access to an Admin Panel, and when looking at other user pages, is able to revoke/give privileges. Default ones are:
<pre>
active Yes
admin No
commenter Yes
moderator No
reporter Yes
uploader Yes
</pre>

==To change the default set of privileges==
This is currently possible by checking out a branch that tilly-q is working on.
<pre>
git remote add tilly-q git://gitorious.org/mediagoblin/npigeons-mediagoblin.git
git fetch --all
git cherry-pick 0a5981fd5416c60858c3e460f943692d1c62629d
</pre>
Then set something like <pre>user_privilege_scheme= "reporter,commenter"</pre> in your mediagoblin.ini

PluginsTips

2020-05-11T03:48:00Z

Sturm: /* Quickstart */

==Quickstart==
In the [https://gitorious.org/mediagoblin mediagoblin repository], there's a sample plugin under mediagoblin/plugins/sampleplugin that you can use to get started with plugin creation. The simplest way to get up and running is to
# Follow [[HackingHowto#How_to_set_up_and_maintain_an_environment_for_hacking_with_virtualenv]] to set up a local virtualenv mediagoblin instance
#* run it with ./lazyserver.sh so you get debug output (if you run celeryd separately, you won't see logging.info from stuff run in celery tasks)
# <tt>cp -r mediagoblin/plugins/sampleplugin mediagoblin/plugins/myplugin</tt> (where "myplugin" is your plugin name)
# edit <tt>mediagoblin.ini</tt> and add <nowiki>[[mediagoblin.plugins.myplugin]]</nowiki> under the <nowiki>[plugins]</nowiki> section to enable your plugin

Now you can look at e.g. other core or non-core plugins for inspiration. See [[Available Plugins]] for non-core plugins.

The way you change things in plugins is by use of '''hooks'''. At certain points in the mediagoblin code, a function will say "run all hooks with name XYZ", and if you've defined a hook with such a name in a plugin you've enabled, it'll get run there. The [http://mediagoblin.readthedocs.org/en/latest/pluginwriter/api.html documentation on Plugin API] is your friend for defining hooks. The sample plugin shows a use of the 'setup' hook.

Note: templates are hooked with a call to pluginapi.register_template_hooks, instead of adding to the hooks variable.

==Making an installable plugin==
If you followed the steps above, you can use your plugin by copying it into the plugins folder; however, to get a plugin that is easily installable by users (e.g. with <tt>pip install myplugin</tt>), it should have a certain folder layout.

A good example is the [https://github.com/commonsmachinery/mg-rdfa/ RDFa plugin]. This uses a setup.py file to install the files under the mediagoblin_rdfa folder into the lib/ folder of your mediagoblin installation. If you've checked out both mediagoblin and mg-rdfa in the same folder, e.g. ~/src/, you can do <pre>cd ~/src/mg-rdfa/
../mediagoblin/bin/python setup.py build
../mediagoblin/bin/python setup.py install</pre> to install it to your mediagoblin instance.

The file layout of the repo is:
<pre>
setup.py
MANIFEST.in
README.md
mediagoblin_rdfa/
__init.py__
templates/
mediagoblin/
plugins/
rdfa/
metadata.html
</pre>

The setup.py file defines an option include_package_data=True, which makes it read the file MANIFEST.in; MANIFEST.in contains rules for which files to include when installing. In this case, rule <tt>recursive-include mediagoblin_rdfa *.html</tt> makes it include the HTML template file (and any other you put under mediagoblin_rdfa), retaining the folder layout.

==Referencing the mediagoblin test set in a plugin==

The tests in mediagoblin define a nice "test_app" and functions for logging in and posting and so on. You can use this in your installable plugin.

From your plugin (assuming a layout like mg-rdfa described above), doing

cp -r ../mediagoblin/mediagoblin/tests .

lets you run

../mediagoblin/bin/py.test tests --boxed

In fact, the only files you need are `conftest.py` and `pytest.ini`, and then you can copy over a single `test_foo.py` (only making sure import statements are absolute) and it should run fine.

You also need to call setup_plugins() in your setup() function for your plugin to be properly loaded before testing.

An example of this test method is in the [https://gitorious.org/mediagoblin-stock/mediagoblin-hidden_original/ "hidden original" plugin], which subclasses the submission tests.

See also [http://mediagoblin.readthedocs.org/en/latest/pluginwriter/tests.html Writing unit tests for plugins] in the docs.

== Translating / Localising plugins ==
''How do we do [[Translations]] in plugins?''

(At least, a plugin would have to install a .mo file in e.g. lib/python2.7/site-packages/pluginname-0.1.3-py2.7.egg/pluginname/i18n/nn_NO/LC_MESSAGES/pluginname.mo (with domain "pluginname"?). Then mediagoblin would have to either discover that the file exists when setting up the plugin, or the plugin would have to add that to some list in some hook.

mg_globals.py seems to create a gettext variable pointing at mediagoblin/i18n:
<pre>
thread_scope.translations = gettext.translation(
'mediagoblin',
pkg_resources.resource_filename(
'mediagoblin', 'i18n'), ['en'], fallback=True)
</pre>
which is installed into the jinja template in template.py:
<pre>
template_env.install_gettext_callables(
mg_globals.thread_scope.translations.ugettext,
mg_globals.thread_scope.translations.ungettext)
</pre>
in a function called by app.py:
<pre>
request.template_env = template.get_jinja_env(
self.template_loader, request.locale)
</pre>
)

== Making database models ==
See [[SQLAlchemy Tips]]

GMG FAQ

2020-05-11T03:47:32Z

Sturm: /* Authentication is disabled after an update */

'''NOTE:''' MediaGoblin is in heavy development, so the answers in this FAQ are very likely to be incomplete or obsolete. Please use the documentation, git, mailing list, IRC ''etc''.

== Is it possible to upload many files at a time? ==

''As of 2013-09-08:''

* There is at least one script for that, based on the API, [https://github.com/joar/automgtic automgtic by joar]. It might not work now in some way due to API changes.

* There is experimental support for a [http://piwigo.org/ Piwigo] compatible API, usable with [http://yorba.org/shotwell/ Shotwell]; see "[http://saz.im/blog/shotwell-mg.html Using Shotwell with Mediagoblin]".

* pythonsnake has made [https://github.com/pythonsnake/MediaDwarf/tree/486_multiupload a branch for multiupload] in his repo. Source: [http://www.reddit.com/r/linux/comments/1lselg/mediagoblin_050_released_with_help_from_opw_and/cc3lgu6]

* if you have files already on the server, you can use "gmg batchaddmedia" in the local shell to import media in Mediagoblin

== There is an SQL error ==
If you've changed configuration (like enabling a plug-in) or updated the code, you may need to run a dbupdate, please see [http://docs.mediagoblin.org/siteadmin/deploying.html#install-mediagoblin-and-virtualenv]. The database must be readable (and probably writeable).

== Authentication is disabled after an update ==

Add this to the [plugins] section of mediagoblin.ini:
<pre>[[mediagoblin.plugins.basic_auth]]</pre>

See mediagoblin.ini and [http://lists.mediagoblin.org/pipermail/devel/2013-July/000610.html] for examples of more.

== Development ==

=== Why did you [http://issues.mediagoblin.org/ticket/557 switch] from MongoDB to SQL? ===
There are some notes at
* [[Scaling Down]]
* [[SQL Database Backend]]

Deployment

2020-04-28T15:30:17Z

Sturm: Remove systemd scripts - these are included in the official docs

This page could use a lot of work. For now, a few smaller deployment tips!

See also: http://docs.mediagoblin.org/deploying.html (some of which may belong here)

= uwsgi =

Possibly a cleaner way to do nginx configuration than the official nginx + fastcgi suggestions!

http://nathanielca.se/fossrit/deploying-mediagoblin-1-fastcgi-vs-uwsgi.html

= uwsgi with configs =

Below there are 3 configs: for nginx, for uwsgi version 1.2.3-debian and for supervisord, used to run celery.

In future, when newer versions of uwsgi appear in debian, supervisor can be removed.

All instructions below are for Debian 7. They should also work with rpm-based systems, but with other paths.

<pre>apt-get install uwsgi uwsgi-plugin-python nginx-full supervisor;</pre>

/etc/nginx/sites-available/mediagoblin:
<pre>
server {
server_name <domain>;

access_log /var/log/nginx/mg.access.log;
error_log /var/log/nginx/mg.error.log error;

#include global/common.conf;

client_max_body_size 100m;
add_header X-Content-Type-Options nosniff;

root /path/to/mediagoblin//user_dev/;

location /mgoblin_static/ {
alias /path/to/mediagoblin/mediagoblin/static/;
}
location /mgoblin_media/ {
alias /path/to/mediagoblin/user_dev/media/public/;
}
location /theme_static/ {
}
location /plugin_static/ {
}
location / {
uwsgi_pass unix:///tmp/mg.uwsgi.sock;
uwsgi_param SCRIPT_NAME "";
include uwsgi_params;
}
}
</pre>

/etc/uwsgi/apps-available/mg.yaml:
<pre>
uwsgi:
uid: mediagoblin
gid: mediagoblin
socket: /tmp/mg.uwsgi.sock
chown-socket: www-data:www-data
plugins: python
home: /path/to/mediagoblin/
chdir: /path/to/mediagoblin/
ini-paste: /path/to/mediagoblin/paste_local.ini
</pre>

/etc/supervisor/conf.d/mediagoblin.conf:
<pre>
[program:celery]
command=/path/to/mediagoblin/bin/celery worker -l debug

; Set PYTHONPATH to the directory containing celeryconfig.py
environment=PYTHONPATH="/path/to/mediagoblin",MEDIAGOBLIN_CONFIG="/path/to/mediagoblin/mediagoblin_local.ini",CELERY_CONFIG_MODULE="mediagoblin.init.celery.from_celery"

directory=/path/to/mediagoblin/
user=mediagoblin
numprocs=1
; uncomment below to enable logs saving
;stdout_logfile=/some/logs/path/celeryd_stdout.log
;stderr_logfile=/some/logs/path/celeryd_stderr.log
autostart=true
autorestart=false
startsecs=10

; Need to wait for currently executing tasks to finish at shutdown.
; Increase this if you have very long running tasks.
stopwaitsecs = 600
</pre>

After setting all configs do:
<pre>
ln -s /etc/nginx/sites-available/mediagoblin /etc/nginx/sites-enabled/
ln -s /etc/uwsgi/apps-available/mg.yaml /etc/uwsgi/apps-enabled/
</pre>

And don't forget to restart all your daemons:
<pre>
service uwsgi restart;
service nginx restart;
service supervisor stop; sleep 1; service supervisor start # sleep 1 might be needed here because supervisor really stops not at once
</pre>

= FCGI script =

This works great with the apache FCGID config example in the next section :) in which case you should name it "mg.fcgi".

Before use, make sure you replace '/path/to/mediagoblin/bin/python' with a real path on your server, e.g. '/srv/www/myhomepage.com/mediagoblin/bin/python'. Also replace '/path/to/mediagoblin/paste.ini'.

If you encounter problems, try executing executing the script manually, e.g. <pre>./mg.fcgi</pre>

Script:

<pre>#!/path/to/mediagoblin/bin/python

# Written in 2011 by Christopher Allan Webber
#
# To the extent possible under law, the author(s) have dedicated all
# copyright and related and neighboring rights to this software to the
# public domain worldwide. This software is distributed without any
# warranty.
#
# You should have received a copy of the CC0 Public Domain Dedication along
# with this software. If not, see
# <http://creativecommons.org/publicdomain/zero/1.0/>.

from paste.deploy import loadapp
from flup.server.fcgi import WSGIServer

CONFIG_PATH = '/path/to/mediagoblin/paste.ini'

## Uncomment this to run celery in "always eager" mode... ie, you don't have
## to run a separate process, but submissions wait till processing finishes
# import os
# os.environ['CELERY_ALWAYS_EAGER'] = 'true'

def launch_fcgi():
ccengine_wsgi_app = loadapp('config:' + CONFIG_PATH)
WSGIServer(ccengine_wsgi_app).run()

if __name__ == '__main__':
launch_fcgi()</pre>

= Apache 2 Config With fcgid =

Note that the libapache2-mod-fcgi in Debian is in the main section. libapache2-mod-fcgid can be used, but requires a slightly different configuration. For yum-based distributions, you may need to install mod_fcgid.

<VirtualHost *:80>
Options +ExecCGI

# Accept up to 16MB requests
FcgidMaxRequestLen 16777216

ServerName mediagoblin.example.org

Alias /mgoblin_static/ /path/to/mediagoblin/mediagoblin/static/
Alias /mgoblin_media/ /path/to/mediagoblin/user_dev/media/public/

ScriptAlias / /path/to/mediagoblin/mg.fcgi/
</VirtualHost>

= Apache 2 Config With mod_wsgi =

Apache can manage the MediaGoblin application itself with mod_wsgi. It requires slightly more configuration on the Apache side, but cuts out the FastCGI middleware. See their [http://code.google.com/p/modwsgi/wiki/ConfigurationGuidelines configuration guidelines] for advanced configuration.

<VirtualHost *:80>
ServerName mediagoblin.example.org

Alias /mgoblin_static/ /path/to/mediagoblin/mediagoblin/static/
Alias /mgoblin_media/ /path/to/mediagoblin/user_dev/media/public/

WSGIScriptAlias / /path/to/mediagoblin/wsgi.py
# Set user and group to whatever user you used to install mediagoblin (if you used a system account,
# it may have the group 'nogroup' assigned, in that case you can remove the group parameter)
# Remember to change python-path too!
# Replace the python version in the 'python-path' below with the correct one (eg 2.x -> 2.7)
WSGIPassAuthorization On
WSGIDaemonProcess gmg user=mediagoblin group=mediagoblin processes=2 threads=10 \
umask=0007 inactivity-timeout=900 maximum-requests=1000 \
python-path=/path/to/mediagoblin/:/path/to/mediagoblin/lib/python-2.x/site-packages/
WSGIProcessGroup gmg
WSGIApplicationGroup %{GLOBAL}

<Directory "/path/to/mediagoblin/mediagoblin/static/">
Order allow,deny
Allow from all
</Directory>
<Directory "/path/to/mediagoblin/user_dev/media/public">
Order allow,deny
Allow from all
</Directory>
</VirtualHost>

You'll also need to copy this into /path/to/mediagoblin/wsgi.py:

#!/path/to/mediagoblin/bin/python

# Written in 2011 by Christopher Allan Webber
#
# To the extent possible under law, the author(s) have dedicated all
# copyright and related and neighboring rights to this software to the
# public domain worldwide. This software is distributed without any
# warranty.
#
# You should have received a copy of the CC0 Public Domain Dedication along
# with this software. If not, see
# <http://creativecommons.org/publicdomain/zero/1.0/>.

import site
# Replace the python version with the correct one in the line below (eg 2.x -> 2.7)
site.addsitedir('/path/to/mediagoblin/lib/python-2.x/site-packages')

from paste.deploy import loadapp

CONFIG_PATH = '/path/to/mediagoblin/paste.ini'

## Uncomment this to run celery in "always eager" mode... ie, you don't have
## to run a separate process, but submissions wait till processing finishes
#import os
#os.environ['CELERY_ALWAYS_EAGER'] = 'true'

application = loadapp('config:' + CONFIG_PATH)

If you're getting strange errors when trying to upload something, your WSGI setup is probably not starting Celery. You should start it yourself, perhaps with your preferred init system or service supervisor.

= Apache Config Example =
This configuration example uses mod_fastcgi.

To install and enable mod_fastcgi on a Debian/Ubuntu based system:
<pre># apt-get install libapache2-mod-suexec libapache2-mod-fastcgi
# a2enmod suexec
# a2enmod fastcgi</pre>

Sample configuration:
<pre>
<VirtualHost *:80>
ServerName mediagoblin.yourdomain.tld
ServerAdmin webmaster@yourdoimain.tld
DocumentRoot /var/www/
# Custom log files
CustomLog /var/log/apache2/mediagobling_access.log combined
ErrorLog /var/log/apache2/mediagoblin_error.log

# Serve static and media files via alias
Alias /mgoblin_static/ /path/to/mediagoblin/mediagoblin/static/
Alias /mgoblin_media/ /path/to/mediagoblin/user_dev/media/public/

# Rewrite all URLs to fcgi, except for static and media urls
RewriteEngine On
RewriteRule ^(mgoblin_static|mgoblin_media)($|/) - [L]
RewriteCond %{REQUEST_FILENAME} !-f
RewriteRule ^/(.*)$ /mg.fcgi/$1 [QSA,L]

# Allow access to static and media directories
<Directory /path/to/mediagoblin/mediagoblin/static>
Order allow,deny
Allow from all
</Directory>
<Directory /path/to/mediagoblin/mediagoblin/user_dev/media/public>
Order allow,deny
Allow from all
</Directory>

# Connect to fcgi server
FastCGIExternalServer /var/www/mg.fcgi -host 127.0.0.1:26543
</VirtualHost>
</pre>
Then, you need to make sure mediagoblin is running in fcgi mode:
<pre>cd /path/to/mediagoblin
./lazyserver.sh --server-name=fcgi fcgi_host=127.0.0.1 fcgi_port=26543</pre>

Note: there may be several ways to improve this configuration

If it is too slow and you use the deflate module, you could try to use the following option : SetOutputFilter INFLATE

= Lighttpd =

This configuration example uses mod_fastcgi.
Make a symbolic link from <pre>/etc/lighttpd/conf-available/10-fastcgi.conf</pre> to <pre>/etc/lighttpd/conf-enabled/10-fastcgi.conf</pre>

<pre>
ln -s /etc/lighttpd/conf-available/10-fastcgi.conf /etc/lighttpd/conf-enabled/10-fastcgi.conf
</pre>

then edit your /etc/lighttpd/conf-enabled/10-fastcgi.conf file modifying it as below to serve mediagoblin on the /tube/ path of your webserver.

<pre>
## FastCGI programs have the same functionality as CGI programs,
## but are considerably faster through lower interpreter startup
## time and socketed communication
##
## Documentation: /usr/share/doc/lighttpd-doc/fastcgi.txt.gz
## http://www.lighttpd.net/documentation/fastcgi.html

server.modules += ( "mod_fastcgi" )

## Start an FastCGI server for mediagoblin (lazyserver.sh or other deployments scripts should be up and running)
fastcgi.server = (
# url at which the app should be accessible on the server
"/tube" =>
# mnemonical name of the backend
( "mg-local" => (
"host" => "127.0.0.1",
"port" => 6543,
"docroot" => "/path/to/mediagoblin-git-folder/mediagoblin",
"check-local" => "disable"
)
)

)
</pre>

Then open your /etc/lighttpd/lighttpd.conf and add the configuration to serve directly the static/public folders

<pre>
alias.url += (
"/mgoblin_static/" => "/path/to/mediagoblin-git-folder/mediagoblin/static/",
"/mgoblin_media/" => "/path/to/mediagoblin-git-folder/user_dev/media/public/",
"/theme_static/" => "/path/to/mediagoblin-git-folder/user_dev/theme_static/",
"/plugin_static/" => "/path/to/mediagoblin-git-folder/user_dev/plugin_static/"
)

</pre>

Done!

= OpenShift =

Thers's a blogpost saying how to [http://www.sud0.com/gnu-media-goblin-on-openshift.html install mediagoblin on openshift].

= Juju =

There is a juju [https://juju.ubuntu.com/Charms charm] available for deploying mediagoblin into EC2 or on your local box. [https://juju.ubuntu.com/ juju] is available in Ubuntu 11.10 and later, though it is recommended that you pull it from [https://launchpad.net/~juju/+archive/pkgs the juju PPA], which includes backported packages going back to Ubuntu 11.10. To use the juju charm, install juju and configure either the [https://juju.ubuntu.com/docs/provider-configuration-local.html local provider] or one of the cloud API providers, currently the [https://juju.ubuntu.com/docs/provider-configuration-ec2.html EC2 provider] is the best supported and works not only with Amazon Web Services but also OpenStack clouds. There is also a newer native OpenStack API provider which is known to support HP Cloud.
<pre>
# if you have not bootstrapped
juju bootstrap
mkdir ~/charms
bzr init-repo ~/charms/precise
bzr branch lp:~clint-fewbar/charms/precise/mediagoblin/trunk ~/charms/precise/mediagoblin
juju deploy --repository ~/charms local:mediagoblin
juju expose mediagoblin
</pre>

Currently the charm is volatile, deploying from trunk, and deploys a single-server version of MediaGoblin only. It will eventually relate to the existing juju charms for other supported data stores to allow one to scale out their MediaGoblin instance.

= Init scripts =

== Debian init scripts ==

Joar has some scripts for running celery and mediagoblin separately that are designed for Debian.

https://github.com/joar/mediagoblin-init-scripts

== Arch Linux init scripts ==

[http://whird.jpope.org/2012/04/14/mediagoblin-archlinux-rcd-scripts Jeremy Pope has written a nice blogpost] on how to add init scripts to deploy MediaGoblin with both the python paste http server and the celery deployments separated.

If you want a simpler setup and don't want to deploy celery separately, consider either turning CELERY_ALWAYS_EAGER to true in the paste init script described above, or check out [http://chimo.chromic.org/2012/03/01/mediagoblin-init-script-on-archlinux/ Chimo's guide].

== Generic, simple init script ==

This is a super stupidly simple init script that was used for mediagoblin.com... note that this has Celery running in always eager mode.

You will need to adjust the paths appropriately. This could probably be better written!

#! /bin/sh

## Stupidly simple mediagoblin init script.
#
# Written in 2012 by Christopher Allan Webber
#
# To the extent possible under law, the author(s) have dedicated all
# copyright and related and neighboring rights to this software to the
# public domain worldwide. This software is distributed without any
# warranty.
#
# You should have received a copy of the CC0 Public Domain Dedication along
# with this software. If not, see
# <http://creativecommons.org/publicdomain/zero/1.0/>.

PASTER=/srv/mediagoblin.com/bin/paster
PASTE_CONFIG=/srv/mediagoblin.com/paste.ini
OPTIONS="--pid-file=/tmp/mediagoblin.pid \
--log-file=/srv/mediagoblin.com/paster.log \
--server-name=fcgi fcgi_host=127.0.0.1 fcgi_port=26543"

CELERY_ALWAYS_EAGER=true su -pc "$PASTER serve $PASTE_CONFIG $1 $OPTIONS" webadmin

= Running on Dreamhost.com =

===Set up your python virtualenv===

dreamhost.com servers come with python 2.4 and 2.5 installed which is too old for mediagoblin. This means you need to compile and install a newer python (don't worry this is really not difficult on dreamhost servers). In order to be able to install python packages for a local user without touching system files, we need to setup a python ''virtualenv''. Fortunately, this is not too tricky either. If your server has python 2.6 or 2.7 installed already, you can skip the [[#Install a local python|python installation stuff]] and you'll only need to [[#Setup virtualenv to install local python packages|install virtualenv]].

====Install a local python====
# Download the latest python: http://python.org/ftp/python/XXX/Python-XXX.tar.bz2
# Unpack with <pre>tar xvjf Python-XXX.tar.bz2</pre>
# ''cd'' into the directory and compile and install python locally:
<blockquote><pre>./configure --prefix=$HOME/local
make
make install</pre></blockquote>
:This will install python (I used 2.7.3) into /home/<USERNAME>/local/bin/python. You might get warnings about some modules not being able to compile. :It was tcl/tk and bzip2 mainly, but things still worked out overall.
:
:You should now be able to invoke <tt>~/local/bin/python</tt> and fall into a shell of your new python (exit with ctrl-d). Congrats, you have now a new python 2.7 that you can use. However, you will need to be able to install additional packages as a user and this is what virtualenv allows.

====Setup virtualenv to install local python packages====
# Download the latest virtualenv: http://pypi.python.org/packages/source/v/virtualenv/XXX
# Install the virtualenv: <blockquote><pre>~/local/bin/python ~/virtualenv-1.8/virtualenv.py $HOME/local/virtenv</pre></blockquote>
:: You will now have: ~/local/virtenv/bin/python
# In ~/.bash_profile add: <blockquote><pre>PATH=~/local/virtenv/bin:~/local/bin:${PATH}</pre></blockquote>
:: so that your local python will be preferred.
:: Log out, log in again and test python" to see which version will be invoked. It should be the new python. Check "which easy_install" to see if the one in local/virtenv would be executed.
::
:: You have now 1) a local ''python'' installation that you can use, and 2) ''easy_install'' will also work with your local user installation. From now on you can e.g. locally install the nose testing framework (''easy_install nose'') and use it (''python -c "import nose"'').

===Install mediagoblin as a site package===

# Check out mediagoblin from git to e.g. ~/mediagoblin
# Install MediaGoblin and all dependencies for MediaGoblin with easy_install.
:* In the mediagoblin directory issue:
:<blockquote><pre>python setup.py</pre></blockquote>
:* You will also need to: easy_install lxml
:* Python-image was trickier to install: <pre>easy_install --find-links http://www.pythonware.com/products/pil/ Imaging</pre>
::Test by leaving the mediagoblin directory and see if you can import it: <pre>python -c "import mediagoblin"</pre> looking for error messages.

===Set up an WSGI environment on Dreamhost===

# Enable the mod_passenger setting for ruby/python in the domains web panel
# ''cd'' into the domain directory (e.g. ~/media.sspaeth.de for me)
# Copy mediagoblin.ini and paste.ini from the ~/mediagoblin directory here
# Create passenger_wsgi.py in your domain directory (e.g. ~/media.sspaeth.de for me):
<blockquote><pre>import sys, os
INTERP = "/home/<username>/local/virtenv/bin/python"
#INTERP is present twice so that the new python interpreter knows the actual executable path
if sys.executable != INTERP: os.execl(INTERP, INTERP, *sys.argv)

from paste.deploy import loadapp
application = loadapp('config:/home/mediagoblin/media.sspaeth.de/paste.ini')

#If in case of errors, all you get are mysterious error 500, you can set debug=true in paste.ini to see stack traces
# Otherwise, add this:
#from paste.exceptions.errormiddleware import ErrorMiddleware
#application = ErrorMiddleware(application, debug=True)</pre></blockquote>
# Set up the database by issueing: <pre>gmg dbupdate</pre>
# (optional but recommended) Serve the static files directly from the webserver.
:In paste.ini in this section: [composite:routing] comment out the static files:
#/mgoblin_static/ = mediagoblin_static
#/theme_static/ = theme_static
:and symlink the mediagobin/mediagoblin/static directoy to public/mgoblin_static
: and mediagoblin/mediagoblin/themes to public/theme_static
:
:so it is displayed directly. This step might be different depending on your web server configuration. There is no reason that static
:files need to go through all the python indirection when they can be served directly by nginx/apache/...
:
:In case you want to delete your git checkout after the installation (you don't need it, since you installed the mediagoblin package to ~/local/virtenv/lib/python2.7/mediagoblin... you should do the symlinking from there.
===Open Issues===
Please fill in the blanks if you find them out:
* How to enable logging to a file or standard html logs? Console output just disappears.
* How to set up things not using sqlite. What's wrong with mySQL?

===Troubleshooting===
* First of all: invoke <pre>python passenger_wsgi.py</pre> directly from the shell. This will tell you if there are import errors etc. If this command exits without any output on the console, you have already achieved a lot.
* In ''paste.ini'' set debug=true. This will show you python backtraces directly in the web page
* You will need to configure an smtp user/passwd/server in mediagoblin.ini, so you actually get the account creation token mailed out. Hint, the relevant settings are:
<blockquote><pre>email_debug_mode = false
email_sender_address = postmaster@sspaeth.de
email_smtp_host = SMTP.DOMAIN.TLD
email_smtp_user = USERNAME
email_smtp_pass = WEIRDPASSWORD</pre></blockquote>
* In case you can upload media, but it does not appear. You don't have the celery server running. Add <pre>CELERY_ALWAYS_EAGER = true</pre> to the ''[celery]'' section in mediagoblin.ini

=Miscellaneous Hacks=
==Force translation==
There might some conditions under which you would prefer that MediaGoblin always return the same translation. If you are deploying with nginx and fastcgi, you can force MediaGoblin to return a specific translation regardless of browser preferences by passing a specific HTTP_ACCEPT_LANGUAGE fastcgi parameter in your location block. Example last line in location block:
<nowiki>
fastcgi_param HTTP_ACCEPT_LANGUAGE es; #force spanish translation
</nowiki>

==Create an admin user==

To create an admin user, first create the user you need either via the website or the command
<pre>
./bin/gmg adduser
</pre>

Then to turn it into an admin account use

<pre>
./bin/gmg makeadmin your_username
</pre>

UnitTests

2019-09-19T08:03:23Z

Sturm:

= Unit tests =

FIXME - i think there's some information in chris' brain dumps page that should get ported here.

In the meantime, if you're interested in helping with unit tests, come see us in #mediagoblin on freenode.net.

== Running the unit tests ==

To run the unit tests, do:

./runtests.sh

To run a specific test, do:

./runtests.sh <TEST>

For example:

./runtests.sh mediagoblin/tests/test_submission.py::TestSubmissionBasics::test_collection_selection

<tt>runtests.sh</tt> does some minor setup and calls py.test. If you pass in <tt>-h</tt>, you'll get the
py.test help which shows you options for other things you can do with the unit test system. For details see the [https://docs.pytest.org/en/latest/usage.html pytest] documentation.

UnitTests

2019-09-19T07:48:29Z

Sturm: Update testing docs.

= Unit tests =

FIXME - i think there's some information in chris' brain dumps page that should get ported here.

In the meantime, if you're interested in helping with unit tests, come see us in #mediagoblin on freenode.net.

== Running the unit tests ==

To run the unit tests, do:

./runtests.sh

To run a specific test, do:

./runtests.sh <TEST>

For example:

./runtests.sh mediagoblin/tests/test_submission.py::TestSubmissionBasics.test_collection_selection

<tt>runtests.sh</tt> does some minor setup and calls py.test. If you pass in <tt>-h</tt>, you'll get the
py.test help which shows you options for other things you can do with the unit test system.

Meeting

2016-09-17T15:30:34Z

Sturm: Remove old link to logs archive

== MediaGoblin Monthly Meeting ==

'''When:''' 9:00 am Pacific Time first Saturday of the month. [http://www.timeanddate.com/worldclock/converter.html Convert time to your timezone]. Print current UTC time: <code>date -u +"It's %F %T UTC"</code>. [https://en.wikipedia.org/wiki/Daylight_saving_time_in_the_United_States#2005_revision_to_dates_of_observance Pacific Time in 2014 has DST between March 9th and November 2nd].

'''Where:''' IRC #mediagoblin on irc.freenode.net

Always announced several days in advance on the [http://lists.mediagoblin.org/pipermail/devel/ mailing list] as is date adjustments, agenda discussion and other meeting preparation.

'''Purpose:''' The idea is to discuss the past month, what happened, what was good, what should be done better. And to create roadmap for the upcoming month and assign tasks to people willing to handle them.

Typical Agenda topics:

* What happened in the last month, what was good, what could be better next time?
* What should be done next month?

Meetings are logged. See below for logs of each meeting.

== Next Meeting ==

Every first Saturday of the month with JIT-compiled agenda.

=== Oct 1, 2016 ===

== Past Meetings ==

=== Sept 4, 2016, 17:00 UTC ===

[[20160904_Log]]

=== May 7, 2016 ===

=== April 2, 2016, 17:00 UTC ===
* 0.9.0 release (done!)
* GSoC
* 1.0

[[20160402_Log]]

=== March 5, 2016, 9:00AM Pacific Time, 17:00 UTC ===
* 0.9.0 release (imminent!)
* GSoC
** Project ideas
** Interested mentors?
* Federation mini-update

[[20160305_Log]]

=== February 6, 2016, 9:00AM Pacific Time, 17:00 UTC ===

* Continuous integration / Commit Notifications
* Move sqlite to development-only? (no more migrations)
* Upcoming 0.9.0 release
* Path to 1.0
* Stripe retreat update
* ActivityPub update (related!)
* GSOC ideas, and volunteers?

[[20160206_Log]]

=== January 2, 2016, 9:00AM Pacific Time, 17:00 UTC ===

* 0.9.0
* FOSDEM
* 0.8.2
[[20160102_Log]]

=== November 7, 2015, 9:00AM Pacific Time, 17:00 UTC ===

* 0.8.1 and 0.9.0
* Activipy and W3C Social WG stuff
* Help squash bugs!
* Revisiting the code / issue hosting situation??

=== March 7, 2015, 09:00AM Pacific Time, 17:00 UTC ===

* Moving off of gitorious, to?
* 0.8.0 upcoming release
* LibrePlanet and W3C meeting
* GSoC 2015
* Heads up: UserOps list
* Federation status
* Chris to take a temporary break?

=== December 6, 2014, 09:00AM Pacific Time, 17:00 UTC ===

* 0.8.0 upcoming release
** Current state (including looking at issue list)
** How to help!
*** Help us [https://issues.mediagoblin.org/query?status=new&status=in_progress&status=accepted&status=review&group=status&milestone=0.8.0 fix issues!]
*** Documentation (check it! improve it!)
*** Gstreamer 1.0 merge?
*** Help test!
*** Translate? (Maybe, but maybe not yet?)
* Translation talk, if breton is around
* Update on federation
* Update on W3C group

=== November 1, 2014, 09:00AM Pacific Time, 16:00 UTC ===

Loose meeting structure :)

=== October 4, 2014, 09:00AM Pacific Time, 16:00 UTC ===

* 0.8.0 progress
** Python 3 is in!
** Cleanup happening
** What's next
*** Gstreamer 1.0 merge
*** Search merge
*** [https://issues.mediagoblin.org/query?status=new&status=in_progress&status=accepted&status=review&group=status&milestone=0.8.0 Tickets!]
* Autoconf update
* Breton's translation update
* Federation update
* Deployment research update
* Add your things!

=== September 6, 2014, 09:00AM Pacific Time, 16:00 UTC ===

* Things happened! Horray!
** 0.7.0 is out!
** GSoC is done!
* Transifex move... help!
* 0.8.0 planning
* Updates on federation
* Updates on campaign-todo-items
* Premium hosting and deployment
* Documentation updates ( j1mc )
* Triage day! And the [https://etherpad.mozilla.org/gmg-triage new setup]!
* Help on reviewing?
* Epicanis' feature questions

=== August 2, 2014, 09:00AM Pacific Time, 16:00 UTC ===

* GSoC updates
* State of 0.7.0
* State of Federation
* State of post-campaign stuff (rewards, etc)
* General community updates
* Feedback: how are things going?

=== June 7, 2014, 09:00AM Pacific Time, 16:00 UTC ===

* GSoC updates
* Researchcation brief summary
* Campaign-related updates
* Upcoming release
* Code reviews

=== May 3, 2014, 09:00AM Pacific Time, 16:00 UTC ===

* GSoC starts!
* Post campaign updates!
** Horray, we did it!
** Unlocked features
** The rewards
** Premium hosting brainstorm
** Extra features brainstorm
* [http://lists.mediagoblin.org/pipermail/devel/2014-May/000867.html Metadata] discussion
* Chris' researchcation
** Federation stuff
** Deployment stuff
** Other stuff?
* Help review!
* Add your items HERE!

=== March 1st, 2014, 09:00AM Pacific Time, 17:00 UTC ===

* GSoC
* The [http://mediagoblin.org/pages/campaign.html crowdfunding campaign!]
** State of things / Q & A
** You can help!
* MediaGoblin in the meanwhile

=== November 2nd, 2013, 09:00AM Pacific Time, 16:00 UTC ===

Pretty loose on the schedule this month? :)

* Post-conference wrapup stuff?
* What's ahead in the next year for MediaGoblin?

=== October 5th, 2013, 09:00AM Pacific Time, 16:00 UTC ===

* Post-OPW/GSoC wrapup discussion
* Huge pile of code to review
* Planning out 0.6.0
* Road to 1.0
* mediagoblin.org changes
* GNU 30th recap, upcoming conferences
* MediaGoblin's graphic design?

=== September 7th, 2013 ===

* 0.5.0 release recap!
* Next release: 0.6.0!
* GSoC/OPW updates
* Review queue that needs attention
* GNU 30th! (and traveling)
* Other things???

=== August 3rd, 2013 9:00 am Pacific Time (2013-08-03 16:00 UTC) ===

* Configure && make merge
* 0.5.0 plans
* GSoC / OPW updates
* GNU 30th birthday party / GoblinCon? :)
* Documentation overhaul
* Reprocessing
* Bonus topics
** Mumble server
** XUDD

=== July 6th, 2013 9:00 am Pacific Time (2013-07-06 16:00 UTC) ===

* 0.4.0 is out! On to 0.4.1!
* OPW/GSoC update
* Federation status
* Module owners (and reducing the "Chris Webber bottleneck")?
** Projects like Blender, the Linux Kernel, and qemu have "module owners", people responsible for a domain of the code
** Could/should MediaGoblin do the same?
** How would that be broken up?

=== Jun 1st, 2013 9:00 am Pacific Time (2013-06-01 16:00 UTC) ===

* Welcoming our GSoC and OPW interns
* The coming 0.4.0
* What's after 0.4.0?
* RTL

=== May 4th, 2013, 9:00 am Pacific Time (2013-05-04 16:00 UTC) ===

[[meeting-2013-05-04|May 4th, 2013, 9:00 am Pacific Time (2013-05-04 16:00 UTC)]]

* GSOC and Gnome Outreach for Women participation update
* Mention the bug triage meeting
* Improving our unit tests?
* 0.4.0 release coming soon
* Help review code?
* Thanking simonft for sysadmin help!

=== April 6, 2013, 9:00 am Pacific Time (2013-03-30 16:00 UTC) ===

* Plugins update
* Post-libreplanet sprint merging
* Gstreamer 1.0 stuff (if Joar is here!)
* GSOC and Gnome Outreach for Women participation
* ???

=== March 2nd, 2013, 9:00 am Pacific Time (2013-03-02 16:00 UTC) ===

* Bug triage day discussion
* Upgrading Trac to 1.0
* Next release: 0.3.3
* Consider have release dates?
* Plugin stystem
* Consider moving to GStreamer 1.0
** Debian - 1.0 in sid
** Ubuntu - 1.0 in 12.10
*** Possibly backports for 12.04
** Fedora - 1.0 in 18
* Upcoming conferences and hackathons

=== February 9th, 2013, 9:00 am Pacific Time (2013-02-09 16:00 UTC) ===

* 0.3.3 milestone! What about our next release? :)
* Where to put Developer docs?
*: Our Documentation for developers is currently a bit split. Some are on the wiki, some in the main docs. There are pros and cons for both. We should consider where to put things. One place? Which? Or decide on an individual basis?
*: Good about main docs: Easy to integrate source code doc strings. That way internal api docs can be kept mostly up to date.
*: Good about wiki: Doesn't feel so "set in stone".
* wiki spam: Do we want to change something?
* [http://lists.mediagoblin.org/pipermail/devel/2012-November/000307.html Designing features!]
* Plugins, and architecting for plugins
* Chris Webber gives updates on how he's settling into his role ;)

=== October 13th, 2012, 9:00 am Pacific Time (2012-10-13 16:00 UTC) ===

* 0.3.2 release
** What existing features need to be wrapped up?
*** Werkzeug switch
** What time might we do the release?
* Fundraising campaign
** Keeping things going mid-campaign
** You have questions? I have answers, kinda :)
* Getting new contributors involved
* Plugins? New features?

==== Etherpad ====
<pre>
AGENDA

0.3.2 release

What existing features need to be wrapped up?

Werkzeug switch

What time might we do the release?

Congrats to Deb from the mediagoblin team! Congrats de Deb!

Fundraising campaign

Keeping things going mid-campaign

You have questions? I have answers, kinda :)

Getting new contributors involved

Plugins? New features?

-- http://wiki.mediagoblin.org/Meeting#Next_Meeting
Fundraising stuff
Things are going great mostly when people check it out!
But how to spread the word?

should contact more podcasts, etc

currently working with FSF on this

need community to spread the word!

List of places already spreaded list and contacted

VideoThumbnailerMarkII
New video thumbnailer, rewritten to try to eliminate a bug in the old one where processing would stall.
New bugs introduce (of course ;)
Collections
Merged - Thanks aaronw!
WebOb => Werkzeug switch
Made some things break. Need help with testing + bugfixes
borked stuffs:

Accessing paths without trailing slashes, e.g. /submit (instead of /submit/)

Still a lot of legacy WebOb responses (such as webob.exc.HTTPFound() HTTPForbidden() left)

API
Delivered to mrn.is, tryggvib will test it and get back with feedback.
Working, still a lot of room for improvements.
Mostly done, usable, still room for improvements. Example applications:

https://github.com/jwandborg/automgtic

https://github.com/jwandborg/omgmg
</pre>

=== September 1st, 2012, 9:00 am Pacific Time (2012-09-01 16:00 UTC) ===

[http://mediagoblin.org/irclogs/irc_meeting_2012-09-01.txt IRC log]

* FIXME - can someone type in summary here?

=== August 4th, 2012, 9:00 am Pacific Time (2012-08-04 16:00 UTC) ===

[http://mediagoblin.org/irclogs/irc_meeting_2012-08-04.txt IRC log]

* Release schedule
* Plugins and themes! Who's working on one? What problems are you having? -- Please write up issues for problems so they can get fixed!
* Should we namespace plugins? If so, how should we namespace plugins?
** Python 3.3 will have support for namespace plugins. [http://www.python.org/dev/peps/pep-0420/#namespace-packages-today]
** In Python >=2.3, <3.3 it's a hack [http://www.python.org/dev/peps/pep-0402/#the-problem][http://www.python.org/dev/peps/pep-0420/#namespace-packages-today]
** Flask has a workaround[https://github.com/mitsuhiko/flask/blob/master/flask/ext/__init__.py]

=== July 7th, 2012, 9:00 am Pacific Time (2012-07-07 16:00 UTC) ===

[http://mediagoblin.org/irclogs/irc_meeting_2012-07-07.txt IRC log]

Announcements:

* Anyone who wants to edit the wiki needs to be in the goblin army group. Ask Will or Chris to get added.
* Plugin infrastructure landed. If you're interested in writing plugins, talk to Will. Some documentation at http://docs.mediagoblin.org/#part-2-plugin-writer-s-guide

Agenda:

* Keyboard shortcuts ([http://issues.mediagoblin.org/ticket/346 #346])
* Ticket triaging?
* Base plugin stuff!
* Theming
* Conference: OSCON
* Chris Webber's new "office hours"

=== June 2nd, 2012, 9:00 am Pacific Time ===

[http://mediagoblin.org/irclogs/irc_meeting_2012-06-02.txt IRC log]

* docs changes
** Will split the docs/ guide into a Site Administrator's Guide and a Plugin Writer's Guide
** Has anyone looked at the Plugin Writer's Guide, yet?
** Will wants to add a "Contributor's Guide" to docs/ which he'd update from the wiki before every release
* Is there a way to improve our unit tests and motivation to write them?
** Simulating a browser by the way of [http://phantomjs.org/ PhantomJS], [http://seleniumhq.org/ Selenium] instead of having code simulating other code against itself might be more natural to write and even more testing the actual application. I have a good feeling about this, please prove me wrong if I'd be. --[[User:Joar|Joar]] 08:53, 28 May 2012 (EDT)
* Administrative panel/tools and user uploads panel
* Git and tickets
* Plugins
** What's the state of things?
** Documentation
** What plugins might we want to build for this upcoming release?
** What things do we currently have that we might want to pluginify?
* State of kuneco/federation mini-update (Chris)

=== May 5th, 2012, 9:00 am Pacific Time ===

[http://mediagoblin.org/irclogs/irc_meeting_2012-05-05.txt IRC log]

* Post-release reflections
** Woohoo, release!
** How did this release process go?
*** We should talk about that conference.
** What's left to clean up?
*** Mongokit->SQL "style" query conversion?
*** Other cruft code?
* What are our next goals?
** Plugins
** Federation
** Favoriting
*** Take that, Pinterest! ;)
** Galleries
** Theming
*** Using sass would be neat
** Access restrictions
*** User management, or having a "secret url" that is not in the photo index that you can share with friends and generate as needed for any media type
** What about traffic? Some of us will host GMG on limited plans.
** Some kind of coding guidelines? Do we have a philosophy like "Keep it Simple, Stupid"
*** This concerns things like: Should plugins land in core eventually, do we want to support ALL THE MEDIA TYPES, ...
** Podcasting support?
** Things that have been hanging???
** Bugtrackers and milestone?
** More??? We should organize things!
* jancborchardt and his team of UX wizard-students
* Website redesign
* OpenShift?

=== April 7th, 2012, 4:00 pm UTC ===

[http://mediagoblin.org/irclogs/irc_meeting_2012-04-07.txt IRC log]

* Post-SQL stuff
* Pending 0.0.3 release!
* Are there stray patches/branches to be merged?
* Our glorious upcoming plugin future! (Update from Will)

=== March 3rd, 2012, 9:00 am Pacific Time ===

[http://mediagoblin.org/irclogs/irc_meeting_2012-03-03.txt IRC log]

* [[GSOC 2012]]
* State of the SQL transition (preview: it's super close, but we need help!)
* Plugin discussion (Will can't make this, but we should talk about use cases)
* MediaGoblin at upcoming conferences
* PageKite accounts

=== 2012-02 (held on 2012-02-04) ===

[http://mediagoblin.org/irclogs/irc_meeting_2012-02-04.txt IRC log]

* Code style guide? See also: http://issues.mediagoblin.org/ticket/197
* Kuneco/federation
* API
* More testing discussion?
* Theming?
* Preliminary plugin discussion
* Status update from the "SQL Team".

Some of the decisions:

* file an issue about proper <audio> support.
* some TODOs recorded

=== 2011-12 (held on 2011-12-03) ===

[http://mediagoblin.org/irclogs/irc_meeting_2011-12-03.txt IRC log]

* We plan to create a plugin system. Do we want to create that soon or push it off until things settle a bit more? ([[User:Willkg|Willkg]] 08:54, 10 November 2011 (EST))
* [[Feature Ideas]]: What should we do about the wiki page? Keep it and have it as a monthly topic for "what next"? Convert everything to long waiting bugs?
* Possibility of an [[SQL Database Backend]]?
*: 'executive summary' (well, you should read the long docs): "We could move to sql. It's probably replacing one type of pain by another type of pain, but those are somewhat comparable. Leaving the main question: Do we want to occupy our main devs for some long time with this task and loose momentum?"
* Schendje's [http://wiki.mediagoblin.org/Feature_Ideas/Activities activities proposal]
* "Coming up next" blogpost draft by Deb Nicholson
* Jef's requests:
** Ticket #466 "Use of "Submit" in site copy is sterile and not as friendly and welcoming as it could be". I'd really like to change this soon to something more suitable. How can we improve the wording here? Some alternatives have been mentioned in the bug report, but which one should we pick? Link: http://bugs.foocorp.net/issues/466
** The concept and naming of "favourites". We'll (hopefully) be able to "favourite" media soon, which I *think* means that 1) it'll work like a "I like this" comment, a quick token of appreciation, 2) it'll be added to your list of favourites so you can save and promote it, and 3) we could maybe use the number of favourites as a ranking. What I'd like to know is: is that the intended purpose? If so, should we name them favo(u)rites or something else? "Like", "love", "save", "appreciate", "heart", "high five" and many more could all be contenders. And the name should be consistent with the action and purpose, of course. So I'd like to clear up how and why we will use favourites and what we should call them.

=== 2011-11 (held on 2011-11-05) ===

[http://mediagoblin.org/irclogs/irc_meeting_2011-11-05.txt IRC log]

* What happened in the last month, what was good, what could be better next time?
** Release:
*** Good: 0.1.0 released!
*** Bad: postponing vs not postponing
** Sites and deployment documentation:
*** Good: new mediagoblin.org
*** Good: deployment documentation
*** Bad: py-bcrypt’s site was down just after the release, so the virtualenv deployment didn’t work, and it wasn’t clear how to fix it.
** Live instances:
*** Joar has a live instance!
*** But what does it mean? Should ordinary users start using it?
**** Details at [[User:Joar/mg.wandborg.se]] -- [[User:Joar|Joar]] 17:01, 6 November 2011 (EST)
*** nyergler added a note about "heartbeat"/status to API notes
* What should be done next month?
* Starting real work on federation (via OStatus)... and do we split any of this work out into its own library?
* An API
* Creative Commons licensing tools
* Merging in the multimedia/video branch
*: (this is *very close* already actually thanks to the hard work of Joar Wandborg! But we need some help on the gstreamer front to fix a few issues... if you or someone you know is an expert in this area we could really use their help to make the videos that come out smoother!)
* Rollover items from 0.1.0
* Multiple file upload interface
* Drag and drop uploads interface (probably related!)

=== 2011-10 (held on 2011-10-01) ===

[http://mediagoblin.org/irclogs/irc_meeting_2011-10-01.txt IRC log]

This month's meeting was a quickly announced short meeting. The project is getting back on track and next month's meeting will be scheduled more properly. A bunch of people were around.

The most important decisions:
* The project will keep monthly releases. They're the heartbeat of the project.
* Release 0.1.0 this sunday/monday.
* New website will hopefully be deployed in the next few days.
* And the following things are planned to happen during this month: Most importantly federation. The developers have decided to make up their minds on what federation aactually should mean for MediaGoblin. Concerning code, probably "activity streams" are the first goal. If there is no (good) python library for this, a new stand alone library may be created. If so, a name for it has to be found. It should have something about communication in it. And the other thing to happen during this month is an ongoing discussion about "bus factor".

=== 2011-09 (held on 2011-09-03) ===

[http://mediagoblin.org/irclogs/irc_meeting_2011-09-03.txt IRC log]

=== 2011-08 (held on 2011-08-06) ===

[http://mediagoblin.org/irclogs/irc_meeting_2011-08-06.txt IRC log]