ref(router): split domains to its own custom directive

In order to support multiple certs on multiple custom domains bound to
the same application, we need to split out each custom domain to its own
`server {}` directive. In master, the domain etcd keys are set like so:

    SET /deis/domains/go "www.bacongobbler.com foo.bacongobbler.com"

In confd v0.5.0, there is no way to split strings by whitespace so
there's no way to iterate through each domain bound to an application.
In this commit, there's a controller data migration script which will
migrate existing etcd keys for custom domain endpoints over to the new
syntax:

    SET /deis/domains/www.bacongobbler.com "go"
    SET /deis/domains/foo.bacongobbler.com "go"

Confd v0.8.0 has support for splitting strings, but with this approach
we can start providing support for migrations such as the one proposed
in #3399.

Author: Matthew Fisher

api/models.py

@@ -977,29 +977,26 @@ def _etcd_publish_cert(**kwargs):
 
 def _etcd_purge_cert(**kwargs):
     cert = kwargs['instance']
-    _etcd_client.delete('/deis/certs/{}'.format(cert),
-                        prevExist=True, dir=True, recursive=True)
+    try:
+        _etcd_client.delete('/deis/certs/{}'.format(cert),
+                            prevExist=True, dir=True, recursive=True)
+    except KeyError:
+        pass
 
 
 def _etcd_publish_domains(**kwargs):
-    app = kwargs['instance'].app
-    app_domains = app.domain_set.all()
-    if app_domains:
-        _etcd_client.write('/deis/domains/{}'.format(app),
-                           ' '.join(str(d.domain) for d in app_domains))
+    domain = kwargs['instance']
+    if kwargs['created']:
+        _etcd_client.write('/deis/domains/{}'.format(domain), domain.app)
 
 
 def _etcd_purge_domains(**kwargs):
-    app = kwargs['instance'].app
-    app_domains = app.domain_set.all()
-    if app_domains:
-        _etcd_client.write('/deis/domains/{}'.format(app),
-                           ' '.join(str(d.domain) for d in app_domains))
-    else:
-        try:
-            _etcd_client.delete('/deis/domains/{}'.format(app))
-        except KeyError:
-            pass
+    domain = kwargs['instance']
+    try:
+        _etcd_client.delete('/deis/certs/{}'.format(domain),
+                            prevExist=True, dir=True, recursive=True)
+    except KeyError:
+        pass
 
 
 # Log significant app-related events

bin/boot

@@ -56,6 +56,14 @@ etcd_safe_mkdir /deis/services
 etcd_safe_mkdir /deis/domains
 etcd_safe_mkdir /deis/platform
 
+# run etcd data migrations
+echo "controller: running etcd data migrations..."
+for script in $(ls /app/migrations/data/*.sh);
+do
+    . $script;
+done
+echo "controller: done running etcd data migrations."
+
 # wait for confd to run once and install initial templates
 until confd -onetime -node $ETCD --confdir /app --interval 5 --quiet 2>/dev/null; do
 	echo "controller: waiting for confd to write initial templates..."

migrations/data/0001.sh

@@ -0,0 +1,19 @@
+#!/usr/bin/env bash
+
+ETCD_PORT=${ETCD_PORT:-4001}
+ETCD="$HOST:$ETCD_PORT"
+ETCDCTL="etcdctl -C $ETCD"
+
+if [[ "$($ETCDCTL get /deis/migrations/data/0001 2> /dev/null)" != "done" ]];
+then
+    for i in $($ETCDCTL ls /deis/domains 2> /dev/null);
+    do
+        for j in $($ETCDCTL get $i);
+        do
+            $ETCDCTL set /deis/domains/$j "$(basename $i)" 1> /dev/null;
+            echo "migrated $j"
+        done;
+        $ETCDCTL rm $i;
+    done
+    $ETCDCTL set /deis/migrations/data/0001 "done"
+fi