{"action":"created","issue":{"url":"https://api.github.com/repos/mozilla/kuma/issues/3073","labels_url":"https://api.github.com/repos/mozilla/kuma/issues/3073/labels{/name}","comments_url":"https://api.github.com/repos/mozilla/kuma/issues/3073/comments","events_url":"https://api.github.com/repos/mozilla/kuma/issues/3073/events","html_url":"https://github.com/mozilla/kuma/pull/3073","id":57277856,"number":3073,"title":"(DO NOT MERGE) Django upgrade","user":{"login":"ubernostrum","id":12384,"avatar_url":"https://avatars.githubusercontent.com/u/12384?v=3","gravatar_id":"","url":"https://api.github.com/users/ubernostrum","html_url":"https://github.com/ubernostrum","followers_url":"https://api.github.com/users/ubernostrum/followers","following_url":"https://api.github.com/users/ubernostrum/following{/other_user}","gists_url":"https://api.github.com/users/ubernostrum/gists{/gist_id}","starred_url":"https://api.github.com/users/ubernostrum/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ubernostrum/subscriptions","organizations_url":"https://api.github.com/users/ubernostrum/orgs","repos_url":"https://api.github.com/users/ubernostrum/repos","events_url":"https://api.github.com/users/ubernostrum/events{/privacy}","received_events_url":"https://api.github.com/users/ubernostrum/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/mozilla/kuma/labels/back%20end","name":"back end","color":"bfd4f2"},{"url":"https://api.github.com/repos/mozilla/kuma/labels/not%20ready","name":"not ready","color":"f7c6c7"}],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":118,"created_at":"2015-02-11T05:21:52Z","updated_at":"2015-06-05T10:37:52Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/mozilla/kuma/pulls/3073","html_url":"https://github.com/mozilla/kuma/pull/3073","diff_url":"https://github.com/mozilla/kuma/pull/3073.diff","patch_url":"https://github.com/mozilla/kuma/pull/3073.patch"},"body":"This is the tracking PR for upgrading kuma to Django 1.7. This PR contains our project meeting notes & tasks.\r\n\r\nThe process:\r\n1. `git fetch mozilla`\r\n2. `get checkout mozilla/django-upgrade-1116335`\r\n3. `git submodule sync && git submodule update --init`\r\n4. `find . -name \"*.pyc\" | xargs rm -f`\r\n5. (vagrant-only) `vagrant provision`\r\n6. Either:\r\n   * [django-compat-lint](https://github.com/ubernostrum/django-compat-lint) ([bash script](https://gist.github.com/ubernostrum/0fb56cafab16bb8af546)) kuma with the 1.7 ruleset\r\n   * `./manage.py test 2> test-stderr.txt`\r\n\r\n7. Analyze common errors\r\n8. Pick an error to fix\r\n9. Add yourself to a \"Tasks for code\" item below\r\n\r\nTasks for code:\r\n- [ ] @groovecoder verify updated `django-statici18n` usage\r\n- [x] @groovecoder - throw new enhanced intern tests at the branch\r\n- [x] @jezdez - convert puppet provisioning to ansible\r\n  - [x] debug rabbitmq install\r\n- [x] @jezdez - Update kuma setup docs\r\n  - [x] Remove host machine install docs\r\n  - [x] Convert vagrant/vm docs from puppet to ansible (e.g., install ansible on host machine)\r\n  - [x] mark submodules as deprecated\r\n  - [x] pip install `compiled.txt`\r\n- [ ] @ubernostrum and/or @darkwing and/or others - spot-check ansible vm build\r\n\r\nTasks for deploy:\r\nAnytime:\r\n- [ ] with Sheeri - Add utf8_distinct_ci collation to MySQL ([bug 1161107](https://bugzilla.mozilla.org/show_bug.cgi?id=1161107))\r\n\r\nMay 26\r\n- [x] With Jake and cyliang: Create new python 2.7 `virtualenv` ([bug 1148435](https://bugzilla.mozilla.org/show_bug.cgi?id=1148435))\r\n- [x] With Jake and cyliang: Install dependencies from this branch's `compiled.txt` requirements file into the new `virtualenv`\r\n\r\nJune 2\r\n- [x] Ping VM team re: snapshot & potential restore\r\n- [x] Ping MDN teams re: stage server freeze\r\n- [x] Deploy branch to stage ([logs](http://developeradm.private.scl3.mozilla.com/chief/developer.stage/logs/?C=M;O=D))\r\n  - http://developeradm.private.scl3.mozilla.com/chief/developer.stage/logs/3c95d5eabe720b5ca9e25ececfba7da9786325e3.1433259513\r\n    - error: `err: fatal: destination path 'vendor/src/elasticsearch-dsl-py' already exists and is not an empty directory.` ([cause](https://github.com/mozilla/kuma/commit/061a1e602d85cb8225ba8efc9378e6ea4ed1c4f4))\r\n    - fix: `rm -rf vendor/src/elasticsearch-dsl-py`\r\n  - http://developeradm.private.scl3.mozilla.com/chief/developer.stage/logs/3c95d5eabe720b5ca9e25ececfba7da9786325e3.1433259741\r\n    - error: `ImportError: cannot import name widgets`\r\n    - fix: `find . -name \"*.pyc\" | xargs rm -f`\r\n  - http://developeradm.private.scl3.mozilla.com/chief/developer.stage/logs/3c95d5eabe720b5ca9e25ececfba7da9786325e3.1433262124\r\n    - error: `ImportError: No module named Image`\r\n    - fix: add VENV_DIR to the commander_settings.py and https://github.com/mozilla/kuma/commit/2d8b7d7fac66d413e26397960a43793ce8a1a94f\r\n  - http://developeradm.private.scl3.mozilla.com/chief/developer.stage/logs/2d8b7d7fac66d413e26397960a43793ce8a1a94f.1433271998\r\n    - error: `ImportError: No module named git`\r\n    - fix: https://github.com/mozilla/kuma/commit/0836005e29b798bea544be625c88c903a0b40919\r\n  - http://developeradm.private.scl3.mozilla.com/chief/developer.stage/logs/2d8b7d7fac66d413e26397960a43793ce8a1a94f.1433271998\r\n    - error: `django.db.utils.OperationalError: (1060, \"Duplicate column name 'user_id'\")`\r\n    - fix: Continue with fake migrations below ...\r\n- [x] With Jake and cyliang: Convert web heads Apache to use python 2.7 path\r\n  - error: https://cliang.pastebin.mozilla.org/8835477\r\n    - fix: <cyliang> Hrm.  Didn't make it from the admin host to the webhead.  Will try to force the files out ... W00t.  that did it.\r\n  - error: all-servers.conf file moved.  (Was in kuma/etc/apache/all-servers.conf; now in kuma/provisioning/roles/kuma/files/apache2/all-servers.conf)\r\n    - fix: Altering include line\r\n  - error: https://cliang.pastebin.mozilla.org/8835480\r\n    - fix: Remove https://github.com/mozilla/kuma/blame/master/wsgi/kuma.wsgi#L36-L41 (https://github.com/mozilla/kuma/commit/0276e9ff5b338e845943d8d7cc952676e7afb822)\r\n- [x] With Jake and cyliang: Manually do [fake migrations](https://github.com/mozilla/kuma/pull/3073#issuecomment-99107431) during the first deployment\r\n- [x] Deploy branch to stage again\r\n  - http://developeradm.private.scl3.mozilla.com/chief/developer.stage/logs/0276e9ff5b338e845943d8d7cc952676e7afb822.1433282257\r\n    - error: `Unknown command: 'update_badges'`\r\n    - fix: https://github.com/mozilla/kuma/commit/8068ff61f1698383dd8adf36b1d99cf03918dbbd\r\n- [ ] Update cron jobs to use new python2.7 venv\r\n\r\nJune 2-4\r\n- [ ] Stage Test, test, test with writers, WebQA, devs, et al.\r\n- [ ] Fix Travis builds on branch\r\n\r\nJune 8\r\n- [ ] Merge branch into master\r\n\r\nJune 8\r\n- [ ] Repeat deployment steps on Prod\r\n\r\nTasks for post-deploy:\r\n- [ ] Clean out db tables for removed apps and/or libraries, including stale content type records\r\n- [ ] @groovecoder - notify dev-events team that MDN events page is gone\r\n- [ ] @groovecoder - notify mdn lists that features are gone: demo comments\r\n- [ ] @jezdez - send email to dev-mdn re: big dev environment changes (e.g., new `vendor` scheme and `pip` requirements usage)\r\n- [ ] @groovecoder - schedule mdn-dev (+ Cloud Ops?) post-mortem on the update project, including: \r\n  - Policy for on-going updates to MDN python dependencies to prevent another huge gap\r\n  - Discuss pip-ifying dependencies, peep-like checks, installing from tarballs, adding pip install compiled to chief script\r\n  - Discuss a new tagging system\r\n  - Discuss html5lib usage\r\n  - Discuss PostgreSQL\r\n- [ ] Update `django-rest-framework`\r\n- [ ] @jezdez - re-base, merge, & push https://github.com/mozilla/kuma/pull/3062\r\n  - [ ] @groovecoder - schedule mdn-dev meeting re: new config design"},"comment":{"url":"https://api.github.com/repos/mozilla/kuma/issues/comments/109255275","html_url":"https://github.com/mozilla/kuma/pull/3073#issuecomment-109255275","issue_url":"https://api.github.com/repos/mozilla/kuma/issues/3073","id":109255275,"user":{"login":"ubernostrum","id":12384,"avatar_url":"https://avatars.githubusercontent.com/u/12384?v=3","gravatar_id":"","url":"https://api.github.com/users/ubernostrum","html_url":"https://github.com/ubernostrum","followers_url":"https://api.github.com/users/ubernostrum/followers","following_url":"https://api.github.com/users/ubernostrum/following{/other_user}","gists_url":"https://api.github.com/users/ubernostrum/gists{/gist_id}","starred_url":"https://api.github.com/users/ubernostrum/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ubernostrum/subscriptions","organizations_url":"https://api.github.com/users/ubernostrum/orgs","repos_url":"https://api.github.com/users/ubernostrum/repos","events_url":"https://api.github.com/users/ubernostrum/events{/privacy}","received_events_url":"https://api.github.com/users/ubernostrum/received_events","type":"User","site_admin":false},"created_at":"2015-06-05T10:37:52Z","updated_at":"2015-06-05T10:37:52Z","body":"When trying to follow vagrant install instructions, getting this at the submodule init step:\r\n\r\n    $ git submodule update --init --recursive\r\n    Submodule 'testdata' (https://github.com/html5lib/html5lib-tests.git) registered for path 'html5lib/tests/testdata'\r\n    Cloning into 'html5lib/tests/testdata'...\r\n    remote: Counting objects: 3953, done.\r\n    remote: Total 3953 (delta 0), reused 0 (delta 0), pack-reused 3953\r\n    Receiving objects: 100% (3953/3953), 4.91 MiB | 2.74 MiB/s, done.\r\n    Resolving deltas: 100% (2028/2028), done.\r\n    Checking connectivity... done.\r\n    Submodule path 'vendor/src/html5lib/html5lib/tests/testdata': checked out 'f6a1b202de14fc057b196044c5ebef4672be3dd0'\r\n    fatal: Needed a single revision\r\n    Unable to find current revision in submodule path 'vendor/src/urlobject'"}}