{"action":"created","issue":{"url":"https://api.github.com/repos/kite-sdk/kite/issues/349","labels_url":"https://api.github.com/repos/kite-sdk/kite/issues/349/labels{/name}","comments_url":"https://api.github.com/repos/kite-sdk/kite/issues/349/comments","events_url":"https://api.github.com/repos/kite-sdk/kite/issues/349/events","html_url":"https://github.com/kite-sdk/kite/pull/349","id":68214145,"number":349,"title":"Speed up schema migration when loading all schemas from a directory","user":{"login":"prazanna","id":1994157,"avatar_url":"https://avatars.githubusercontent.com/u/1994157?v=3","gravatar_id":"","url":"https://api.github.com/users/prazanna","html_url":"https://github.com/prazanna","followers_url":"https://api.github.com/users/prazanna/followers","following_url":"https://api.github.com/users/prazanna/following{/other_user}","gists_url":"https://api.github.com/users/prazanna/gists{/gist_id}","starred_url":"https://api.github.com/users/prazanna/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/prazanna/subscriptions","organizations_url":"https://api.github.com/users/prazanna/orgs","repos_url":"https://api.github.com/users/prazanna/repos","events_url":"https://api.github.com/users/prazanna/events{/privacy}","received_events_url":"https://api.github.com/users/prazanna/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":1,"created_at":"2015-04-13T23:01:16Z","updated_at":"2015-04-14T17:02:44Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/kite-sdk/kite/pulls/349","html_url":"https://github.com/kite-sdk/kite/pull/349","diff_url":"https://github.com/kite-sdk/kite/pull/349.diff","patch_url":"https://github.com/kite-sdk/kite/pull/349.patch"},"body":"The following changes are made\r\n1. kicking off HbaseAdmin.createTableAsync for a bunch of tables and waiting for HBaseAdmin.isTableAvailable for all the tables is much quicker than the sync version HBaseAdmin.createTable sequentially for all the tables. The SchemaTool waits for a maximum of 10 minutes for all the tables to become available which seems like a very legible buffer.\r\n2. HBaseAdmin.disableTable and HBaseAdmin.enableTable are very costly (~25% time spent over the schema migration). Instead of creating tables as and when we know about a entity schema, construct the HTableDescriptor for all the entity schemas for a specific table, this was we dont have to add column families at a later point of time which requires the disable and enable"},"comment":{"url":"https://api.github.com/repos/kite-sdk/kite/issues/comments/92981960","html_url":"https://github.com/kite-sdk/kite/pull/349#issuecomment-92981960","issue_url":"https://api.github.com/repos/kite-sdk/kite/issues/349","id":92981960,"user":{"login":"rdblue","id":87915,"avatar_url":"https://avatars.githubusercontent.com/u/87915?v=3","gravatar_id":"","url":"https://api.github.com/users/rdblue","html_url":"https://github.com/rdblue","followers_url":"https://api.github.com/users/rdblue/followers","following_url":"https://api.github.com/users/rdblue/following{/other_user}","gists_url":"https://api.github.com/users/rdblue/gists{/gist_id}","starred_url":"https://api.github.com/users/rdblue/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/rdblue/subscriptions","organizations_url":"https://api.github.com/users/rdblue/orgs","repos_url":"https://api.github.com/users/rdblue/repos","events_url":"https://api.github.com/users/rdblue/events{/privacy}","received_events_url":"https://api.github.com/users/rdblue/received_events","type":"User","site_admin":false},"created_at":"2015-04-14T17:02:44Z","updated_at":"2015-04-14T17:02:44Z","body":"Looks like this breaks the CDH4 and Hadoop 1 profiles. That's not necessarily a blocker because we need to discuss when to drop support for them. If that's the route you'd like to go, could you bring it up on the list? Otherwise, we should try to make this work for all profiles."}}