{"push_id":607298550,"size":34,"distinct_size":34,"ref":"refs/heads/master","head":"503218e7ece24c5f8e25f93bd4714ded95d0c562","before":"0ae038a29f2768968dc8480fcf80e56a8f0acb6b","commits":[{"sha":"1b1f71b1917d11490a27c3d5af8efa3fdb91f573","author":{"email":"5e971741b1857fa368fce427039c0ade1139c460@us.ibm.com","name":"ibmcb"},"message":"Merge pull request #50 from jtaleric/master\n\nUpdate ProvisionVM work","distinct":true,"url":"https://api.github.com/repos/jtaleric/cbtool/commits/1b1f71b1917d11490a27c3d5af8efa3fdb91f573"},{"sha":"a2eb2d478cffb6372d9a4a70afc0ad5dfd022713","author":{"email":"5e971741b1857fa368fce427039c0ade1139c460@us.ibm.com","name":"MARCIO A. SILVA"},"message":"New workloads:\n\n- Apache Giraph: an iterative graph processing system built for high scalability.\n\nChanges:\n\n1) Do not check for the existence of a floating IP pool in OpenStack, unless the\nVM_DEFAULTS attribute CB_JUMPHOST is set to \"True\" (i.e., $True) in OpenStack. Not every\nOpenStack installation uses floating IPs to provide external reachability for VMs (e.g.,\nFlat networking could be used instead) and CB shouldn't check for it unless really needed.\n\n2) Cleanup in the logging output. The default verbosity level - 5 - was way too verbose\nto be effective as a debugging tool (it was quite overwhelming, actually). Now 3 more\nverbosity levels were created (1 - 8), being the level 5 focused on ACTIVE operations\non a Cloud (such, as VM and VV creation).\n\n3) The Global Object VM_DEFAULTS has a new attribute, LEAVE_INSTANCE_ON_FAILURE. This\nattribute, when set to $True (default is $False), instructs CB to leave VMs in place,\nin case the attachment operation is considered failed by CB. Very useful for \"post-mortem\"\nanalysis. IMPORTANT: Currently, implemented only for the OpenStack Cloud Adapter.\n\n4) Several bugfixes for the OpenStack Cloud Adapter.\n\n5) Bugfix for a case where the user specify the JUMP_HOST = $True (i.e., automatically\ncreate the VM jump box) but does not have the image \"cb_nullworkload\" registered on the Cloud.\n\n6) Added proper description (plus additional code cleanup) for Virtual Workloads\nredis-ycsb and hpcc\n\n7) The functions service_restart_enable, and services_stop_disable were re-written to\nsupport services in Ubuntu and RHEL with multiple different mechanisms (e.g., systemctl,\nservice/rc.d, service/chkconfig)\n\n8) Improvements on \"stats\" API call. First of all, the data returned by the API is a JSON\nobject, instead of a list of lists (much easier to parse and use). Second, the API call\nnow supports two options: \"object_type\" (default is \"all\") and \"output\" (default is\n\"print\"). When calling stats from the API, the user can specify output to be \"json\" and\nthen he will just receive back a JSON object. The default value \"print\" is used by the\nCLI, where printing a properly formatted response is important. The second improvement is\nthe capability to, if allowed by the cloud, to include the number of VMs reported directly\nby it on the list of counters for the \"VM\" object.\n\n9) Implemented a primitive \"backoff\" algorithm for cases where the instance boot\ncompletion is checked through ssh over a jumphost. After one third of attempts is made,\nthe default timeout for the ssh (which is half of the value of the \"update_frequency\" for\neach VM) will doubled, being doubled again after two thirds of the attempts are made.\n\n10) Updated automated installer. Now the installer requires the specification of a \"role\"\n(\"-r\", \"--role\") to the node where it is run (possible values are \"orchestrator\" and\n\"workload\"). The automated installer now takes care of deactivating firewalld,\niptables and ipfw on workload VMs.\n\n11) Refactoring on the core \"operations\" code. a) Now, a particular instantiation\nof a cloud operations class, for a given user and experiment identifier is stored on\nshared dictionary. This will ensure that this instantiation can be re-utilized across\nmultiple operations, reducing the need for repeated dynamic module imports. b) A new\nshared variable, \"expid\", caches the result of query to the \"time\" global object on the\nObject Store. This means a reduced number of queries across multiple operations.\n\n12) Support for PubSub through both CLI and API, including setting of timeouts for\nsubscribers. The command \"msgpub VM mychannel mymessage\" (the API equivalent is\napi.msgpub(\"TESTSIMCLOUD\", \"VM\", \"mychannel\", \"mymessage\")) will publish the message\n\"mymessage\" on the channel \"VM:mychannel\". The command \"waiton VM mychannel mymessage\n120\" (the API equivalent is api.waiton(\"TESTSIMCLOUD\", \"VM\", \"mychannel\", \"mymessage\",\n120)) will cause the CLI/API client to block waiting for the message \"mymessage\" to be\npublished on the channel \"VM:mychannel\" with a timeout of 120 seconds.\n\n13) A new VM attribute, \"comments\", is now automatically stored on the Metric Store. This\nis very handy if, during an experiment, an user wishes to \"annotate\" certain VMs for later\nanalysis.\n\n14) In OpenStack clouds, extract the total time to complete the provisioning request\ndirectly from nova API, instead of relying on the value determined by CB (e.g., through\npolling). Since the total time reported by CB and by nova API differ, the actual time\nspent by CB waiting for the provisioning request to complete is added to VM's \"comments\"\nattribute.","distinct":true,"url":"https://api.github.com/repos/jtaleric/cbtool/commits/a2eb2d478cffb6372d9a4a70afc0ad5dfd022713"},{"sha":"e81d2576f12ff530573983d5d3815f46797a3498","author":{"email":"5e971741b1857fa368fce427039c0ade1139c460@us.ibm.com","name":"MARCIO A. SILVA"},"message":"Merge branch 'master' of github.com:ibmcb/cbtool","distinct":true,"url":"https://api.github.com/repos/jtaleric/cbtool/commits/e81d2576f12ff530573983d5d3815f46797a3498"},{"sha":"a49715993175a1514973d887ad42fa5e80435212","author":{"email":"96c0df849e609578393837c2b9d3f870d6c355fc@cn.ibm.com","name":"Michael R. Hines"},"message":"GUI branding support, GUI ssl (HTTPS) support, MTU checking, and OpenVPN bugfixes\n\n1. Regression test passed.\n2. GUI Branding: You can change the top-right icon to whatever you want\n             (e.g. IBM, or SPEC, or whatever....)\n3. GUI SSL: You can provide your own SSL key and certificate for encryption\n4. MTU Checking: Some clouds networks have different MTU sizes (or broken MTUs\n   in the case of misconfigured VLANs), preventing CB from operating correctly.\n   This provides options to override the MTU inside the Guest so that it can\n   be reachable.\n5. Some bugfixes for OpenVPN support.\n6. And some other bugfixes I probably forgot about.","distinct":true,"url":"https://api.github.com/repos/jtaleric/cbtool/commits/a49715993175a1514973d887ad42fa5e80435212"},{"sha":"39854d289b00909f0e8e9ebbedc36a6bcf0ab6ca","author":{"email":"96c0df849e609578393837c2b9d3f870d6c355fc@cn.ibm.com","name":"Michael R. Hines"},"message":"This one doesn't exist upstream. Removing.","distinct":true,"url":"https://api.github.com/repos/jtaleric/cbtool/commits/39854d289b00909f0e8e9ebbedc36a6bcf0ab6ca"},{"sha":"f54e349ff334fb10335dc1e6fde1b6af338c686b","author":{"email":"5e971741b1857fa368fce427039c0ade1139c460@us.ibm.com","name":"MARCIO A. SILVA"},"message":"- Bugfixes for the VM creation code in OpenStack clouds (sometimes, the VM state\ncan suddenly flip from ACTIVE to ERROR, and the attachment should stop as soon\nas we see the error).\n\n- To better help with testing of the VM creation code in Cloud Adapters, a new\nattribute in VM_DEFAULTS - called FORCE_FAILURE - can be used to cause the whole\nVM creation to fail (inside the Cloud Adapter code) predictably.","distinct":true,"url":"https://api.github.com/repos/jtaleric/cbtool/commits/f54e349ff334fb10335dc1e6fde1b6af338c686b"},{"sha":"c7df15800637c41eb9b26a2484031c1376b7acc0","author":{"email":"b5865b7813e6f8e228e86db4e81b89cc616a2c49@gartner.com","name":"Daniel Bowers"},"message":"Allow either Apache or CDH dfsadmin report format when parsing for cluster status","distinct":true,"url":"https://api.github.com/repos/jtaleric/cbtool/commits/c7df15800637c41eb9b26a2484031c1376b7acc0"},{"sha":"199a3fdc9f62bce9cc38b07b2390de58f9dbfd80","author":{"email":"5e971741b1857fa368fce427039c0ade1139c460@us.ibm.com","name":"ibmcb"},"message":"Merge pull request #53 from bowers/master\n\nAllow either Apache or CDH dfsadmin report format","distinct":true,"url":"https://api.github.com/repos/jtaleric/cbtool/commits/199a3fdc9f62bce9cc38b07b2390de58f9dbfd80"},{"sha":"d0f2eb1eb6b56de883bcc95673d315a430e381cc","author":{"email":"5e971741b1857fa368fce427039c0ade1139c460@us.ibm.com","name":"MARCIO A. SILVA"},"message":"Merge branch 'master' of github.com:ibmcb/cbtool","distinct":true,"url":"https://api.github.com/repos/jtaleric/cbtool/commits/d0f2eb1eb6b56de883bcc95673d315a430e381cc"},{"sha":"10d62d4d609f11c2e841b977d36896893e23af67","author":{"email":"5e971741b1857fa368fce427039c0ade1139c460@us.ibm.com","name":"ibmcb"},"message":"Merge pull request #51 from hinesmr/master\n\nGUI branding support, GUI ssl (HTTPS) support, MTU checking, and OpenVPN bugfixes","distinct":true,"url":"https://api.github.com/repos/jtaleric/cbtool/commits/10d62d4d609f11c2e841b977d36896893e23af67"},{"sha":"97404e988f17e3f9017fd9c06e8b7af16bb7515d","author":{"email":"5e971741b1857fa368fce427039c0ade1139c460@us.ibm.com","name":"MARCIO A. SILVA"},"message":"Merge branch 'master' of github.com:ibmcb/cbtool","distinct":true,"url":"https://api.github.com/repos/jtaleric/cbtool/commits/97404e988f17e3f9017fd9c06e8b7af16bb7515d"},{"sha":"0a7b34c43119d6da3dc0fd354707bd094b0aa06a","author":{"email":"6511ea8d830316f5c9a3864675cdbff363c5e501@gmail.com","name":"Marcio Silva"},"message":"/ ‘docs/figures/cbtool_architecture.png’","distinct":true,"url":"https://api.github.com/repos/jtaleric/cbtool/commits/0a7b34c43119d6da3dc0fd354707bd094b0aa06a"},{"sha":"dcf065907c2bda04a84d121fa785d666503e806a","author":{"email":"6511ea8d830316f5c9a3864675cdbff363c5e501@gmail.com","name":"Marcio Silva"},"message":"/ ‘docs/figures/cbtool_overview_complex.png’","distinct":true,"url":"https://api.github.com/repos/jtaleric/cbtool/commits/dcf065907c2bda04a84d121fa785d666503e806a"},{"sha":"86c767a6cf5029ba2b8bd1f5f69026173ec13701","author":{"email":"6511ea8d830316f5c9a3864675cdbff363c5e501@gmail.com","name":"Marcio Silva"},"message":"+ ‘docs/figures/cbtool_cloud_virtual_network_option1.png’","distinct":true,"url":"https://api.github.com/repos/jtaleric/cbtool/commits/86c767a6cf5029ba2b8bd1f5f69026173ec13701"},{"sha":"368602563b547c2c7d0f70b41d20118ad28ac56a","author":{"email":"6511ea8d830316f5c9a3864675cdbff363c5e501@gmail.com","name":"Marcio Silva"},"message":"+ ‘docs/figures/cbtool_cloud_virtual_network_option2.png’","distinct":true,"url":"https://api.github.com/repos/jtaleric/cbtool/commits/368602563b547c2c7d0f70b41d20118ad28ac56a"},{"sha":"255a8d35f065ede45ffe27c6a8f4d4a4a666ded3","author":{"email":"6511ea8d830316f5c9a3864675cdbff363c5e501@gmail.com","name":"Marcio Silva"},"message":"+ ‘docs/figures/cbtool_cloud_virtual_network_option3.png’","distinct":true,"url":"https://api.github.com/repos/jtaleric/cbtool/commits/255a8d35f065ede45ffe27c6a8f4d4a4a666ded3"},{"sha":"da8195e29343008549ebcdbe038130b64377ec6d","author":{"email":"6511ea8d830316f5c9a3864675cdbff363c5e501@gmail.com","name":"Marcio Silva"},"message":"/ ‘docs/figures/cbtool_cloud_virtual_network_option3.png’","distinct":true,"url":"https://api.github.com/repos/jtaleric/cbtool/commits/da8195e29343008549ebcdbe038130b64377ec6d"},{"sha":"d3f912923089f82cf0317e443b79d1a402007c8f","author":{"email":"5e971741b1857fa368fce427039c0ade1139c460@us.ibm.com","name":"MARCIO A. SILVA"},"message":"Bugfix for host discovery through the OpenStack cloud adapter.\n\nBugfix for OpenStack Cloud Adapters (sometime the access URL does\nnot contain two colons (:), and we should deal with it appropriately).\n\nCode cleanup (including proper description) for ibm_daytrader VApp.","distinct":true,"url":"https://api.github.com/repos/jtaleric/cbtool/commits/d3f912923089f82cf0317e443b79d1a402007c8f"},{"sha":"4b0c1e90c667b5f4c27b4f11f0f033a7fbcbfe97","author":{"email":"5e971741b1857fa368fce427039c0ade1139c460@us.ibm.com","name":"MARCIO A. SILVA"},"message":"Merge branch 'master' of github.com:ibmcb/cbtool","distinct":true,"url":"https://api.github.com/repos/jtaleric/cbtool/commits/4b0c1e90c667b5f4c27b4f11f0f033a7fbcbfe97"},{"sha":"b4f6ab8c1617359af4c198448d68b565a5caf861","author":{"email":"5e971741b1857fa368fce427039c0ade1139c460@us.ibm.com","name":"MARCIO A. SILVA"},"message":"Automatically add file SPEC_dependencies.txt on the installer file list.","distinct":true,"url":"https://api.github.com/repos/jtaleric/cbtool/commits/b4f6ab8c1617359af4c198448d68b565a5caf861"}]}