{"action":"created","issue":{"url":"https://api.github.com/repos/HIPS/Spearmint/issues/19","labels_url":"https://api.github.com/repos/HIPS/Spearmint/issues/19/labels{/name}","comments_url":"https://api.github.com/repos/HIPS/Spearmint/issues/19/comments","events_url":"https://api.github.com/repos/HIPS/Spearmint/issues/19/events","html_url":"https://github.com/HIPS/Spearmint/issues/19","id":73122913,"number":19,"title":"NaN crash","user":{"login":"mylesnovick","id":6547683,"avatar_url":"https://avatars.githubusercontent.com/u/6547683?v=3","gravatar_id":"","url":"https://api.github.com/users/mylesnovick","html_url":"https://github.com/mylesnovick","followers_url":"https://api.github.com/users/mylesnovick/followers","following_url":"https://api.github.com/users/mylesnovick/following{/other_user}","gists_url":"https://api.github.com/users/mylesnovick/gists{/gist_id}","starred_url":"https://api.github.com/users/mylesnovick/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mylesnovick/subscriptions","organizations_url":"https://api.github.com/users/mylesnovick/orgs","repos_url":"https://api.github.com/users/mylesnovick/repos","events_url":"https://api.github.com/users/mylesnovick/events{/privacy}","received_events_url":"https://api.github.com/users/mylesnovick/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"milestone":null,"comments":3,"created_at":"2015-05-04T20:39:31Z","updated_at":"2015-05-05T18:59:31Z","closed_at":"2015-05-05T18:24:03Z","body":"After several successful runs, it seems spearmint crashes with the following output:\r\n```\r\n/Users/name/Desktop/external_libraries/Spearmint/spearmint/tasks/task.py:287: RuntimeWarning: invalid value encountered in subtract\r\n  return y - mean\r\nFitting GP for main task...\r\nTraceback (most recent call last):\r\n File \"main.py\", line 494, in <module>\r\n   main()\r\n File \"main.py\", line 286, in main\r\n   suggested_job = get_suggestion(chooser, resource.tasks, db, expt_dir, options, resource_name)\r\n File \"main.py\", line 355, in get_suggestion\r\n   hypers = chooser.fit(task_group, hypers, task_options)\r\n File \"/Users/name/Desktop/external_libraries/Spearmint/spearmint/choosers/default_chooser.py\", line 309, in fit\r\n   hypers=hypers.get(task_name, None)\r\n File \"/Users/name/Desktop/external_libraries/Spearmint/spearmint/models/gp.py\", line 505, in fit\r\n   self._hypers_list = self._collect_samples(self.mcmc_iters)\r\n File \"/Users/name/Desktop/external_libraries/Spearmint/spearmint/models/gp.py\", line 378, in _collect_samples\r\n   sampler.sample(self)\r\n File \"/Users/name/Desktop/external_libraries/Spearmint/spearmint/sampling/slice_sampler.py\", line 262, in sample\r\n   params_array, current_ll = slice_sample(params_array, self.logprob, model, **self.sampler_options)\r\n File \"/Users/name/Desktop/external_libraries/Spearmint/spearmint/sampling/mcmc.py\", line 354, in slice_sample\r\n   new_x, new_llh = direction_slice(direction, init_x)\r\n File \"/Users/name/Desktop/external_libraries/Spearmint/spearmint/sampling/mcmc.py\", line 289, in direction_slice\r\n   llh_s = np.log(npr.rand()) + dir_logprob(0.0)\r\n File \"/Users/name/Desktop/external_libraries/Spearmint/spearmint/sampling/mcmc.py\", line 272, in dir_logprob\r\n   return logprob(direction*z + init_x, *logprob_args)\r\n File \"/Users/name/Desktop/external_libraries/Spearmint/spearmint/sampling/slice_sampler.py\", line 240, in logprob\r\n   lp += model.log_likelihood()\r\n File \"/Users/name/Desktop/external_libraries/Spearmint/spearmint/models/gp.py\", line 538, in log_likelihood\r\n   solve = spla.cho_solve((chol, True), self.observed_values - self.mean.value)\r\n File \"/usr/local/lib/python2.7/site-packages/scipy/linalg/decomp_cholesky.py\", line 162, in cho_solve\r\n   b1 = asarray_chkfinite(b)\r\n File \"/usr/local/lib/python2.7/site-packages/numpy/lib/function_base.py\", line 613, in asarray_chkfinite\r\n   \"array must not contain infs or NaNs\")\r\nValueError: array must not contain infs or NaNs\r\n```\r\n---------------\r\n\r\nMy config file is as follows, if helpful:\r\n```json\r\n{\r\n   \"language\": \"PYTHON\",\r\n   \"main-file\": \"stub_optimizing.py\",\r\n   \"experiment-name\": \"swingy-monkey-optimization\",\r\n   \"likelihood\": \"GAUSSIAN\",\r\n   \"variables\": {\r\n       \"height_bucket_div\": {\r\n           \"type\": \"FLOAT\",\r\n           \"size\": 1,\r\n           \"min\": 1,\r\n           \"max\": 15\r\n       },\r\n       \"width_bucket_div\": {\r\n           \"type\": \"FLOAT\",\r\n           \"size\": 1,\r\n           \"min\": 1,\r\n           \"max\": 10\r\n       },\r\n       \"vel_bucket_len\": {\r\n           \"type\": \"FLOAT\",\r\n           \"size\": 1,\r\n           \"min\": 1,\r\n           \"max\": 30\r\n       },\r\n       \"discount\": {\r\n           \"type\": \"FLOAT\",\r\n           \"size\": 1,\r\n           \"min\": 0,\r\n           \"max\": 1\r\n       },\r\n       \"greed_exp\": {\r\n           \"type\": \"FLOAT\",\r\n           \"size\": 1,\r\n           \"min\": 1,\r\n           \"max\": 3\r\n       }\r\n   }\r\n}\r\n```"},"comment":{"url":"https://api.github.com/repos/HIPS/Spearmint/issues/comments/99182267","html_url":"https://github.com/HIPS/Spearmint/issues/19#issuecomment-99182267","issue_url":"https://api.github.com/repos/HIPS/Spearmint/issues/19","id":99182267,"user":{"login":"JasperSnoek","id":3066843,"avatar_url":"https://avatars.githubusercontent.com/u/3066843?v=3","gravatar_id":"","url":"https://api.github.com/users/JasperSnoek","html_url":"https://github.com/JasperSnoek","followers_url":"https://api.github.com/users/JasperSnoek/followers","following_url":"https://api.github.com/users/JasperSnoek/following{/other_user}","gists_url":"https://api.github.com/users/JasperSnoek/gists{/gist_id}","starred_url":"https://api.github.com/users/JasperSnoek/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/JasperSnoek/subscriptions","organizations_url":"https://api.github.com/users/JasperSnoek/orgs","repos_url":"https://api.github.com/users/JasperSnoek/repos","events_url":"https://api.github.com/users/JasperSnoek/events{/privacy}","received_events_url":"https://api.github.com/users/JasperSnoek/received_events","type":"User","site_admin":false},"created_at":"2015-05-05T18:59:31Z","updated_at":"2015-05-05T18:59:31Z","body":"I meant the input values and output values for your experiments (not the\ncode output) :-)\n\nJasper\n\nOn Tue, May 5, 2015 at 2:24 PM, mylesnovick <notifications@github.com>\nwrote:\n\n> Using database at localhost.\n> Getting suggestion...\n>\n> Suggestion:     NAME          TYPE       VALUE\n>                 ----          ----       -----\n>                 discount      float      0.000000\n>                 vel_bucket_l  float      1.000000\n>                 width_bucket  float      1.000000\n>                 height_bucke  float      1.000000\n> Submitted job 1 with local scheduler (process id: 38454).\n> Status: 1 pending, 0 complete.\n>\n> Getting suggestion...\n>\n> Suggestion:     NAME          TYPE       VALUE\n>                 ----          ----       -----\n>                 discount      float      0.500000\n>                 vel_bucket_l  float      15.500000\n>                 width_bucket  float      5.500000\n>                 height_bucke  float      8.000000\n> Submitted job 2 with local scheduler (process id: 38461).\n> Status: 1 pending, 1 complete.\n>\n> Fitting GP for main task...\n> Getting suggestion...\n>\n> Minimum expected objective value under model is 0.55830 (+/- 0.21668), at location:\n>                 NAME          TYPE       VALUE\n>                 ----          ----       -----\n>                 discount      float      0.492920\n>                 vel_bucket_l  float      15.606201\n>                 width_bucket  float      8.499268\n>                 height_bucke  float      10.799316\n>\n> Minimum of observed values is 0.600000, at location:\n>                 NAME          TYPE       VALUE\n>                 ----          ----       -----\n>                 discount      float      0.500000\n>                 vel_bucket_l  float      15.500000\n>                 width_bucket  float      5.500000\n>                 height_bucke  float      8.000000\n>\n> Suggestion:     NAME          TYPE       VALUE\n>                 ----          ----       -----\n>                 discount      float      1.000000\n>                 vel_bucket_l  float      18.563723\n>                 width_bucket  float      10.000000\n>                 height_bucke  float      14.624490\n> Submitted job 3 with local scheduler (process id: 38468).\n> Status: 1 pending, 2 complete.\n>\n> Fitting GP for main task...\n> Getting suggestion...\n>\n> Minimum expected objective value under model is 0.01744 (+/- 0.00086), at location:\n>                 NAME          TYPE       VALUE\n>                 ----          ----       -----\n>                 discount      float      1.000000\n>                 vel_bucket_l  float      18.563723\n>                 width_bucket  float      10.000000\n>                 height_bucke  float      14.624490\n>\n> Minimum of observed values is 0.017442, at location:\n>                 NAME          TYPE       VALUE\n>                 ----          ----       -----\n>                 discount      float      1.000000\n>                 vel_bucket_l  float      18.563723\n>                 width_bucket  float      10.000000\n>                 height_bucke  float      14.624490\n>\n> Suggestion:     NAME          TYPE       VALUE\n>                 ----          ----       -----\n>                 discount      float      0.999157\n>                 vel_bucket_l  float      29.968313\n>                 width_bucket  float      9.753354\n>                 height_bucke  float      15.000000\n> Submitted job 4 with local scheduler (process id: 38499).\n> Status: 1 pending, 3 complete.\n>\n> Fitting GP for main task...\n> Getting suggestion...\n>\n> Minimum expected objective value under model is 0.01744 (+/- 0.00083), at location:\n>                 NAME          TYPE       VALUE\n>                 ----          ----       -----\n>                 discount      float      1.000000\n>                 vel_bucket_l  float      18.563723\n>                 width_bucket  float      10.000000\n>                 height_bucke  float      14.624490\n>\n> Minimum of observed values is 0.017442, at location:\n>                 NAME          TYPE       VALUE\n>                 ----          ----       -----\n>                 discount      float      1.000000\n>                 vel_bucket_l  float      18.563723\n>                 width_bucket  float      10.000000\n>                 height_bucke  float      14.624490\n> /Users/name/Desktop/external_libraries/Spearmint/spearmint/transformations/beta_warp.py:206: UserWarning: BetaWarp encountered negative values: [ -1.11022302e-16]\n>   warnings.warn('BetaWarp encountered negative values: %s' % inputs[inputs<0])\n> /Users/name/Desktop/external_libraries/Spearmint/spearmint/transformations/beta_warp.py:206: UserWarning: BetaWarp encountered negative values: [ -2.77555756e-17]\n>   warnings.warn('BetaWarp encountered negative values: %s' % inputs[inputs<0])\n> /Users/name/Desktop/external_libraries/Spearmint/spearmint/transformations/beta_warp.py:206: UserWarning: BetaWarp encountered negative values: [ -1.11022302e-16  -1.11022302e-16  -2.77555756e-17]\n>   warnings.warn('BetaWarp encountered negative values: %s' % inputs[inputs<0])\n>\n> Suggestion:     NAME          TYPE       VALUE\n>                 ----          ----       -----\n>                 discount      float      0.825223\n>                 vel_bucket_l  float      20.096509\n>                 width_bucket  float      9.953394\n>                 height_bucke  float      1.000000\n> Submitted job 5 with local scheduler (process id: 38506).\n> Status: 1 pending, 4 complete.\n>\n> Fitting GP for main task...\n> Getting suggestion...\n>\n> Minimum expected objective value under model is 0.01744 (+/- 0.00079), at location:\n>                 NAME          TYPE       VALUE\n>                 ----          ----       -----\n>                 discount      float      1.000000\n>                 vel_bucket_l  float      18.563723\n>                 width_bucket  float      10.000000\n>                 height_bucke  float      14.624490\n>\n> Minimum of observed values is 0.017442, at location:\n>                 NAME          TYPE       VALUE\n>                 ----          ----       -----\n>                 discount      float      1.000000\n>                 vel_bucket_l  float      18.563723\n>                 width_bucket  float      10.000000\n>                 height_bucke  float      14.624490\n>\n> Suggestion:     NAME          TYPE       VALUE\n>                 ----          ----       -----\n>                 discount      float      1.000000\n>                 vel_bucket_l  float      1.075082\n>                 width_bucket  float      10.000000\n>                 height_bucke  float      11.797219\n> Submitted job 6 with local scheduler (process id: 38513).\n> Status: 1 pending, 5 complete.\n>\n> Fitting GP for main task...\n> Getting suggestion...\n>\n> Minimum expected objective value under model is 0.01745 (+/- 0.00072), at location:\n>                 NAME          TYPE       VALUE\n>                 ----          ----       -----\n>                 discount      float      1.000000\n>                 vel_bucket_l  float      18.563723\n>                 width_bucket  float      10.000000\n>                 height_bucke  float      14.624490\n>\n> Minimum of observed values is 0.017442, at location:\n>                 NAME          TYPE       VALUE\n>                 ----          ----       -----\n>                 discount      float      1.000000\n>                 vel_bucket_l  float      18.563723\n>                 width_bucket  float      10.000000\n>                 height_bucke  float      14.624490\n>\n> Suggestion:     NAME          TYPE       VALUE\n>                 ----          ----       -----\n>                 discount      float      0.000000\n>                 vel_bucket_l  float      18.890624\n>                 width_bucket  float      10.000000\n>                 height_bucke  float      15.000000\n> Submitted job 7 with local scheduler (process id: 38520).\n> Status: 1 pending, 6 complete.\n>\n> Fitting GP for main task...\n> Getting suggestion...\n>\n> Minimum expected objective value under model is -0.02247 (+/- 0.18498), at location:\n>                 NAME          TYPE       VALUE\n>                 ----          ----       -----\n>                 discount      float      0.949829\n>                 vel_bucket_l  float      11.340454\n>                 width_bucket  float      7.869751\n>                 height_bucke  float      14.885498\n>\n> Minimum of observed values is 0.017442, at location:\n>                 NAME          TYPE       VALUE\n>                 ----          ----       -----\n>                 discount      float      1.000000\n>                 vel_bucket_l  float      18.563723\n>                 width_bucket  float      10.000000\n>                 height_bucke  float      14.624490\n>\n> Suggestion:     NAME          TYPE       VALUE\n>                 ----          ----       -----\n>                 discount      float      0.604825\n>                 vel_bucket_l  float      1.000000\n>                 width_bucket  float      1.000000\n>                 height_bucke  float      14.944403\n> Submitted job 8 with local scheduler (process id: 38527).\n> Status: 1 pending, 7 complete.\n>\n> Fitting GP for main task...\n> Getting suggestion...\n>\n> Minimum expected objective value under model is 0.01745 (+/- 0.00125), at location:\n>                 NAME          TYPE       VALUE\n>                 ----          ----       -----\n>                 discount      float      1.000000\n>                 vel_bucket_l  float      18.563723\n>                 width_bucket  float      10.000000\n>                 height_bucke  float      14.624490\n>\n> Minimum of observed values is 0.017442, at location:\n>                 NAME          TYPE       VALUE\n>                 ----          ----       -----\n>                 discount      float      1.000000\n>                 vel_bucket_l  float      18.563723\n>                 width_bucket  float      10.000000\n>                 height_bucke  float      14.624490\n> /Users/name/Desktop/external_libraries/Spearmint/spearmint/transformations/beta_warp.py:206: UserWarning: BetaWarp encountered negative values: [ -1.73472348e-18]\n>   warnings.warn('BetaWarp encountered negative values: %s' % inputs[inputs<0])\n>\n> Suggestion:     NAME          TYPE       VALUE\n>                 ----          ----       -----\n>                 discount      float      1.000000\n>                 vel_bucket_l  float      1.000000\n>                 width_bucket  float      4.186812\n>                 height_bucke  float      14.999844\n> Submitted job 9 with local scheduler (process id: 38557).\n> Status: 1 pending, 8 complete.\n>\n> Fitting GP for main task...\n> Getting suggestion...\n>\n> Minimum expected objective value under model is 0.01745 (+/- 0.00122), at location:\n>                 NAME          TYPE       VALUE\n>                 ----          ----       -----\n>                 discount      float      1.000000\n>                 vel_bucket_l  float      18.563723\n>                 width_bucket  float      10.000000\n>                 height_bucke  float      14.624490\n>\n> Minimum of observed values is 0.017442, at location:\n>                 NAME          TYPE       VALUE\n>                 ----          ----       -----\n>                 discount      float      1.000000\n>                 vel_bucket_l  float      18.563723\n>                 width_bucket  float      10.000000\n>                 height_bucke  float      14.624490\n>\n> Suggestion:     NAME          TYPE       VALUE\n>                 ----          ----       -----\n>                 discount      float      1.000000\n>                 vel_bucket_l  float      30.000000\n>                 width_bucket  float      1.000000\n>                 height_bucke  float      6.565894\n> Submitted job 10 with local scheduler (process id: 38564).\n> Status: 1 pending, 9 complete.\n>\n> Fitting GP for main task...\n> Getting suggestion...\n>\n> Minimum expected objective value under model is -0.07341 (+/- 0.14712), at location:\n>                 NAME          TYPE       VALUE\n>                 ----          ----       -----\n>                 discount      float      0.999268\n>                 vel_bucket_l  float      27.118408\n>                 width_bucket  float      4.302490\n>                 height_bucke  float      9.479980\n>\n> Minimum of observed values is 0.017442, at location:\n>                 NAME          TYPE       VALUE\n>                 ----          ----       -----\n>                 discount      float      1.000000\n>                 vel_bucket_l  float      18.563723\n>                 width_bucket  float      10.000000\n>                 height_bucke  float      14.624490\n>\n> Suggestion:     NAME          TYPE       VALUE\n>                 ----          ----       -----\n>                 discount      float      1.000000\n>                 vel_bucket_l  float      22.916578\n>                 width_bucket  float      4.950625\n>                 height_bucke  float      15.000000\n> Submitted job 11 with local scheduler (process id: 38571).\n> Status: 1 pending, 10 complete.\n>\n> Fitting GP for main task...\n> Getting suggestion...\n>\n> Minimum expected objective value under model is -0.00066 (+/- 0.25903), at location:\n>                 NAME          TYPE       VALUE\n>                 ----          ----       -----\n>                 discount      float      0.999207\n>                 vel_bucket_l  float      23.527039\n>                 width_bucket  float      1.370789\n>                 height_bucke  float      13.619995\n>\n> Minimum of observed values is 0.017442, at location:\n>                 NAME          TYPE       VALUE\n>                 ----          ----       -----\n>                 discount      float      1.000000\n>                 vel_bucket_l  float      18.563723\n>                 width_bucket  float      10.000000\n>                 height_bucke  float      14.624490\n> /Users/name/Desktop/external_libraries/Spearmint/spearmint/transformations/beta_warp.py:206: UserWarning: BetaWarp encountered negative values: [ -1.38777878e-17]\n>   warnings.warn('BetaWarp encountered negative values: %s' % inputs[inputs<0])\n> /Users/name/Desktop/external_libraries/Spearmint/spearmint/transformations/beta_warp.py:206: UserWarning: BetaWarp encountered negative values: [ -3.46944695e-18]\n>   warnings.warn('BetaWarp encountered negative values: %s' % inputs[inputs<0])\n> /Users/name/Desktop/external_libraries/Spearmint/spearmint/transformations/beta_warp.py:206: UserWarning: BetaWarp encountered negative values: [ -1.38777878e-17  -3.46944695e-18]\n>   warnings.warn('BetaWarp encountered negative values: %s' % inputs[inputs<0])\n>\n> Suggestion:     NAME          TYPE       VALUE\n>                 ----          ----       -----\n>                 discount      float      1.000000\n>                 vel_bucket_l  float      30.000000\n>                 width_bucket  float      1.000000\n>                 height_bucke  float      14.172804\n> Submitted job 12 with local scheduler (process id: 38578).\n> Status: 1 pending, 11 complete.\n>\n> Fitting GP for main task...\n> Getting suggestion...\n>\n> Minimum expected objective value under model is 0.01177 (+/- 0.00119), at location:\n>                 NAME          TYPE       VALUE\n>                 ----          ----       -----\n>                 discount      float      1.000000\n>                 vel_bucket_l  float      30.000000\n>                 width_bucket  float      1.000000\n>                 height_bucke  float      14.172804\n>\n> Minimum of observed values is 0.011719, at location:\n>                 NAME          TYPE       VALUE\n>                 ----          ----       -----\n>                 discount      float      1.000000\n>                 vel_bucket_l  float      30.000000\n>                 width_bucket  float      1.000000\n>                 height_bucke  float      14.172804\n>\n> Suggestion:     NAME          TYPE       VALUE\n>                 ----          ----       -----\n>                 discount      float      0.996677\n>                 vel_bucket_l  float      30.000000\n>                 width_bucket  float      1.000000\n>                 height_bucke  float      1.000000\n> Submitted job 13 with local scheduler (process id: 38585).\n> Status: 1 pending, 12 complete.\n>\n> Fitting GP for main task...\n> Getting suggestion...\n>\n> Minimum expected objective value under model is 0.01052 (+/- 0.01036), at location:\n>                 NAME          TYPE       VALUE\n>                 ----          ----       -----\n>                 discount      float      0.996826\n>                 vel_bucket_l  float      29.539795\n>                 width_bucket  float      1.573486\n>                 height_bucke  float      11.510254\n>\n> Minimum of observed values is 0.011719, at location:\n>                 NAME          TYPE       VALUE\n>                 ----          ----       -----\n>                 discount      float      1.000000\n>                 vel_bucket_l  float      30.000000\n>                 width_bucket  float      1.000000\n>                 height_bucke  float      14.172804\n>\n> Suggestion:     NAME          TYPE       VALUE\n>                 ----          ----       -----\n>                 discount      float      0.745479\n>                 vel_bucket_l  float      30.000000\n>                 width_bucket  float      1.000000\n>                 height_bucke  float      15.000000\n> Submitted job 14 with local scheduler (process id: 38592).\n> Status: 1 pending, 13 complete.\n>\n> Fitting GP for main task...\n> Getting suggestion...\n>\n> Minimum expected objective value under model is 0.01179 (+/- 0.00110), at location:\n>                 NAME          TYPE       VALUE\n>                 ----          ----       -----\n>                 discount      float      1.000000\n>                 vel_bucket_l  float      30.000000\n>                 width_bucket  float      1.000000\n>                 height_bucke  float      14.172804\n>\n> Minimum of observed values is 0.011719, at location:\n>                 NAME          TYPE       VALUE\n>                 ----          ----       -----\n>                 discount      float      1.000000\n>                 vel_bucket_l  float      30.000000\n>                 width_bucket  float      1.000000\n>                 height_bucke  float      14.172804\n> /Users/name/Desktop/external_libraries/Spearmint/spearmint/transformations/beta_warp.py:206: UserWarning: BetaWarp encountered negative values: [ -8.67361738e-19]\n>   warnings.warn('BetaWarp encountered negative values: %s' % inputs[inputs<0])\n>\n> Suggestion:     NAME          TYPE       VALUE\n>                 ----          ----       -----\n>                 discount      float      0.916716\n>                 vel_bucket_l  float      30.000000\n>                 width_bucket  float      1.014586\n>                 height_bucke  float      14.696722\n> Submitted job 15 with local scheduler (process id: 38622).\n> Status: 1 pending, 14 complete.\n>\n> Fitting GP for main task...\n> Getting suggestion...\n>\n> Minimum expected objective value under model is 0.01175 (+/- 0.00106), at location:\n>                 NAME          TYPE       VALUE\n>                 ----          ----       -----\n>                 discount      float      1.000000\n>                 vel_bucket_l  float      30.000000\n>                 width_bucket  float      1.000000\n>                 height_bucke  float      14.172804\n>\n> Minimum of observed values is 0.011719, at location:\n>                 NAME          TYPE       VALUE\n>                 ----          ----       -----\n>                 discount      float      1.000000\n>                 vel_bucket_l  float      30.000000\n>                 width_bucket  float      1.000000\n>                 height_bucke  float      14.172804\n>\n> Suggestion:     NAME          TYPE       VALUE\n>                 ----          ----       -----\n>                 discount      float      1.000000\n>                 vel_bucket_l  float      7.654120\n>                 width_bucket  float      7.379478\n>                 height_bucke  float      14.856693\n> Submitted job 16 with local scheduler (process id: 38629).\n> Status: 1 pending, 15 complete.\n>\n> Fitting GP for main task...\n> Getting suggestion...\n>\n> Minimum expected objective value under model is -0.04116 (+/- 0.14564), at location:\n>                 NAME          TYPE       VALUE\n>                 ----          ----       -----\n>                 discount      float      0.999939\n>                 vel_bucket_l  float      27.753845\n>                 width_bucket  float      7.815369\n>                 height_bucke  float      5.153687\n>\n> Minimum of observed values is 0.008646, at location:\n>                 NAME          TYPE       VALUE\n>                 ----          ----       -----\n>                 discount      float      1.000000\n>                 vel_bucket_l  float      7.654120\n>                 width_bucket  float      7.379478\n>                 height_bucke  float      14.856693\n>\n> Suggestion:     NAME          TYPE       VALUE\n>                 ----          ----       -----\n>                 discount      float      0.069703\n>                 vel_bucket_l  float      30.000000\n>                 width_bucket  float      1.005543\n>                 height_bucke  float      14.946583\n> Submitted job 17 with local scheduler (process id: 38637).\n> Status: 1 pending, 16 complete.\n>\n> Fitting GP for main task...\n> Getting suggestion...\n>\n> Minimum expected objective value under model is -0.01464 (+/- 0.14775), at location:\n>                 NAME          TYPE       VALUE\n>                 ----          ----       -----\n>                 discount      float      0.999939\n>                 vel_bucket_l  float      27.753845\n>                 width_bucket  float      7.815369\n>                 height_bucke  float      5.153687\n>\n> Minimum of observed values is 0.008646, at location:\n>                 NAME          TYPE       VALUE\n>                 ----          ----       -----\n>                 discount      float      1.000000\n>                 vel_bucket_l  float      7.654120\n>                 width_bucket  float      7.379478\n>                 height_bucke  float      14.856693\n>\n> Suggestion:     NAME          TYPE       VALUE\n>                 ----          ----       -----\n>                 discount      float      1.000000\n>                 vel_bucket_l  float      29.530498\n>                 width_bucket  float      7.493393\n>                 height_bucke  float      10.860084\n> Submitted job 18 with local scheduler (process id: 38644).\n> Status: 1 pending, 17 complete.\n>\n> Fitting GP for main task...\n> Getting suggestion...\n>\n> Minimum expected objective value under model is 0.00865 (+/- 0.00103), at location:\n>                 NAME          TYPE       VALUE\n>                 ----          ----       -----\n>                 discount      float      1.000000\n>                 vel_bucket_l  float      7.654120\n>                 width_bucket  float      7.379478\n>                 height_bucke  float      14.856693\n>\n> Minimum of observed values is 0.008646, at location:\n>                 NAME          TYPE       VALUE\n>                 ----          ----       -----\n>                 discount      float      1.000000\n>                 vel_bucket_l  float      7.654120\n>                 width_bucket  float      7.379478\n>                 height_bucke  float      14.856693\n>\n> Suggestion:     NAME          TYPE       VALUE\n>                 ----          ----       -----\n>                 discount      float      0.001565\n>                 vel_bucket_l  float      30.000000\n>                 width_bucket  float      1.000000\n>                 height_bucke  float      1.000000\n> Submitted job 19 with local scheduler (process id: 38654).\n> Status: 1 pending, 18 complete.\n>\n> Fitting GP for main task...\n> Getting suggestion...\n>\n> Minimum expected objective value under model is 0.00867 (+/- 0.00104), at location:\n>                 NAME          TYPE       VALUE\n>                 ----          ----       -----\n>                 discount      float      1.000000\n>                 vel_bucket_l  float      7.654120\n>                 width_bucket  float      7.379478\n>                 height_bucke  float      14.856693\n>\n> Minimum of observed values is 0.008646, at location:\n>                 NAME          TYPE       VALUE\n>                 ----          ----       -----\n>                 discount      float      1.000000\n>                 vel_bucket_l  float      7.654120\n>                 width_bucket  float      7.379478\n>                 height_bucke  float      14.856693\n>\n> Suggestion:     NAME          TYPE       VALUE\n>                 ----          ----       -----\n>                 discount      float      0.002172\n>                 vel_bucket_l  float      1.000000\n>                 width_bucket  float      10.000000\n>                 height_bucke  float      15.000000\n> Submitted job 20 with local scheduler (process id: 38686).\n> Status: 1 pending, 19 complete.\n>\n> Fitting GP for main task...\n> Getting suggestion...\n>\n> Minimum expected objective value under model is 0.00866 (+/- 0.00104), at location:\n>                 NAME          TYPE       VALUE\n>                 ----          ----       -----\n>                 discount      float      1.000000\n>                 vel_bucket_l  float      7.654120\n>                 width_bucket  float      7.379478\n>                 height_bucke  float      14.856693\n>\n> Minimum of observed values is 0.008646, at location:\n>                 NAME          TYPE       VALUE\n>                 ----          ----       -----\n>                 discount      float      1.000000\n>                 vel_bucket_l  float      7.654120\n>                 width_bucket  float      7.379478\n>                 height_bucke  float      14.856693\n>\n> Suggestion:     NAME          TYPE       VALUE\n>                 ----          ----       -----\n>                 discount      float      0.138561\n>                 vel_bucket_l  float      1.000000\n>                 width_bucket  float      1.000000\n>                 height_bucke  float      1.005832\n> Submitted job 21 with local scheduler (process id: 38858).\n> Status: 1 pending, 20 complete.\n>\n> /Users/name/Desktop/external_libraries/Spearmint/spearmint/tasks/task.py:287: RuntimeWarning: invalid value encountered in subtract\n>   return y - mean\n> Fitting GP for main task...\n> Traceback (most recent call last):\n>   File \"main.py\", line 494, in <module>\n>     main()\n>   File \"main.py\", line 286, in main\n>     suggested_job = get_suggestion(chooser, resource.tasks, db, expt_dir, options, resource_name)\n>   File \"main.py\", line 355, in get_suggestion\n>     hypers = chooser.fit(task_group, hypers, task_options)\n>   File \"/Users/name/Desktop/external_libraries/Spearmint/spearmint/choosers/default_chooser.py\", line 309, in fit\n>     hypers=hypers.get(task_name, None)\n>   File \"/Users/name/Desktop/external_libraries/Spearmint/spearmint/models/gp.py\", line 505, in fit\n>     self._hypers_list = self._collect_samples(self.mcmc_iters)\n>   File \"/Users/name/Desktop/external_libraries/Spearmint/spearmint/models/gp.py\", line 378, in _collect_samples\n>     sampler.sample(self)\n>   File \"/Users/name/Desktop/external_libraries/Spearmint/spearmint/sampling/slice_sampler.py\", line 262, in sample\n>     params_array, current_ll = slice_sample(params_array, self.logprob, model, **self.sampler_options)\n>   File \"/Users/name/Desktop/external_libraries/Spearmint/spearmint/sampling/mcmc.py\", line 354, in slice_sample\n>     new_x, new_llh = direction_slice(direction, init_x)\n>   File \"/Users/name/Desktop/external_libraries/Spearmint/spearmint/sampling/mcmc.py\", line 289, in direction_slice\n>     llh_s = np.log(npr.rand()) + dir_logprob(0.0)\n>   File \"/Users/name/Desktop/external_libraries/Spearmint/spearmint/sampling/mcmc.py\", line 272, in dir_logprob\n>     return logprob(direction*z + init_x, *logprob_args)\n>   File \"/Users/name/Desktop/external_libraries/Spearmint/spearmint/sampling/slice_sampler.py\", line 240, in logprob\n>     lp += model.log_likelihood()\n>   File \"/Users/name/Desktop/external_libraries/Spearmint/spearmint/models/gp.py\", line 538, in log_likelihood\n>     solve = spla.cho_solve((chol, True), self.observed_values - self.mean.value)\n>   File \"/usr/local/lib/python2.7/site-packages/scipy/linalg/decomp_cholesky.py\", line 162, in cho_solve\n>     b1 = asarray_chkfinite(b)\n>   File \"/usr/local/lib/python2.7/site-packages/numpy/lib/function_base.py\", line 613, in asarray_chkfinite\n>     \"array must not contain infs or NaNs\")\n> ValueError: array must not contain infs or NaNs\n>\n> —\n> Reply to this email directly or view it on GitHub\n> <https://github.com/HIPS/Spearmint/issues/19#issuecomment-99166407>.\n>\n"}}