{"action":"opened","issue":{"url":"https://api.github.com/repos/logstash-plugins/logstash-output-google_bigquery/issues/4","labels_url":"https://api.github.com/repos/logstash-plugins/logstash-output-google_bigquery/issues/4/labels{/name}","comments_url":"https://api.github.com/repos/logstash-plugins/logstash-output-google_bigquery/issues/4/comments","events_url":"https://api.github.com/repos/logstash-plugins/logstash-output-google_bigquery/issues/4/events","html_url":"https://github.com/logstash-plugins/logstash-output-google_bigquery/issues/4","id":56881844,"number":4,"title":"Logstash crashs and Google BigQuery feature upgrade","user":{"login":"talevy","id":388837,"avatar_url":"https://avatars.githubusercontent.com/u/388837?v=3","gravatar_id":"","url":"https://api.github.com/users/talevy","html_url":"https://github.com/talevy","followers_url":"https://api.github.com/users/talevy/followers","following_url":"https://api.github.com/users/talevy/following{/other_user}","gists_url":"https://api.github.com/users/talevy/gists{/gist_id}","starred_url":"https://api.github.com/users/talevy/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/talevy/subscriptions","organizations_url":"https://api.github.com/users/talevy/orgs","repos_url":"https://api.github.com/users/talevy/repos","events_url":"https://api.github.com/users/talevy/events{/privacy}","received_events_url":"https://api.github.com/users/talevy/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":0,"created_at":"2015-02-06T23:18:04Z","updated_at":"2015-02-06T23:18:04Z","closed_at":null,"body":"Hi \r\n1. Running Logstash i get the following error over and over again:\r\nIOError: closed stream\r\nflush at org/jruby/RubyIO.java:2199\r\nsize at org/jruby/RubyFile.java:1108\r\nmethod_missing at /opt/logstash/lib/logstash/outputs/google_bigquery.rb:565\r\nreceive at /opt/logstash/lib/logstash/outputs/google_bigquery.rb:194\r\nhandle at /opt/logstash/lib/logstash/outputs/base.rb:86\r\nworker_setup at /opt/logstash/lib/logstash/outputs/base.rb:78\r\nI'm trying to understand what am i doing wrong \r\ni've tested my configuration and everything seems more than fine \r\nas sometimes it works and sometimes it just fails with unknown reason\r\n2. Google BigQuery output plugin \r\nI think its a good idea to add the threshold attribute for allowed errors within an bq upload job, you can see example in the bigquery portal\r\n3. Unknown bug of file control within Google BigQuery plugin\r\nwithin the plugin you have two keys you can set:\r\ndeleter_interval_secs - set the interval in sec for deleting the temp file from disk\r\nuploader_interval_secs - set the interval in sec from data collection to uploading the data to bigquery\r\nI've noted that despite that the file was uploaded and was done been written with data, once it's deleted using the deleter_interval_secs key, Logstash craches because it can't find the file\r\n\r\n\r\nmigrated from: https://logstash.jira.com/browse/LOGSTASH-2247"}}