{"action":"created","issue":{"url":"https://api.github.com/repos/apache/spark/issues/9593","labels_url":"https://api.github.com/repos/apache/spark/issues/9593/labels{/name}","comments_url":"https://api.github.com/repos/apache/spark/issues/9593/comments","events_url":"https://api.github.com/repos/apache/spark/issues/9593/events","html_url":"https://github.com/apache/spark/pull/9593","id":116073271,"number":9593,"title":"[SPARK-11627] Add initial input rate limit for spark streaming backpressure mechanism.","user":{"login":"junhaoMg","id":10882500,"avatar_url":"https://avatars.githubusercontent.com/u/10882500?v=3","gravatar_id":"","url":"https://api.github.com/users/junhaoMg","html_url":"https://github.com/junhaoMg","followers_url":"https://api.github.com/users/junhaoMg/followers","following_url":"https://api.github.com/users/junhaoMg/following{/other_user}","gists_url":"https://api.github.com/users/junhaoMg/gists{/gist_id}","starred_url":"https://api.github.com/users/junhaoMg/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/junhaoMg/subscriptions","organizations_url":"https://api.github.com/users/junhaoMg/orgs","repos_url":"https://api.github.com/users/junhaoMg/repos","events_url":"https://api.github.com/users/junhaoMg/events{/privacy}","received_events_url":"https://api.github.com/users/junhaoMg/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":7,"created_at":"2015-11-10T09:56:11Z","updated_at":"2015-11-19T23:09:44Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/apache/spark/pulls/9593","html_url":"https://github.com/apache/spark/pull/9593","diff_url":"https://github.com/apache/spark/pull/9593.diff","patch_url":"https://github.com/apache/spark/pull/9593.patch"},"body":"https://issues.apache.org/jira/browse/SPARK-11627\r\n\r\nSpark Streaming backpressure mechanism has no initial input rate limit, it might cause OOM exception.\r\nIn the firest batch task ,receivers receive data at the maximum speed they can reach,it might exhaust executors memory resources. Add a initial input rate limit value can make sure the Streaming job execute  success in the first batch,then the backpressure mechanism can adjust receiving rate adaptively."},"comment":{"url":"https://api.github.com/repos/apache/spark/issues/comments/158229319","html_url":"https://github.com/apache/spark/pull/9593#issuecomment-158229319","issue_url":"https://api.github.com/repos/apache/spark/issues/9593","id":158229319,"user":{"login":"SparkQA","id":8108735,"avatar_url":"https://avatars.githubusercontent.com/u/8108735?v=3","gravatar_id":"","url":"https://api.github.com/users/SparkQA","html_url":"https://github.com/SparkQA","followers_url":"https://api.github.com/users/SparkQA/followers","following_url":"https://api.github.com/users/SparkQA/following{/other_user}","gists_url":"https://api.github.com/users/SparkQA/gists{/gist_id}","starred_url":"https://api.github.com/users/SparkQA/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/SparkQA/subscriptions","organizations_url":"https://api.github.com/users/SparkQA/orgs","repos_url":"https://api.github.com/users/SparkQA/repos","events_url":"https://api.github.com/users/SparkQA/events{/privacy}","received_events_url":"https://api.github.com/users/SparkQA/received_events","type":"User","site_admin":false},"created_at":"2015-11-19T23:09:44Z","updated_at":"2015-11-19T23:09:44Z","body":"**[Test build #46357 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46357/consoleFull)** for PR 9593 at commit [`cd6e324`](https://github.com/apache/spark/commit/cd6e3248aede20f3aae45d89ccb0a5f3724b5b29).\n * This patch passes all tests.\n * This patch merges cleanly.\n * This patch adds no public classes."}}