{"action":"created","issue":{"url":"https://api.github.com/repos/apache/spark/issues/10081","labels_url":"https://api.github.com/repos/apache/spark/issues/10081/labels{/name}","comments_url":"https://api.github.com/repos/apache/spark/issues/10081/comments","events_url":"https://api.github.com/repos/apache/spark/issues/10081/events","html_url":"https://github.com/apache/spark/pull/10081","id":119835344,"number":10081,"title":"[SPARK-12081] Make unified memory manager work with small heaps","user":{"login":"andrewor14","id":2133137,"avatar_url":"https://avatars.githubusercontent.com/u/2133137?v=3","gravatar_id":"","url":"https://api.github.com/users/andrewor14","html_url":"https://github.com/andrewor14","followers_url":"https://api.github.com/users/andrewor14/followers","following_url":"https://api.github.com/users/andrewor14/following{/other_user}","gists_url":"https://api.github.com/users/andrewor14/gists{/gist_id}","starred_url":"https://api.github.com/users/andrewor14/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/andrewor14/subscriptions","organizations_url":"https://api.github.com/users/andrewor14/orgs","repos_url":"https://api.github.com/users/andrewor14/repos","events_url":"https://api.github.com/users/andrewor14/events{/privacy}","received_events_url":"https://api.github.com/users/andrewor14/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":6,"created_at":"2015-12-01T23:48:59Z","updated_at":"2015-12-02T00:49:18Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/apache/spark/pulls/10081","html_url":"https://github.com/apache/spark/pull/10081","diff_url":"https://github.com/apache/spark/pull/10081.diff","patch_url":"https://github.com/apache/spark/pull/10081.patch"},"body":"The existing `spark.memory.fraction` (default 0.75) gives the system 25% of the space to work with. For small heaps, this is not enough: e.g. default 1GB leaves only 250MB system memory. This is especially a problem in local mode, where the driver and executor are crammed in the same JVM. Members of the community have reported driver OOM's in such cases.\r\n\r\n**New proposal.** We now reserve 300MB before taking the 75%. For 1GB JVMs, this leaves `(1024 - 300) * 0.75 = 543MB` for execution and storage. This is proposal (1) listed in the [JIRA](https://issues.apache.org/jira/browse/SPARK-12081)."},"comment":{"url":"https://api.github.com/repos/apache/spark/issues/comments/161143969","html_url":"https://github.com/apache/spark/pull/10081#issuecomment-161143969","issue_url":"https://api.github.com/repos/apache/spark/issues/10081","id":161143969,"user":{"login":"SparkQA","id":8108735,"avatar_url":"https://avatars.githubusercontent.com/u/8108735?v=3","gravatar_id":"","url":"https://api.github.com/users/SparkQA","html_url":"https://github.com/SparkQA","followers_url":"https://api.github.com/users/SparkQA/followers","following_url":"https://api.github.com/users/SparkQA/following{/other_user}","gists_url":"https://api.github.com/users/SparkQA/gists{/gist_id}","starred_url":"https://api.github.com/users/SparkQA/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/SparkQA/subscriptions","organizations_url":"https://api.github.com/users/SparkQA/orgs","repos_url":"https://api.github.com/users/SparkQA/repos","events_url":"https://api.github.com/users/SparkQA/events{/privacy}","received_events_url":"https://api.github.com/users/SparkQA/received_events","type":"User","site_admin":false},"created_at":"2015-12-02T00:49:18Z","updated_at":"2015-12-02T00:49:18Z","body":"**[Test build #2140 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2140/consoleFull)** for PR 10081 at commit [`1571877`](https://github.com/apache/spark/commit/15718776665db6ebff463587e726bb1e704dabc7)."}}