{"push_id":889350035,"size":1,"distinct_size":1,"ref":"refs/heads/branch-1.6","head":"bf8b95fa45f52a621d13333080516d62b690a022","before":"4c84f6e91d61a358c179b04bf6d1bc8b9559b6d0","commits":[{"sha":"bf8b95fa45f52a621d13333080516d62b690a022","author":{"email":"02e0a999c50b1f88df7a8f5a04e1b76b35ea6a88@databricks.com","name":"Andrew Or"},"message":"[SPARK-12108] Make event logs smaller\n\n**Problem.** Event logs in 1.6 were much bigger than 1.5. I ran page rank and the event log size in 1.6 was almost 5x that in 1.5. I did a bisect to find that the RDD callsite added in #9398 is largely responsible for this.\n\n**Solution.** This patch removes the long form of the callsite (which is not used!) from the event log. This reduces the size of the event log significantly.\n\n*Note on compatibility*: if this patch is to be merged into 1.6.0, then it won't break any compatibility. Otherwise, if it is merged into 1.6.1, then we might need to add more backward compatibility handling logic (currently does not exist yet).\n\nAuthor: Andrew Or <andrew@databricks.com>\n\nCloses #10115 from andrewor14/smaller-event-logs.\n\n(cherry picked from commit 688e521c2833a00069272a6749153d721a0996f6)\nSigned-off-by: Andrew Or <andrew@databricks.com>","distinct":true,"url":"https://api.github.com/repos/apache/spark/commits/bf8b95fa45f52a621d13333080516d62b690a022"}]}