{"push_id":624702400,"size":2,"distinct_size":2,"ref":"refs/heads/master","head":"6f0d55d76f758d217fd18ffa0ccf273d7ab0377b","before":"e40ea8742a8771ecd46b182f45b5fcd8bd6dd725","commits":[{"sha":"a0846c4b635eac8d8637c83d490177f881952d27","author":{"email":"e5dd8a3899598b2e85930c5ff06b11c053ef654f@databricks.com","name":"Josh Rosen"},"message":"[SPARK-6716] Change SparkContext.DRIVER_IDENTIFIER from <driver> to driver\n\nCurrently, the driver's executorId is set to `<driver>`. This choice of ID was present in older Spark versions, but it has started to cause problems now that executorIds are used in more contexts, such as Ganglia metric names or driver thread-dump links the web UI. The angle brackets must be escaped when embedding this ID in XML or as part of URLs and this has led to multiple problems:\n\n- https://issues.apache.org/jira/browse/SPARK-6484\n- https://issues.apache.org/jira/browse/SPARK-4313\n\nThe simplest solution seems to be to change this id to something that does not contain any special characters, such as `driver`.\n\nI'm not sure whether we can perform this change in a patch release, since this ID may be considered a stable API by metrics users, but it's probably okay to do this in a major release as long as we document it in the release notes.\n\nAuthor: Josh Rosen <joshrosen@databricks.com>\n\nCloses #5372 from JoshRosen/driver-id-fix and squashes the following commits:\n\n42d3c10 [Josh Rosen] Clarify comment\n0c5d04b [Josh Rosen] Add backwards-compatibility in BlockManagerId.isDriver\n7ff12e0 [Josh Rosen] Change SparkContext.DRIVER_IDENTIFIER from <driver> to driver","distinct":true,"url":"https://api.github.com/repos/AlpineNow/spark/commits/a0846c4b635eac8d8637c83d490177f881952d27"},{"sha":"6f0d55d76f758d217fd18ffa0ccf273d7ab0377b","author":{"email":"bb4f0116d076ed248df3e00cffa3248df7b031c5@twitch.tv","name":"Matt Aasted"},"message":"[SPARK-6636] Use public DNS hostname everywhere in spark_ec2.py\n\nThe spark_ec2.py script uses public_dns_name everywhere in the script except for testing ssh availability, which is done using the public ip address of the instances. This breaks the script for users who are deploying the cluster with a private-network-only security group. The fix is to use public_dns_name in the remaining place.\n\nAuthor: Matt Aasted <aasted@twitch.tv>\n\nCloses #5302 from aasted/master and squashes the following commits:\n\n60cf6ee [Matt Aasted] [SPARK-6636] Use public DNS hostname everywhere in spark_ec2.py","distinct":true,"url":"https://api.github.com/repos/AlpineNow/spark/commits/6f0d55d76f758d217fd18ffa0ccf273d7ab0377b"}]}