{"action":"created","issue":{"url":"https://api.github.com/repos/mesos/kafka/issues/94","labels_url":"https://api.github.com/repos/mesos/kafka/issues/94/labels{/name}","comments_url":"https://api.github.com/repos/mesos/kafka/issues/94/comments","events_url":"https://api.github.com/repos/mesos/kafka/issues/94/events","html_url":"https://github.com/mesos/kafka/issues/94","id":98856003,"number":94,"title":"Kafka brokers are getting lost","user":{"login":"echinthaka","id":1459631,"avatar_url":"https://avatars.githubusercontent.com/u/1459631?v=3","gravatar_id":"","url":"https://api.github.com/users/echinthaka","html_url":"https://github.com/echinthaka","followers_url":"https://api.github.com/users/echinthaka/followers","following_url":"https://api.github.com/users/echinthaka/following{/other_user}","gists_url":"https://api.github.com/users/echinthaka/gists{/gist_id}","starred_url":"https://api.github.com/users/echinthaka/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/echinthaka/subscriptions","organizations_url":"https://api.github.com/users/echinthaka/orgs","repos_url":"https://api.github.com/users/echinthaka/repos","events_url":"https://api.github.com/users/echinthaka/events{/privacy}","received_events_url":"https://api.github.com/users/echinthaka/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":7,"created_at":"2015-08-03T23:22:44Z","updated_at":"2015-08-04T19:54:04Z","closed_at":null,"body":"I'm trying to run Kafka scheduler within Marathon with the following job description. I was able to get the scheduler working but the brokers come up but keep getting lost (as seen in the scheduler log and mesos dashboard). What am I doing wrong here. Please note that in my cluster, mesos-master node will never run mesos-slave role. \r\n\r\n```\r\n{\r\n  \"id\": \"/platform/kafka\",\r\n  \"instances\": 1, \r\n  \"cpus\": 2,\r\n  \"mem\": 2048,\r\n  \"ports\": [8000],\r\n  \"container\": {\r\n        \"type\": \"DOCKER\",\r\n        \"docker\": {\r\n            \"image\": \"private-registry/kafka-mesos:201508032203\",\r\n            \"forcePullImage\": true,\r\n            \"network\": \"HOST\"\r\n        }\r\n  },  \r\n  \"healthChecks\": [\r\n    {\"path\": \"/api\", \"protocol\": \"HTTP\"}\r\n  ],\r\n \"env\": {\r\n        \"MESOS_NATIVE_JAVA_LIBRARY\": \"/usr/local/lib/libmesos.so\"\r\n  },\r\n  \"cmd\": \"cd /kafka-mesos && ./kafka-mesos.sh scheduler --storage zk:/mesos-kafka --master zk://<zk-node>:2181/mesos --zk <zk-node>:2181 --api http://$HOSTNAME:8000\"\r\n}\r\n```\r\n\r\nAlso, the instructions (here)[https://github.com/mesos/kafka/tree/master/src/docker#running-image-in-marathon] suggests to set the api as `master:7000` but I can not do it since I don't have mesos running as a slave too in mesos master node. Hence, I had to use `$HOSTNAME` to get the slave this will get scheduled. \r\n\r\nReally appreciate if someone can help to fix this issue."},"comment":{"url":"https://api.github.com/repos/mesos/kafka/issues/comments/127735510","html_url":"https://github.com/mesos/kafka/issues/94#issuecomment-127735510","issue_url":"https://api.github.com/repos/mesos/kafka/issues/94","id":127735510,"user":{"login":"dmitrypekar","id":2434593,"avatar_url":"https://avatars.githubusercontent.com/u/2434593?v=3","gravatar_id":"","url":"https://api.github.com/users/dmitrypekar","html_url":"https://github.com/dmitrypekar","followers_url":"https://api.github.com/users/dmitrypekar/followers","following_url":"https://api.github.com/users/dmitrypekar/following{/other_user}","gists_url":"https://api.github.com/users/dmitrypekar/gists{/gist_id}","starred_url":"https://api.github.com/users/dmitrypekar/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/dmitrypekar/subscriptions","organizations_url":"https://api.github.com/users/dmitrypekar/orgs","repos_url":"https://api.github.com/users/dmitrypekar/repos","events_url":"https://api.github.com/users/dmitrypekar/events{/privacy}","received_events_url":"https://api.github.com/users/dmitrypekar/received_events","type":"User","site_admin":false},"created_at":"2015-08-04T19:54:04Z","updated_at":"2015-08-04T19:54:04Z","body":"Can you please check logs /var/log/syslog on host on which broker is lost? It could be that there is some mesos-related error, like failed to chown sandbox directory or some other. "}}