{"action":"created","issue":{"url":"https://api.github.com/repos/kubernetes/kubernetes/issues/12723","labels_url":"https://api.github.com/repos/kubernetes/kubernetes/issues/12723/labels{/name}","comments_url":"https://api.github.com/repos/kubernetes/kubernetes/issues/12723/comments","events_url":"https://api.github.com/repos/kubernetes/kubernetes/issues/12723/events","html_url":"https://github.com/kubernetes/kubernetes/issues/12723","id":101002555,"number":12723,"title":"Strange Behavior when creating pods and RC v1.0.1","user":{"login":"kgrvamsi","id":1199031,"avatar_url":"https://avatars.githubusercontent.com/u/1199031?v=3","gravatar_id":"","url":"https://api.github.com/users/kgrvamsi","html_url":"https://github.com/kgrvamsi","followers_url":"https://api.github.com/users/kgrvamsi/followers","following_url":"https://api.github.com/users/kgrvamsi/following{/other_user}","gists_url":"https://api.github.com/users/kgrvamsi/gists{/gist_id}","starred_url":"https://api.github.com/users/kgrvamsi/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/kgrvamsi/subscriptions","organizations_url":"https://api.github.com/users/kgrvamsi/orgs","repos_url":"https://api.github.com/users/kgrvamsi/repos","events_url":"https://api.github.com/users/kgrvamsi/events{/privacy}","received_events_url":"https://api.github.com/users/kgrvamsi/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"milestone":null,"comments":3,"created_at":"2015-08-14T12:38:10Z","updated_at":"2015-08-17T06:27:03Z","closed_at":"2015-08-14T18:57:09Z","body":"Configuration\r\n\r\nVersion\r\n\r\n    core@ip-10-20-30-35 / $ kube-apiserver --version\r\n    Kubernetes v1.0.1\r\n\r\nComponents Health\r\n\r\n    core@ip-10-20-30-35 ~ $ kubectl get cs\r\n    NAME                 STATUS    MESSAGE              ERROR\r\n    controller-manager   Healthy   ok                   nil\r\n    scheduler            Healthy   ok                   nil\r\n    etcd-0               Healthy   {\"health\": \"true\"}   nil\r\n\r\n\r\nEnvironment Variables\r\n\r\n    KUBE_APISERVER_OPTS=\"--bind-address=0.0.0.0 \\\r\n     --address=0.0.0.0 \\\r\n     --etcd_servers=http://10.20.30.35:4001 \\\r\n     --service-cluster-ip-range=10.200.0.0/16 \\\r\n     --etcd-prefix=\"/cluster1/username/registry\" \\\r\n     --logtostderr=true \\\r\n      --profiling=true \\\r\n      --insecure-port=8080 \\\r\n      --v=2\"\r\n     \r\n    KUBE_CONTROLLER_MANAGER_OPTS=\"--logtostderr=true \\\r\n     --master=http://0.0.0.0:8080 \\\r\n     --v=2\"\r\n\r\n    KUBE_SCHEDULER_OPTS=\"--logtostderr=true \\\r\n    --master=http://0.0.0.0:8080 \\\r\n    --v=2\"\r\n\r\nETCD Output\r\n\r\n    core@ip-10-20-30-35 ~ $ etcdctl -C=http://10.20.30.35:4001 ls --recursive\r\n    /cluster1\r\n    /cluster1/username\r\n    /cluster1/username/registry\r\n    /cluster1/username/registry/namespaces\r\n    /cluster1/username/registry/namespaces/default\r\n    /cluster1/username/registry/ranges\r\n    /cluster1/username/registry/ranges/servicenodeports\r\n    /cluster1/username/registry/ranges/serviceips\r\n    /cluster1/username/registry/services\r\n    /cluster1/username/registry/services/endpoints\r\n    /cluster1/username/registry/services/endpoints/default\r\n    /cluster1/username/registry/services/endpoints/default/kubernetes\r\n    /cluster1/username/registry/services/specs\r\n    /cluster1/username/registry/services/specs/default\r\n    /cluster1/username/registry/services/specs/default/kubernetes\r\n    /cluster1/username/registry++--logtostderr=true++--profiling=true++--insecure-port=8080++--v=2\r\n    /cluster1/username/registry++--logtostderr=true++--profiling=true++--insecure-port=8080++--v=2/events\r\n    /cluster1/username/registry++--logtostderr=true++--profiling=true++--insecure-port=8080++--v=2/events/default\r\n    /cluster1/username/registry++--logtostderr=true++--profiling=true++--insecure-port=8080++--v=2/minions\r\n    /cluster1/username/registry++--logtostderr=true++--profiling=true++--insecure-port=8080++--v=2/minions/ip-10-20-30-34.ec2.internal\r\n    /cluster1/username/registry++--logtostderr=true++--profiling=true++--insecure-port=8080++--v=2/minions/ip-10-20-30-36.ec2.internal\r\n    /cluster1/username/registry++--logtostderr=true++--profiling=true++--insecure-port=8080++--v=2/minions/ip-10-20-30-37.ec2.internal\r\n    /cluster1/username/registry++--logtostderr=true++--profiling=true++--insecure-port=8080++--v=2/namespaces\r\n    /cluster1/username/registry++--logtostderr=true++--profiling=true++--insecure-port=8080++--v=2/namespaces/default\r\n    /cluster1/username/registry++--logtostderr=true++--profiling=true++--insecure-port=8080++--v=2/ranges\r\n    /cluster1/username/registry++--logtostderr=true++--profiling=true++--insecure-port=8080++--v=2/ranges/serviceips\r\n    /cluster1/username/registry++--logtostderr=true++--profiling=true++--insecure-port=8080++--v=2/ranges/servicenodeports\r\n    /cluster1/username/registry++--logtostderr=true++--profiling=true++--insecure-port=8080++--v=2/services\r\n    /cluster1/username/registry++--logtostderr=true++--profiling=true++--insecure-port=8080++--v=2/services/endpoints\r\n    /cluster1/username/registry++--logtostderr=true++--profiling=true++--insecure-port=8080++--v=2/services/endpoints/default\r\n    /cluster1/username/registry++--logtostderr=true++--profiling=true++--insecure-port=8080++--v=2/services/endpoints/default/kubernetes\r\n    /cluster1/username/registry++--logtostderr=true++--profiling=true++--insecure-port=8080++--v=2/services/specs\r\n    /cluster1/username/registry++--logtostderr=true++--profiling=true++--insecure-port=8080++--v=2/services/specs/default\r\n    /cluster1/username/registry++--logtostderr=true++--profiling=true++--insecure-port=8080++--v=2/services/specs/default/kubernetes\r\n    /cluster1/username/registry++--logtostderr=true++--profiling=true++--insecure-port=8080++--v=2/controllers\r\n    /cluster1/username/registry++--logtostderr=true++--profiling=true++--insecure-port=8080++--v=2/controllers/default\r\n    /cluster1/username/registry++--logtostderr=true++--profiling=true++--insecure-port=8080++--v=2/controllers/default/nginx\r\n    /cluster1/username/registry++--logtostderr=true++--profiling=true++--insecure-port=8080++--v=2/pods\r\n    /cluster1/username/registry++--logtostderr=true++--profiling=true++--insecure-port=8080++--v=2/pods/default\r\n    /cluster1/username/registry++--logtostderr=true++--profiling=true++--insecure-port=8080++--v=2/pods/default/testing\r\n    /coreos.com\r\n    /coreos.com/network\r\n    /coreos.com/network/config\r\n    /coreos.com/network/subnets\r\n    /coreos.com/network/subnets/10.10.34.0-24\r\n    /coreos.com/network/subnets/10.10.86.0-24\r\n    /coreos.com/network/subnets/10.10.87.0-24\r\n    /coreos.com/network/subnets/10.10.19.0-24\r\n    /coreos.com/updateengine\r\n    /coreos.com/updateengine/rebootlock\r\n    /coreos.com/updateengine/rebootlock/semaphore\r\n\r\nKubectl Output\r\n\r\n    core@ip-10-20-30-35 ~ $ kubectl get rc\r\n    CONTROLLER   CONTAINER(S)   IMAGE(S)       SELECTOR     REPLICAS\r\n    nginx        nginx          nginx:latest   name=nginx   3\r\n\r\n    core@ip-10-20-30-35 ~ $ kubectl get pods\r\n    NAME      READY     STATUS    RESTARTS   AGE\r\n    testing   0/1       Pending   0          30m\r\n\r\n    core@ip-10-20-30-35 ~ $ kubectl describe rc nginx\r\n    Name:           nginx\r\n    Namespace:      default\r\n    Image(s):       nginx:latest\r\n    Selector:       name=nginx\r\n    Labels:         name=nginx\r\n    Replicas:       0 current / 3 desired\r\n    Pods Status:    0 Running / 0 Waiting / 0 Succeeded / 0 Failed\r\n    No events.\r\n\r\n    core@ip-10-20-30-35 ~ $ kubectl describe pod testing\r\n    Name:                           testing\r\n    Namespace:                      default\r\n    Image(s):                       ubuntu:14.04\r\n    Node:                           /\r\n    Labels:                         <none>\r\n    Status:                         Pending\r\n    Reason:\r\n    Message:\r\n    IP:\r\n    Replication Controllers:        <none>\r\n    Containers:\r\n    messager:\r\n        Image:              ubuntu:14.04\r\n        State:              Waiting\r\n        Ready:              False\r\n        Restart Count:      0\r\n    No events.\r\n\r\nReplication Controller Template \r\n\r\n    apiVersion: v1\r\n    kind: ReplicationController\r\n    metadata:\r\n      labels:\r\n        name: nginx\r\n     name: nginx\r\n    spec:\r\n       replicas: 3\r\n    selector:\r\n     name: nginx\r\n    template:\r\n      metadata:\r\n        labels:\r\n          name: nginx\r\n      spec:\r\n        containers:\r\n          - name: nginx\r\n          image: nginx:latest\r\n          name: nginx\r\n          ports:\r\n            - containerPort: 80\r\n              name: nginx-webserver\r\n\r\nPod Template\r\n\r\n    apiVersion: v1\r\n    kind: Pod\r\n    metadata:\r\n      name: testing\r\n    spec:\r\n      containers:\r\n      - name: messager\r\n        image: \"ubuntu:14.04\"\r\n\r\nLogs -- Kube-Api Server\r\n\r\n    Aug 14 11:41:47 ip-10-20-30-35.ec2.internal systemd[1]: Starting Kubernetes API Server...\r\n    Aug 14 11:41:47 ip-10-20-30-35.ec2.internal kube-apiserver[1066]: I0814 11:41:47.401703    1066 plugins.go:69] No cloud provider specified.\r\n    Aug 14 11:41:47 ip-10-20-30-35.ec2.internal kube-apiserver[1066]: I0814 11:41:47.403225    1066 master.go:273] Node port range unspecified. Defaulting to 30000-32767.\r\n    Aug 14 11:41:47 ip-10-20-30-35.ec2.internal kube-apiserver[1066]: I0814 11:41:47.404034    1066 master.go:295] Will report 10.20.30.35 as public IP address.\r\n    Aug 14 11:41:47 ip-10-20-30-35.ec2.internal kube-apiserver[1066]: [restful] 2015/08/14 11:41:47 log.go:30: [restful/swagger] listing is available at https://10.20.30.35:6443/swaggerapi/\r\n    Aug 14 11:41:47 ip-10-20-30-35.ec2.internal kube-apiserver[1066]: [restful] 2015/08/14 11:41:47 log.go:30: [restful/swagger] https://10.20.30.35:6443/swaggerui/ is mapped to folder /swagger-ui/\r\n    Aug 14 11:41:47 ip-10-20-30-35.ec2.internal kube-apiserver[1066]: I0814 11:41:47.442892    1066 server.go:441] Serving securely on 0.0.0.0:6443\r\n    Aug 14 11:41:47 ip-10-20-30-35.ec2.internal kube-apiserver[1066]: I0814 11:41:47.443088    1066 server.go:483] Serving insecurely on 0.0.0.0:8080\r\n    Aug 14 11:41:47 ip-10-20-30-35.ec2.internal kube-apiserver[1066]: I0814 11:41:47.619194    1066 server.go:456] Using self-signed cert (/var/run/kubernetes/apiserver.crt, /var/run/kubernetes/apiserver.key)\r\n\r\nLogs -- Kube-Controller-Manager\r\n\r\n     Aug 14 12:36:27 ip-10-20-30-35.ec2.internal kube-controller-manager[1077]: E0814 12:36:27.984061    1077 nodecontroller.go:255] Error monitoring node status: the server could not find the requested resource\r\n    Aug 14 12:36:28 ip-10-20-30-35.ec2.internal kube-controller-manager[1077]: E0814 12:36:28.336139    1077 reflector.go:130] Failed to list *api.Service: the server could not find the requested resource\r\n     Aug 14 12:36:28 ip-10-20-30-35.ec2.internal kube-controller-manager[1077]: E0814 12:36:28.337197    1077 reflector.go:130] Failed to list *api.Pod: the server could not find the requested resource\r\n    Aug 14 12:36:28 ip-10-20-30-35.ec2.internal kube-controller-manager[1077]: E0814 12:36:28.337851    1077 reflector.go:130] Failed to list *api.Pod: the server could not find the requested resource\r\n    Aug 14 12:36:28 ip-10-20-30-35.ec2.internal kube-controller-manager[1077]: E0814 12:36:28.338497    1077 reflector.go:130] Failed to list *api.ReplicationController: the server could not find the requested resource\r\n     Aug 14 12:36:28 ip-10-20-30-35.ec2.internal kube-controller-manager[1077]: E0814 12:36:28.339116    1077 reflector.go:130] Failed to list *api.Namespace: the server could not find the requested resource\r\n\r\nLog-- Kube-scheduller\r\n\r\n    Aug 14 12:37:21 ip-10-20-30-35.ec2.internal kube-scheduler[1080]: E0814 12:37:21.392015    1080 reflector.go:130] Failed to list *api.Pod: the server could not find the requested resource\r\n    Aug 14 12:37:21 ip-10-20-30-35.ec2.internal kube-scheduler[1080]: E0814 12:37:21.396356    1080 reflector.go:130] Failed to list *api.Node: the server could not find the requested resource\r\n    Aug 14 12:37:22 ip-10-20-30-35.ec2.internal kube-scheduler[1080]: E0814 12:37:22.391626    1080 reflector.go:130] Failed to list *api.Service: the server could not find the requested resource\r\n    Aug 14 12:37:22 ip-10-20-30-35.ec2.internal kube-scheduler[1080]: E0814 12:37:22.392266    1080 reflector.go:130] Failed to list *api.Pod: the server could not find the requested resource\r\n    Aug 14 12:37:22 ip-10-20-30-35.ec2.internal kube-scheduler[1080]: E0814 12:37:22.392793    1080 reflector.go:130] Failed to list *api.Pod: the server could not find the requested resource\r\n    Aug 14 12:37:22 ip-10-20-30-35.ec2.internal kube-scheduler[1080]: E0814 12:37:22.396670    1080 reflector.go:130] Failed to list *api.Node: the server could not find the requested resource\r\n\r\n\r\nI have stopped all the minions connecting to the Api Server but still the output shows the minions are in ready state\r\n\r\n    core@ip-10-20-30-35 ~ $ kubectl get nodes\r\n    NAME                          LABELS                                               STATUS\r\n    ip-10-20-30-34.ec2.internal   kubernetes.io/hostname=ip-10-20-30-34.ec2.internal   Ready\r\n    ip-10-20-30-36.ec2.internal   kubernetes.io/hostname=ip-10-20-30-36.ec2.internal   Ready\r\n    ip-10-20-30-37.ec2.internal   kubernetes.io/hostname=ip-10-20-30-37.ec2.internal   Ready\r\n\r\n\r\n\r\n\r\n\r\n    \r\n\r\n\r\n    \r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n    "},"comment":{"url":"https://api.github.com/repos/kubernetes/kubernetes/issues/comments/131693808","html_url":"https://github.com/kubernetes/kubernetes/issues/12723#issuecomment-131693808","issue_url":"https://api.github.com/repos/kubernetes/kubernetes/issues/12723","id":131693808,"user":{"login":"kgrvamsi","id":1199031,"avatar_url":"https://avatars.githubusercontent.com/u/1199031?v=3","gravatar_id":"","url":"https://api.github.com/users/kgrvamsi","html_url":"https://github.com/kgrvamsi","followers_url":"https://api.github.com/users/kgrvamsi/followers","following_url":"https://api.github.com/users/kgrvamsi/following{/other_user}","gists_url":"https://api.github.com/users/kgrvamsi/gists{/gist_id}","starred_url":"https://api.github.com/users/kgrvamsi/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/kgrvamsi/subscriptions","organizations_url":"https://api.github.com/users/kgrvamsi/orgs","repos_url":"https://api.github.com/users/kgrvamsi/repos","events_url":"https://api.github.com/users/kgrvamsi/events{/privacy}","received_events_url":"https://api.github.com/users/kgrvamsi/received_events","type":"User","site_admin":false},"created_at":"2015-08-17T06:27:03Z","updated_at":"2015-08-17T06:27:03Z","body":"Today there was a new issue in one of the cluster with 1.0.1 version and all the minions went down and docker daemon went down.This issue i have raised it earlier #12269 and now will be replying with the information of the logs we have with the present state of the cluster @brendandburns  if you still feel the problem is because of the 0.0.0.0:8080 url then i dont see a point why the minons got stopped with this inreturn docker daemon also stopped as well."}}