{"action":"created","issue":{"url":"https://api.github.com/repos/kubernetes/kubernetes/issues/15228","labels_url":"https://api.github.com/repos/kubernetes/kubernetes/issues/15228/labels{/name}","comments_url":"https://api.github.com/repos/kubernetes/kubernetes/issues/15228/comments","events_url":"https://api.github.com/repos/kubernetes/kubernetes/issues/15228/events","html_url":"https://github.com/kubernetes/kubernetes/pull/15228","id":110233898,"number":15228,"title":"Use [Conformance] to tag conformance tests","user":{"login":"sttts","id":730123,"avatar_url":"https://avatars.githubusercontent.com/u/730123?v=3","gravatar_id":"","url":"https://api.github.com/users/sttts","html_url":"https://github.com/sttts","followers_url":"https://api.github.com/users/sttts/followers","following_url":"https://api.github.com/users/sttts/following{/other_user}","gists_url":"https://api.github.com/users/sttts/gists{/gist_id}","starred_url":"https://api.github.com/users/sttts/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/sttts/subscriptions","organizations_url":"https://api.github.com/users/sttts/orgs","repos_url":"https://api.github.com/users/sttts/repos","events_url":"https://api.github.com/users/sttts/events{/privacy}","received_events_url":"https://api.github.com/users/sttts/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/kubernetes/kubernetes/labels/area/test","name":"area/test","color":"fad8c7"},{"url":"https://api.github.com/repos/kubernetes/kubernetes/labels/cla:%20yes","name":"cla: yes","color":"bfe5bf"},{"url":"https://api.github.com/repos/kubernetes/kubernetes/labels/size/L","name":"size/L","color":"ee9900"},{"url":"https://api.github.com/repos/kubernetes/kubernetes/labels/team/test-infra","name":"team/test-infra","color":"d2b48c"}],"state":"open","locked":false,"assignee":{"login":"quinton-hoole","id":10390785,"avatar_url":"https://avatars.githubusercontent.com/u/10390785?v=3","gravatar_id":"","url":"https://api.github.com/users/quinton-hoole","html_url":"https://github.com/quinton-hoole","followers_url":"https://api.github.com/users/quinton-hoole/followers","following_url":"https://api.github.com/users/quinton-hoole/following{/other_user}","gists_url":"https://api.github.com/users/quinton-hoole/gists{/gist_id}","starred_url":"https://api.github.com/users/quinton-hoole/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/quinton-hoole/subscriptions","organizations_url":"https://api.github.com/users/quinton-hoole/orgs","repos_url":"https://api.github.com/users/quinton-hoole/repos","events_url":"https://api.github.com/users/quinton-hoole/events{/privacy}","received_events_url":"https://api.github.com/users/quinton-hoole/received_events","type":"User","site_admin":false},"milestone":null,"comments":22,"created_at":"2015-10-07T14:10:35Z","updated_at":"2015-10-09T17:04:17Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/kubernetes/kubernetes/pulls/15228","html_url":"https://github.com/kubernetes/kubernetes/pull/15228","diff_url":"https://github.com/kubernetes/kubernetes/pull/15228.diff","patch_url":"https://github.com/kubernetes/kubernetes/pull/15228.patch"},"body":"This PR removes the blacklist in hack/conformance-test.sh and replaces it with tagging in the description of the conformance tests themselves. I.e. conformance tests are selected using a white list.\r\n\r\nTODO:\r\n- [x] compare with previous master conformance test selection\r\n- [x] compare with v1 test selection and create a diff for review\r\n- [ ] get somebody to review the new conformance tests compared to v1\r\n\r\nChanges from conformance-v1 to this PR:\r\n```diff\r\n--- filter-conformance-v1.txt\t2015-10-07 20:46:17.000000000 +0100\r\n+++ sorted-conformance-tag.txt\t2015-10-08 14:39:19.000000000 +0100\r\n@@ -3,18 +3,44 @@\r\n Docker Containers should be able to override the image's default commmand (docker entrypoint)\r\n Docker Containers should use the image defaults if command and args are blank\r\n Downward API should provide pod name and namespace as env vars\r\n-EmptyDir volumes should have the correct mode\r\n-EmptyDir volumes should support r/w\r\n+Downward API volume should provide labels and annotations files\r\n+EmptyDir volumes should support (non-root,0644,default)\r\n+EmptyDir volumes should support (non-root,0644,tmpfs)\r\n+EmptyDir volumes should support (non-root,0666,default)\r\n+EmptyDir volumes should support (non-root,0666,tmpfs)\r\n+EmptyDir volumes should support (non-root,0777,default)\r\n+EmptyDir volumes should support (non-root,0777,tmpfs)\r\n+EmptyDir volumes should support (root,0644,default)\r\n+EmptyDir volumes should support (root,0644,tmpfs)\r\n+EmptyDir volumes should support (root,0666,default)\r\n+EmptyDir volumes should support (root,0666,tmpfs)\r\n+EmptyDir volumes should support (root,0777,default)\r\n+EmptyDir volumes should support (root,0777,tmpfs)\r\n+EmptyDir volumes volume on default medium should have the correct mode\r\n+EmptyDir volumes volume on tmpfs should have the correct mode\r\n Events should be sent by kubelets and the scheduler about pods scheduling and running\r\n+Examples e2e [Example]ClusterDns should create pod that uses dns\r\n Kubectl client Guestbook application should create and stop a working application\r\n+Kubectl client Kubectl api-versions should check if v1 is in available api versions\r\n+Kubectl client Kubectl cluster-info should check if Kubernetes master services is included in cluster-info\r\n+Kubectl client Kubectl describe should check if kubectl describe prints relevant information for rc and pods\r\n+Kubectl client Kubectl expose should create services for rc\r\n+Kubectl client Kubectl label should update the label on a resource\r\n+Kubectl client Kubectl logs should be able to retrieve and filter logs\r\n+Kubectl client Kubectl patch should add annotations for pods in rc\r\n+Kubectl client Kubectl run pod should create a pod from an image when restart is Never\r\n+Kubectl client Kubectl run pod should create a pod from an image when restart is OnFailure\r\n+Kubectl client Kubectl run rc should create an rc from an image\r\n+Kubectl client Kubectl version should check is all data is printed\r\n+Kubectl client Proxy server should support --unix-socket=/path\r\n+Kubectl client Proxy server should support proxy with --port 0\r\n Kubectl client Update Demo should create and stop a replication controller\r\n Kubectl client Update Demo should do a rolling update of a replication controller\r\n Kubectl client Update Demo should scale a replication controller\r\n Networking should function for intra-pod communication\r\n Networking should provide Internet connection for containers\r\n Networking should provide unchanging, static URL paths for kubernetes api services\r\n+Pods should *not* be restarted with a /healthz http liveness probe\r\n Pods should *not* be restarted with a docker exec \"cat /tmp/health\" liveness probe\r\n Pods should be restarted with a /healthz http liveness probe\r\n Pods should be restarted with a docker exec \"cat /tmp/health\" liveness probe\r\n@@ -23,6 +49,10 @@\r\n Pods should be updated\r\n Pods should contain environment variables for services\r\n Pods should get a host IP\r\n+Pods should have monotonically increasing restart count\r\n+Port forwarding With a server that expects a client request should support a client that connects, sends data, and disconnects\r\n+Port forwarding With a server that expects a client request should support a client that connects, sends no data, and disconnects\r\n+Port forwarding With a server that expects no client request should support a client that connects, sends no data, and disconnects\r\n PreStop should call prestop when killing a pod\r\n Probing container with readiness probe should not be ready before initial delay and never restart\r\n Probing container with readiness probe that fails should never be ready and never restart\r\n@@ -30,17 +60,19 @@\r\n Proxy version v1 should proxy logs on node with explicit kubelet port\r\n Proxy version v1 should proxy through a service and a pod\r\n Proxy version v1 should proxy to cadvisor\r\n ReplicationController should serve a basic image on each replica with a public image\r\n+SchedulerPredicates validates resource limits of pods that are allowed to run\r\n+SchedulerPredicates validates that NodeSelector is respected if matching\r\n+SchedulerPredicates validates that NodeSelector is respected if not matching\r\n Secrets should be consumable from pods\r\n Service endpoints latency should not be very high\r\n ServiceAccounts should mount an API token into pods\r\n Services should provide secure master service\r\n Services should serve a basic endpoint from pods\r\n Services should serve multiport endpoints from pods\r\n Variable Expansion should allow composing env vars into new env vars\r\n Variable Expansion should allow substituting values in a container's args\r\n Variable Expansion should allow substituting values in a container's command\r\n-hostDir should give a volume the correct mode\r\n-hostDir should support r/w on tmpfs\r\n+hostPath should give a volume the correct mode\r\n+hostPath should support r/w\r\n+kube-ui should check that the kube-ui instance is alive\r\n```\r\n"},"comment":{"url":"https://api.github.com/repos/kubernetes/kubernetes/issues/comments/146933014","html_url":"https://github.com/kubernetes/kubernetes/pull/15228#issuecomment-146933014","issue_url":"https://api.github.com/repos/kubernetes/kubernetes/issues/15228","id":146933014,"user":{"login":"k8s-bot","id":12551979,"avatar_url":"https://avatars.githubusercontent.com/u/12551979?v=3","gravatar_id":"","url":"https://api.github.com/users/k8s-bot","html_url":"https://github.com/k8s-bot","followers_url":"https://api.github.com/users/k8s-bot/followers","following_url":"https://api.github.com/users/k8s-bot/following{/other_user}","gists_url":"https://api.github.com/users/k8s-bot/gists{/gist_id}","starred_url":"https://api.github.com/users/k8s-bot/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/k8s-bot/subscriptions","organizations_url":"https://api.github.com/users/k8s-bot/orgs","repos_url":"https://api.github.com/users/k8s-bot/repos","events_url":"https://api.github.com/users/k8s-bot/events{/privacy}","received_events_url":"https://api.github.com/users/k8s-bot/received_events","type":"User","site_admin":false},"created_at":"2015-10-09T17:04:17Z","updated_at":"2015-10-09T17:04:17Z","body":"GCE e2e test build/test **passed** for commit 9fa384a619c4009caf26193880e507839b55ca2e.\n* [Build Log](https://storage.cloud.google.com/kubernetes-jenkins/pr-logs/9fa384a619c4009caf26193880e507839b55ca2e/kubernetes-pull-build-test-e2e-gce/12092/build-log.txt)\n* [Test Artifacts](https://console.developers.google.com/storage/browser/kubernetes-jenkins/pr-logs/9fa384a619c4009caf26193880e507839b55ca2e/kubernetes-pull-build-test-e2e-gce/12092/_artifacts/)\n* [Internal Jenkins Results](http://goto.google.com/prkubekins/job/kubernetes-pull-build-test-e2e-gce//12092)\n"}}