Skip to content

Instantly share code, notes, and snippets.

@smreed

smreed/docker ps -a

Last active August 29, 2015 14:13
Show Gist options
  • Save smreed/6e6ebfab11d8ec7933a3 to your computer and use it in GitHub Desktop.
Save smreed/6e6ebfab11d8ec7933a3 to your computer and use it in GitHub Desktop.
Download ZIP
cadvisor problem on k8s 0.8.0
Raw
docker ps -a
sreed@kubernetes-minion-4:~$ sudo docker ps -a
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
6f01f5894d23 kubernetes/pause:go "/pause" 2 seconds ago k8s_net.1509ae25_cadvisor-agent.default.file_cadvisormanifes12uqn2ohido76855gdecd9roadm7l0_3af445a9
46b0e8b9a850 kubernetes/pause:go "/pause" 12 seconds ago k8s_net.1509ae25_cadvisor-agent.default.file_cadvisormanifes12uqn2ohido76855gdecd9roadm7l0_a1ca4847
7a22f825d2f8 kubernetes/pause:go "/pause" 22 seconds ago k8s_net.1509ae25_cadvisor-agent.default.file_cadvisormanifes12uqn2ohido76855gdecd9roadm7l0_96ddebf3
e9d97fa93634 kubernetes/pause:go "/pause" 32 seconds ago k8s_net.1509ae25_cadvisor-agent.default.file_cadvisormanifes12uqn2ohido76855gdecd9roadm7l0_28217a17
54ebd236816a kubernetes/pause:go "/pause" 42 seconds ago k8s_net.1509ae25_cadvisor-agent.default.file_cadvisormanifes12uqn2ohido76855gdecd9roadm7l0_af3e061a
6dcc1cf7febc kubernetes/pause:go "/pause" 52 seconds ago k8s_net.1509ae25_cadvisor-agent.default.file_cadvisormanifes12uqn2ohido76855gdecd9roadm7l0_3c3dbe83
853f1101f25d kubernetes/pause:go "/pause" About a minute ago k8s_net.1509ae25_cadvisor-agent.default.file_cadvisormanifes12uqn2ohido76855gdecd9roadm7l0_7757773c
ac8def2f6b23 kubernetes/pause:go "/pause" 19 minutes ago Up 19 minutes k8s_net.61d3abb6_bd6bc202-9a8b-11e4-af56-42010af0dcb6.default.etcd_bd6bc202-9a8b-11e4-af56-42010af0dcb6_46bf27eb
29de1bbd873c kubernetes/pause:go "/pause" 20 minutes ago Up 20 minutes k8s_net.61d3abb6_bc1262aa-9a8b-11e4-af56-42010af0dcb6.default.etcd_bc1262aa-9a8b-11e4-af56-42010af0dcb6_65916080
f655f9838f00 kubernetes/pause:go "/pause" 23 minutes ago Up 23 minutes 0.0.0.0:6379->6379/tcp k8s_net.d21fae8c_redis-3.default.etcd_3475f3f6-9a8b-11e4-af56-42010af0dcb6_c88ec0d6
41307dc8ed5a kubernetes/fluentd-elasticsearch:latest "/bin/sh -c '/usr/sb 29 minutes ago Up 29 minutes k8s_fluentd-es.e2ed314_fluentd-to-elasticsearch.default.file_fluentdesmanife2u464h05heqcpotoddodpnehjaqsde_45ab2df2
817af3651074 kubernetes/pause:go "/pause" 30 minutes ago Up 30 minutes k8s_net.77108a9f_fluentd-to-elasticsearch.default.file_fluentdesmanife2u464h05heqcpotoddodpnehjaqsde_2ac610db
db083aa6b1b4 kubernetes/pause:go "/pause" 30 minutes ago Up 30 minutes 0.0.0.0:4194->8080/tcp k8s_net.a0f18f6e_cadvisormanifes12uqn2ohido76855gdecd9roadm7l0.default.file_cadvisormanifes12uqn2ohido76855gdecd9roadm7l0_aa970084
sreed@kubernetes-minion-4:~$
Raw
kubelet.log
This file has been truncated, but you can view the full file.
I0112 18:11:25.172242 2273 kubelet.go:157] No api servers specified.
I0112 18:11:25.172336 2273 kubelet.go:94] Connecting to docker on unix:///var/run/docker.sock
I0112 18:11:25.204646 2273 plugins.go:56] Registering credential provider: .dockercfg
I0112 18:11:25.207601 2273 event.go:62] Event(api.ObjectReference{Kind:"Minion", Namespace:"", Name:"temp-instance.c.eternal-empire-754.internal", UID:"temp-instance.c.eternal-empire-754.internal", APIVersion:"", ResourceVersion:"", FieldPath:""}): status: '', reason: 'starting' Starting kubelet.
E0112 18:11:25.209039 2273 http.go:55] Failed to read URL: http://metadata.google.internal/computeMetadata/v1beta1/instance/attributes/google-container-manifest: 404 Not Found
I0112 18:11:25.209274 2273 plugins.go:56] Registering credential provider: google-dockercfg
I0112 18:11:25.209648 2273 plugins.go:56] Registering credential provider: google-dockercfg-url
I0112 18:11:25.210003 2273 plugins.go:56] Registering credential provider: google-container-registry
E0112 18:11:25.210797 2273 kubelet.go:570] Couldn't make a ref to pod cadvisormanifes12uqn2ohido76855gdecd9roadm7l0, container net: 'unexpected self link format: ''; got version '[]''
I0112 18:11:25.211166 2273 provider.go:91] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
I0112 18:11:25.211316 2273 provider.go:91] Refreshing cache for provider: *gcp_credentials.dockerConfigKeyProvider
E0112 18:11:25.211764 2273 config.go:82] while trying to read http://metadata.google.internal./computeMetadata/v1/instance/attributes/google-dockercfg: http status code: 404 while fetching url: %!v(MISSING)
I0112 18:11:25.211781 2273 provider.go:91] Refreshing cache for provider: *gcp_credentials.dockerConfigUrlKeyProvider
E0112 18:11:25.213095 2273 config.go:82] while trying to read http://metadata.google.internal./computeMetadata/v1/instance/attributes/google-dockercfg-url: http status code: 404 while fetching url: %!v(MISSING)
E0112 18:11:28.618617 2273 kubelet.go:445] Couldn't make a ref to pod cadvisormanifes12uqn2ohido76855gdecd9roadm7l0, container net: 'unexpected self link format: ''; got version '[]''
E0112 18:11:28.972198 2273 kubelet.go:742] Couldn't make a ref to pod cadvisormanifes12uqn2ohido76855gdecd9roadm7l0, container cadvisor: 'unexpected self link format: ''; got version '[]''
E0112 18:11:40.327780 2273 kubelet.go:445] Couldn't make a ref to pod cadvisormanifes12uqn2ohido76855gdecd9roadm7l0, container cadvisor: 'unexpected self link format: ''; got version '[]''
E0112 18:11:45.021027 2273 http.go:55] Failed to read URL: http://metadata.google.internal/computeMetadata/v1beta1/instance/attributes/google-container-manifest: 404 Not Found
E0112 18:12:05.022078 2273 http.go:55] Failed to read URL: http://metadata.google.internal/computeMetadata/v1beta1/instance/attributes/google-container-manifest: 404 Not Found
E0112 18:12:25.023011 2273 http.go:55] Failed to read URL: http://metadata.google.internal/computeMetadata/v1beta1/instance/attributes/google-container-manifest: 404 Not Found
E0112 18:12:45.024034 2273 http.go:55] Failed to read URL: http://metadata.google.internal/computeMetadata/v1beta1/instance/attributes/google-container-manifest: 404 Not Found
E0112 18:13:05.025045 2273 http.go:55] Failed to read URL: http://metadata.google.internal/computeMetadata/v1beta1/instance/attributes/google-container-manifest: 404 Not Found
E0112 18:13:25.025899 2273 http.go:55] Failed to read URL: http://metadata.google.internal/computeMetadata/v1beta1/instance/attributes/google-container-manifest: 404 Not Found
E0112 18:13:45.026818 2273 http.go:55] Failed to read URL: http://metadata.google.internal/computeMetadata/v1beta1/instance/attributes/google-container-manifest: 404 Not Found
E0112 18:14:05.028156 2273 http.go:55] Failed to read URL: http://metadata.google.internal/computeMetadata/v1beta1/instance/attributes/google-container-manifest: 404 Not Found
E0112 18:14:25.029099 2273 http.go:55] Failed to read URL: http://metadata.google.internal/computeMetadata/v1beta1/instance/attributes/google-container-manifest: 404 Not Found
E0112 18:14:45.029993 2273 http.go:55] Failed to read URL: http://metadata.google.internal/computeMetadata/v1beta1/instance/attributes/google-container-manifest: 404 Not Found
E0112 18:15:05.031152 2273 http.go:55] Failed to read URL: http://metadata.google.internal/computeMetadata/v1beta1/instance/attributes/google-container-manifest: 404 Not Found
E0112 18:15:25.032028 2273 http.go:55] Failed to read URL: http://metadata.google.internal/computeMetadata/v1beta1/instance/attributes/google-container-manifest: 404 Not Found
E0112 18:15:45.033011 2273 http.go:55] Failed to read URL: http://metadata.google.internal/computeMetadata/v1beta1/instance/attributes/google-container-manifest: 404 Not Found
E0112 18:16:05.034141 2273 http.go:55] Failed to read URL: http://metadata.google.internal/computeMetadata/v1beta1/instance/attributes/google-container-manifest: 404 Not Found
E0112 18:16:25.035117 2273 http.go:55] Failed to read URL: http://metadata.google.internal/computeMetadata/v1beta1/instance/attributes/google-container-manifest: 404 Not Found
E0112 18:16:45.036089 2273 http.go:55] Failed to read URL: http://metadata.google.internal/computeMetadata/v1beta1/instance/attributes/google-container-manifest: 404 Not Found
E0112 18:17:05.037110 2273 http.go:55] Failed to read URL: http://metadata.google.internal/computeMetadata/v1beta1/instance/attributes/google-container-manifest: 404 Not Found
E0112 18:17:25.038138 2273 http.go:55] Failed to read URL: http://metadata.google.internal/computeMetadata/v1beta1/instance/attributes/google-container-manifest: 404 Not Found
E0112 18:17:45.039165 2273 http.go:55] Failed to read URL: http://metadata.google.internal/computeMetadata/v1beta1/instance/attributes/google-container-manifest: 404 Not Found
E0112 18:18:05.040583 2273 http.go:55] Failed to read URL: http://metadata.google.internal/computeMetadata/v1beta1/instance/attributes/google-container-manifest: 404 Not Found
E0112 18:18:25.041582 2273 http.go:55] Failed to read URL: http://metadata.google.internal/computeMetadata/v1beta1/instance/attributes/google-container-manifest: 404 Not Found
E0112 18:18:45.042659 2273 http.go:55] Failed to read URL: http://metadata.google.internal/computeMetadata/v1beta1/instance/attributes/google-container-manifest: 404 Not Found
E0112 18:19:05.043849 2273 http.go:55] Failed to read URL: http://metadata.google.internal/computeMetadata/v1beta1/instance/attributes/google-container-manifest: 404 Not Found
E0112 18:19:25.044853 2273 http.go:55] Failed to read URL: http://metadata.google.internal/computeMetadata/v1beta1/instance/attributes/google-container-manifest: 404 Not Found
E0112 18:19:45.046332 2273 http.go:55] Failed to read URL: http://metadata.google.internal/computeMetadata/v1beta1/instance/attributes/google-container-manifest: 404 Not Found
E0112 18:20:05.047474 2273 http.go:55] Failed to read URL: http://metadata.google.internal/computeMetadata/v1beta1/instance/attributes/google-container-manifest: 404 Not Found
E0112 18:20:25.048485 2273 http.go:55] Failed to read URL: http://metadata.google.internal/computeMetadata/v1beta1/instance/attributes/google-container-manifest: 404 Not Found
E0112 18:20:45.049556 2273 http.go:55] Failed to read URL: http://metadata.google.internal/computeMetadata/v1beta1/instance/attributes/google-container-manifest: 404 Not Found
E0112 18:21:05.050676 2273 http.go:55] Failed to read URL: http://metadata.google.internal/computeMetadata/v1beta1/instance/attributes/google-container-manifest: 404 Not Found
E0112 18:21:25.051679 2273 http.go:55] Failed to read URL: http://metadata.google.internal/computeMetadata/v1beta1/instance/attributes/google-container-manifest: 404 Not Found
I0112 18:38:42.367252 2506 kubelet.go:157] No api servers specified.
I0112 18:38:42.367340 2506 kubelet.go:94] Connecting to docker on unix:///var/run/docker.sock
I0112 18:38:42.386822 2506 event.go:62] Event(api.ObjectReference{Kind:"Minion", Namespace:"", Name:"kubernetes-minion-4.c.eternal-empire-754.internal", UID:"kubernetes-minion-4.c.eternal-empire-754.internal", APIVersion:"", ResourceVersion:"", FieldPath:""}): status: '', reason: 'starting' Starting kubelet.
I0112 18:38:42.404608 2506 plugins.go:56] Registering credential provider: google-dockercfg
E0112 18:38:42.404740 2506 http.go:55] Failed to read URL: http://metadata.google.internal/computeMetadata/v1beta1/instance/attributes/google-container-manifest: 404 Not Found
I0112 18:38:42.404976 2506 plugins.go:56] Registering credential provider: google-dockercfg-url
I0112 18:38:42.405372 2506 plugins.go:56] Registering credential provider: google-container-registry
I0112 18:38:42.405390 2506 plugins.go:56] Registering credential provider: .dockercfg
E0112 18:38:42.406295 2506 kubelet.go:570] Couldn't make a ref to pod cadvisormanifes12uqn2ohido76855gdecd9roadm7l0, container net: 'unexpected self link format: ''; got version '[]''
E0112 18:38:42.462752 2506 kubelet.go:445] Couldn't make a ref to pod cadvisormanifes12uqn2ohido76855gdecd9roadm7l0, container net: 'unexpected self link format: ''; got version '[]''
E0112 18:38:42.924044 2506 kubelet.go:742] Couldn't make a ref to pod cadvisormanifes12uqn2ohido76855gdecd9roadm7l0, container cadvisor: 'unexpected self link format: ''; got version '[]''
I0112 18:38:42.976571 2506 provider.go:91] Refreshing cache for provider: *gcp_credentials.dockerConfigKeyProvider
E0112 18:38:42.977235 2506 config.go:82] while trying to read http://metadata.google.internal./computeMetadata/v1/instance/attributes/google-dockercfg: http status code: 404 while fetching url: %!v(MISSING)
I0112 18:38:42.977263 2506 provider.go:91] Refreshing cache for provider: *gcp_credentials.dockerConfigUrlKeyProvider
E0112 18:38:42.978755 2506 config.go:82] while trying to read http://metadata.google.internal./computeMetadata/v1/instance/attributes/google-dockercfg-url: http status code: 404 while fetching url: %!v(MISSING)
I0112 18:38:42.980286 2506 provider.go:91] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
E0112 18:38:44.039661 2506 kubelet.go:445] Couldn't make a ref to pod cadvisormanifes12uqn2ohido76855gdecd9roadm7l0, container cadvisor: 'unexpected self link format: ''; got version '[]''
E0112 18:39:02.405894 2506 http.go:55] Failed to read URL: http://metadata.google.internal/computeMetadata/v1beta1/instance/attributes/google-container-manifest: 404 Not Found
E0112 18:39:12.411426 2506 kubelet.go:570] Couldn't make a ref to pod cadvisormanifes12uqn2ohido76855gdecd9roadm7l0, container net: 'unexpected self link format: ''; got version '[]''
E0112 18:39:12.413519 2506 kubelet.go:445] Couldn't make a ref to pod cadvisormanifes12uqn2ohido76855gdecd9roadm7l0, container net: 'unexpected self link format: ''; got version '[]''
E0112 18:39:12.783713 2506 kubelet.go:742] Couldn't make a ref to pod cadvisormanifes12uqn2ohido76855gdecd9roadm7l0, container cadvisor: 'unexpected self link format: ''; got version '[]''
I0112 18:39:12.878681 4877 node.go:52] Connecting to docker on unix:///var/run/docker.sock
I0112 18:39:12.880212 4877 util.go:135] Sending events to APIserver.
I0112 18:39:12.881295 4877 standalone.go:194] Adding manifest file: /etc/kubernetes/manifests
I0112 18:39:12.881327 4877 file.go:50] Watching path "/etc/kubernetes/manifests"
I0112 18:39:12.881343 4877 standalone.go:205] Watching for etcd configs at [http://10.240.220.182:4001]
I0112 18:39:12.881365 4877 etcd.go:57] Watching etcd for /registry/nodes/kubernetes-minion-4.c.eternal-empire-754.internal/boundpods
I0112 18:39:12.882429 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/cadvisor.manifest": default.cadvisor-agent (cadvisormanifes12uqn2ohido76855gdecd9roadm7l0)
I0112 18:39:12.882628 4877 util.go:42] Trying to create cadvisor client.
I0112 18:39:12.882649 4877 util.go:48] Successfully created cadvisor client.
I0112 18:39:12.882684 4877 plugins.go:56] Registering credential provider: .dockercfg
I0112 18:39:12.882742 4877 server.go:50] Starting to listen on 0.0.0.0:10250
I0112 18:39:12.885556 4877 logs.go:39] etcd DEBUG: get /registry/nodes/kubernetes-minion-4.c.eternal-empire-754.internal/boundpods [http://10.240.220.182:4001]
I0112 18:39:12.885590 4877 logs.go:39] etcd DEBUG: Connecting to etcd: attempt1forkeys/registry/nodes/kubernetes-minion-4.c.eternal-empire-754.internal/boundpods?consistent=true&recursive=false&sorted=false
I0112 18:39:12.885602 4877 logs.go:39] etcd DEBUG: send.request.to http://10.240.220.182:4001/v2/keys/registry/nodes/kubernetes-minion-4.c.eternal-empire-754.internal/boundpods?consistent=true&recursive=false&sorted=false | method GET
I0112 18:39:12.885872 4877 event.go:92] Event(api.ObjectReference{Kind:"Minion", Namespace:"default", Name:"kubernetes-minion-4.c.eternal-empire-754.internal", UID:"kubernetes-minion-4.c.eternal-empire-754.internal", APIVersion:"", ResourceVersion:"", FieldPath:""}): status: '', reason: 'starting' Starting kubelet.
I0112 18:39:12.888384 4877 plugins.go:56] Registering credential provider: google-dockercfg
I0112 18:39:12.888563 4877 logs.go:39] etcd DEBUG: recv.response.fromhttp://10.240.220.182:4001/v2/keys/registry/nodes/kubernetes-minion-4.c.eternal-empire-754.internal/boundpods?consistent=true&recursive=false&sorted=false
I0112 18:39:12.888606 4877 logs.go:39] etcd DEBUG: recv.success.http://10.240.220.182:4001/v2/keys/registry/nodes/kubernetes-minion-4.c.eternal-empire-754.internal/boundpods?consistent=true&recursive=false&sorted=false
I0112 18:39:12.888649 4877 logs.go:39] etcd DEBUG: watch /registry/nodes/kubernetes-minion-4.c.eternal-empire-754.internal/boundpods [http://10.240.220.182:4001]
I0112 18:39:12.888661 4877 logs.go:39] etcd DEBUG: get /registry/nodes/kubernetes-minion-4.c.eternal-empire-754.internal/boundpods [http://10.240.220.182:4001]
I0112 18:39:12.888686 4877 logs.go:39] etcd DEBUG: Connecting to etcd: attempt1forkeys/registry/nodes/kubernetes-minion-4.c.eternal-empire-754.internal/boundpods?consistent=true&wait=true&waitIndex=19
I0112 18:39:12.888704 4877 logs.go:39] etcd DEBUG: send.request.to http://10.240.220.182:4001/v2/keys/registry/nodes/kubernetes-minion-4.c.eternal-empire-754.internal/boundpods?consistent=true&wait=true&waitIndex=19 | method GET
I0112 18:39:12.888831 4877 plugins.go:56] Registering credential provider: google-dockercfg-url
I0112 18:39:12.889230 4877 plugins.go:56] Registering credential provider: google-container-registry
I0112 18:39:12.889356 4877 logs.go:39] etcd DEBUG: recv.response.fromhttp://10.240.220.182:4001/v2/keys/registry/nodes/kubernetes-minion-4.c.eternal-empire-754.internal/boundpods?consistent=true&wait=true&waitIndex=19
I0112 18:39:12.894298 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:39:12.930333 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:39:12.956313 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 6aa05a2992801eafa523ea72d70f2de26d5e027fb30e41f5fa73f5ba805b9987
E0112 18:39:12.988436 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 6aa05a2992801eafa523ea72d70f2de26d5e027fb30e41f5fa73f5ba805b9987: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:39:12.988497 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 6aa05a2992801eafa523ea72d70f2de26d5e027fb30e41f5fa73f5ba805b9987: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:39:12.988565 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 6aa05a2992801eafa523ea72d70f2de26d5e027fb30e41f5fa73f5ba805b9987 with error: API error (500): Cannot start container 6aa05a2992801eafa523ea72d70f2de26d5e027fb30e41f5fa73f5ba805b9987: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:39:13.005010 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 6aa05a2992801eafa523ea72d70f2de26d5e027fb30e41f5fa73f5ba805b9987: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:39:17.695436 4877 server.go:324] GET /healthz: (10.406us) 200
I0112 18:39:22.895839 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:39:22.897667 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:39:22.980553 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id f3d466e770a324d10c967e049d82f5576047d39c8fa3b0846bc0030061fb0850
E0112 18:39:23.020285 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container f3d466e770a324d10c967e049d82f5576047d39c8fa3b0846bc0030061fb0850: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:39:23.020315 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container f3d466e770a324d10c967e049d82f5576047d39c8fa3b0846bc0030061fb0850: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:39:23.020382 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id f3d466e770a324d10c967e049d82f5576047d39c8fa3b0846bc0030061fb0850 with error: API error (500): Cannot start container f3d466e770a324d10c967e049d82f5576047d39c8fa3b0846bc0030061fb0850: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:39:23.026074 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container f3d466e770a324d10c967e049d82f5576047d39c8fa3b0846bc0030061fb0850: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:39:23.451608 4877 server.go:324] GET /healthz: (10.639us) 200
I0112 18:39:27.761699 4877 server.go:324] GET /healthz: (10.952us) 200
I0112 18:39:32.883307 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/cadvisor.manifest": default.cadvisor-agent (cadvisormanifes12uqn2ohido76855gdecd9roadm7l0)
I0112 18:39:32.883568 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/fluentd-es.manifest": default.fluentd-to-elasticsearch (fluentdesmanife2u464h05heqcpotoddodpnehjaqsde)
I0112 18:39:32.888455 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:39:32.891374 4877 kubelet.go:793] Network container doesn't exist for pod "fluentd-to-elasticsearch.default.file", killing and re-creating the pod
I0112 18:39:32.892685 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:39:32.899501 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"fluentd-to-elasticsearch", UID:"fluentdesmanife2u464h05heqcpotoddodpnehjaqsde", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:39:32.958461 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 91c05c3d37751161668f3e2ccda45877484bc246add8e967e7f0afce3aa8fcf0
I0112 18:39:33.028643 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"fluentd-to-elasticsearch", UID:"fluentdesmanife2u464h05heqcpotoddodpnehjaqsde", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 817af3651074d0cd4f4a7fe78c86a1c16d99ada74afac99d916313c4645ff7d8
E0112 18:39:33.052226 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 91c05c3d37751161668f3e2ccda45877484bc246add8e967e7f0afce3aa8fcf0: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:39:33.052251 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 91c05c3d37751161668f3e2ccda45877484bc246add8e967e7f0afce3aa8fcf0: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:39:33.052410 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 91c05c3d37751161668f3e2ccda45877484bc246add8e967e7f0afce3aa8fcf0 with error: API error (500): Cannot start container 91c05c3d37751161668f3e2ccda45877484bc246add8e967e7f0afce3aa8fcf0: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:39:33.058117 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 91c05c3d37751161668f3e2ccda45877484bc246add8e967e7f0afce3aa8fcf0: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:39:33.147952 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"fluentd-to-elasticsearch", UID:"fluentdesmanife2u464h05heqcpotoddodpnehjaqsde", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'running', reason: 'started' Started with docker id 817af3651074d0cd4f4a7fe78c86a1c16d99ada74afac99d916313c4645ff7d8
I0112 18:39:33.155004 4877 provider.go:91] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
I0112 18:39:33.155028 4877 config.go:55] looking for .dockercfg at /.dockercfg
I0112 18:39:33.155093 4877 provider.go:91] Refreshing cache for provider: *gcp_credentials.dockerConfigKeyProvider
I0112 18:39:33.155638 4877 config.go:95] body of failing http response: &{0xc208110180 {0 0} false ?reflect.Value? 0x512010 0x511fa0}
E0112 18:39:33.155715 4877 metadata.go:109] while reading 'google-dockercfg' metadata: http status code: 404 while fetching url http://metadata.google.internal./computeMetadata/v1/instance/attributes/google-dockercfg
I0112 18:39:33.155729 4877 provider.go:91] Refreshing cache for provider: *gcp_credentials.dockerConfigUrlKeyProvider
I0112 18:39:33.157045 4877 config.go:95] body of failing http response: &{0xc208110300 {0 0} false ?reflect.Value? 0x512010 0x511fa0}
E0112 18:39:33.157072 4877 metadata.go:121] while reading 'google-dockercfg-url' metadata: http status code: 404 while fetching url http://metadata.google.internal./computeMetadata/v1/instance/attributes/google-dockercfg-url
I0112 18:39:33.158453 4877 docker.go:214] Pulling image kubernetes/fluentd-elasticsearch without credentials
I0112 18:39:36.407475 4877 server.go:324] GET /healthz: (12.396us) 200
I0112 18:39:37.800123 4877 server.go:324] GET /healthz: (12.144us) 200
I0112 18:39:42.924217 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:39:42.944863 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:39:43.348613 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id fc8a155fb223e28daca935b8c0048df4aa58ff0a3bd709469ca4f4d828c0a90c
E0112 18:39:43.444871 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container fc8a155fb223e28daca935b8c0048df4aa58ff0a3bd709469ca4f4d828c0a90c: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:39:43.444901 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container fc8a155fb223e28daca935b8c0048df4aa58ff0a3bd709469ca4f4d828c0a90c: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:39:43.445112 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id fc8a155fb223e28daca935b8c0048df4aa58ff0a3bd709469ca4f4d828c0a90c with error: API error (500): Cannot start container fc8a155fb223e28daca935b8c0048df4aa58ff0a3bd709469ca4f4d828c0a90c: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:39:43.445140 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container fc8a155fb223e28daca935b8c0048df4aa58ff0a3bd709469ca4f4d828c0a90c: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:39:47.841596 4877 server.go:324] GET /healthz: (12.92us) 200
I0112 18:39:49.280544 4877 server.go:324] GET /healthz: (11.559us) 200
I0112 18:39:52.884778 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/cadvisor.manifest": default.cadvisor-agent (cadvisormanifes12uqn2ohido76855gdecd9roadm7l0)
I0112 18:39:52.885207 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/fluentd-es.manifest": default.fluentd-to-elasticsearch (fluentdesmanife2u464h05heqcpotoddodpnehjaqsde)
I0112 18:39:52.959030 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:39:53.050398 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:39:53.430643 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 07d2ab7e1430d570ef62f62ff81a6c2822a5b3ac9dea48152674f4292f25972c
E0112 18:39:53.507326 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 07d2ab7e1430d570ef62f62ff81a6c2822a5b3ac9dea48152674f4292f25972c: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:39:53.507360 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 07d2ab7e1430d570ef62f62ff81a6c2822a5b3ac9dea48152674f4292f25972c: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:39:53.507606 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 07d2ab7e1430d570ef62f62ff81a6c2822a5b3ac9dea48152674f4292f25972c with error: API error (500): Cannot start container 07d2ab7e1430d570ef62f62ff81a6c2822a5b3ac9dea48152674f4292f25972c: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:39:53.513809 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 07d2ab7e1430d570ef62f62ff81a6c2822a5b3ac9dea48152674f4292f25972c: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:39:57.884185 4877 server.go:324] GET /healthz: (10.691us) 200
I0112 18:39:58.091425 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"fluentd-to-elasticsearch", UID:"fluentdesmanife2u464h05heqcpotoddodpnehjaqsde", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"spec.containers{fluentd-es}"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/fluentd-elasticsearch"
I0112 18:39:58.324476 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"fluentd-to-elasticsearch", UID:"fluentdesmanife2u464h05heqcpotoddodpnehjaqsde", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"spec.containers{fluentd-es}"}): status: 'waiting', reason: 'created' Created with docker id 41307dc8ed5a534aac59ec5046913ac0934330b28ad3acf4065ba32566be3c82
I0112 18:39:58.418986 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"fluentd-to-elasticsearch", UID:"fluentdesmanife2u464h05heqcpotoddodpnehjaqsde", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"spec.containers{fluentd-es}"}): status: 'running', reason: 'started' Started with docker id 41307dc8ed5a534aac59ec5046913ac0934330b28ad3acf4065ba32566be3c82
I0112 18:40:02.110817 4877 server.go:324] GET /healthz: (12.802us) 200
I0112 18:40:02.960970 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:40:02.964309 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:40:03.053188 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 8f73e44c2574cd52b3a4709fe198fc995c11fdd37ab3d7d3cd6aaa365f56eb74
E0112 18:40:03.083990 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 8f73e44c2574cd52b3a4709fe198fc995c11fdd37ab3d7d3cd6aaa365f56eb74: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:40:03.084025 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 8f73e44c2574cd52b3a4709fe198fc995c11fdd37ab3d7d3cd6aaa365f56eb74: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:40:03.084206 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 8f73e44c2574cd52b3a4709fe198fc995c11fdd37ab3d7d3cd6aaa365f56eb74 with error: API error (500): Cannot start container 8f73e44c2574cd52b3a4709fe198fc995c11fdd37ab3d7d3cd6aaa365f56eb74: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:40:03.089299 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 8f73e44c2574cd52b3a4709fe198fc995c11fdd37ab3d7d3cd6aaa365f56eb74: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:40:07.925923 4877 server.go:324] GET /healthz: (11.585us) 200
I0112 18:40:12.886047 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/cadvisor.manifest": default.cadvisor-agent (cadvisormanifes12uqn2ohido76855gdecd9roadm7l0)
I0112 18:40:12.886325 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/fluentd-es.manifest": default.fluentd-to-elasticsearch (fluentdesmanife2u464h05heqcpotoddodpnehjaqsde)
I0112 18:40:13.094391 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:40:13.097416 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:40:13.441428 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id a43affb447faf527ffcf4aba331ff83de64524c0ae30109cb6603f2b82835170
E0112 18:40:13.516561 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container a43affb447faf527ffcf4aba331ff83de64524c0ae30109cb6603f2b82835170: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:40:13.516618 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container a43affb447faf527ffcf4aba331ff83de64524c0ae30109cb6603f2b82835170: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:40:13.516824 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id a43affb447faf527ffcf4aba331ff83de64524c0ae30109cb6603f2b82835170 with error: API error (500): Cannot start container a43affb447faf527ffcf4aba331ff83de64524c0ae30109cb6603f2b82835170: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:40:13.522659 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container a43affb447faf527ffcf4aba331ff83de64524c0ae30109cb6603f2b82835170: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:40:15.337613 4877 server.go:324] GET /healthz: (10.462us) 200
I0112 18:40:16.687574 4877 server.go:324] GET /healthz: (10.458us) 200
I0112 18:40:17.683397 4877 server.go:324] GET /healthz: (11.184us) 200
I0112 18:40:17.685941 4877 server.go:324] GET /healthz: (5.422us) 200
I0112 18:40:17.968782 4877 server.go:324] GET /healthz: (10.911us) 200
I0112 18:40:23.096251 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:40:23.098045 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:40:23.196316 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 4340a1702c6cf297107a6d47143cc7ab8aa7613d3bd67ce45f3ead47db3de3b2
E0112 18:40:23.243854 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 4340a1702c6cf297107a6d47143cc7ab8aa7613d3bd67ce45f3ead47db3de3b2: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:40:23.243887 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 4340a1702c6cf297107a6d47143cc7ab8aa7613d3bd67ce45f3ead47db3de3b2: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:40:23.244072 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 4340a1702c6cf297107a6d47143cc7ab8aa7613d3bd67ce45f3ead47db3de3b2 with error: API error (500): Cannot start container 4340a1702c6cf297107a6d47143cc7ab8aa7613d3bd67ce45f3ead47db3de3b2: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:40:23.255565 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 4340a1702c6cf297107a6d47143cc7ab8aa7613d3bd67ce45f3ead47db3de3b2: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:40:28.015791 4877 server.go:324] GET /healthz: (11.017us) 200
I0112 18:40:28.194822 4877 server.go:324] GET /healthz: (10.752us) 200
I0112 18:40:32.887287 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/cadvisor.manifest": default.cadvisor-agent (cadvisormanifes12uqn2ohido76855gdecd9roadm7l0)
I0112 18:40:32.887566 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/fluentd-es.manifest": default.fluentd-to-elasticsearch (fluentdesmanife2u464h05heqcpotoddodpnehjaqsde)
I0112 18:40:33.098284 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:40:33.100096 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:40:33.180700 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 1966be2b0a8d5be3ff01f2e30d1ac01e14c4b2e8f5fc47156993b5fc751e208d
E0112 18:40:33.227994 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 1966be2b0a8d5be3ff01f2e30d1ac01e14c4b2e8f5fc47156993b5fc751e208d: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:40:33.228038 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 1966be2b0a8d5be3ff01f2e30d1ac01e14c4b2e8f5fc47156993b5fc751e208d: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:40:33.228167 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 1966be2b0a8d5be3ff01f2e30d1ac01e14c4b2e8f5fc47156993b5fc751e208d with error: API error (500): Cannot start container 1966be2b0a8d5be3ff01f2e30d1ac01e14c4b2e8f5fc47156993b5fc751e208d: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:40:33.232968 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 1966be2b0a8d5be3ff01f2e30d1ac01e14c4b2e8f5fc47156993b5fc751e208d: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:40:38.051430 4877 server.go:324] GET /healthz: (10.056us) 200
I0112 18:40:41.089846 4877 server.go:324] GET /healthz: (10.734us) 200
I0112 18:40:43.100268 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:40:43.102351 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:40:43.196635 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 1898e0826a42cb51b9da04b80c82a73726b789c4e1f801ff4c7e750bf9b2ac4c
E0112 18:40:43.236541 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 1898e0826a42cb51b9da04b80c82a73726b789c4e1f801ff4c7e750bf9b2ac4c: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:40:43.236583 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 1898e0826a42cb51b9da04b80c82a73726b789c4e1f801ff4c7e750bf9b2ac4c: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:40:43.236804 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 1898e0826a42cb51b9da04b80c82a73726b789c4e1f801ff4c7e750bf9b2ac4c with error: API error (500): Cannot start container 1898e0826a42cb51b9da04b80c82a73726b789c4e1f801ff4c7e750bf9b2ac4c: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:40:43.242993 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 1898e0826a42cb51b9da04b80c82a73726b789c4e1f801ff4c7e750bf9b2ac4c: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:40:48.091184 4877 server.go:324] GET /healthz: (22.562us) 200
I0112 18:40:52.888328 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/cadvisor.manifest": default.cadvisor-agent (cadvisormanifes12uqn2ohido76855gdecd9roadm7l0)
I0112 18:40:52.888624 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/fluentd-es.manifest": default.fluentd-to-elasticsearch (fluentdesmanife2u464h05heqcpotoddodpnehjaqsde)
I0112 18:40:53.102439 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:40:53.104481 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:40:53.212999 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 969f405bffd7d300a6238d6c33e2dbdce4b7d4cb532d0edbf44b7a44fd8fcd53
E0112 18:40:53.260995 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 969f405bffd7d300a6238d6c33e2dbdce4b7d4cb532d0edbf44b7a44fd8fcd53: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:40:53.261037 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 969f405bffd7d300a6238d6c33e2dbdce4b7d4cb532d0edbf44b7a44fd8fcd53: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:40:53.261254 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 969f405bffd7d300a6238d6c33e2dbdce4b7d4cb532d0edbf44b7a44fd8fcd53 with error: API error (500): Cannot start container 969f405bffd7d300a6238d6c33e2dbdce4b7d4cb532d0edbf44b7a44fd8fcd53: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:40:53.267881 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 969f405bffd7d300a6238d6c33e2dbdce4b7d4cb532d0edbf44b7a44fd8fcd53: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:40:54.953163 4877 server.go:324] GET /healthz: (13.469us) 200
I0112 18:40:58.132329 4877 server.go:324] GET /healthz: (10.133us) 200
I0112 18:41:03.105224 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:41:03.107174 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:41:03.188076 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id b1c5a5a1cc293eaab1d16de778ec702ca3172b6df07a96c2ff12c270c380a0b8
E0112 18:41:03.244098 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container b1c5a5a1cc293eaab1d16de778ec702ca3172b6df07a96c2ff12c270c380a0b8: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:41:03.244139 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container b1c5a5a1cc293eaab1d16de778ec702ca3172b6df07a96c2ff12c270c380a0b8: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:41:03.244359 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id b1c5a5a1cc293eaab1d16de778ec702ca3172b6df07a96c2ff12c270c380a0b8 with error: API error (500): Cannot start container b1c5a5a1cc293eaab1d16de778ec702ca3172b6df07a96c2ff12c270c380a0b8: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:41:03.250207 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container b1c5a5a1cc293eaab1d16de778ec702ca3172b6df07a96c2ff12c270c380a0b8: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:41:07.945256 4877 server.go:324] GET /healthz: (11.107us) 200
I0112 18:41:08.174455 4877 server.go:324] GET /healthz: (10.768us) 200
I0112 18:41:12.889338 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/cadvisor.manifest": default.cadvisor-agent (cadvisormanifes12uqn2ohido76855gdecd9roadm7l0)
I0112 18:41:12.889799 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/fluentd-es.manifest": default.fluentd-to-elasticsearch (fluentdesmanife2u464h05heqcpotoddodpnehjaqsde)
I0112 18:41:13.109916 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:41:13.118864 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:41:13.188616 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 0ff3cd4a9b00927e890744185eca6cfc8b55f6beeb444c691f9afce586e664d4
E0112 18:41:13.228222 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 0ff3cd4a9b00927e890744185eca6cfc8b55f6beeb444c691f9afce586e664d4: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:41:13.228276 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 0ff3cd4a9b00927e890744185eca6cfc8b55f6beeb444c691f9afce586e664d4: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:41:13.228623 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 0ff3cd4a9b00927e890744185eca6cfc8b55f6beeb444c691f9afce586e664d4 with error: API error (500): Cannot start container 0ff3cd4a9b00927e890744185eca6cfc8b55f6beeb444c691f9afce586e664d4: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:41:13.233918 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 0ff3cd4a9b00927e890744185eca6cfc8b55f6beeb444c691f9afce586e664d4: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:41:18.215552 4877 server.go:324] GET /healthz: (10.747us) 200
I0112 18:41:20.802724 4877 server.go:324] GET /healthz: (10.548us) 200
I0112 18:41:23.111755 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:41:23.113552 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:41:23.212426 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 5708d0bba5e32f4e8ac39463bcc06451b9f7542d87bb2282ea09e6b0e09cd209
E0112 18:41:23.260276 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 5708d0bba5e32f4e8ac39463bcc06451b9f7542d87bb2282ea09e6b0e09cd209: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:41:23.260315 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 5708d0bba5e32f4e8ac39463bcc06451b9f7542d87bb2282ea09e6b0e09cd209: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:41:23.260489 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 5708d0bba5e32f4e8ac39463bcc06451b9f7542d87bb2282ea09e6b0e09cd209 with error: API error (500): Cannot start container 5708d0bba5e32f4e8ac39463bcc06451b9f7542d87bb2282ea09e6b0e09cd209: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:41:23.266175 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 5708d0bba5e32f4e8ac39463bcc06451b9f7542d87bb2282ea09e6b0e09cd209: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:41:28.255996 4877 server.go:324] GET /healthz: (12.5us) 200
I0112 18:41:32.387747 4877 server.go:324] GET /healthz: (10.583us) 200
I0112 18:41:32.624681 4877 server.go:324] GET /stats?num_stats=10: (13.001us) 301
I0112 18:41:32.625906 4877 server.go:324] GET /stats/: (700.98us) 500
goroutine 110 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2081c2300, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2081c2300, 0xc208166b40, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2081c2300, 0x7f8a04dbf1b0, 0xc208236540)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2081c2300, 0xc208001ee0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2081c2300, 0xc208001ee0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2081c2300, 0xc208001ee0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2081c2300, 0xc208001ee0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2081c2300, 0xc208001ee0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20800e820, 0xc208001ee0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:41:32.890546 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/cadvisor.manifest": default.cadvisor-agent (cadvisormanifes12uqn2ohido76855gdecd9roadm7l0)
I0112 18:41:32.890827 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/fluentd-es.manifest": default.fluentd-to-elasticsearch (fluentdesmanife2u464h05heqcpotoddodpnehjaqsde)
I0112 18:41:33.114006 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:41:33.115938 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:41:33.204203 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id e1ca9a0825e8f438d6d7f339108039ac7ebf6a1c9b15e8996f9f49e85847ecf8
E0112 18:41:33.235848 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container e1ca9a0825e8f438d6d7f339108039ac7ebf6a1c9b15e8996f9f49e85847ecf8: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:41:33.235878 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container e1ca9a0825e8f438d6d7f339108039ac7ebf6a1c9b15e8996f9f49e85847ecf8: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:41:33.236015 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id e1ca9a0825e8f438d6d7f339108039ac7ebf6a1c9b15e8996f9f49e85847ecf8 with error: API error (500): Cannot start container e1ca9a0825e8f438d6d7f339108039ac7ebf6a1c9b15e8996f9f49e85847ecf8: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:41:33.242467 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container e1ca9a0825e8f438d6d7f339108039ac7ebf6a1c9b15e8996f9f49e85847ecf8: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:41:35.159287 4877 server.go:324] GET /healthz: (9.992us) 200
I0112 18:41:38.350794 4877 server.go:324] GET /healthz: (10.216us) 200
I0112 18:41:42.377020 4877 server.go:324] GET /healthz: (10.003us) 200
I0112 18:41:42.427021 4877 server.go:324] GET /stats?num_stats=9: (13.66us) 301
I0112 18:41:42.428579 4877 server.go:324] GET /stats/: (503.953us) 500
goroutine 110 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208172300, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208172300, 0xc2081b4d70, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208172300, 0x7f8a04dbf1b0, 0xc208214590)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208172300, 0xc20814c8f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208172300, 0xc20814c8f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208172300, 0xc20814c8f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208172300, 0xc20814c8f0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208172300, 0xc20814c8f0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20812b0e0, 0xc20814c8f0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:41:43.115875 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:41:43.117775 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:41:43.188023 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id e93dbdaa628d1d5d43f745e2912ddf39c5e53d815dd086a0f2a5c6b26238fec7
E0112 18:41:43.227711 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container e93dbdaa628d1d5d43f745e2912ddf39c5e53d815dd086a0f2a5c6b26238fec7: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:41:43.227748 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container e93dbdaa628d1d5d43f745e2912ddf39c5e53d815dd086a0f2a5c6b26238fec7: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:41:43.227831 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id e93dbdaa628d1d5d43f745e2912ddf39c5e53d815dd086a0f2a5c6b26238fec7 with error: API error (500): Cannot start container e93dbdaa628d1d5d43f745e2912ddf39c5e53d815dd086a0f2a5c6b26238fec7: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:41:43.234086 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container e93dbdaa628d1d5d43f745e2912ddf39c5e53d815dd086a0f2a5c6b26238fec7: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:41:48.103948 4877 server.go:324] GET /healthz: (11.248us) 200
I0112 18:41:48.385031 4877 server.go:324] GET /healthz: (8.301us) 200
I0112 18:41:52.585356 4877 server.go:324] GET /healthz: (10.415us) 200
I0112 18:41:52.760841 4877 server.go:324] GET /stats?num_stats=10: (13.789us) 301
I0112 18:41:52.762527 4877 server.go:324] GET /stats/: (544.18us) 500
goroutine 110 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2081df9e0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2081df9e0, 0xc208254dc0, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2081df9e0, 0x7f8a04dbf1b0, 0xc2082147a0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2081df9e0, 0xc20814c820)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2081df9e0, 0xc20814c820)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2081df9e0, 0xc20814c820)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2081df9e0, 0xc20814c820)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2081df9e0, 0xc20814c820)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20812a140, 0xc20814c820)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:41:52.891603 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/cadvisor.manifest": default.cadvisor-agent (cadvisormanifes12uqn2ohido76855gdecd9roadm7l0)
I0112 18:41:52.891943 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/fluentd-es.manifest": default.fluentd-to-elasticsearch (fluentdesmanife2u464h05heqcpotoddodpnehjaqsde)
I0112 18:41:53.118423 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:41:53.120347 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:41:53.188534 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 5cf228fb86d06dbce5960e5e6cd3e2bb4e0de4bb3ac1c173fa6b55fa6550bcf4
E0112 18:41:53.227902 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 5cf228fb86d06dbce5960e5e6cd3e2bb4e0de4bb3ac1c173fa6b55fa6550bcf4: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:41:53.227941 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 5cf228fb86d06dbce5960e5e6cd3e2bb4e0de4bb3ac1c173fa6b55fa6550bcf4: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:41:53.228089 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 5cf228fb86d06dbce5960e5e6cd3e2bb4e0de4bb3ac1c173fa6b55fa6550bcf4 with error: API error (500): Cannot start container 5cf228fb86d06dbce5960e5e6cd3e2bb4e0de4bb3ac1c173fa6b55fa6550bcf4: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:41:53.233252 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 5cf228fb86d06dbce5960e5e6cd3e2bb4e0de4bb3ac1c173fa6b55fa6550bcf4: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:41:58.433321 4877 server.go:324] GET /healthz: (10.238us) 200
I0112 18:42:01.236639 4877 server.go:324] GET /healthz: (11.216us) 200
I0112 18:42:02.484598 4877 server.go:324] GET /healthz: (23.872us) 200
I0112 18:42:02.553521 4877 server.go:324] GET /stats?num_stats=9: (50.26us) 301
I0112 18:42:02.555178 4877 server.go:324] GET /stats/: (646.779us) 500
goroutine 110 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20819e0c0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20819e0c0, 0xc2081b5b30, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20819e0c0, 0x7f8a04dbf1b0, 0xc2081a04b0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20819e0c0, 0xc20814cb60)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20819e0c0, 0xc20814cb60)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20819e0c0, 0xc20814cb60)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20819e0c0, 0xc20814cb60)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20819e0c0, 0xc20814cb60)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20812b900, 0xc20814cb60)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:42:03.120337 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:42:03.122308 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:42:03.219880 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 5004ced774a5aea08d12a967d734c503b0dae370408b497dc2edf03ee2f6d4bf
E0112 18:42:03.259897 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 5004ced774a5aea08d12a967d734c503b0dae370408b497dc2edf03ee2f6d4bf: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:42:03.259948 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 5004ced774a5aea08d12a967d734c503b0dae370408b497dc2edf03ee2f6d4bf: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:42:03.260059 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 5004ced774a5aea08d12a967d734c503b0dae370408b497dc2edf03ee2f6d4bf with error: API error (500): Cannot start container 5004ced774a5aea08d12a967d734c503b0dae370408b497dc2edf03ee2f6d4bf: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:42:03.260095 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 5004ced774a5aea08d12a967d734c503b0dae370408b497dc2edf03ee2f6d4bf: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:42:08.542284 4877 server.go:324] GET /healthz: (11.845us) 200
I0112 18:42:12.371768 4877 server.go:324] GET /healthz: (11.411us) 200
I0112 18:42:12.457772 4877 server.go:324] GET /stats?num_stats=9: (24.126us) 301
I0112 18:42:12.459494 4877 server.go:324] GET /stats/: (630.456us) 500
goroutine 110 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2081c25a0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2081c25a0, 0xc208255860, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2081c25a0, 0x7f8a04dbf1b0, 0xc2081d3fa0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2081c25a0, 0xc20814c9c0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2081c25a0, 0xc20814c9c0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2081c25a0, 0xc20814c9c0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2081c25a0, 0xc20814c9c0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2081c25a0, 0xc20814c9c0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20812a820, 0xc20814c9c0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:42:12.892768 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/cadvisor.manifest": default.cadvisor-agent (cadvisormanifes12uqn2ohido76855gdecd9roadm7l0)
I0112 18:42:12.893012 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/fluentd-es.manifest": default.fluentd-to-elasticsearch (fluentdesmanife2u464h05heqcpotoddodpnehjaqsde)
I0112 18:42:13.122490 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:42:13.124257 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:42:13.220156 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 390527dab9fe335128f10053ee6a475d707db3ee819c6ad07be91c4202a1e5dc
E0112 18:42:13.240092 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 390527dab9fe335128f10053ee6a475d707db3ee819c6ad07be91c4202a1e5dc: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:42:13.240123 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 390527dab9fe335128f10053ee6a475d707db3ee819c6ad07be91c4202a1e5dc: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:42:13.240258 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 390527dab9fe335128f10053ee6a475d707db3ee819c6ad07be91c4202a1e5dc with error: API error (500): Cannot start container 390527dab9fe335128f10053ee6a475d707db3ee819c6ad07be91c4202a1e5dc: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:42:13.245114 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 390527dab9fe335128f10053ee6a475d707db3ee819c6ad07be91c4202a1e5dc: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:42:14.277317 4877 server.go:324] GET /healthz: (10.085us) 200
I0112 18:42:18.594237 4877 server.go:324] GET /healthz: (10.306us) 200
I0112 18:42:22.374781 4877 server.go:324] GET /healthz: (10.464us) 200
I0112 18:42:22.435148 4877 server.go:324] GET /stats?num_stats=9: (12.699us) 301
I0112 18:42:22.436809 4877 server.go:324] GET /stats/: (545.889us) 500
goroutine 110 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20817c600, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20817c600, 0xc208255770, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20817c600, 0x7f8a04dbf1b0, 0xc208144e20)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20817c600, 0xc2080da820)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20817c600, 0xc2080da820)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20817c600, 0xc2080da820)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20817c600, 0xc2080da820)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20817c600, 0xc2080da820)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20812bcc0, 0xc2080da820)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:42:23.125669 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:42:23.127373 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:42:23.228382 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id cff35eb105295132e597fe5350ce658dce7fd669511d062e0683438e702feb52
E0112 18:42:23.267846 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container cff35eb105295132e597fe5350ce658dce7fd669511d062e0683438e702feb52: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:42:23.267886 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container cff35eb105295132e597fe5350ce658dce7fd669511d062e0683438e702feb52: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:42:23.268014 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id cff35eb105295132e597fe5350ce658dce7fd669511d062e0683438e702feb52 with error: API error (500): Cannot start container cff35eb105295132e597fe5350ce658dce7fd669511d062e0683438e702feb52: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:42:23.273064 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container cff35eb105295132e597fe5350ce658dce7fd669511d062e0683438e702feb52: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:42:27.341703 4877 server.go:324] GET /healthz: (13.74us) 200
I0112 18:42:28.635950 4877 server.go:324] GET /healthz: (11.095us) 200
I0112 18:42:32.389375 4877 server.go:324] GET /healthz: (10.753us) 200
I0112 18:42:32.589210 4877 server.go:324] GET /stats?num_stats=10: (13.024us) 301
I0112 18:42:32.691966 4877 server.go:324] GET /stats/: (101.734581ms) 500
goroutine 110 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20813d2c0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20813d2c0, 0xc208254050, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20813d2c0, 0x7f8a04dbf1b0, 0xc20816e040)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20813d2c0, 0xc20814d790)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20813d2c0, 0xc20814d790)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20813d2c0, 0xc20814d790)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20813d2c0, 0xc20814d790)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20813d2c0, 0xc20814d790)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20800f040, 0xc20814d790)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:42:32.893849 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/cadvisor.manifest": default.cadvisor-agent (cadvisormanifes12uqn2ohido76855gdecd9roadm7l0)
I0112 18:42:32.894115 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/fluentd-es.manifest": default.fluentd-to-elasticsearch (fluentdesmanife2u464h05heqcpotoddodpnehjaqsde)
I0112 18:42:33.127637 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:42:33.129424 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:42:33.228146 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id f9a5ec5996567e5b6838745d917230ac66394c1cc9fb90415c20618b07febb97
E0112 18:42:33.275825 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container f9a5ec5996567e5b6838745d917230ac66394c1cc9fb90415c20618b07febb97: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:42:33.275870 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container f9a5ec5996567e5b6838745d917230ac66394c1cc9fb90415c20618b07febb97: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:42:33.276058 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id f9a5ec5996567e5b6838745d917230ac66394c1cc9fb90415c20618b07febb97 with error: API error (500): Cannot start container f9a5ec5996567e5b6838745d917230ac66394c1cc9fb90415c20618b07febb97: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:42:33.281114 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container f9a5ec5996567e5b6838745d917230ac66394c1cc9fb90415c20618b07febb97: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:42:38.692015 4877 server.go:324] GET /healthz: (19.979us) 200
I0112 18:42:40.420028 4877 server.go:324] GET /healthz: (11.69us) 200
I0112 18:42:43.129554 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:42:43.131458 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:42:43.196188 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 73bcd286754bd75ec14d77942de65ae203f7578958a0637c0b0ea91f7a1ff0f7
E0112 18:42:43.235941 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 73bcd286754bd75ec14d77942de65ae203f7578958a0637c0b0ea91f7a1ff0f7: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:42:43.235983 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 73bcd286754bd75ec14d77942de65ae203f7578958a0637c0b0ea91f7a1ff0f7: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:42:43.236193 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 73bcd286754bd75ec14d77942de65ae203f7578958a0637c0b0ea91f7a1ff0f7 with error: API error (500): Cannot start container 73bcd286754bd75ec14d77942de65ae203f7578958a0637c0b0ea91f7a1ff0f7: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:42:43.241468 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 73bcd286754bd75ec14d77942de65ae203f7578958a0637c0b0ea91f7a1ff0f7: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:42:48.729408 4877 server.go:324] GET /healthz: (11.102us) 200
I0112 18:42:51.020353 4877 server.go:324] GET /healthz: (19.231us) 200
I0112 18:42:52.894882 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/cadvisor.manifest": default.cadvisor-agent (cadvisormanifes12uqn2ohido76855gdecd9roadm7l0)
I0112 18:42:52.895202 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/fluentd-es.manifest": default.fluentd-to-elasticsearch (fluentdesmanife2u464h05heqcpotoddodpnehjaqsde)
I0112 18:42:53.131740 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:42:53.133614 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:42:53.228187 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 12568e04781b6028e64006f622122a187090f04de2b907955f1feb5b0ee938b0
E0112 18:42:53.275941 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 12568e04781b6028e64006f622122a187090f04de2b907955f1feb5b0ee938b0: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:42:53.275978 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 12568e04781b6028e64006f622122a187090f04de2b907955f1feb5b0ee938b0: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:42:53.276161 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 12568e04781b6028e64006f622122a187090f04de2b907955f1feb5b0ee938b0 with error: API error (500): Cannot start container 12568e04781b6028e64006f622122a187090f04de2b907955f1feb5b0ee938b0: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:42:53.282949 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 12568e04781b6028e64006f622122a187090f04de2b907955f1feb5b0ee938b0: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:42:53.367739 4877 server.go:324] GET /healthz: (6.998us) 200
I0112 18:42:58.770429 4877 server.go:324] GET /healthz: (11.628us) 200
I0112 18:43:03.133929 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:43:03.136153 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:43:03.220270 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 16c792a47c2fef6fc4888afc6b55f9c99238d47833d965213cb35d393b1a448d
E0112 18:43:03.259976 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 16c792a47c2fef6fc4888afc6b55f9c99238d47833d965213cb35d393b1a448d: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:43:03.260019 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 16c792a47c2fef6fc4888afc6b55f9c99238d47833d965213cb35d393b1a448d: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:43:03.260139 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 16c792a47c2fef6fc4888afc6b55f9c99238d47833d965213cb35d393b1a448d with error: API error (500): Cannot start container 16c792a47c2fef6fc4888afc6b55f9c99238d47833d965213cb35d393b1a448d: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:43:03.266626 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 16c792a47c2fef6fc4888afc6b55f9c99238d47833d965213cb35d393b1a448d: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:43:06.386659 4877 server.go:324] GET /healthz: (10.778us) 200
I0112 18:43:08.809891 4877 server.go:324] GET /healthz: (11.611us) 200
I0112 18:43:12.896001 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/cadvisor.manifest": default.cadvisor-agent (cadvisormanifes12uqn2ohido76855gdecd9roadm7l0)
I0112 18:43:12.896259 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/fluentd-es.manifest": default.fluentd-to-elasticsearch (fluentdesmanife2u464h05heqcpotoddodpnehjaqsde)
I0112 18:43:13.136034 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:43:13.138186 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:43:13.244105 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 280be367e5c880c29251005b2c0f917591830093fe9dfd3c62f9054d41cc1484
E0112 18:43:13.283932 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 280be367e5c880c29251005b2c0f917591830093fe9dfd3c62f9054d41cc1484: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:43:13.283961 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 280be367e5c880c29251005b2c0f917591830093fe9dfd3c62f9054d41cc1484: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:43:13.284017 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 280be367e5c880c29251005b2c0f917591830093fe9dfd3c62f9054d41cc1484 with error: API error (500): Cannot start container 280be367e5c880c29251005b2c0f917591830093fe9dfd3c62f9054d41cc1484: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:43:13.289151 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 280be367e5c880c29251005b2c0f917591830093fe9dfd3c62f9054d41cc1484: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:43:18.859273 4877 server.go:324] GET /healthz: (10.375us) 200
I0112 18:43:19.371910 4877 server.go:324] GET /healthz: (12.266us) 200
I0112 18:43:21.958720 4877 server.go:324] GET /healthz: (10.184us) 200
I0112 18:43:22.009757 4877 server.go:324] GET /stats?num_stats=10: (19.718us) 301
I0112 18:43:22.010858 4877 server.go:324] GET /stats/: (600.932us) 500
goroutine 182 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20817cae0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20817cae0, 0xc2081b4820, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20817cae0, 0x7f8a04dbf1b0, 0xc208144b70)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20817cae0, 0xc2080da4e0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20817cae0, 0xc2080da4e0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20817cae0, 0xc2080da4e0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20817cae0, 0xc2080da4e0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20817cae0, 0xc2080da4e0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20812b7c0, 0xc2080da4e0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:43:23.138001 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:43:23.140094 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:43:23.244325 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 6cc091f24fdbbd6c19c6f9284e7af87839f0c300b7fab6db23b76efa3af1b641
E0112 18:43:23.283593 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 6cc091f24fdbbd6c19c6f9284e7af87839f0c300b7fab6db23b76efa3af1b641: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:43:23.283634 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 6cc091f24fdbbd6c19c6f9284e7af87839f0c300b7fab6db23b76efa3af1b641: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:43:23.283784 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 6cc091f24fdbbd6c19c6f9284e7af87839f0c300b7fab6db23b76efa3af1b641 with error: API error (500): Cannot start container 6cc091f24fdbbd6c19c6f9284e7af87839f0c300b7fab6db23b76efa3af1b641: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:43:23.283810 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 6cc091f24fdbbd6c19c6f9284e7af87839f0c300b7fab6db23b76efa3af1b641: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:43:28.899981 4877 server.go:324] GET /healthz: (14.124us) 200
I0112 18:43:31.922043 4877 server.go:324] GET /healthz: (11.145us) 200
I0112 18:43:32.021042 4877 server.go:324] GET /stats?num_stats=9: (21.345us) 301
I0112 18:43:32.022576 4877 server.go:324] GET /stats/: (561.33us) 500
goroutine 182 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2081ccc60, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2081ccc60, 0xc208255270, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2081ccc60, 0x7f8a04dbf1b0, 0xc2081696f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2081ccc60, 0xc20814c340)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2081ccc60, 0xc20814c340)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2081ccc60, 0xc20814c340)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2081ccc60, 0xc20814c340)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2081ccc60, 0xc20814c340)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20800e280, 0xc20814c340)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:43:32.338087 4877 server.go:324] GET /healthz: (6.269us) 200
I0112 18:43:32.897081 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/cadvisor.manifest": default.cadvisor-agent (cadvisormanifes12uqn2ohido76855gdecd9roadm7l0)
I0112 18:43:32.897372 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/fluentd-es.manifest": default.fluentd-to-elasticsearch (fluentdesmanife2u464h05heqcpotoddodpnehjaqsde)
I0112 18:43:33.139979 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:43:33.143114 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:43:33.220338 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 68d3f90cf01d867b283e4fd438ae2ef569a3901b0c3617ebbf86c24c131a925e
E0112 18:43:33.259791 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 68d3f90cf01d867b283e4fd438ae2ef569a3901b0c3617ebbf86c24c131a925e: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:43:33.259835 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 68d3f90cf01d867b283e4fd438ae2ef569a3901b0c3617ebbf86c24c131a925e: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:43:33.259979 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 68d3f90cf01d867b283e4fd438ae2ef569a3901b0c3617ebbf86c24c131a925e with error: API error (500): Cannot start container 68d3f90cf01d867b283e4fd438ae2ef569a3901b0c3617ebbf86c24c131a925e: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:43:33.265216 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 68d3f90cf01d867b283e4fd438ae2ef569a3901b0c3617ebbf86c24c131a925e: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:43:38.958121 4877 server.go:324] GET /healthz: (11.203us) 200
I0112 18:43:41.948137 4877 server.go:324] GET /healthz: (10.042us) 200
I0112 18:43:42.000648 4877 server.go:324] GET /stats?num_stats=9: (19.471us) 301
I0112 18:43:42.002206 4877 server.go:324] GET /stats/: (538.505us) 500
goroutine 182 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20810e6c0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20810e6c0, 0xc2081b4140, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20810e6c0, 0x7f8a04dbf1b0, 0xc208169f00)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20810e6c0, 0xc20814d5f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20810e6c0, 0xc20814d5f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20810e6c0, 0xc20814d5f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20810e6c0, 0xc20814d5f0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20810e6c0, 0xc20814d5f0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20800e5a0, 0xc20814d5f0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:43:43.142315 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:43:43.145910 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:43:43.236221 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 7077486f86f328d3e7a74c8d9785775f220417214fee6a7c07dffc78f7c9f171
E0112 18:43:43.267645 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 7077486f86f328d3e7a74c8d9785775f220417214fee6a7c07dffc78f7c9f171: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:43:43.267687 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 7077486f86f328d3e7a74c8d9785775f220417214fee6a7c07dffc78f7c9f171: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:43:43.267829 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 7077486f86f328d3e7a74c8d9785775f220417214fee6a7c07dffc78f7c9f171 with error: API error (500): Cannot start container 7077486f86f328d3e7a74c8d9785775f220417214fee6a7c07dffc78f7c9f171: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:43:43.273001 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 7077486f86f328d3e7a74c8d9785775f220417214fee6a7c07dffc78f7c9f171: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:43:45.330164 4877 server.go:324] GET /healthz: (11.191us) 200
I0112 18:43:49.000823 4877 server.go:324] GET /healthz: (10.304us) 200
I0112 18:43:51.919171 4877 server.go:324] GET /healthz: (11.672us) 200
I0112 18:43:52.012056 4877 server.go:324] GET /stats?num_stats=9: (33.696us) 301
I0112 18:43:52.013580 4877 server.go:324] GET /stats/: (657.744us) 500
goroutine 182 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20817d800, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20817d800, 0xc2082554f0, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20817d800, 0x7f8a04dbf1b0, 0xc2081688a0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20817d800, 0xc2080db930)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20817d800, 0xc2080db930)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20817d800, 0xc2080db930)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20817d800, 0xc2080db930)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20817d800, 0xc2080db930)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20812b4a0, 0xc2080db930)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:43:52.898238 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/cadvisor.manifest": default.cadvisor-agent (cadvisormanifes12uqn2ohido76855gdecd9roadm7l0)
I0112 18:43:52.898576 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/fluentd-es.manifest": default.fluentd-to-elasticsearch (fluentdesmanife2u464h05heqcpotoddodpnehjaqsde)
I0112 18:43:53.144401 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:43:53.147762 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:43:53.196202 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 1d694101be667c5a1795ed90147721482c7862e0412c9225af23364332e5622f
E0112 18:43:53.236136 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 1d694101be667c5a1795ed90147721482c7862e0412c9225af23364332e5622f: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:43:53.236170 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 1d694101be667c5a1795ed90147721482c7862e0412c9225af23364332e5622f: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:43:53.236285 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 1d694101be667c5a1795ed90147721482c7862e0412c9225af23364332e5622f with error: API error (500): Cannot start container 1d694101be667c5a1795ed90147721482c7862e0412c9225af23364332e5622f: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:43:53.242265 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 1d694101be667c5a1795ed90147721482c7862e0412c9225af23364332e5622f: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:43:58.237668 4877 server.go:324] GET /healthz: (10.415us) 200
I0112 18:43:59.040490 4877 server.go:324] GET /healthz: (10.391us) 200
I0112 18:44:01.803418 4877 server.go:324] GET /healthz: (10.657us) 200
I0112 18:44:01.858585 4877 server.go:324] GET /stats?num_stats=9: (16.043us) 301
I0112 18:44:01.860471 4877 server.go:324] GET /stats/: (754.371us) 500
goroutine 182 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208005080, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208005080, 0xc2081b4320, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208005080, 0x7f8a04dbf1b0, 0xc208169810)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208005080, 0xc20814da00)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208005080, 0xc20814da00)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208005080, 0xc20814da00)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208005080, 0xc20814da00)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208005080, 0xc20814da00)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20812b360, 0xc20814da00)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:44:03.146574 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:44:03.148949 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:44:03.244069 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 99747ea690fc7b06b5182140ef115f23b82f6e85869177e646abda44b8fe4ff3
E0112 18:44:03.284013 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 99747ea690fc7b06b5182140ef115f23b82f6e85869177e646abda44b8fe4ff3: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:44:03.284042 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 99747ea690fc7b06b5182140ef115f23b82f6e85869177e646abda44b8fe4ff3: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:44:03.284161 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 99747ea690fc7b06b5182140ef115f23b82f6e85869177e646abda44b8fe4ff3 with error: API error (500): Cannot start container 99747ea690fc7b06b5182140ef115f23b82f6e85869177e646abda44b8fe4ff3: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:44:03.289454 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 99747ea690fc7b06b5182140ef115f23b82f6e85869177e646abda44b8fe4ff3: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:44:09.083645 4877 server.go:324] GET /healthz: (11.456us) 200
I0112 18:44:11.519985 4877 server.go:324] GET /healthz: (11.234us) 200
I0112 18:44:11.801050 4877 server.go:324] GET /healthz: (5.7us) 200
I0112 18:44:11.879700 4877 server.go:324] GET /stats?num_stats=9: (12.074us) 301
I0112 18:44:11.881298 4877 server.go:324] GET /stats/: (497.131us) 500
goroutine 182 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208205080, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208205080, 0xc208255810, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208205080, 0x7f8a04dbf1b0, 0xc20816f8c0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208205080, 0xc20814c0d0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208205080, 0xc20814c0d0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208205080, 0xc20814c0d0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208205080, 0xc20814c0d0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208205080, 0xc20814c0d0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20812b2c0, 0xc20814c0d0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:44:12.852182 4877 logs.go:39] etcd DEBUG: recv.success.http://10.240.220.182:4001/v2/keys/registry/nodes/kubernetes-minion-4.c.eternal-empire-754.internal/boundpods?consistent=true&wait=true&waitIndex=19
I0112 18:44:12.852338 4877 etcd.go:70] Watch closed (&api.Status{TypeMeta:api.TypeMeta{Kind:"", APIVersion:""}, ListMeta:api.ListMeta{SelfLink:"", ResourceVersion:""}, Status:"Failure", Message:"unexpected end of JSON input", Reason:"", Details:(*api.StatusDetails)(nil), Code:0}). Reopening.
I0112 18:44:12.899351 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/cadvisor.manifest": default.cadvisor-agent (cadvisormanifes12uqn2ohido76855gdecd9roadm7l0)
I0112 18:44:12.900860 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/fluentd-es.manifest": default.fluentd-to-elasticsearch (fluentdesmanife2u464h05heqcpotoddodpnehjaqsde)
I0112 18:44:13.148808 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:44:13.150977 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:44:13.236124 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 1e37f73bd6e8346541f01aa03f06cb7d71a69788b1e8fcf2fda9966493572926
E0112 18:44:13.275689 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 1e37f73bd6e8346541f01aa03f06cb7d71a69788b1e8fcf2fda9966493572926: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:44:13.275720 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 1e37f73bd6e8346541f01aa03f06cb7d71a69788b1e8fcf2fda9966493572926: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:44:13.275860 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 1e37f73bd6e8346541f01aa03f06cb7d71a69788b1e8fcf2fda9966493572926 with error: API error (500): Cannot start container 1e37f73bd6e8346541f01aa03f06cb7d71a69788b1e8fcf2fda9966493572926: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:44:13.280719 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 1e37f73bd6e8346541f01aa03f06cb7d71a69788b1e8fcf2fda9966493572926: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:44:13.852745 4877 logs.go:39] etcd DEBUG: get /registry/nodes/kubernetes-minion-4.c.eternal-empire-754.internal/boundpods [http://10.240.220.182:4001]
I0112 18:44:13.852799 4877 logs.go:39] etcd DEBUG: Connecting to etcd: attempt1forkeys/registry/nodes/kubernetes-minion-4.c.eternal-empire-754.internal/boundpods?consistent=true&recursive=false&sorted=false
I0112 18:44:13.852813 4877 logs.go:39] etcd DEBUG: send.request.to http://10.240.220.182:4001/v2/keys/registry/nodes/kubernetes-minion-4.c.eternal-empire-754.internal/boundpods?consistent=true&recursive=false&sorted=false | method GET
I0112 18:44:13.855459 4877 logs.go:39] etcd DEBUG: recv.response.fromhttp://10.240.220.182:4001/v2/keys/registry/nodes/kubernetes-minion-4.c.eternal-empire-754.internal/boundpods?consistent=true&recursive=false&sorted=false
I0112 18:44:13.855500 4877 logs.go:39] etcd DEBUG: recv.success.http://10.240.220.182:4001/v2/keys/registry/nodes/kubernetes-minion-4.c.eternal-empire-754.internal/boundpods?consistent=true&recursive=false&sorted=false
I0112 18:44:13.855537 4877 logs.go:39] etcd DEBUG: watch /registry/nodes/kubernetes-minion-4.c.eternal-empire-754.internal/boundpods [http://10.240.220.182:4001]
I0112 18:44:13.855560 4877 logs.go:39] etcd DEBUG: get /registry/nodes/kubernetes-minion-4.c.eternal-empire-754.internal/boundpods [http://10.240.220.182:4001]
I0112 18:44:13.855593 4877 logs.go:39] etcd DEBUG: Connecting to etcd: attempt1forkeys/registry/nodes/kubernetes-minion-4.c.eternal-empire-754.internal/boundpods?consistent=true&wait=true&waitIndex=1160
I0112 18:44:13.855606 4877 logs.go:39] etcd DEBUG: send.request.to http://10.240.220.182:4001/v2/keys/registry/nodes/kubernetes-minion-4.c.eternal-empire-754.internal/boundpods?consistent=true&wait=true&waitIndex=1160 | method GET
I0112 18:44:13.856168 4877 logs.go:39] etcd DEBUG: recv.response.fromhttp://10.240.220.182:4001/v2/keys/registry/nodes/kubernetes-minion-4.c.eternal-empire-754.internal/boundpods?consistent=true&wait=true&waitIndex=1160
I0112 18:44:19.122314 4877 server.go:324] GET /healthz: (11.717us) 200
I0112 18:44:21.809813 4877 server.go:324] GET /healthz: (10.644us) 200
I0112 18:44:21.861226 4877 server.go:324] GET /stats?num_stats=9: (23.079us) 301
I0112 18:44:21.862904 4877 server.go:324] GET /stats/: (529.318us) 500
goroutine 182 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20816a900, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20816a900, 0xc2081b5630, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20816a900, 0x7f8a04dbf1b0, 0xc2082152b0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20816a900, 0xc20814d930)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20816a900, 0xc20814d930)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20816a900, 0xc20814d930)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20816a900, 0xc20814d930)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20816a900, 0xc20814d930)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20800fa40, 0xc20814d930)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:44:23.150697 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:44:23.152598 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:44:23.236256 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id d1229b5ceb11429aebbb327f8df31ca3477286cde960946323b49b6b53037706
E0112 18:44:23.275708 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container d1229b5ceb11429aebbb327f8df31ca3477286cde960946323b49b6b53037706: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:44:23.275739 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container d1229b5ceb11429aebbb327f8df31ca3477286cde960946323b49b6b53037706: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:44:23.275868 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id d1229b5ceb11429aebbb327f8df31ca3477286cde960946323b49b6b53037706 with error: API error (500): Cannot start container d1229b5ceb11429aebbb327f8df31ca3477286cde960946323b49b6b53037706: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:44:23.281055 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container d1229b5ceb11429aebbb327f8df31ca3477286cde960946323b49b6b53037706: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:44:24.843433 4877 server.go:324] GET /healthz: (11.22us) 200
I0112 18:44:29.162051 4877 server.go:324] GET /healthz: (9.955us) 200
I0112 18:44:31.805270 4877 server.go:324] GET /healthz: (10.489us) 200
I0112 18:44:31.869191 4877 server.go:324] GET /stats?num_stats=9: (12.625us) 301
I0112 18:44:31.870881 4877 server.go:324] GET /stats/: (730.922us) 500
goroutine 182 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2081c3560, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2081c3560, 0xc208255ae0, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2081c3560, 0x7f8a04dbf1b0, 0xc2081d37e0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2081c3560, 0xc20814cc30)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2081c3560, 0xc20814cc30)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2081c3560, 0xc20814cc30)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2081c3560, 0xc20814cc30)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2081c3560, 0xc20814cc30)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20812b900, 0xc20814cc30)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:44:32.901725 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/cadvisor.manifest": default.cadvisor-agent (cadvisormanifes12uqn2ohido76855gdecd9roadm7l0)
I0112 18:44:32.902159 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/fluentd-es.manifest": default.fluentd-to-elasticsearch (fluentdesmanife2u464h05heqcpotoddodpnehjaqsde)
I0112 18:44:33.152628 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:44:33.154766 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:44:33.259932 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 920c6e831f2e442ceaa392a98c0f50b35d4956f1fbe048f11101305170e766c8
E0112 18:44:33.308066 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 920c6e831f2e442ceaa392a98c0f50b35d4956f1fbe048f11101305170e766c8: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:44:33.308112 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 920c6e831f2e442ceaa392a98c0f50b35d4956f1fbe048f11101305170e766c8: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:44:33.308241 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 920c6e831f2e442ceaa392a98c0f50b35d4956f1fbe048f11101305170e766c8 with error: API error (500): Cannot start container 920c6e831f2e442ceaa392a98c0f50b35d4956f1fbe048f11101305170e766c8: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:44:33.314063 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 920c6e831f2e442ceaa392a98c0f50b35d4956f1fbe048f11101305170e766c8: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:44:37.817017 4877 server.go:324] GET /healthz: (20.161us) 200
I0112 18:44:39.209101 4877 server.go:324] GET /healthz: (10.874us) 200
I0112 18:44:41.799386 4877 server.go:324] GET /healthz: (12.763us) 200
I0112 18:44:41.857450 4877 server.go:324] GET /stats?num_stats=9: (17.202us) 301
I0112 18:44:41.859123 4877 server.go:324] GET /stats/: (609.984us) 500
goroutine 182 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208150840, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208150840, 0xc208254aa0, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208150840, 0x7f8a04dbf1b0, 0xc208145100)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208150840, 0xc20814d1e0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208150840, 0xc20814d1e0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208150840, 0xc20814d1e0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208150840, 0xc20814d1e0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208150840, 0xc20814d1e0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20812adc0, 0xc20814d1e0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:44:43.155015 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:44:43.156968 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:44:43.228052 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 468c4b6e9b979119acaf8c7d94da7cf9264d148e17f88b6579fa6f5737351962
E0112 18:44:43.259689 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 468c4b6e9b979119acaf8c7d94da7cf9264d148e17f88b6579fa6f5737351962: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:44:43.259719 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 468c4b6e9b979119acaf8c7d94da7cf9264d148e17f88b6579fa6f5737351962: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:44:43.259844 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 468c4b6e9b979119acaf8c7d94da7cf9264d148e17f88b6579fa6f5737351962 with error: API error (500): Cannot start container 468c4b6e9b979119acaf8c7d94da7cf9264d148e17f88b6579fa6f5737351962: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:44:43.269000 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 468c4b6e9b979119acaf8c7d94da7cf9264d148e17f88b6579fa6f5737351962: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:44:49.250813 4877 server.go:324] GET /healthz: (11.266us) 200
I0112 18:44:50.762498 4877 server.go:324] GET /healthz: (9.868us) 200
I0112 18:44:51.907737 4877 server.go:324] GET /healthz: (11.201us) 200
I0112 18:44:52.001796 4877 server.go:324] GET /stats?num_stats=10: (34.656us) 301
I0112 18:44:52.003457 4877 server.go:324] GET /stats/: (764.658us) 500
goroutine 182 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2081738c0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2081738c0, 0xc2082545f0, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2081738c0, 0x7f8a04dbf1b0, 0xc2081a0410)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2081738c0, 0xc20814cc30)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2081738c0, 0xc20814cc30)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2081738c0, 0xc20814cc30)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2081738c0, 0xc20814cc30)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2081738c0, 0xc20814cc30)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20812b7c0, 0xc20814cc30)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:44:52.902883 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/cadvisor.manifest": default.cadvisor-agent (cadvisormanifes12uqn2ohido76855gdecd9roadm7l0)
I0112 18:44:52.903267 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/fluentd-es.manifest": default.fluentd-to-elasticsearch (fluentdesmanife2u464h05heqcpotoddodpnehjaqsde)
I0112 18:44:53.157119 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:44:53.159304 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:44:53.260168 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 190cbf7591c1e1db3727adca3a508a6fa0679203012f294525f47ba754502cc7
E0112 18:44:53.292084 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 190cbf7591c1e1db3727adca3a508a6fa0679203012f294525f47ba754502cc7: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:44:53.292122 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 190cbf7591c1e1db3727adca3a508a6fa0679203012f294525f47ba754502cc7: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:44:53.292309 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 190cbf7591c1e1db3727adca3a508a6fa0679203012f294525f47ba754502cc7 with error: API error (500): Cannot start container 190cbf7591c1e1db3727adca3a508a6fa0679203012f294525f47ba754502cc7: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:44:53.296981 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 190cbf7591c1e1db3727adca3a508a6fa0679203012f294525f47ba754502cc7: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:44:59.291472 4877 server.go:324] GET /healthz: (11.257us) 200
I0112 18:45:03.159788 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:45:03.161963 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:45:03.220003 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id f8a96b774bfa9f6568e7176c3955fe7c49a69d66bcaf982705e0d28b44fe37c8
E0112 18:45:03.259669 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container f8a96b774bfa9f6568e7176c3955fe7c49a69d66bcaf982705e0d28b44fe37c8: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:45:03.259700 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container f8a96b774bfa9f6568e7176c3955fe7c49a69d66bcaf982705e0d28b44fe37c8: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:45:03.259906 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id f8a96b774bfa9f6568e7176c3955fe7c49a69d66bcaf982705e0d28b44fe37c8 with error: API error (500): Cannot start container f8a96b774bfa9f6568e7176c3955fe7c49a69d66bcaf982705e0d28b44fe37c8: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:45:03.264965 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container f8a96b774bfa9f6568e7176c3955fe7c49a69d66bcaf982705e0d28b44fe37c8: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:45:06.296135 4877 server.go:324] GET /healthz: (11.746us) 200
I0112 18:45:06.758419 4877 server.go:324] GET /healthz: (8.111us) 200
I0112 18:45:09.334438 4877 server.go:324] GET /healthz: (11.031us) 200
I0112 18:45:12.904082 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/cadvisor.manifest": default.cadvisor-agent (cadvisormanifes12uqn2ohido76855gdecd9roadm7l0)
I0112 18:45:12.904397 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/fluentd-es.manifest": default.fluentd-to-elasticsearch (fluentdesmanife2u464h05heqcpotoddodpnehjaqsde)
I0112 18:45:13.162056 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:45:13.163935 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:45:13.219928 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 9abc2eea9d73f4be23ddc20f2bd15cf26fd0e62d880aaf6e9569512b1eac64c7
E0112 18:45:13.259867 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 9abc2eea9d73f4be23ddc20f2bd15cf26fd0e62d880aaf6e9569512b1eac64c7: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:45:13.259899 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 9abc2eea9d73f4be23ddc20f2bd15cf26fd0e62d880aaf6e9569512b1eac64c7: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:45:13.260005 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 9abc2eea9d73f4be23ddc20f2bd15cf26fd0e62d880aaf6e9569512b1eac64c7 with error: API error (500): Cannot start container 9abc2eea9d73f4be23ddc20f2bd15cf26fd0e62d880aaf6e9569512b1eac64c7: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:45:13.260031 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 9abc2eea9d73f4be23ddc20f2bd15cf26fd0e62d880aaf6e9569512b1eac64c7: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:45:19.377920 4877 server.go:324] GET /healthz: (10.041us) 200
I0112 18:45:19.656873 4877 server.go:324] GET /healthz: (9.254us) 200
I0112 18:45:21.473793 4877 server.go:324] GET /healthz: (11.26us) 200
I0112 18:45:21.537427 4877 server.go:324] GET /stats?num_stats=10: (17.28us) 301
I0112 18:45:21.538446 4877 server.go:324] GET /stats/: (565.382us) 500
goroutine 275 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20817dec0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20817dec0, 0xc208167e50, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20817dec0, 0x7f8a04dbf1b0, 0xc208168a20)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20817dec0, 0xc2080da9c0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20817dec0, 0xc2080da9c0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20817dec0, 0xc2080da9c0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20817dec0, 0xc2080da9c0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20817dec0, 0xc2080da9c0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20812bcc0, 0xc2080da9c0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:45:23.165233 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:45:23.167244 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:45:23.276007 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 7899f1c2eb43564ad2a67b90a439ed37625f37a4a26998347eec7bf11c9cecdf
E0112 18:45:23.307624 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 7899f1c2eb43564ad2a67b90a439ed37625f37a4a26998347eec7bf11c9cecdf: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:45:23.307654 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 7899f1c2eb43564ad2a67b90a439ed37625f37a4a26998347eec7bf11c9cecdf: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:45:23.307761 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 7899f1c2eb43564ad2a67b90a439ed37625f37a4a26998347eec7bf11c9cecdf with error: API error (500): Cannot start container 7899f1c2eb43564ad2a67b90a439ed37625f37a4a26998347eec7bf11c9cecdf: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:45:23.312907 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 7899f1c2eb43564ad2a67b90a439ed37625f37a4a26998347eec7bf11c9cecdf: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:45:29.417046 4877 server.go:324] GET /healthz: (11.367us) 200
I0112 18:45:31.443942 4877 server.go:324] GET /healthz: (12.375us) 200
I0112 18:45:31.503776 4877 server.go:324] GET /stats?num_stats=9: (13.865us) 301
I0112 18:45:31.505498 4877 server.go:324] GET /stats/: (618.768us) 500
goroutine 275 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2081e21e0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2081e21e0, 0xc2081b43c0, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2081e21e0, 0x7f8a04dbf1b0, 0xc2081623e0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2081e21e0, 0xc20814d790)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2081e21e0, 0xc20814d790)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2081e21e0, 0xc20814d790)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2081e21e0, 0xc20814d790)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2081e21e0, 0xc20814d790)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20800e820, 0xc20814d790)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:45:32.668738 4877 server.go:324] GET /healthz: (10.719us) 200
I0112 18:45:32.906476 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/cadvisor.manifest": default.cadvisor-agent (cadvisormanifes12uqn2ohido76855gdecd9roadm7l0)
I0112 18:45:32.906922 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/fluentd-es.manifest": default.fluentd-to-elasticsearch (fluentdesmanife2u464h05heqcpotoddodpnehjaqsde)
I0112 18:45:33.167111 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:45:33.169110 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:45:33.276050 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id cd1300904428983caf4c54b1e39a5ae2e6a00ef0bd09141713dbab1bb5827472
E0112 18:45:33.315953 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container cd1300904428983caf4c54b1e39a5ae2e6a00ef0bd09141713dbab1bb5827472: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:45:33.315984 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container cd1300904428983caf4c54b1e39a5ae2e6a00ef0bd09141713dbab1bb5827472: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:45:33.316132 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id cd1300904428983caf4c54b1e39a5ae2e6a00ef0bd09141713dbab1bb5827472 with error: API error (500): Cannot start container cd1300904428983caf4c54b1e39a5ae2e6a00ef0bd09141713dbab1bb5827472: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:45:33.321719 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container cd1300904428983caf4c54b1e39a5ae2e6a00ef0bd09141713dbab1bb5827472: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:45:39.470346 4877 server.go:324] GET /healthz: (10.715us) 200
I0112 18:45:43.169102 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:45:43.171049 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:45:43.243731 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 3b4781ba3c9cd5bfe31481c0d4ce7fc8a24cc1a127bee96675829f7cdf1f07da
E0112 18:45:43.291815 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 3b4781ba3c9cd5bfe31481c0d4ce7fc8a24cc1a127bee96675829f7cdf1f07da: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:45:43.291852 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 3b4781ba3c9cd5bfe31481c0d4ce7fc8a24cc1a127bee96675829f7cdf1f07da: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:45:43.291979 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 3b4781ba3c9cd5bfe31481c0d4ce7fc8a24cc1a127bee96675829f7cdf1f07da with error: API error (500): Cannot start container 3b4781ba3c9cd5bfe31481c0d4ce7fc8a24cc1a127bee96675829f7cdf1f07da: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:45:43.292017 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 3b4781ba3c9cd5bfe31481c0d4ce7fc8a24cc1a127bee96675829f7cdf1f07da: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:45:45.581353 4877 server.go:324] GET /healthz: (12.042us) 200
I0112 18:45:46.665217 4877 logs.go:39] etcd DEBUG: recv.success.http://10.240.220.182:4001/v2/keys/registry/nodes/kubernetes-minion-4.c.eternal-empire-754.internal/boundpods?consistent=true&wait=true&waitIndex=1160
I0112 18:45:46.665640 4877 logs.go:39] etcd DEBUG: get /registry/nodes/kubernetes-minion-4.c.eternal-empire-754.internal/boundpods [http://10.240.220.182:4001]
I0112 18:45:46.665679 4877 logs.go:39] etcd DEBUG: Connecting to etcd: attempt1forkeys/registry/nodes/kubernetes-minion-4.c.eternal-empire-754.internal/boundpods?consistent=true&wait=true&waitIndex=1549
I0112 18:45:46.665690 4877 logs.go:39] etcd DEBUG: send.request.to http://10.240.220.182:4001/v2/keys/registry/nodes/kubernetes-minion-4.c.eternal-empire-754.internal/boundpods?consistent=true&wait=true&waitIndex=1549 | method GET
I0112 18:45:46.700772 4877 logs.go:39] etcd DEBUG: recv.response.fromhttp://10.240.220.182:4001/v2/keys/registry/nodes/kubernetes-minion-4.c.eternal-empire-754.internal/boundpods?consistent=true&wait=true&waitIndex=1549
I0112 18:45:46.702536 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:45:46.702869 4877 kubelet.go:793] Network container doesn't exist for pod "redis-3.default.etcd", killing and re-creating the pod
I0112 18:45:46.704587 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:45:46.711195 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"redis-3", UID:"3475f3f6-9a8b-11e4-af56-42010af0dcb6", APIVersion:"v1beta1", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:45:46.781420 4877 server.go:324] GET /healthz: (8.08us) 200
I0112 18:45:46.792083 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id ace7bf556dfe29e157d6d12e32ddd89da56b5f004cfe9e5f23a3116223e76e5f
I0112 18:45:46.796877 4877 server.go:324] GET /api/v1beta1/podInfo?podID=redis-3&podNamespace=default: (7.665708ms) 200
I0112 18:45:46.868622 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"redis-3", UID:"3475f3f6-9a8b-11e4-af56-42010af0dcb6", APIVersion:"v1beta1", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id f655f9838f00e0c48f6de44215a4de08b9ebf0b09867791999d320b4c48a7e62
E0112 18:45:46.883896 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container ace7bf556dfe29e157d6d12e32ddd89da56b5f004cfe9e5f23a3116223e76e5f: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:45:46.883927 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container ace7bf556dfe29e157d6d12e32ddd89da56b5f004cfe9e5f23a3116223e76e5f: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:45:46.884093 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id ace7bf556dfe29e157d6d12e32ddd89da56b5f004cfe9e5f23a3116223e76e5f with error: API error (500): Cannot start container ace7bf556dfe29e157d6d12e32ddd89da56b5f004cfe9e5f23a3116223e76e5f: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:45:46.889885 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container ace7bf556dfe29e157d6d12e32ddd89da56b5f004cfe9e5f23a3116223e76e5f: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:45:47.035526 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"redis-3", UID:"3475f3f6-9a8b-11e4-af56-42010af0dcb6", APIVersion:"v1beta1", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'running', reason: 'started' Started with docker id f655f9838f00e0c48f6de44215a4de08b9ebf0b09867791999d320b4c48a7e62
I0112 18:45:49.508801 4877 server.go:324] GET /healthz: (11.706us) 200
I0112 18:45:52.907698 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/cadvisor.manifest": default.cadvisor-agent (cadvisormanifes12uqn2ohido76855gdecd9roadm7l0)
I0112 18:45:52.908105 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/fluentd-es.manifest": default.fluentd-to-elasticsearch (fluentdesmanife2u464h05heqcpotoddodpnehjaqsde)
I0112 18:45:53.408463 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=10: (2.041705ms) 500
goroutine 308 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20813e240, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20813e240, 0xc2082819b0, 0x27, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20813e240, 0x7f8a04dbf1b0, 0xc208365730)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20813e240, 0xc2080da820)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20813e240, 0xc2080da820)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20813e240, 0xc2080da820)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20813e240, 0xc2080da820)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20813e240, 0xc2080da820)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20800f4a0, 0xc2080da820)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:45:53.487885 4877 server.go:324] GET /healthz: (190.881us) 200
I0112 18:45:53.576722 4877 server.go:324] GET /stats?num_stats=10: (24.525us) 301
I0112 18:45:53.578813 4877 server.go:324] GET /stats/: (1.279623ms) 500
goroutine 308 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20813e480, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20813e480, 0xc20838bc70, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20813e480, 0x7f8a04dbf1b0, 0xc208365c50)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20813e480, 0xc2080db2b0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20813e480, 0xc2080db2b0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20813e480, 0xc2080db2b0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20813e480, 0xc2080db2b0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20813e480, 0xc2080db2b0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20800f7c0, 0xc2080db2b0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:45:54.306917 4877 provider.go:91] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
I0112 18:45:54.306957 4877 config.go:55] looking for .dockercfg at /.dockercfg
I0112 18:45:54.307037 4877 provider.go:91] Refreshing cache for provider: *gcp_credentials.dockerConfigKeyProvider
I0112 18:45:54.311329 4877 config.go:95] body of failing http response: &{0xc2081118c0 {0 0} false ?reflect.Value? 0x512010 0x511fa0}
E0112 18:45:54.311416 4877 metadata.go:109] while reading 'google-dockercfg' metadata: http status code: 404 while fetching url http://metadata.google.internal./computeMetadata/v1/instance/attributes/google-dockercfg
I0112 18:45:54.311460 4877 provider.go:91] Refreshing cache for provider: *gcp_credentials.dockerConfigUrlKeyProvider
I0112 18:45:54.312915 4877 config.go:95] body of failing http response: &{0xc208111b00 {0 0} false ?reflect.Value? 0x512010 0x511fa0}
E0112 18:45:54.312962 4877 metadata.go:121] while reading 'google-dockercfg-url' metadata: http status code: 404 while fetching url http://metadata.google.internal./computeMetadata/v1/instance/attributes/google-dockercfg-url
I0112 18:45:56.738460 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:45:56.798917 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:45:57.019115 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id a8763df65ea6ac39b7e3e43b3366c15fce02297cf5c088295d4a6882b3e8f75c
E0112 18:45:57.106155 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container a8763df65ea6ac39b7e3e43b3366c15fce02297cf5c088295d4a6882b3e8f75c: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:45:57.106193 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container a8763df65ea6ac39b7e3e43b3366c15fce02297cf5c088295d4a6882b3e8f75c: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:45:57.106386 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id a8763df65ea6ac39b7e3e43b3366c15fce02297cf5c088295d4a6882b3e8f75c with error: API error (500): Cannot start container a8763df65ea6ac39b7e3e43b3366c15fce02297cf5c088295d4a6882b3e8f75c: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:45:57.106414 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container a8763df65ea6ac39b7e3e43b3366c15fce02297cf5c088295d4a6882b3e8f75c: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:45:58.634013 4877 server.go:324] GET /healthz: (25.835us) 200
I0112 18:45:59.561165 4877 server.go:324] GET /healthz: (11.492us) 200
I0112 18:46:03.387731 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=9: (2.127008ms) 500
goroutine 308 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208253c80, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208253c80, 0xc2083861e0, 0x27, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208253c80, 0x7f8a04dbf1b0, 0xc20838d8c0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208253c80, 0xc2080db5f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208253c80, 0xc2080db5f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208253c80, 0xc2080db5f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208253c80, 0xc2080db5f0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208253c80, 0xc2080db5f0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20842c6e0, 0xc2080db5f0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:46:03.427256 4877 server.go:324] GET /healthz: (5.55us) 200
I0112 18:46:03.508674 4877 server.go:324] GET /stats?num_stats=9: (16.921us) 301
I0112 18:46:03.509852 4877 server.go:324] GET /stats/: (538.779us) 500
goroutine 308 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208253f20, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208253f20, 0xc2083a9590, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208253f20, 0x7f8a04dbf1b0, 0xc20838de80)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208253f20, 0xc2083eeb60)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208253f20, 0xc2083eeb60)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208253f20, 0xc2083eeb60)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208253f20, 0xc2083eeb60)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208253f20, 0xc2083eeb60)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20842ca00, 0xc2083eeb60)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:46:06.740699 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:46:06.742831 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:46:06.916653 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id f802cc69afa1cc488f89ab54798bb3840ffeb2a8c0228274a02f57ca39cf9a29
E0112 18:46:06.967896 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container f802cc69afa1cc488f89ab54798bb3840ffeb2a8c0228274a02f57ca39cf9a29: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:46:06.967933 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container f802cc69afa1cc488f89ab54798bb3840ffeb2a8c0228274a02f57ca39cf9a29: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:46:06.968082 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id f802cc69afa1cc488f89ab54798bb3840ffeb2a8c0228274a02f57ca39cf9a29 with error: API error (500): Cannot start container f802cc69afa1cc488f89ab54798bb3840ffeb2a8c0228274a02f57ca39cf9a29: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:46:06.968122 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container f802cc69afa1cc488f89ab54798bb3840ffeb2a8c0228274a02f57ca39cf9a29: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:46:07.238126 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"redis-3", UID:"3475f3f6-9a8b-11e4-af56-42010af0dcb6", APIVersion:"v1beta1", ResourceVersion:"", FieldPath:"spec.containers{redis-master}"}): status: 'waiting', reason: 'pulled' Successfully pulled image "gcr.io/eternal_empire_754/core-reasoning-redis:latest"
I0112 18:46:07.316455 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"redis-3", UID:"3475f3f6-9a8b-11e4-af56-42010af0dcb6", APIVersion:"v1beta1", ResourceVersion:"", FieldPath:"spec.containers{redis-master}"}): status: 'waiting', reason: 'created' Created with docker id bb930007e10640423ac33e0e082865f270a25efd25e739315d4a866642251a49
I0112 18:46:07.414534 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"redis-3", UID:"3475f3f6-9a8b-11e4-af56-42010af0dcb6", APIVersion:"v1beta1", ResourceVersion:"", FieldPath:"spec.containers{redis-master}"}): status: 'running', reason: 'started' Started with docker id bb930007e10640423ac33e0e082865f270a25efd25e739315d4a866642251a49
I0112 18:46:09.607248 4877 server.go:324] GET /healthz: (11.281us) 200
I0112 18:46:11.798738 4877 server.go:324] GET /healthz: (11.067us) 200
I0112 18:46:12.908907 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/cadvisor.manifest": default.cadvisor-agent (cadvisormanifes12uqn2ohido76855gdecd9roadm7l0)
I0112 18:46:12.909356 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/fluentd-es.manifest": default.fluentd-to-elasticsearch (fluentdesmanife2u464h05heqcpotoddodpnehjaqsde)
I0112 18:46:13.393917 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=9: (105.574278ms) 500
goroutine 308 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2082e8a20, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2082e8a20, 0xc2082ea120, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2082e8a20, 0x7f8a04dbf1b0, 0xc2082ee220)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2082e8a20, 0xc2083eeea0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2082e8a20, 0xc2083eeea0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2082e8a20, 0xc2083eeea0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2082e8a20, 0xc2083eeea0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2082e8a20, 0xc2083eeea0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20823f860, 0xc2083eeea0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:46:13.569366 4877 server.go:324] GET /healthz: (6.524us) 200
I0112 18:46:13.635273 4877 server.go:324] GET /stats?num_stats=10: (29.054us) 301
I0112 18:46:13.636639 4877 server.go:324] GET /stats/: (378.213us) 500
goroutine 308 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2082e84e0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2082e84e0, 0xc208254320, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2082e84e0, 0x7f8a04dbf1b0, 0xc2082ee610)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2082e84e0, 0xc2080da9c0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2082e84e0, 0xc2080da9c0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2082e84e0, 0xc2080da9c0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2082e84e0, 0xc2080da9c0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2082e84e0, 0xc2080da9c0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20842c1e0, 0xc2080da9c0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:46:16.743177 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:46:16.745109 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:46:16.844087 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id b836e20517658b577bcb5a4caa89b1a165b812e7abbaf2b3108e52c9705fd082
E0112 18:46:16.891884 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container b836e20517658b577bcb5a4caa89b1a165b812e7abbaf2b3108e52c9705fd082: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:46:16.891918 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container b836e20517658b577bcb5a4caa89b1a165b812e7abbaf2b3108e52c9705fd082: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:46:16.892127 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id b836e20517658b577bcb5a4caa89b1a165b812e7abbaf2b3108e52c9705fd082 with error: API error (500): Cannot start container b836e20517658b577bcb5a4caa89b1a165b812e7abbaf2b3108e52c9705fd082: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:46:16.897985 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container b836e20517658b577bcb5a4caa89b1a165b812e7abbaf2b3108e52c9705fd082: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:46:17.948003 4877 server.go:324] GET /healthz: (13.279us) 200
I0112 18:46:17.961883 4877 server.go:324] GET /api/v1beta1/podInfo?podID=redis-3&podNamespace=default: (6.267357ms) 200
I0112 18:46:19.641634 4877 server.go:324] GET /healthz: (12.107us) 200
I0112 18:46:23.170336 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=9: (2.814199ms) 500
goroutine 308 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2081df9e0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2081df9e0, 0xc208412990, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2081df9e0, 0x7f8a04dbf1b0, 0xc2082a0650)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2081df9e0, 0xc2080dadd0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2081df9e0, 0xc2080dadd0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2081df9e0, 0xc2080dadd0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2081df9e0, 0xc2080dadd0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2081df9e0, 0xc2080dadd0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2083aae60, 0xc2080dadd0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:46:23.242456 4877 server.go:324] GET /healthz: (7.859us) 200
I0112 18:46:23.404528 4877 server.go:324] GET /stats?num_stats=9: (15.418us) 301
I0112 18:46:23.405769 4877 server.go:324] GET /stats/: (612.981us) 500
goroutine 308 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2081dff20, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2081dff20, 0xc208352230, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2081dff20, 0x7f8a04dbf1b0, 0xc2082a0b80)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2081dff20, 0xc2084660d0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2081dff20, 0xc2084660d0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2081dff20, 0xc2084660d0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2081dff20, 0xc2084660d0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2081dff20, 0xc2084660d0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2083ab220, 0xc2084660d0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:46:24.687286 4877 server.go:324] GET /healthz: (11.088us) 200
I0112 18:46:26.745663 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:46:26.750153 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:46:26.828113 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id e7c259c22cc038a2cdc9863da76e7a28489cfa4426c0abfeda26257e279eef4a
E0112 18:46:26.871723 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container e7c259c22cc038a2cdc9863da76e7a28489cfa4426c0abfeda26257e279eef4a: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:46:26.871756 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container e7c259c22cc038a2cdc9863da76e7a28489cfa4426c0abfeda26257e279eef4a: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:46:26.871879 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id e7c259c22cc038a2cdc9863da76e7a28489cfa4426c0abfeda26257e279eef4a with error: API error (500): Cannot start container e7c259c22cc038a2cdc9863da76e7a28489cfa4426c0abfeda26257e279eef4a: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:46:26.877673 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container e7c259c22cc038a2cdc9863da76e7a28489cfa4426c0abfeda26257e279eef4a: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:46:29.675059 4877 server.go:324] GET /healthz: (10.382us) 200
I0112 18:46:32.910345 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/cadvisor.manifest": default.cadvisor-agent (cadvisormanifes12uqn2ohido76855gdecd9roadm7l0)
I0112 18:46:32.910725 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/fluentd-es.manifest": default.fluentd-to-elasticsearch (fluentdesmanife2u464h05heqcpotoddodpnehjaqsde)
I0112 18:46:33.227891 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=9: (2.510562ms) 500
goroutine 308 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2081c3aa0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2081c3aa0, 0xc208474fc0, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2081c3aa0, 0x7f8a04dbf1b0, 0xc208314610)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2081c3aa0, 0xc208466340)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2081c3aa0, 0xc208466340)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2081c3aa0, 0xc208466340)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2081c3aa0, 0xc208466340)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2081c3aa0, 0xc208466340)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20823efa0, 0xc208466340)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:46:33.256739 4877 server.go:324] GET /healthz: (5.622us) 200
I0112 18:46:33.313706 4877 server.go:324] GET /stats?num_stats=9: (12.915us) 301
I0112 18:46:33.314888 4877 server.go:324] GET /stats/: (383.82us) 500
goroutine 308 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20817c0c0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20817c0c0, 0xc20838b130, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20817c0c0, 0x7f8a04dbf1b0, 0xc208314b50)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20817c0c0, 0xc2083eef70)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20817c0c0, 0xc2083eef70)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20817c0c0, 0xc2083eef70)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20817c0c0, 0xc2083eef70)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20817c0c0, 0xc2083eef70)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20800e0a0, 0xc2083eef70)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:46:36.748171 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:46:36.750125 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:46:36.824306 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 97352b264eacd01074046fb5aab7ea39e642b4f9980e473208d5d06aa08ad402
E0112 18:46:36.859816 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 97352b264eacd01074046fb5aab7ea39e642b4f9980e473208d5d06aa08ad402: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:46:36.859851 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 97352b264eacd01074046fb5aab7ea39e642b4f9980e473208d5d06aa08ad402: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:46:36.859925 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 97352b264eacd01074046fb5aab7ea39e642b4f9980e473208d5d06aa08ad402 with error: API error (500): Cannot start container 97352b264eacd01074046fb5aab7ea39e642b4f9980e473208d5d06aa08ad402: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:46:36.865449 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 97352b264eacd01074046fb5aab7ea39e642b4f9980e473208d5d06aa08ad402: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:46:37.732995 4877 server.go:324] GET /healthz: (10.841us) 200
I0112 18:46:39.720940 4877 server.go:324] GET /healthz: (16.562us) 200
I0112 18:46:43.276745 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=9: (2.757201ms) 500
goroutine 308 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208172240, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208172240, 0xc20822a5a0, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208172240, 0x7f8a04dbf1b0, 0xc208145190)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208172240, 0xc2083ef1e0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208172240, 0xc2083ef1e0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208172240, 0xc2083ef1e0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208172240, 0xc2083ef1e0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208172240, 0xc2083ef1e0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2084185a0, 0xc2083ef1e0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:46:43.441155 4877 server.go:324] GET /healthz: (11.252us) 200
I0112 18:46:43.527569 4877 server.go:324] GET /stats?num_stats=10: (35.298us) 301
I0112 18:46:43.528924 4877 server.go:324] GET /stats/: (614.359us) 500
goroutine 308 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208172840, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208172840, 0xc20833a8c0, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208172840, 0x7f8a04dbf1b0, 0xc208145890)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208172840, 0xc2080daea0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208172840, 0xc2080daea0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208172840, 0xc2080daea0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208172840, 0xc2080daea0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208172840, 0xc2080daea0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2084188c0, 0xc2080daea0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:46:46.750745 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:46:46.752681 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:46:46.844605 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 241d2dd0855610b004880adb97a2f99bf2790e4c66d641e6b02b0e1b6ae2d280
E0112 18:46:46.884105 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 241d2dd0855610b004880adb97a2f99bf2790e4c66d641e6b02b0e1b6ae2d280: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:46:46.884157 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 241d2dd0855610b004880adb97a2f99bf2790e4c66d641e6b02b0e1b6ae2d280: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:46:46.884420 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 241d2dd0855610b004880adb97a2f99bf2790e4c66d641e6b02b0e1b6ae2d280 with error: API error (500): Cannot start container 241d2dd0855610b004880adb97a2f99bf2790e4c66d641e6b02b0e1b6ae2d280: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:46:46.889792 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 241d2dd0855610b004880adb97a2f99bf2790e4c66d641e6b02b0e1b6ae2d280: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:46:49.129596 4877 server.go:324] GET /healthz: (11.524us) 200
I0112 18:46:49.144849 4877 server.go:324] GET /api/v1beta1/podInfo?podID=redis-3&podNamespace=default: (5.53428ms) 200
I0112 18:46:49.761450 4877 server.go:324] GET /healthz: (11.664us) 200
I0112 18:46:50.815964 4877 server.go:324] GET /healthz: (11.183us) 200
I0112 18:46:52.911599 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/cadvisor.manifest": default.cadvisor-agent (cadvisormanifes12uqn2ohido76855gdecd9roadm7l0)
I0112 18:46:52.911986 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/fluentd-es.manifest": default.fluentd-to-elasticsearch (fluentdesmanife2u464h05heqcpotoddodpnehjaqsde)
I0112 18:46:53.170003 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=9: (2.731827ms) 500
goroutine 308 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20817d140, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20817d140, 0xc2084862d0, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20817d140, 0x7f8a04dbf1b0, 0xc2082a0b20)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20817d140, 0xc2080db2b0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20817d140, 0xc2080db2b0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20817d140, 0xc2080db2b0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20817d140, 0xc2080db2b0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20817d140, 0xc2080db2b0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2083ab900, 0xc2080db2b0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:46:53.233359 4877 server.go:324] GET /healthz: (9.208us) 200
I0112 18:46:53.297513 4877 server.go:324] GET /stats?num_stats=9: (36.601us) 301
I0112 18:46:53.298957 4877 server.go:324] GET /stats/: (633.498us) 500
goroutine 308 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20817d6e0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20817d6e0, 0xc208369ef0, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20817d6e0, 0x7f8a04dbf1b0, 0xc2082a0f70)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20817d6e0, 0xc20814cc30)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20817d6e0, 0xc20814cc30)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20817d6e0, 0xc20814cc30)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20817d6e0, 0xc20814cc30)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20817d6e0, 0xc20814cc30)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2083abb80, 0xc20814cc30)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:46:56.753043 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:46:56.755130 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:46:56.828950 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 39612b65e994976d47be96b8512041d7886aca019be4c3cd1675adbe710a2af0
E0112 18:46:56.860381 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 39612b65e994976d47be96b8512041d7886aca019be4c3cd1675adbe710a2af0: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:46:56.860424 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 39612b65e994976d47be96b8512041d7886aca019be4c3cd1675adbe710a2af0: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:46:56.860625 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 39612b65e994976d47be96b8512041d7886aca019be4c3cd1675adbe710a2af0 with error: API error (500): Cannot start container 39612b65e994976d47be96b8512041d7886aca019be4c3cd1675adbe710a2af0: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:46:56.866341 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 39612b65e994976d47be96b8512041d7886aca019be4c3cd1675adbe710a2af0: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:46:57.337067 4877 server.go:324] GET /healthz: (13.853us) 200
I0112 18:46:57.351374 4877 server.go:324] GET /containerLogs/default/redis-3/redis-master?follow=false: (11.817796ms) 200
I0112 18:46:59.789569 4877 server.go:324] GET /healthz: (12.845us) 200
I0112 18:47:03.205850 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=9: (2.461722ms) 500
goroutine 308 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20816baa0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20816baa0, 0xc2084178c0, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20816baa0, 0x7f8a04dbf1b0, 0xc208339590)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20816baa0, 0xc20814dad0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20816baa0, 0xc20814dad0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20816baa0, 0xc20814dad0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20816baa0, 0xc20814dad0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20816baa0, 0xc20814dad0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208418d20, 0xc20814dad0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:47:03.236431 4877 server.go:324] GET /healthz: (12.35us) 200
I0112 18:47:03.282318 4877 server.go:324] GET /stats?num_stats=9: (35.977us) 301
I0112 18:47:03.283542 4877 server.go:324] GET /stats/: (563.759us) 500
goroutine 308 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2081de120, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2081de120, 0xc20838aaf0, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2081de120, 0x7f8a04dbf1b0, 0xc2083399f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2081de120, 0xc2082b9c70)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2081de120, 0xc2082b9c70)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2081de120, 0xc2082b9c70)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2081de120, 0xc2082b9c70)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2081de120, 0xc2082b9c70)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208419040, 0xc2082b9c70)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:47:03.826706 4877 server.go:324] GET /healthz: (11.348us) 200
I0112 18:47:06.755775 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:47:06.757616 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:47:06.852833 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 4ce0bfa6c3499389bd9f345e9265b6887df577bf86433115823a7314bf6a12d6
E0112 18:47:06.892622 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 4ce0bfa6c3499389bd9f345e9265b6887df577bf86433115823a7314bf6a12d6: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:47:06.892666 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 4ce0bfa6c3499389bd9f345e9265b6887df577bf86433115823a7314bf6a12d6: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:47:06.892889 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 4ce0bfa6c3499389bd9f345e9265b6887df577bf86433115823a7314bf6a12d6 with error: API error (500): Cannot start container 4ce0bfa6c3499389bd9f345e9265b6887df577bf86433115823a7314bf6a12d6: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:47:06.898166 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 4ce0bfa6c3499389bd9f345e9265b6887df577bf86433115823a7314bf6a12d6: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:47:09.830474 4877 server.go:324] GET /healthz: (11.158us) 200
I0112 18:47:12.912817 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/cadvisor.manifest": default.cadvisor-agent (cadvisormanifes12uqn2ohido76855gdecd9roadm7l0)
I0112 18:47:12.913143 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/fluentd-es.manifest": default.fluentd-to-elasticsearch (fluentdesmanife2u464h05heqcpotoddodpnehjaqsde)
I0112 18:47:13.229221 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=9: (5.679497ms) 500
goroutine 308 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208442000, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208442000, 0xc208272240, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208442000, 0x7f8a04dbf1b0, 0xc2082a69f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208442000, 0xc2082b9ee0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208442000, 0xc2082b9ee0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208442000, 0xc2082b9ee0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208442000, 0xc2082b9ee0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208442000, 0xc2082b9ee0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208418000, 0xc2082b9ee0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:47:13.258684 4877 server.go:324] GET /healthz: (8.44us) 200
I0112 18:47:13.327304 4877 server.go:324] GET /stats?num_stats=10: (24.683us) 301
I0112 18:47:13.328813 4877 server.go:324] GET /stats/: (742.64us) 500
goroutine 308 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208442660, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208442660, 0xc2083a8370, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208442660, 0x7f8a04dbf1b0, 0xc2082a6ef0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208442660, 0xc2082b85b0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208442660, 0xc2082b85b0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208442660, 0xc2082b85b0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208442660, 0xc2082b85b0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208442660, 0xc2082b85b0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208418280, 0xc2082b85b0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:47:16.758135 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:47:16.760008 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:47:16.844860 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 477f20610c8b149b9f38eabbf5d689179c9d549020732f19bf609689920fc33a
I0112 18:47:16.848527 4877 server.go:324] GET /healthz: (10.191us) 200
E0112 18:47:16.887982 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 477f20610c8b149b9f38eabbf5d689179c9d549020732f19bf609689920fc33a: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:47:16.888019 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 477f20610c8b149b9f38eabbf5d689179c9d549020732f19bf609689920fc33a: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:47:16.888193 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 477f20610c8b149b9f38eabbf5d689179c9d549020732f19bf609689920fc33a with error: API error (500): Cannot start container 477f20610c8b149b9f38eabbf5d689179c9d549020732f19bf609689920fc33a: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:47:16.893270 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 477f20610c8b149b9f38eabbf5d689179c9d549020732f19bf609689920fc33a: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:47:17.019412 4877 server.go:324] GET /healthz: (10.492us) 200
I0112 18:47:19.873780 4877 server.go:324] GET /healthz: (11.94us) 200
I0112 18:47:20.256020 4877 server.go:324] GET /healthz: (11.039us) 200
I0112 18:47:20.278607 4877 server.go:324] GET /api/v1beta1/podInfo?podID=redis-3&podNamespace=default: (12.40639ms) 200
I0112 18:47:23.194886 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=9: (2.30167ms) 500
goroutine 308 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2081c3b00, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2081c3b00, 0xc2082e0870, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2081c3b00, 0x7f8a04dbf1b0, 0xc2082a15a0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2081c3b00, 0xc2082b8820)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2081c3b00, 0xc2082b8820)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2081c3b00, 0xc2082b8820)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2081c3b00, 0xc2082b8820)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2081c3b00, 0xc2082b8820)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2083ab2c0, 0xc2082b8820)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:47:23.352218 4877 server.go:324] GET /healthz: (13.69us) 200
I0112 18:47:23.397419 4877 server.go:324] GET /stats?num_stats=10: (17.708us) 301
I0112 18:47:23.398819 4877 server.go:324] GET /stats/: (629.98us) 500
goroutine 308 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20817c120, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20817c120, 0xc208254410, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20817c120, 0x7f8a04dbf1b0, 0xc2082a1ad0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20817c120, 0xc20814de10)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20817c120, 0xc20814de10)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20817c120, 0xc20814de10)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20817c120, 0xc20814de10)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20817c120, 0xc20814de10)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2083ab5e0, 0xc20814de10)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:47:26.760239 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:47:26.764495 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:47:26.828609 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id b9de4e00c4d97dfabea7d4638bc30f5b50c3cbad1f88c70a0b5a4f36e8f01d95
E0112 18:47:26.876314 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container b9de4e00c4d97dfabea7d4638bc30f5b50c3cbad1f88c70a0b5a4f36e8f01d95: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:47:26.876358 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container b9de4e00c4d97dfabea7d4638bc30f5b50c3cbad1f88c70a0b5a4f36e8f01d95: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:47:26.876555 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id b9de4e00c4d97dfabea7d4638bc30f5b50c3cbad1f88c70a0b5a4f36e8f01d95 with error: API error (500): Cannot start container b9de4e00c4d97dfabea7d4638bc30f5b50c3cbad1f88c70a0b5a4f36e8f01d95: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:47:26.883032 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container b9de4e00c4d97dfabea7d4638bc30f5b50c3cbad1f88c70a0b5a4f36e8f01d95: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:47:29.940453 4877 server.go:324] GET /healthz: (21.067us) 200
I0112 18:47:30.195601 4877 server.go:324] GET /healthz: (14.065us) 200
I0112 18:47:32.914069 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/cadvisor.manifest": default.cadvisor-agent (cadvisormanifes12uqn2ohido76855gdecd9roadm7l0)
I0112 18:47:32.914352 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/fluentd-es.manifest": default.fluentd-to-elasticsearch (fluentdesmanife2u464h05heqcpotoddodpnehjaqsde)
I0112 18:47:33.324499 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=9: (2.535972ms) 500
goroutine 308 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2081c3bc0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2081c3bc0, 0xc208400f30, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2081c3bc0, 0x7f8a04dbf1b0, 0xc208307700)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2081c3bc0, 0xc2080da410)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2081c3bc0, 0xc2080da410)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2081c3bc0, 0xc2080da410)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2081c3bc0, 0xc2080da410)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2081c3bc0, 0xc2080da410)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20823f7c0, 0xc2080da410)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:47:33.354775 4877 server.go:324] GET /healthz: (11.891us) 200
I0112 18:47:33.428414 4877 server.go:324] GET /stats?num_stats=9: (22.759us) 301
I0112 18:47:33.429928 4877 server.go:324] GET /stats/: (578.415us) 500
goroutine 308 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208176240, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208176240, 0xc20838b770, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208176240, 0x7f8a04dbf1b0, 0xc208307b10)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208176240, 0xc2083eeea0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208176240, 0xc2083eeea0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208176240, 0xc2083eeea0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208176240, 0xc2083eeea0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208176240, 0xc2083eeea0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20812b4a0, 0xc2083eeea0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:47:36.762901 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:47:36.764907 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:47:36.865168 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 1019d7526afab54d3e02a6b2f3723487d496f75f5f3509928c8974229838c24a
E0112 18:47:36.900306 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 1019d7526afab54d3e02a6b2f3723487d496f75f5f3509928c8974229838c24a: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:47:36.900350 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 1019d7526afab54d3e02a6b2f3723487d496f75f5f3509928c8974229838c24a: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:47:36.900537 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 1019d7526afab54d3e02a6b2f3723487d496f75f5f3509928c8974229838c24a with error: API error (500): Cannot start container 1019d7526afab54d3e02a6b2f3723487d496f75f5f3509928c8974229838c24a: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:47:36.905645 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 1019d7526afab54d3e02a6b2f3723487d496f75f5f3509928c8974229838c24a: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:47:40.041089 4877 server.go:324] GET /healthz: (11.219us) 200
I0112 18:47:43.533157 4877 server.go:324] GET /healthz: (10.794us) 200
I0112 18:47:46.765767 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:47:46.767779 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:47:46.836854 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 6972bc6b8290862dfdf6ac889ab067e36787bab50106190d5281eb7a15352f96
E0112 18:47:46.880486 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 6972bc6b8290862dfdf6ac889ab067e36787bab50106190d5281eb7a15352f96: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:47:46.880529 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 6972bc6b8290862dfdf6ac889ab067e36787bab50106190d5281eb7a15352f96: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:47:46.880793 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 6972bc6b8290862dfdf6ac889ab067e36787bab50106190d5281eb7a15352f96 with error: API error (500): Cannot start container 6972bc6b8290862dfdf6ac889ab067e36787bab50106190d5281eb7a15352f96: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:47:46.886195 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 6972bc6b8290862dfdf6ac889ab067e36787bab50106190d5281eb7a15352f96: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:47:50.086250 4877 server.go:324] GET /healthz: (11.595us) 200
I0112 18:47:51.410774 4877 server.go:324] GET /healthz: (13.657us) 200
I0112 18:47:51.446685 4877 server.go:324] GET /api/v1beta1/podInfo?podID=redis-3&podNamespace=default: (5.042968ms) 200
I0112 18:47:52.915200 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/cadvisor.manifest": default.cadvisor-agent (cadvisormanifes12uqn2ohido76855gdecd9roadm7l0)
I0112 18:47:52.915506 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/fluentd-es.manifest": default.fluentd-to-elasticsearch (fluentdesmanife2u464h05heqcpotoddodpnehjaqsde)
I0112 18:47:56.553897 4877 server.go:324] GET /healthz: (24.945us) 200
I0112 18:47:56.768381 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:47:56.770684 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:47:56.873293 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id c0297c9269a11f7aea2695f5ba8e02bd19d66254d479f50bab79499224e5e156
E0112 18:47:56.904481 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container c0297c9269a11f7aea2695f5ba8e02bd19d66254d479f50bab79499224e5e156: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:47:56.904525 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container c0297c9269a11f7aea2695f5ba8e02bd19d66254d479f50bab79499224e5e156: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:47:56.904753 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id c0297c9269a11f7aea2695f5ba8e02bd19d66254d479f50bab79499224e5e156 with error: API error (500): Cannot start container c0297c9269a11f7aea2695f5ba8e02bd19d66254d479f50bab79499224e5e156: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:47:56.910442 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container c0297c9269a11f7aea2695f5ba8e02bd19d66254d479f50bab79499224e5e156: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:48:00.127878 4877 server.go:324] GET /healthz: (11.347us) 200
I0112 18:48:03.416494 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=10: (2.559581ms) 500
goroutine 458 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2082ccb40, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2082ccb40, 0xc208220360, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2082ccb40, 0x7f8a04dbf1b0, 0xc208364680)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2082ccb40, 0xc2083ee750)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2082ccb40, 0xc2083ee750)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2082ccb40, 0xc2083ee750)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2082ccb40, 0xc2083ee750)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2082ccb40, 0xc2083ee750)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2082ea3c0, 0xc2083ee750)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:48:03.614413 4877 server.go:324] GET /healthz: (14.148us) 200
I0112 18:48:03.671853 4877 server.go:324] GET /stats?num_stats=10: (26.721us) 301
I0112 18:48:03.673235 4877 server.go:324] GET /stats/: (598.307us) 500
goroutine 458 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2082cd0e0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2082cd0e0, 0xc2083a8500, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2082cd0e0, 0x7f8a04dbf1b0, 0xc208364ba0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2082cd0e0, 0xc2083eeea0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2082cd0e0, 0xc2083eeea0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2082cd0e0, 0xc2083eeea0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2082cd0e0, 0xc2083eeea0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2082cd0e0, 0xc2083eeea0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2082ea640, 0xc2083eeea0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:48:06.770728 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:48:06.772556 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:48:06.864305 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 32a212093bb637c2038852779ebbb12f84ac398bee25a6b7eacfdd5b7e27123a
E0112 18:48:06.892759 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 32a212093bb637c2038852779ebbb12f84ac398bee25a6b7eacfdd5b7e27123a: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:48:06.892818 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 32a212093bb637c2038852779ebbb12f84ac398bee25a6b7eacfdd5b7e27123a: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:48:06.893019 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 32a212093bb637c2038852779ebbb12f84ac398bee25a6b7eacfdd5b7e27123a with error: API error (500): Cannot start container 32a212093bb637c2038852779ebbb12f84ac398bee25a6b7eacfdd5b7e27123a: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:48:06.898308 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 32a212093bb637c2038852779ebbb12f84ac398bee25a6b7eacfdd5b7e27123a: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:48:09.576309 4877 server.go:324] GET /healthz: (10.701us) 200
I0112 18:48:10.163957 4877 server.go:324] GET /healthz: (12.222us) 200
I0112 18:48:12.916312 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/cadvisor.manifest": default.cadvisor-agent (cadvisormanifes12uqn2ohido76855gdecd9roadm7l0)
I0112 18:48:12.916629 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/fluentd-es.manifest": default.fluentd-to-elasticsearch (fluentdesmanife2u464h05heqcpotoddodpnehjaqsde)
I0112 18:48:13.263310 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=9: (2.756633ms) 500
goroutine 458 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2084623c0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2084623c0, 0xc2084615f0, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2084623c0, 0x7f8a04dbf1b0, 0xc208149dc0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2084623c0, 0xc2083ef110)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2084623c0, 0xc2083ef110)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2084623c0, 0xc2083ef110)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2084623c0, 0xc2083ef110)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2084623c0, 0xc2083ef110)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2083ab5e0, 0xc2083ef110)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:48:13.358717 4877 server.go:324] GET /healthz: (11.302us) 200
I0112 18:48:13.407362 4877 server.go:324] GET /stats?num_stats=9: (25.164us) 301
I0112 18:48:13.408760 4877 server.go:324] GET /stats/: (601.66us) 500
goroutine 458 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208462900, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208462900, 0xc208353220, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208462900, 0x7f8a04dbf1b0, 0xc208214440)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208462900, 0xc2080db2b0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208462900, 0xc2080db2b0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208462900, 0xc2080db2b0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208462900, 0xc2080db2b0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208462900, 0xc2080db2b0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2083ab9a0, 0xc2080db2b0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:48:16.772946 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:48:16.774830 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:48:16.841120 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 991cfc4e7461f328446732c9c0d220bc45f82df2a06bc16da9cdf39dbb1c2c8f
E0112 18:48:16.864593 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 991cfc4e7461f328446732c9c0d220bc45f82df2a06bc16da9cdf39dbb1c2c8f: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:48:16.864635 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 991cfc4e7461f328446732c9c0d220bc45f82df2a06bc16da9cdf39dbb1c2c8f: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:48:16.864874 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 991cfc4e7461f328446732c9c0d220bc45f82df2a06bc16da9cdf39dbb1c2c8f with error: API error (500): Cannot start container 991cfc4e7461f328446732c9c0d220bc45f82df2a06bc16da9cdf39dbb1c2c8f: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:48:16.869938 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 991cfc4e7461f328446732c9c0d220bc45f82df2a06bc16da9cdf39dbb1c2c8f: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:48:20.211415 4877 server.go:324] GET /healthz: (10.611us) 200
I0112 18:48:22.852776 4877 server.go:324] GET /healthz: (18.958us) 200
I0112 18:48:22.927273 4877 server.go:324] GET /healthz: (11.444us) 200
I0112 18:48:22.945378 4877 server.go:324] GET /api/v1beta1/podInfo?podID=redis-3&podNamespace=default: (5.100555ms) 200
I0112 18:48:23.169347 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=9: (2.284986ms) 500
goroutine 458 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20817c300, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20817c300, 0xc2082b18c0, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20817c300, 0x7f8a04dbf1b0, 0xc2081bc820)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20817c300, 0xc2080db5f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20817c300, 0xc2080db5f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20817c300, 0xc2080db5f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20817c300, 0xc2080db5f0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20817c300, 0xc2080db5f0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2080efb80, 0xc2080db5f0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:48:23.326591 4877 server.go:324] GET /healthz: (11.554us) 200
I0112 18:48:23.362442 4877 server.go:324] GET /stats?num_stats=9: (23.708us) 301
I0112 18:48:23.363785 4877 server.go:324] GET /stats/: (587.342us) 500
goroutine 458 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20817c900, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20817c900, 0xc2082559f0, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20817c900, 0x7f8a04dbf1b0, 0xc2081bcd90)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20817c900, 0xc208432f70)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20817c900, 0xc208432f70)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20817c900, 0xc208432f70)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20817c900, 0xc208432f70)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20817c900, 0xc208432f70)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20823e960, 0xc208432f70)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:48:26.775159 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:48:26.777064 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:48:26.868882 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 8ab470c57e0d4a2123115893a6dce7ff0cc2f00be3984fa308e157fccb55a728
E0112 18:48:26.900074 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 8ab470c57e0d4a2123115893a6dce7ff0cc2f00be3984fa308e157fccb55a728: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:48:26.900133 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 8ab470c57e0d4a2123115893a6dce7ff0cc2f00be3984fa308e157fccb55a728: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:48:26.900345 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 8ab470c57e0d4a2123115893a6dce7ff0cc2f00be3984fa308e157fccb55a728 with error: API error (500): Cannot start container 8ab470c57e0d4a2123115893a6dce7ff0cc2f00be3984fa308e157fccb55a728: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:48:26.905815 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 8ab470c57e0d4a2123115893a6dce7ff0cc2f00be3984fa308e157fccb55a728: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:48:30.256248 4877 server.go:324] GET /healthz: (10.918us) 200
I0112 18:48:32.917595 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/cadvisor.manifest": default.cadvisor-agent (cadvisormanifes12uqn2ohido76855gdecd9roadm7l0)
I0112 18:48:32.917928 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/fluentd-es.manifest": default.fluentd-to-elasticsearch (fluentdesmanife2u464h05heqcpotoddodpnehjaqsde)
I0112 18:48:33.196046 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=9: (2.50205ms) 500
goroutine 458 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208173f80, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208173f80, 0xc208142900, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208173f80, 0x7f8a04dbf1b0, 0xc20834bf50)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208173f80, 0xc2084331e0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208173f80, 0xc2084331e0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208173f80, 0xc2084331e0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208173f80, 0xc2084331e0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208173f80, 0xc2084331e0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2082eb680, 0xc2084331e0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:48:33.277839 4877 server.go:324] GET /healthz: (15.958us) 200
I0112 18:48:33.347486 4877 server.go:324] GET /stats?num_stats=9: (30.371us) 301
I0112 18:48:33.348920 4877 server.go:324] GET /stats/: (658.978us) 500
goroutine 458 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2081c2600, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2081c2600, 0xc2083a9220, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2081c2600, 0x7f8a04dbf1b0, 0xc208338480)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2081c2600, 0xc208433110)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2081c2600, 0xc208433110)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2081c2600, 0xc208433110)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2081c2600, 0xc208433110)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2081c2600, 0xc208433110)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2082eb900, 0xc208433110)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:48:36.022822 4877 server.go:324] GET /healthz: (11.903us) 200
I0112 18:48:36.777456 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:48:36.779449 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:48:36.876782 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id b627bd1d4e6b3695a8766e95ecc607ef18441b9409ed81d0b828c15736aaf06a
E0112 18:48:36.900351 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container b627bd1d4e6b3695a8766e95ecc607ef18441b9409ed81d0b828c15736aaf06a: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:48:36.900401 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container b627bd1d4e6b3695a8766e95ecc607ef18441b9409ed81d0b828c15736aaf06a: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:48:36.900508 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id b627bd1d4e6b3695a8766e95ecc607ef18441b9409ed81d0b828c15736aaf06a with error: API error (500): Cannot start container b627bd1d4e6b3695a8766e95ecc607ef18441b9409ed81d0b828c15736aaf06a: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:48:36.905848 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container b627bd1d4e6b3695a8766e95ecc607ef18441b9409ed81d0b828c15736aaf06a: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:48:40.296668 4877 server.go:324] GET /healthz: (11.683us) 200
I0112 18:48:43.168098 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=9: (2.666514ms) 500
goroutine 458 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208493b60, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208493b60, 0xc20849b950, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208493b60, 0x7f8a04dbf1b0, 0xc2082fb740)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208493b60, 0xc208433520)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208493b60, 0xc208433520)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208493b60, 0xc208433520)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208493b60, 0xc208433520)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208493b60, 0xc208433520)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2083ab720, 0xc208433520)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:48:43.260493 4877 server.go:324] GET /healthz: (16.826us) 200
I0112 18:48:43.304964 4877 server.go:324] GET /stats?num_stats=9: (198.871us) 301
I0112 18:48:43.306416 4877 server.go:324] GET /stats/: (662.985us) 500
goroutine 458 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208482120, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208482120, 0xc208353220, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208482120, 0x7f8a04dbf1b0, 0xc2082fbe30)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208482120, 0xc2080db380)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208482120, 0xc2080db380)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208482120, 0xc2080db380)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208482120, 0xc2080db380)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208482120, 0xc2080db380)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2083abb80, 0xc2080db380)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:48:46.779892 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:48:46.784545 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:48:46.848773 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id e5ccce73ec3f0cacacc99ea2063377070f306c526e2724cc308d91eb4c879f50
E0112 18:48:46.892507 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container e5ccce73ec3f0cacacc99ea2063377070f306c526e2724cc308d91eb4c879f50: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:48:46.892563 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container e5ccce73ec3f0cacacc99ea2063377070f306c526e2724cc308d91eb4c879f50: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:48:46.892827 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id e5ccce73ec3f0cacacc99ea2063377070f306c526e2724cc308d91eb4c879f50 with error: API error (500): Cannot start container e5ccce73ec3f0cacacc99ea2063377070f306c526e2724cc308d91eb4c879f50: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:48:46.892860 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container e5ccce73ec3f0cacacc99ea2063377070f306c526e2724cc308d91eb4c879f50: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:48:49.128081 4877 server.go:324] GET /healthz: (11.441us) 200
I0112 18:48:50.338078 4877 server.go:324] GET /healthz: (11.535us) 200
I0112 18:48:52.918920 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/cadvisor.manifest": default.cadvisor-agent (cadvisormanifes12uqn2ohido76855gdecd9roadm7l0)
I0112 18:48:52.919285 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/fluentd-es.manifest": default.fluentd-to-elasticsearch (fluentdesmanife2u464h05heqcpotoddodpnehjaqsde)
I0112 18:48:53.143794 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=9: (2.601379ms) 500
goroutine 458 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2081726c0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2081726c0, 0xc20844eea0, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2081726c0, 0x7f8a04dbf1b0, 0xc208307890)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2081726c0, 0xc2080db790)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2081726c0, 0xc2080db790)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2081726c0, 0xc2080db790)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2081726c0, 0xc2080db790)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2081726c0, 0xc2080db790)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2082ebcc0, 0xc2080db790)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:48:53.446285 4877 server.go:324] GET /healthz: (11.915us) 200
I0112 18:48:53.515906 4877 server.go:324] GET /stats?num_stats=10: (31.9us) 301
I0112 18:48:53.517188 4877 server.go:324] GET /stats/: (572.444us) 500
goroutine 458 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208172d20, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208172d20, 0xc20838b900, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208172d20, 0x7f8a04dbf1b0, 0xc208307d00)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208172d20, 0xc208432750)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208172d20, 0xc208432750)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208172d20, 0xc208432750)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208172d20, 0xc208432750)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208172d20, 0xc208432750)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2082ebf40, 0xc208432750)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:48:54.297326 4877 server.go:324] GET /healthz: (12.138us) 200
I0112 18:48:54.314212 4877 server.go:324] GET /api/v1beta1/podInfo?podID=redis-3&podNamespace=default: (5.353238ms) 200
I0112 18:48:56.782317 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:48:56.784268 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:48:56.845038 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id c60c801db93fcad93ee22e755ed1c34795b422cd121f644af8b497f9c54da077
E0112 18:48:56.876468 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container c60c801db93fcad93ee22e755ed1c34795b422cd121f644af8b497f9c54da077: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:48:56.876515 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container c60c801db93fcad93ee22e755ed1c34795b422cd121f644af8b497f9c54da077: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:48:56.876702 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id c60c801db93fcad93ee22e755ed1c34795b422cd121f644af8b497f9c54da077 with error: API error (500): Cannot start container c60c801db93fcad93ee22e755ed1c34795b422cd121f644af8b497f9c54da077: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:48:56.899557 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container c60c801db93fcad93ee22e755ed1c34795b422cd121f644af8b497f9c54da077: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:48:56.933530 4877 restclient.go:141] Waiting for completion of operation 2306
I0112 18:49:00.382110 4877 server.go:324] GET /healthz: (12.592us) 200
I0112 18:49:02.383369 4877 server.go:324] GET /healthz: (11.238us) 200
I0112 18:49:03.187272 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=9: (2.669878ms) 500
goroutine 458 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208482b40, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208482b40, 0xc2083e4360, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208482b40, 0x7f8a04dbf1b0, 0xc20838d8f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208482b40, 0xc2084329c0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208482b40, 0xc2084329c0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208482b40, 0xc2084329c0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208482b40, 0xc2084329c0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208482b40, 0xc2084329c0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2083abc20, 0xc2084329c0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:49:03.236791 4877 server.go:324] GET /healthz: (10.943us) 200
I0112 18:49:03.323757 4877 server.go:324] GET /stats?num_stats=9: (24.172us) 301
I0112 18:49:03.325058 4877 server.go:324] GET /stats/: (573.711us) 500
goroutine 458 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2084830e0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2084830e0, 0xc20833b5e0, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2084830e0, 0x7f8a04dbf1b0, 0xc20838de20)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2084830e0, 0xc2084328f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2084830e0, 0xc2084328f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2084830e0, 0xc2084328f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2084830e0, 0xc2084328f0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2084830e0, 0xc2084328f0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2082ea000, 0xc2084328f0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:49:05.413895 4877 server.go:324] GET /healthz: (11.091us) 200
I0112 18:49:06.784786 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:49:06.786950 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:49:06.884850 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id e661aa3c6aae88ec9dd44f00e2e80a28db9f997d1fcb1014a119d6b1e30e5d98
E0112 18:49:06.932353 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container e661aa3c6aae88ec9dd44f00e2e80a28db9f997d1fcb1014a119d6b1e30e5d98: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:49:06.932397 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container e661aa3c6aae88ec9dd44f00e2e80a28db9f997d1fcb1014a119d6b1e30e5d98: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:49:06.932615 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id e661aa3c6aae88ec9dd44f00e2e80a28db9f997d1fcb1014a119d6b1e30e5d98 with error: API error (500): Cannot start container e661aa3c6aae88ec9dd44f00e2e80a28db9f997d1fcb1014a119d6b1e30e5d98: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:49:06.938200 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container e661aa3c6aae88ec9dd44f00e2e80a28db9f997d1fcb1014a119d6b1e30e5d98: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:49:10.412496 4877 server.go:324] GET /healthz: (14.66us) 200
I0112 18:49:12.920194 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/cadvisor.manifest": default.cadvisor-agent (cadvisormanifes12uqn2ohido76855gdecd9roadm7l0)
I0112 18:49:12.920520 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/fluentd-es.manifest": default.fluentd-to-elasticsearch (fluentdesmanife2u464h05heqcpotoddodpnehjaqsde)
I0112 18:49:15.376666 4877 server.go:324] GET /healthz: (10.725us) 200
I0112 18:49:16.787400 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:49:16.789646 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:49:16.901318 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 3a2fc39ace1401c18c2536a65d3ed1897ecbf709de10190154a92548e44e67df
E0112 18:49:16.940792 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 3a2fc39ace1401c18c2536a65d3ed1897ecbf709de10190154a92548e44e67df: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:49:16.940845 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 3a2fc39ace1401c18c2536a65d3ed1897ecbf709de10190154a92548e44e67df: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:49:16.941093 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 3a2fc39ace1401c18c2536a65d3ed1897ecbf709de10190154a92548e44e67df with error: API error (500): Cannot start container 3a2fc39ace1401c18c2536a65d3ed1897ecbf709de10190154a92548e44e67df: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:49:16.946807 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 3a2fc39ace1401c18c2536a65d3ed1897ecbf709de10190154a92548e44e67df: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:49:20.459002 4877 server.go:324] GET /healthz: (11.782us) 200
I0112 18:49:25.791123 4877 server.go:324] GET /healthz: (12.155us) 200
I0112 18:49:25.811268 4877 server.go:324] GET /api/v1beta1/podInfo?podID=redis-3&podNamespace=default: (5.129615ms) 200
I0112 18:49:26.790116 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:49:26.792183 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:49:26.860568 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 25462e136a999b95da0fdcbf196e88e1912a37821407574455468140e9bce574
E0112 18:49:26.892532 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 25462e136a999b95da0fdcbf196e88e1912a37821407574455468140e9bce574: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:49:26.892585 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 25462e136a999b95da0fdcbf196e88e1912a37821407574455468140e9bce574: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:49:26.892817 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 25462e136a999b95da0fdcbf196e88e1912a37821407574455468140e9bce574 with error: API error (500): Cannot start container 25462e136a999b95da0fdcbf196e88e1912a37821407574455468140e9bce574: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:49:26.900784 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 25462e136a999b95da0fdcbf196e88e1912a37821407574455468140e9bce574: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:49:28.303984 4877 server.go:324] GET /healthz: (12.9us) 200
I0112 18:49:30.499926 4877 server.go:324] GET /healthz: (11.327us) 200
I0112 18:49:31.596197 4877 logs.go:39] etcd DEBUG: recv.success.http://10.240.220.182:4001/v2/keys/registry/nodes/kubernetes-minion-4.c.eternal-empire-754.internal/boundpods?consistent=true&wait=true&waitIndex=1549
I0112 18:49:31.597167 4877 logs.go:39] etcd DEBUG: get /registry/nodes/kubernetes-minion-4.c.eternal-empire-754.internal/boundpods [http://10.240.220.182:4001]
I0112 18:49:31.597224 4877 logs.go:39] etcd DEBUG: Connecting to etcd: attempt1forkeys/registry/nodes/kubernetes-minion-4.c.eternal-empire-754.internal/boundpods?consistent=true&wait=true&waitIndex=2517
I0112 18:49:31.597240 4877 logs.go:39] etcd DEBUG: send.request.to http://10.240.220.182:4001/v2/keys/registry/nodes/kubernetes-minion-4.c.eternal-empire-754.internal/boundpods?consistent=true&wait=true&waitIndex=2517 | method GET
I0112 18:49:31.637121 4877 logs.go:39] etcd DEBUG: recv.response.fromhttp://10.240.220.182:4001/v2/keys/registry/nodes/kubernetes-minion-4.c.eternal-empire-754.internal/boundpods?consistent=true&wait=true&waitIndex=2517
I0112 18:49:31.689250 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:49:31.689849 4877 kubelet.go:793] Network container doesn't exist for pod "bc1262aa-9a8b-11e4-af56-42010af0dcb6.default.etcd", killing and re-creating the pod
I0112 18:49:31.693879 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:49:31.701687 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"bc1262aa-9a8b-11e4-af56-42010af0dcb6", UID:"bc1262aa-9a8b-11e4-af56-42010af0dcb6", APIVersion:"v1beta1", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:49:31.805042 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 68690047089a0a2f1f96f1b4410ace1e1a99e43cff6b20876c1b2a014f823e6b
I0112 18:49:31.902967 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"bc1262aa-9a8b-11e4-af56-42010af0dcb6", UID:"bc1262aa-9a8b-11e4-af56-42010af0dcb6", APIVersion:"v1beta1", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 29de1bbd873c82827fbe5e71693a2e549d14646a25e2ff38848acd4fc8f0a9df
E0112 18:49:31.948768 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 68690047089a0a2f1f96f1b4410ace1e1a99e43cff6b20876c1b2a014f823e6b: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:49:31.948826 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 68690047089a0a2f1f96f1b4410ace1e1a99e43cff6b20876c1b2a014f823e6b: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:49:31.949058 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 68690047089a0a2f1f96f1b4410ace1e1a99e43cff6b20876c1b2a014f823e6b with error: API error (500): Cannot start container 68690047089a0a2f1f96f1b4410ace1e1a99e43cff6b20876c1b2a014f823e6b: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:49:31.954781 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 68690047089a0a2f1f96f1b4410ace1e1a99e43cff6b20876c1b2a014f823e6b: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:49:32.044131 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"bc1262aa-9a8b-11e4-af56-42010af0dcb6", UID:"bc1262aa-9a8b-11e4-af56-42010af0dcb6", APIVersion:"v1beta1", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'running', reason: 'started' Started with docker id 29de1bbd873c82827fbe5e71693a2e549d14646a25e2ff38848acd4fc8f0a9df
I0112 18:49:32.051446 4877 provider.go:91] Refreshing cache for provider: *gcp_credentials.dockerConfigKeyProvider
I0112 18:49:32.053518 4877 config.go:95] body of failing http response: &{0xc208212840 {0 0} false ?reflect.Value? 0x512010 0x511fa0}
E0112 18:49:32.053577 4877 metadata.go:109] while reading 'google-dockercfg' metadata: http status code: 404 while fetching url http://metadata.google.internal./computeMetadata/v1/instance/attributes/google-dockercfg
I0112 18:49:32.053603 4877 provider.go:91] Refreshing cache for provider: *gcp_credentials.dockerConfigUrlKeyProvider
I0112 18:49:32.054784 4877 config.go:95] body of failing http response: &{0xc208212a80 {0 0} false ?reflect.Value? 0x512010 0x511fa0}
E0112 18:49:32.054823 4877 metadata.go:121] while reading 'google-dockercfg-url' metadata: http status code: 404 while fetching url http://metadata.google.internal./computeMetadata/v1/instance/attributes/google-dockercfg-url
I0112 18:49:32.080335 4877 restclient.go:141] Waiting for completion of operation 2521
I0112 18:49:32.921367 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/cadvisor.manifest": default.cadvisor-agent (cadvisormanifes12uqn2ohido76855gdecd9roadm7l0)
I0112 18:49:32.921679 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/fluentd-es.manifest": default.fluentd-to-elasticsearch (fluentdesmanife2u464h05heqcpotoddodpnehjaqsde)
I0112 18:49:37.229621 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"bc1262aa-9a8b-11e4-af56-42010af0dcb6", UID:"bc1262aa-9a8b-11e4-af56-42010af0dcb6", APIVersion:"v1beta1", ResourceVersion:"", FieldPath:"spec.containers{reasoning-gcs-ingest}"}): status: 'waiting', reason: 'pulled' Successfully pulled image "gcr.io/eternal_empire_754/core-reasoning-gcs-ingest:latest"
I0112 18:49:37.295031 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"bc1262aa-9a8b-11e4-af56-42010af0dcb6", UID:"bc1262aa-9a8b-11e4-af56-42010af0dcb6", APIVersion:"v1beta1", ResourceVersion:"", FieldPath:"spec.containers{reasoning-gcs-ingest}"}): status: 'waiting', reason: 'created' Created with docker id f6ea099b6a59b408143032c3fc9512012469f78c5d287f93942b222974be3116
I0112 18:49:37.388358 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"bc1262aa-9a8b-11e4-af56-42010af0dcb6", UID:"bc1262aa-9a8b-11e4-af56-42010af0dcb6", APIVersion:"v1beta1", ResourceVersion:"", FieldPath:"spec.containers{reasoning-gcs-ingest}"}): status: 'running', reason: 'started' Started with docker id f6ea099b6a59b408143032c3fc9512012469f78c5d287f93942b222974be3116
I0112 18:49:40.629396 4877 server.go:324] GET /healthz: (12.65us) 200
I0112 18:49:41.261580 4877 server.go:324] GET /healthz: (11.188us) 200
I0112 18:49:41.692368 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:49:41.694248 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:49:41.804997 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id c6697640ea25302dbd9ce8ac3b187ceaeab8c060fa5d2ba4cde3e862141fd0a8
E0112 18:49:41.824572 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container c6697640ea25302dbd9ce8ac3b187ceaeab8c060fa5d2ba4cde3e862141fd0a8: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:49:41.824619 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container c6697640ea25302dbd9ce8ac3b187ceaeab8c060fa5d2ba4cde3e862141fd0a8: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:49:41.824834 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id c6697640ea25302dbd9ce8ac3b187ceaeab8c060fa5d2ba4cde3e862141fd0a8 with error: API error (500): Cannot start container c6697640ea25302dbd9ce8ac3b187ceaeab8c060fa5d2ba4cde3e862141fd0a8: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:49:41.829231 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container c6697640ea25302dbd9ce8ac3b187ceaeab8c060fa5d2ba4cde3e862141fd0a8: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:49:50.771114 4877 server.go:324] GET /healthz: (13.582us) 200
I0112 18:49:51.695210 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:49:51.697221 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:49:51.780907 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 6fca5580c5e449d877f56308ae6ce31fe78713ef6e40ac485acdb2c0883602b4
I0112 18:49:51.826877 4877 restclient.go:141] Waiting for completion of operation 2672
E0112 18:49:51.829841 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 6fca5580c5e449d877f56308ae6ce31fe78713ef6e40ac485acdb2c0883602b4: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:49:51.829891 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 6fca5580c5e449d877f56308ae6ce31fe78713ef6e40ac485acdb2c0883602b4: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:49:52.922454 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/cadvisor.manifest": default.cadvisor-agent (cadvisormanifes12uqn2ohido76855gdecd9roadm7l0)
I0112 18:49:52.922772 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/fluentd-es.manifest": default.fluentd-to-elasticsearch (fluentdesmanife2u464h05heqcpotoddodpnehjaqsde)
I0112 18:49:53.829851 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 6fca5580c5e449d877f56308ae6ce31fe78713ef6e40ac485acdb2c0883602b4 with error: API error (500): Cannot start container 6fca5580c5e449d877f56308ae6ce31fe78713ef6e40ac485acdb2c0883602b4: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:49:53.829935 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 6fca5580c5e449d877f56308ae6ce31fe78713ef6e40ac485acdb2c0883602b4: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:49:54.071445 4877 logs.go:39] etcd DEBUG: recv.success.http://10.240.220.182:4001/v2/keys/registry/nodes/kubernetes-minion-4.c.eternal-empire-754.internal/boundpods?consistent=true&wait=true&waitIndex=2517
I0112 18:49:54.072970 4877 logs.go:39] etcd DEBUG: get /registry/nodes/kubernetes-minion-4.c.eternal-empire-754.internal/boundpods [http://10.240.220.182:4001]
I0112 18:49:54.073020 4877 logs.go:39] etcd DEBUG: Connecting to etcd: attempt1forkeys/registry/nodes/kubernetes-minion-4.c.eternal-empire-754.internal/boundpods?consistent=true&wait=true&waitIndex=2705
I0112 18:49:54.073034 4877 logs.go:39] etcd DEBUG: send.request.to http://10.240.220.182:4001/v2/keys/registry/nodes/kubernetes-minion-4.c.eternal-empire-754.internal/boundpods?consistent=true&wait=true&waitIndex=2705 | method GET
I0112 18:49:54.123612 4877 logs.go:39] etcd DEBUG: recv.response.fromhttp://10.240.220.182:4001/v2/keys/registry/nodes/kubernetes-minion-4.c.eternal-empire-754.internal/boundpods?consistent=true&wait=true&waitIndex=2705
I0112 18:49:54.209681 4877 server.go:324] GET /healthz: (8.762us) 200
I0112 18:49:54.236017 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:49:54.238644 4877 kubelet.go:793] Network container doesn't exist for pod "bd6bc202-9a8b-11e4-af56-42010af0dcb6.default.etcd", killing and re-creating the pod
I0112 18:49:54.241238 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:49:54.247481 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"bd6bc202-9a8b-11e4-af56-42010af0dcb6", UID:"bd6bc202-9a8b-11e4-af56-42010af0dcb6", APIVersion:"v1beta1", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:49:54.296889 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 1e00d256813b61a57db61c9ecd8095b162e6adf13cb8e37e598af6528467f51c
I0112 18:49:54.354887 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"bd6bc202-9a8b-11e4-af56-42010af0dcb6", UID:"bd6bc202-9a8b-11e4-af56-42010af0dcb6", APIVersion:"v1beta1", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id ac8def2f6b238cf6717b22352604f101e203303c473f85c33c41e9a4dc313ef4
E0112 18:49:54.368367 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 1e00d256813b61a57db61c9ecd8095b162e6adf13cb8e37e598af6528467f51c: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:49:54.368407 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 1e00d256813b61a57db61c9ecd8095b162e6adf13cb8e37e598af6528467f51c: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:49:54.368620 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 1e00d256813b61a57db61c9ecd8095b162e6adf13cb8e37e598af6528467f51c with error: API error (500): Cannot start container 1e00d256813b61a57db61c9ecd8095b162e6adf13cb8e37e598af6528467f51c: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:49:54.368650 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 1e00d256813b61a57db61c9ecd8095b162e6adf13cb8e37e598af6528467f51c: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:49:54.467944 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"bd6bc202-9a8b-11e4-af56-42010af0dcb6", UID:"bd6bc202-9a8b-11e4-af56-42010af0dcb6", APIVersion:"v1beta1", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'running', reason: 'started' Started with docker id ac8def2f6b238cf6717b22352604f101e203303c473f85c33c41e9a4dc313ef4
I0112 18:49:57.520538 4877 server.go:324] GET /healthz: (13.752us) 200
I0112 18:49:57.525430 4877 server.go:324] GET /healthz: (10.373us) 200
I0112 18:49:57.525620 4877 server.go:324] GET /healthz: (5.681us) 200
I0112 18:49:57.618007 4877 server.go:324] GET /api/v1beta1/podInfo?podID=bd6bc202-9a8b-11e4-af56-42010af0dcb6&podNamespace=default: (74.390007ms) 200
I0112 18:49:57.618697 4877 server.go:324] GET /api/v1beta1/podInfo?podID=bc1262aa-9a8b-11e4-af56-42010af0dcb6&podNamespace=default: (70.139234ms) 200
I0112 18:49:57.619354 4877 server.go:324] GET /api/v1beta1/podInfo?podID=redis-3&podNamespace=default: (70.607001ms) 200
I0112 18:49:58.918904 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"bd6bc202-9a8b-11e4-af56-42010af0dcb6", UID:"bd6bc202-9a8b-11e4-af56-42010af0dcb6", APIVersion:"v1beta1", ResourceVersion:"", FieldPath:"spec.containers{reasoning-redis-ingest}"}): status: 'waiting', reason: 'pulled' Successfully pulled image "gcr.io/eternal_empire_754/core-reasoning-redis-ingest:latest"
I0112 18:49:59.005370 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"bd6bc202-9a8b-11e4-af56-42010af0dcb6", UID:"bd6bc202-9a8b-11e4-af56-42010af0dcb6", APIVersion:"v1beta1", ResourceVersion:"", FieldPath:"spec.containers{reasoning-redis-ingest}"}): status: 'waiting', reason: 'created' Created with docker id f9dafd1be6335492aad831a178579648e32d8a01978406276a03dcaa9d822c79
I0112 18:49:59.083166 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"bd6bc202-9a8b-11e4-af56-42010af0dcb6", UID:"bd6bc202-9a8b-11e4-af56-42010af0dcb6", APIVersion:"v1beta1", ResourceVersion:"", FieldPath:"spec.containers{reasoning-redis-ingest}"}): status: 'running', reason: 'started' Started with docker id f9dafd1be6335492aad831a178579648e32d8a01978406276a03dcaa9d822c79
I0112 18:50:00.808528 4877 server.go:324] GET /healthz: (15.244us) 200
I0112 18:50:04.239370 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:50:04.241442 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:50:04.340824 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 023fb72ec23243674deb462e652ef721e5462b3bc872d97d7054bd584f8badba
E0112 18:50:04.388351 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 023fb72ec23243674deb462e652ef721e5462b3bc872d97d7054bd584f8badba: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:50:04.388396 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 023fb72ec23243674deb462e652ef721e5462b3bc872d97d7054bd584f8badba: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:50:04.388597 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 023fb72ec23243674deb462e652ef721e5462b3bc872d97d7054bd584f8badba with error: API error (500): Cannot start container 023fb72ec23243674deb462e652ef721e5462b3bc872d97d7054bd584f8badba: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:50:04.388640 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 023fb72ec23243674deb462e652ef721e5462b3bc872d97d7054bd584f8badba: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:50:06.948073 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=10: (3.327225ms) 500
goroutine 601 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2085298c0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2085298c0, 0xc2084205a0, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2085298c0, 0x7f8a04dbf1b0, 0xc20837d610)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2085298c0, 0xc20814d790)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2085298c0, 0xc20814d790)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2085298c0, 0xc20814d790)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2085298c0, 0xc20814d790)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2085298c0, 0xc20814d790)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208408320, 0xc20814d790)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:50:07.052023 4877 server.go:324] GET /healthz: (22.947us) 200
I0112 18:50:07.134819 4877 server.go:324] GET /stats/bc1262aa-9a8b-11e4-af56-42010af0dcb6/reasoning-gcs-ingest?num_stats=10: (3.864282ms) 500
goroutine 601 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208529e60, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208529e60, 0xc208420990, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208529e60, 0x7f8a04dbf1b0, 0xc20837de90)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208529e60, 0xc20814dba0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208529e60, 0xc20814dba0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208529e60, 0xc20814dba0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208529e60, 0xc20814dba0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208529e60, 0xc20814dba0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2084085a0, 0xc20814dba0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:50:07.155363 4877 server.go:324] GET /stats/bd6bc202-9a8b-11e4-af56-42010af0dcb6/reasoning-redis-ingest?num_stats=10: (3.094531ms) 500
goroutine 601 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2082d0360, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2082d0360, 0xc208420d80, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2082d0360, 0x7f8a04dbf1b0, 0xc208364400)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2082d0360, 0xc2080da680)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2082d0360, 0xc2080da680)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2082d0360, 0xc2080da680)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2082d0360, 0xc2080da680)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2082d0360, 0xc2080da680)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208408640, 0xc2080da680)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:50:07.294765 4877 server.go:324] GET /healthz: (11.215us) 200
I0112 18:50:07.385927 4877 server.go:324] GET /stats?num_stats=10: (25.148us) 301
I0112 18:50:07.387271 4877 server.go:324] GET /stats/: (615.71us) 500
goroutine 601 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2082d0900, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2082d0900, 0xc2083a8aa0, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2082d0900, 0x7f8a04dbf1b0, 0xc208364db0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2082d0900, 0xc2080db2b0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2082d0900, 0xc2080db2b0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2082d0900, 0xc2080db2b0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2082d0900, 0xc2080db2b0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2082d0900, 0xc2080db2b0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208408960, 0xc2080db2b0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:50:10.838943 4877 server.go:324] GET /healthz: (14.005us) 200
I0112 18:50:12.923619 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/cadvisor.manifest": default.cadvisor-agent (cadvisormanifes12uqn2ohido76855gdecd9roadm7l0)
I0112 18:50:12.923947 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/fluentd-es.manifest": default.fluentd-to-elasticsearch (fluentdesmanife2u464h05heqcpotoddodpnehjaqsde)
I0112 18:50:14.242985 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:50:14.244971 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:50:14.328514 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id b504a0719aad54f6e478330e6e11c86cbe5f3166e4b5d3cd3359b6d8c298afeb
E0112 18:50:14.353054 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container b504a0719aad54f6e478330e6e11c86cbe5f3166e4b5d3cd3359b6d8c298afeb: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:50:14.353106 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container b504a0719aad54f6e478330e6e11c86cbe5f3166e4b5d3cd3359b6d8c298afeb: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:50:14.353324 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id b504a0719aad54f6e478330e6e11c86cbe5f3166e4b5d3cd3359b6d8c298afeb with error: API error (500): Cannot start container b504a0719aad54f6e478330e6e11c86cbe5f3166e4b5d3cd3359b6d8c298afeb: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:50:14.358848 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container b504a0719aad54f6e478330e6e11c86cbe5f3166e4b5d3cd3359b6d8c298afeb: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:50:16.927087 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=9: (2.823162ms) 500
goroutine 601 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2082d0240, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2082d0240, 0xc208220a20, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2082d0240, 0x7f8a04dbf1b0, 0xc208364550)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2082d0240, 0xc2080db5f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2082d0240, 0xc2080db5f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2082d0240, 0xc2080db5f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2082d0240, 0xc2080db5f0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2082d0240, 0xc2080db5f0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2083abc20, 0xc2080db5f0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:50:17.264355 4877 server.go:324] GET /stats/bc1262aa-9a8b-11e4-af56-42010af0dcb6/reasoning-gcs-ingest?num_stats=9: (3.293284ms) 500
goroutine 601 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2082d0780, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2082d0780, 0xc208220e10, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2082d0780, 0x7f8a04dbf1b0, 0xc208365020)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2082d0780, 0xc2082cf930)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2082d0780, 0xc2082cf930)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2082d0780, 0xc2082cf930)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2082d0780, 0xc2082cf930)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2082d0780, 0xc2082cf930)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2083abcc0, 0xc2082cf930)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:50:17.283980 4877 server.go:324] GET /stats/bd6bc202-9a8b-11e4-af56-42010af0dcb6/reasoning-redis-ingest?num_stats=9: (3.004461ms) 500
goroutine 601 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2082d0cc0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2082d0cc0, 0xc208221200, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2082d0cc0, 0x7f8a04dbf1b0, 0xc208365660)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2082d0cc0, 0xc2082cfe10)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2082d0cc0, 0xc2082cfe10)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2082d0cc0, 0xc2082cfe10)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2082d0cc0, 0xc2082cfe10)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2082d0cc0, 0xc2082cfe10)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2083abd60, 0xc2082cfe10)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:50:17.301525 4877 server.go:324] GET /healthz: (11.293us) 200
I0112 18:50:17.353332 4877 server.go:324] GET /stats?num_stats=9: (25.452us) 301
I0112 18:50:17.354808 4877 server.go:324] GET /stats/: (606.219us) 500
goroutine 601 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2082d1260, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2082d1260, 0xc20838b180, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2082d1260, 0x7f8a04dbf1b0, 0xc208365b10)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2082d1260, 0xc20814d790)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2082d1260, 0xc20814d790)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2082d1260, 0xc20814d790)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2082d1260, 0xc20814d790)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2082d1260, 0xc20814d790)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208408140, 0xc20814d790)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:50:19.964519 4877 server.go:324] GET /healthz: (11.59us) 200
I0112 18:50:20.882237 4877 server.go:324] GET /healthz: (10.97us) 200
I0112 18:50:24.245649 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:50:24.247414 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:50:24.364504 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id d1808b8881a689fc96dccedbd3ac297f55208f2aa6d6ef6290b86e6b1de5efe4
E0112 18:50:24.404297 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container d1808b8881a689fc96dccedbd3ac297f55208f2aa6d6ef6290b86e6b1de5efe4: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:50:24.404340 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container d1808b8881a689fc96dccedbd3ac297f55208f2aa6d6ef6290b86e6b1de5efe4: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:50:24.404540 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id d1808b8881a689fc96dccedbd3ac297f55208f2aa6d6ef6290b86e6b1de5efe4 with error: API error (500): Cannot start container d1808b8881a689fc96dccedbd3ac297f55208f2aa6d6ef6290b86e6b1de5efe4: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:50:24.412345 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container d1808b8881a689fc96dccedbd3ac297f55208f2aa6d6ef6290b86e6b1de5efe4: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:50:26.955856 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=9: (3.15406ms) 500
goroutine 601 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20840ae40, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20840ae40, 0xc2084bca20, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20840ae40, 0x7f8a04dbf1b0, 0xc2083ad6b0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20840ae40, 0xc20814dad0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20840ae40, 0xc20814dad0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20840ae40, 0xc20814dad0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20840ae40, 0xc20814dad0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20840ae40, 0xc20814dad0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208408c80, 0xc20814dad0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:50:27.155658 4877 server.go:324] GET /stats/bc1262aa-9a8b-11e4-af56-42010af0dcb6/reasoning-gcs-ingest?num_stats=9: (3.074919ms) 500
goroutine 601 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20840b380, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20840b380, 0xc2084bce10, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20840b380, 0x7f8a04dbf1b0, 0xc2083adc60)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20840b380, 0xc2080da8f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20840b380, 0xc2080da8f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20840b380, 0xc2080da8f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20840b380, 0xc2080da8f0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20840b380, 0xc2080da8f0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208408dc0, 0xc2080da8f0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:50:27.174735 4877 server.go:324] GET /stats/bd6bc202-9a8b-11e4-af56-42010af0dcb6/reasoning-redis-ingest?num_stats=9: (2.84875ms) 500
goroutine 601 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20840b8c0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20840b8c0, 0xc2084bd200, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20840b8c0, 0x7f8a04dbf1b0, 0xc2083a03b0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20840b8c0, 0xc2080db040)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20840b8c0, 0xc2080db040)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20840b8c0, 0xc2080db040)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20840b8c0, 0xc2080db040)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20840b8c0, 0xc2080db040)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208408e60, 0xc2080db040)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:50:27.205783 4877 server.go:324] GET /healthz: (12.376us) 200
I0112 18:50:27.296181 4877 server.go:324] GET /stats?num_stats=9: (23.671us) 301
I0112 18:50:27.297657 4877 server.go:324] GET /stats/: (629.566us) 500
goroutine 601 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20840be60, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20840be60, 0xc20833b860, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20840be60, 0x7f8a04dbf1b0, 0xc2083a0ab0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20840be60, 0xc20814c1a0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20840be60, 0xc20814c1a0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20840be60, 0xc20814c1a0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20840be60, 0xc20814c1a0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20840be60, 0xc20814c1a0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2084090e0, 0xc20814c1a0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:50:28.948728 4877 server.go:324] GET /healthz: (12.722us) 200
I0112 18:50:28.966424 4877 server.go:324] GET /healthz: (10.029us) 200
I0112 18:50:28.966791 4877 server.go:324] GET /healthz: (6.401us) 200
I0112 18:50:28.985643 4877 server.go:324] GET /api/v1beta1/podInfo?podID=bc1262aa-9a8b-11e4-af56-42010af0dcb6&podNamespace=default: (19.964531ms) 200
I0112 18:50:29.003275 4877 server.go:324] GET /api/v1beta1/podInfo?podID=redis-3&podNamespace=default: (6.181881ms) 200
I0112 18:50:29.005062 4877 server.go:324] GET /api/v1beta1/podInfo?podID=bd6bc202-9a8b-11e4-af56-42010af0dcb6&podNamespace=default: (5.464194ms) 200
I0112 18:50:30.923420 4877 server.go:324] GET /healthz: (13.181us) 200
I0112 18:50:32.924731 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/cadvisor.manifest": default.cadvisor-agent (cadvisormanifes12uqn2ohido76855gdecd9roadm7l0)
I0112 18:50:32.925123 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/fluentd-es.manifest": default.fluentd-to-elasticsearch (fluentdesmanife2u464h05heqcpotoddodpnehjaqsde)
I0112 18:50:33.186804 4877 server.go:324] GET /healthz: (13.585us) 200
I0112 18:50:34.248199 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:50:34.249916 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:50:34.332715 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 9bc7fd68d2b826f004d659b5c27f3c4a212916b9b31cf7f14b0643ffc5b562aa
E0112 18:50:34.380021 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 9bc7fd68d2b826f004d659b5c27f3c4a212916b9b31cf7f14b0643ffc5b562aa: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:50:34.380063 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 9bc7fd68d2b826f004d659b5c27f3c4a212916b9b31cf7f14b0643ffc5b562aa: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:50:34.380268 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 9bc7fd68d2b826f004d659b5c27f3c4a212916b9b31cf7f14b0643ffc5b562aa with error: API error (500): Cannot start container 9bc7fd68d2b826f004d659b5c27f3c4a212916b9b31cf7f14b0643ffc5b562aa: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:50:34.387050 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 9bc7fd68d2b826f004d659b5c27f3c4a212916b9b31cf7f14b0643ffc5b562aa: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:50:37.088851 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=9: (2.910251ms) 500
goroutine 601 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20840a960, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20840a960, 0xc208424900, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20840a960, 0x7f8a04dbf1b0, 0xc2083ac890)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20840a960, 0xc20814c820)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20840a960, 0xc20814c820)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20840a960, 0xc20814c820)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20840a960, 0xc20814c820)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20840a960, 0xc20814c820)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2083ab680, 0xc20814c820)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:50:37.285455 4877 server.go:324] GET /stats/bd6bc202-9a8b-11e4-af56-42010af0dcb6/reasoning-redis-ingest?num_stats=9: (2.884939ms) 500
goroutine 601 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20840aea0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20840aea0, 0xc208424cf0, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20840aea0, 0x7f8a04dbf1b0, 0xc2083ad2a0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20840aea0, 0xc2080da8f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20840aea0, 0xc2080da8f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20840aea0, 0xc2080da8f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20840aea0, 0xc2080da8f0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20840aea0, 0xc2080da8f0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2083ab720, 0xc2080da8f0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:50:37.318421 4877 server.go:324] GET /stats/bc1262aa-9a8b-11e4-af56-42010af0dcb6/reasoning-gcs-ingest?num_stats=10: (3.025093ms) 500
goroutine 601 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20840b3e0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20840b3e0, 0xc2084250e0, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20840b3e0, 0x7f8a04dbf1b0, 0xc2083ad8e0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20840b3e0, 0xc2080db040)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20840b3e0, 0xc2080db040)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20840b3e0, 0xc2080db040)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20840b3e0, 0xc2080db040)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20840b3e0, 0xc2080db040)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2083ab9a0, 0xc2080db040)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:50:37.389641 4877 server.go:324] GET /healthz: (13.967us) 200
I0112 18:50:37.582055 4877 server.go:324] GET /stats?num_stats=10: (24.503us) 301
I0112 18:50:37.583687 4877 server.go:324] GET /stats/: (766.97us) 500
goroutine 601 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20840b980, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20840b980, 0xc20831bbd0, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20840b980, 0x7f8a04dbf1b0, 0xc2083adf50)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20840b980, 0xc2083d6000)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20840b980, 0xc2083d6000)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20840b980, 0xc2083d6000)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20840b980, 0xc2083d6000)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20840b980, 0xc2083d6000)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2083abc20, 0xc2083d6000)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:50:40.951556 4877 server.go:324] GET /healthz: (13.581us) 200
I0112 18:50:44.251123 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:50:44.253001 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:50:44.348630 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 31816d5667b135f418d357f1d427f334c7031e0037907e37ebc2b2a2f26d3712
E0112 18:50:44.396259 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 31816d5667b135f418d357f1d427f334c7031e0037907e37ebc2b2a2f26d3712: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:50:44.396303 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 31816d5667b135f418d357f1d427f334c7031e0037907e37ebc2b2a2f26d3712: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:50:44.396508 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 31816d5667b135f418d357f1d427f334c7031e0037907e37ebc2b2a2f26d3712 with error: API error (500): Cannot start container 31816d5667b135f418d357f1d427f334c7031e0037907e37ebc2b2a2f26d3712: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:50:44.401315 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 31816d5667b135f418d357f1d427f334c7031e0037907e37ebc2b2a2f26d3712: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:50:45.946404 4877 server.go:324] GET /healthz: (21.384us) 200
I0112 18:50:46.919645 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=9: (3.769753ms) 500
goroutine 601 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208005440, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208005440, 0xc2084dd3b0, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208005440, 0x7f8a04dbf1b0, 0xc208149c90)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208005440, 0xc2083d6340)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208005440, 0xc2083d6340)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208005440, 0xc2083d6340)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208005440, 0xc2083d6340)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208005440, 0xc2083d6340)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208409f40, 0xc2083d6340)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:50:47.242401 4877 server.go:324] GET /stats/bc1262aa-9a8b-11e4-af56-42010af0dcb6/reasoning-gcs-ingest?num_stats=9: (6.52317ms) 500
goroutine 601 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208005980, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208005980, 0xc2084dd7a0, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208005980, 0x7f8a04dbf1b0, 0xc2082144e0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208005980, 0xc208000b60)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208005980, 0xc208000b60)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208005980, 0xc208000b60)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208005980, 0xc208000b60)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208005980, 0xc208000b60)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2082960a0, 0xc208000b60)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:50:47.262284 4877 server.go:324] GET /stats/bd6bc202-9a8b-11e4-af56-42010af0dcb6/reasoning-redis-ingest?num_stats=9: (2.888073ms) 500
goroutine 601 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208005f20, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208005f20, 0xc2084ddb90, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208005f20, 0x7f8a04dbf1b0, 0xc208214bc0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208005f20, 0xc208001930)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208005f20, 0xc208001930)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208005f20, 0xc208001930)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208005f20, 0xc208001930)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208005f20, 0xc208001930)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2080ee140, 0xc208001930)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:50:47.276193 4877 server.go:324] GET /healthz: (12.243us) 200
I0112 18:50:47.375091 4877 server.go:324] GET /stats?num_stats=9: (25.461us) 301
I0112 18:50:47.376646 4877 server.go:324] GET /stats/: (800.926us) 500
goroutine 601 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20810f680, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20810f680, 0xc20833b720, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20810f680, 0x7f8a04dbf1b0, 0xc208215510)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20810f680, 0xc2084f4750)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20810f680, 0xc2084f4750)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20810f680, 0xc2084f4750)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20810f680, 0xc2084f4750)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20810f680, 0xc2084f4750)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2080efb80, 0xc2084f4750)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:50:51.068593 4877 server.go:324] GET /healthz: (11.761us) 200
I0112 18:50:52.927811 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/cadvisor.manifest": default.cadvisor-agent (cadvisormanifes12uqn2ohido76855gdecd9roadm7l0)
I0112 18:50:52.928135 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/fluentd-es.manifest": default.fluentd-to-elasticsearch (fluentdesmanife2u464h05heqcpotoddodpnehjaqsde)
I0112 18:50:54.254685 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:50:54.256355 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:50:54.365061 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id a09b6697ad0838262cc8688a10515d974254165d1d25a4f9b0cd96e92c4768a6
E0112 18:50:54.388632 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container a09b6697ad0838262cc8688a10515d974254165d1d25a4f9b0cd96e92c4768a6: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:50:54.388680 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container a09b6697ad0838262cc8688a10515d974254165d1d25a4f9b0cd96e92c4768a6: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:50:54.388909 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id a09b6697ad0838262cc8688a10515d974254165d1d25a4f9b0cd96e92c4768a6 with error: API error (500): Cannot start container a09b6697ad0838262cc8688a10515d974254165d1d25a4f9b0cd96e92c4768a6: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:50:54.393995 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container a09b6697ad0838262cc8688a10515d974254165d1d25a4f9b0cd96e92c4768a6: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:50:56.922706 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=9: (3.361976ms) 500
goroutine 601 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2081727e0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2081727e0, 0xc208432900, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2081727e0, 0x7f8a04dbf1b0, 0xc2082a1ec0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2081727e0, 0xc2084f4c30)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2081727e0, 0xc2084f4c30)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2081727e0, 0xc2084f4c30)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2081727e0, 0xc2084f4c30)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2081727e0, 0xc2084f4c30)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208409e00, 0xc2084f4c30)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:50:57.249680 4877 server.go:324] GET /stats/bc1262aa-9a8b-11e4-af56-42010af0dcb6/reasoning-gcs-ingest?num_stats=9: (3.103654ms) 500
goroutine 601 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208172d20, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208172d20, 0xc208432cf0, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208172d20, 0x7f8a04dbf1b0, 0xc20828c530)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208172d20, 0xc2083d7e10)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208172d20, 0xc2083d7e10)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208172d20, 0xc2083d7e10)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208172d20, 0xc2083d7e10)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208172d20, 0xc2083d7e10)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208409ea0, 0xc2083d7e10)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:50:57.270436 4877 server.go:324] GET /stats/bd6bc202-9a8b-11e4-af56-42010af0dcb6/reasoning-redis-ingest?num_stats=9: (3.611607ms) 500
goroutine 601 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2081732c0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2081732c0, 0xc2084330e0, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2081732c0, 0x7f8a04dbf1b0, 0xc20828ccc0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2081732c0, 0xc20814ca90)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2081732c0, 0xc20814ca90)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2081732c0, 0xc20814ca90)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2081732c0, 0xc20814ca90)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2081732c0, 0xc20814ca90)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208409f40, 0xc20814ca90)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:50:57.287176 4877 server.go:324] GET /healthz: (9.79us) 200
I0112 18:50:57.334347 4877 server.go:324] GET /stats?num_stats=9: (25.502us) 301
I0112 18:50:57.335808 4877 server.go:324] GET /stats/: (564.771us) 500
goroutine 601 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208173980, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208173980, 0xc20831a4b0, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208173980, 0x7f8a04dbf1b0, 0xc20828d1a0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208173980, 0xc2080da270)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208173980, 0xc2080da270)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208173980, 0xc2080da270)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208173980, 0xc2080da270)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208173980, 0xc2080da270)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2083aa960, 0xc2080da270)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:50:59.319787 4877 server.go:324] GET /healthz: (15.667us) 200
I0112 18:51:00.399770 4877 server.go:324] GET /healthz: (13.276us) 200
I0112 18:51:00.399918 4877 server.go:324] GET /healthz: (4.035us) 200
I0112 18:51:00.400785 4877 server.go:324] GET /healthz: (7.658us) 200
I0112 18:51:00.436006 4877 server.go:324] GET /api/v1beta1/podInfo?podID=bc1262aa-9a8b-11e4-af56-42010af0dcb6&podNamespace=default: (10.953529ms) 200
I0112 18:51:00.436757 4877 server.go:324] GET /api/v1beta1/podInfo?podID=bd6bc202-9a8b-11e4-af56-42010af0dcb6&podNamespace=default: (11.486546ms) 200
I0112 18:51:00.437381 4877 server.go:324] GET /api/v1beta1/podInfo?podID=redis-3&podNamespace=default: (11.990338ms) 200
I0112 18:51:01.111514 4877 server.go:324] GET /healthz: (14.76us) 200
I0112 18:51:04.257625 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:51:04.259617 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:51:04.332765 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 35ef5bb87fbd7454b219c0d8cb275e3c665fe615c6c71a5ad6e9ee2d3877eb77
E0112 18:51:04.380249 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 35ef5bb87fbd7454b219c0d8cb275e3c665fe615c6c71a5ad6e9ee2d3877eb77: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:51:04.380298 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 35ef5bb87fbd7454b219c0d8cb275e3c665fe615c6c71a5ad6e9ee2d3877eb77: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:51:04.380501 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 35ef5bb87fbd7454b219c0d8cb275e3c665fe615c6c71a5ad6e9ee2d3877eb77 with error: API error (500): Cannot start container 35ef5bb87fbd7454b219c0d8cb275e3c665fe615c6c71a5ad6e9ee2d3877eb77: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:51:04.385769 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 35ef5bb87fbd7454b219c0d8cb275e3c665fe615c6c71a5ad6e9ee2d3877eb77: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:51:07.001958 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=9: (3.115036ms) 500
goroutine 601 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208143080, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208143080, 0xc20842e7e0, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208143080, 0x7f8a04dbf1b0, 0xc2082a0e20)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208143080, 0xc2080da4e0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208143080, 0xc2080da4e0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208143080, 0xc2080da4e0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208143080, 0xc2080da4e0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208143080, 0xc2080da4e0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208408c80, 0xc2080da4e0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:51:07.202690 4877 server.go:324] GET /stats/bd6bc202-9a8b-11e4-af56-42010af0dcb6/reasoning-redis-ingest?num_stats=9: (2.893147ms) 500
goroutine 601 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2081435c0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2081435c0, 0xc20842ebd0, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2081435c0, 0x7f8a04dbf1b0, 0xc2082a13e0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2081435c0, 0xc2083d6680)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2081435c0, 0xc2083d6680)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2081435c0, 0xc2083d6680)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2081435c0, 0xc2083d6680)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2081435c0, 0xc2083d6680)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208408dc0, 0xc2083d6680)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:51:07.236689 4877 server.go:324] GET /stats/bc1262aa-9a8b-11e4-af56-42010af0dcb6/reasoning-gcs-ingest?num_stats=9: (3.412554ms) 500
goroutine 601 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208143b60, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208143b60, 0xc20842efc0, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208143b60, 0x7f8a04dbf1b0, 0xc2082a19c0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208143b60, 0xc2083d6b60)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208143b60, 0xc2083d6b60)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208143b60, 0xc2083d6b60)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208143b60, 0xc2083d6b60)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208143b60, 0xc2083d6b60)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208408e60, 0xc2083d6b60)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:51:07.271599 4877 server.go:324] GET /healthz: (14.334us) 200
I0112 18:51:07.342407 4877 server.go:324] GET /stats?num_stats=9: (24.768us) 301
I0112 18:51:07.343904 4877 server.go:324] GET /stats/: (639.251us) 500
goroutine 601 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208172180, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208172180, 0xc208353d10, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208172180, 0x7f8a04dbf1b0, 0xc2082a1e40)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208172180, 0xc2083d72b0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208172180, 0xc2083d72b0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208172180, 0xc2083d72b0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208172180, 0xc2083d72b0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208172180, 0xc2083d72b0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2084090e0, 0xc2083d72b0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:51:11.138622 4877 server.go:324] GET /healthz: (14.005us) 200
I0112 18:51:12.449082 4877 server.go:324] GET /healthz: (12.894us) 200
I0112 18:51:12.929025 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/cadvisor.manifest": default.cadvisor-agent (cadvisormanifes12uqn2ohido76855gdecd9roadm7l0)
I0112 18:51:12.929314 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/fluentd-es.manifest": default.fluentd-to-elasticsearch (fluentdesmanife2u464h05heqcpotoddodpnehjaqsde)
I0112 18:51:14.260676 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:51:14.262745 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:51:14.324676 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 59d16995892021c83f9a1137fed857d1619bc80cb4500b3f0c2137780ff32c31
E0112 18:51:14.348274 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 59d16995892021c83f9a1137fed857d1619bc80cb4500b3f0c2137780ff32c31: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:51:14.348327 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 59d16995892021c83f9a1137fed857d1619bc80cb4500b3f0c2137780ff32c31: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:51:14.348562 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 59d16995892021c83f9a1137fed857d1619bc80cb4500b3f0c2137780ff32c31 with error: API error (500): Cannot start container 59d16995892021c83f9a1137fed857d1619bc80cb4500b3f0c2137780ff32c31: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:51:14.348596 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 59d16995892021c83f9a1137fed857d1619bc80cb4500b3f0c2137780ff32c31: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:51:16.906063 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=9: (2.9694ms) 500
goroutine 601 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20816a600, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20816a600, 0xc2082d4fc0, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20816a600, 0x7f8a04dbf1b0, 0xc2082a02d0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20816a600, 0xc2083d7520)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20816a600, 0xc2083d7520)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20816a600, 0xc2083d7520)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20816a600, 0xc2083d7520)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20816a600, 0xc2083d7520)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208409d60, 0xc2083d7520)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:51:17.318697 4877 server.go:324] GET /stats/bc1262aa-9a8b-11e4-af56-42010af0dcb6/reasoning-gcs-ingest?num_stats=9: (2.816444ms) 500
goroutine 601 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20816ab40, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20816ab40, 0xc2082d53b0, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20816ab40, 0x7f8a04dbf1b0, 0xc2082a0830)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20816ab40, 0xc2083d71e0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20816ab40, 0xc2083d71e0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20816ab40, 0xc2083d71e0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20816ab40, 0xc2083d71e0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20816ab40, 0xc2083d71e0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208409e00, 0xc2083d71e0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:51:17.337611 4877 server.go:324] GET /stats/bd6bc202-9a8b-11e4-af56-42010af0dcb6/reasoning-redis-ingest?num_stats=9: (2.629362ms) 500
goroutine 601 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20816b0e0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20816b0e0, 0xc2082d57a0, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20816b0e0, 0x7f8a04dbf1b0, 0xc2082a0de0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20816b0e0, 0xc2083d7790)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20816b0e0, 0xc2083d7790)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20816b0e0, 0xc2083d7790)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20816b0e0, 0xc2083d7790)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20816b0e0, 0xc2083d7790)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208409ea0, 0xc2083d7790)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:51:17.367293 4877 server.go:324] GET /healthz: (12.088us) 200
I0112 18:51:17.416097 4877 server.go:324] GET /stats?num_stats=10: (28.017us) 301
I0112 18:51:17.417300 4877 server.go:324] GET /stats/: (523.192us) 500
goroutine 601 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20816b680, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20816b680, 0xc2083525a0, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20816b680, 0x7f8a04dbf1b0, 0xc2082a12e0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20816b680, 0xc2080da340)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20816b680, 0xc2080da340)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20816b680, 0xc2080da340)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20816b680, 0xc2080da340)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20816b680, 0xc2080da340)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2083aa8c0, 0xc2080da340)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:51:21.225215 4877 server.go:324] GET /healthz: (19.925us) 200
I0112 18:51:24.263223 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:51:24.265414 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:51:24.348613 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id d26cb141ce855bf54b13bfbc45bd23d088125656769fad9cca9076ec2ab31c95
E0112 18:51:24.396458 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container d26cb141ce855bf54b13bfbc45bd23d088125656769fad9cca9076ec2ab31c95: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:51:24.396519 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container d26cb141ce855bf54b13bfbc45bd23d088125656769fad9cca9076ec2ab31c95: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:51:24.396613 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id d26cb141ce855bf54b13bfbc45bd23d088125656769fad9cca9076ec2ab31c95 with error: API error (500): Cannot start container d26cb141ce855bf54b13bfbc45bd23d088125656769fad9cca9076ec2ab31c95: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:51:24.396652 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container d26cb141ce855bf54b13bfbc45bd23d088125656769fad9cca9076ec2ab31c95: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:51:25.349201 4877 server.go:324] GET /healthz: (11.55us) 200
I0112 18:51:27.041168 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=9: (2.879619ms) 500
goroutine 601 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208299b00, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208299b00, 0xc20815c240, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208299b00, 0x7f8a04dbf1b0, 0xc208315100)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208299b00, 0xc2080da820)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208299b00, 0xc2080da820)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208299b00, 0xc2080da820)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208299b00, 0xc2080da820)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208299b00, 0xc2080da820)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208408780, 0xc2080da820)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:51:27.359580 4877 server.go:324] GET /stats/bc1262aa-9a8b-11e4-af56-42010af0dcb6/reasoning-gcs-ingest?num_stats=9: (2.875763ms) 500
goroutine 601 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20813e240, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20813e240, 0xc20815c630, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20813e240, 0x7f8a04dbf1b0, 0xc208315710)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20813e240, 0xc2084f4ea0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20813e240, 0xc2084f4ea0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20813e240, 0xc2084f4ea0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20813e240, 0xc2084f4ea0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20813e240, 0xc2084f4ea0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2084088c0, 0xc2084f4ea0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:51:27.378752 4877 server.go:324] GET /stats/bd6bc202-9a8b-11e4-af56-42010af0dcb6/reasoning-redis-ingest?num_stats=9: (2.867945ms) 500
goroutine 601 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20813e7e0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20813e7e0, 0xc20815ca20, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20813e7e0, 0x7f8a04dbf1b0, 0xc208315d70)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20813e7e0, 0xc2084f5380)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20813e7e0, 0xc2084f5380)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20813e7e0, 0xc2084f5380)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20813e7e0, 0xc2084f5380)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20813e7e0, 0xc2084f5380)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208408960, 0xc2084f5380)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:51:27.417339 4877 server.go:324] GET /healthz: (21.859us) 200
I0112 18:51:27.660693 4877 server.go:324] GET /stats?num_stats=10: (24.461us) 301
I0112 18:51:27.662147 4877 server.go:324] GET /stats/: (576.121us) 500
goroutine 601 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20813ee40, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20813ee40, 0xc2083682d0, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20813ee40, 0x7f8a04dbf1b0, 0xc208306320)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20813ee40, 0xc2084f5ba0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20813ee40, 0xc2084f5ba0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20813ee40, 0xc2084f5ba0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20813ee40, 0xc2084f5ba0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20813ee40, 0xc2084f5ba0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208408be0, 0xc2084f5ba0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:51:31.417237 4877 server.go:324] GET /healthz: (11.605us) 200
I0112 18:51:31.751738 4877 server.go:324] GET /healthz: (12.005us) 200
I0112 18:51:31.752049 4877 server.go:324] GET /healthz: (6.048us) 200
I0112 18:51:31.757015 4877 server.go:324] GET /healthz: (10.37us) 200
I0112 18:51:31.793365 4877 server.go:324] GET /api/v1beta1/podInfo?podID=bd6bc202-9a8b-11e4-af56-42010af0dcb6&podNamespace=default: (10.818002ms) 200
I0112 18:51:31.794026 4877 server.go:324] GET /api/v1beta1/podInfo?podID=bc1262aa-9a8b-11e4-af56-42010af0dcb6&podNamespace=default: (11.245242ms) 200
I0112 18:51:31.794689 4877 server.go:324] GET /api/v1beta1/podInfo?podID=redis-3&podNamespace=default: (10.785571ms) 200
I0112 18:51:32.930251 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/cadvisor.manifest": default.cadvisor-agent (cadvisormanifes12uqn2ohido76855gdecd9roadm7l0)
I0112 18:51:32.930596 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/fluentd-es.manifest": default.fluentd-to-elasticsearch (fluentdesmanife2u464h05heqcpotoddodpnehjaqsde)
I0112 18:51:34.266138 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:51:34.267846 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:51:34.363033 4877 restclient.go:141] Waiting for completion of operation 3071
E0112 18:51:34.416207 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container b550befd93ea7c3583c47feac8b3dec2debf9f1a1a7aab0dce87098682cbd6e8: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:51:34.416264 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container b550befd93ea7c3583c47feac8b3dec2debf9f1a1a7aab0dce87098682cbd6e8: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:51:36.365933 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id b550befd93ea7c3583c47feac8b3dec2debf9f1a1a7aab0dce87098682cbd6e8
I0112 18:51:36.371052 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id b550befd93ea7c3583c47feac8b3dec2debf9f1a1a7aab0dce87098682cbd6e8 with error: API error (500): Cannot start container b550befd93ea7c3583c47feac8b3dec2debf9f1a1a7aab0dce87098682cbd6e8: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:51:36.375239 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container b550befd93ea7c3583c47feac8b3dec2debf9f1a1a7aab0dce87098682cbd6e8: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:51:36.892107 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=9: (3.393383ms) 500
goroutine 601 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2081720c0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2081720c0, 0xc2084de7e0, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2081720c0, 0x7f8a04dbf1b0, 0xc208325350)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2081720c0, 0xc2084f5e10)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2081720c0, 0xc2084f5e10)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2081720c0, 0xc2084f5e10)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2081720c0, 0xc2084f5e10)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2081720c0, 0xc2084f5e10)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208408a00, 0xc2084f5e10)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:51:37.146972 4877 server.go:324] GET /stats/bc1262aa-9a8b-11e4-af56-42010af0dcb6/reasoning-gcs-ingest?num_stats=9: (2.919773ms) 500
goroutine 601 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208172660, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208172660, 0xc2084debd0, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208172660, 0x7f8a04dbf1b0, 0xc208325ac0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208172660, 0xc2080db790)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208172660, 0xc2080db790)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208172660, 0xc2080db790)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208172660, 0xc2080db790)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208172660, 0xc2080db790)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208408aa0, 0xc2080db790)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:51:37.166247 4877 server.go:324] GET /stats/bd6bc202-9a8b-11e4-af56-42010af0dcb6/reasoning-redis-ingest?num_stats=9: (2.720343ms) 500
goroutine 601 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208172ba0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208172ba0, 0xc2084defc0, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208172ba0, 0x7f8a04dbf1b0, 0xc208325ff0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208172ba0, 0xc2084f41a0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208172ba0, 0xc2084f41a0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208172ba0, 0xc2084f41a0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208172ba0, 0xc2084f41a0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208172ba0, 0xc2084f41a0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208408b40, 0xc2084f41a0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:51:37.187953 4877 server.go:324] GET /healthz: (12.32us) 200
I0112 18:51:37.232707 4877 server.go:324] GET /stats?num_stats=9: (26.103us) 301
I0112 18:51:37.234060 4877 server.go:324] GET /stats/: (649.762us) 500
goroutine 601 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208173140, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208173140, 0xc20838bc70, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208173140, 0x7f8a04dbf1b0, 0xc2083145b0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208173140, 0xc2084f4a90)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208173140, 0xc2084f4a90)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208173140, 0xc2084f4a90)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208173140, 0xc2084f4a90)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208173140, 0xc2084f4a90)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208408e60, 0xc2084f4a90)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:51:38.214754 4877 server.go:324] GET /healthz: (12.683us) 200
I0112 18:51:41.465225 4877 server.go:324] GET /healthz: (11.875us) 200
I0112 18:51:44.268973 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:51:44.270933 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:51:44.365927 4877 restclient.go:141] Waiting for completion of operation 3115
E0112 18:51:44.444257 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 2c7b4933735f93b786ae9c4c641093d7542d8cfa29d81f04ade88390a077f1d9: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:51:44.444306 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 2c7b4933735f93b786ae9c4c641093d7542d8cfa29d81f04ade88390a077f1d9: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:51:46.370235 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 2c7b4933735f93b786ae9c4c641093d7542d8cfa29d81f04ade88390a077f1d9
I0112 18:51:46.403267 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 2c7b4933735f93b786ae9c4c641093d7542d8cfa29d81f04ade88390a077f1d9 with error: API error (500): Cannot start container 2c7b4933735f93b786ae9c4c641093d7542d8cfa29d81f04ade88390a077f1d9: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:51:46.408587 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 2c7b4933735f93b786ae9c4c641093d7542d8cfa29d81f04ade88390a077f1d9: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:51:46.927538 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=9: (3.323466ms) 500
goroutine 601 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208004300, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208004300, 0xc208267320, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208004300, 0x7f8a04dbf1b0, 0xc2085fe1f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208004300, 0xc2084f4d00)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208004300, 0xc2084f4d00)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208004300, 0xc2084f4d00)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208004300, 0xc2084f4d00)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208004300, 0xc2084f4d00)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20823ebe0, 0xc2084f4d00)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:51:47.149098 4877 server.go:324] GET /stats/bd6bc202-9a8b-11e4-af56-42010af0dcb6/reasoning-redis-ingest?num_stats=9: (3.149739ms) 500
goroutine 601 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208004ba0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208004ba0, 0xc208267710, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208004ba0, 0x7f8a04dbf1b0, 0xc2085fe6c0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208004ba0, 0xc2083d64e0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208004ba0, 0xc2083d64e0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208004ba0, 0xc2083d64e0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208004ba0, 0xc2083d64e0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208004ba0, 0xc2083d64e0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20823ec80, 0xc2083d64e0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:51:47.182599 4877 server.go:324] GET /stats/bc1262aa-9a8b-11e4-af56-42010af0dcb6/reasoning-gcs-ingest?num_stats=9: (3.265347ms) 500
goroutine 601 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208005140, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208005140, 0xc208267b00, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208005140, 0x7f8a04dbf1b0, 0xc2085feb90)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208005140, 0xc2083d69c0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208005140, 0xc2083d69c0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208005140, 0xc2083d69c0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208005140, 0xc2083d69c0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208005140, 0xc2083d69c0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20823f180, 0xc2083d69c0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:51:47.266528 4877 server.go:324] GET /healthz: (12.577us) 200
I0112 18:51:47.434556 4877 server.go:324] GET /stats?num_stats=10: (24.226us) 301
I0112 18:51:47.435927 4877 server.go:324] GET /stats/: (553.859us) 500
goroutine 601 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2080056e0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2080056e0, 0xc208189f90, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2080056e0, 0x7f8a04dbf1b0, 0xc2085ff010)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2080056e0, 0xc2083d76c0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2080056e0, 0xc2083d76c0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2080056e0, 0xc2083d76c0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2080056e0, 0xc2083d76c0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2080056e0, 0xc2083d76c0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20823fa40, 0xc2083d76c0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:51:51.511356 4877 server.go:324] GET /healthz: (11.092us) 200
I0112 18:51:52.931532 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/cadvisor.manifest": default.cadvisor-agent (cadvisormanifes12uqn2ohido76855gdecd9roadm7l0)
I0112 18:51:52.931805 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/fluentd-es.manifest": default.fluentd-to-elasticsearch (fluentdesmanife2u464h05heqcpotoddodpnehjaqsde)
I0112 18:51:54.165370 4877 server.go:324] GET /healthz: (11.574us) 200
I0112 18:51:54.272047 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:51:54.273875 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:51:54.381059 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 3f6e6ca873a730ebbb5ba2f58031e16af3776cb4a70c333fd648a53feb58c0f2
E0112 18:51:54.404645 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 3f6e6ca873a730ebbb5ba2f58031e16af3776cb4a70c333fd648a53feb58c0f2: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:51:54.404701 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 3f6e6ca873a730ebbb5ba2f58031e16af3776cb4a70c333fd648a53feb58c0f2: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:51:54.405013 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 3f6e6ca873a730ebbb5ba2f58031e16af3776cb4a70c333fd648a53feb58c0f2 with error: API error (500): Cannot start container 3f6e6ca873a730ebbb5ba2f58031e16af3776cb4a70c333fd648a53feb58c0f2: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:51:54.410407 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 3f6e6ca873a730ebbb5ba2f58031e16af3776cb4a70c333fd648a53feb58c0f2: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:51:56.899546 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=9: (3.269921ms) 500
goroutine 601 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208173bc0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208173bc0, 0xc20845e090, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208173bc0, 0x7f8a04dbf1b0, 0xc208149d80)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208173bc0, 0xc2083d7ee0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208173bc0, 0xc2083d7ee0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208173bc0, 0xc2083d7ee0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208173bc0, 0xc2083d7ee0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208173bc0, 0xc2083d7ee0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2083aabe0, 0xc2083d7ee0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:51:57.266738 4877 server.go:324] GET /stats/bc1262aa-9a8b-11e4-af56-42010af0dcb6/reasoning-gcs-ingest?num_stats=9: (2.95754ms) 500
goroutine 601 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2081c2120, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2081c2120, 0xc20845e480, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2081c2120, 0x7f8a04dbf1b0, 0xc208214510)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2081c2120, 0xc2080da680)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2081c2120, 0xc2080da680)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2081c2120, 0xc2080da680)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2081c2120, 0xc2080da680)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2081c2120, 0xc2080da680)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2083aac80, 0xc2080da680)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:51:57.286272 4877 server.go:324] GET /stats/bd6bc202-9a8b-11e4-af56-42010af0dcb6/reasoning-redis-ingest?num_stats=9: (2.96379ms) 500
goroutine 601 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2081c26c0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2081c26c0, 0xc20845e870, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2081c26c0, 0x7f8a04dbf1b0, 0xc208214d90)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2081c26c0, 0xc2080dad00)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2081c26c0, 0xc2080dad00)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2081c26c0, 0xc2080dad00)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2081c26c0, 0xc2080dad00)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2081c26c0, 0xc2080dad00)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2083aad20, 0xc2080dad00)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:51:57.307468 4877 server.go:324] GET /healthz: (10.631us) 200
I0112 18:51:57.351685 4877 server.go:324] GET /stats?num_stats=9: (39.173us) 301
I0112 18:51:57.353084 4877 server.go:324] GET /stats/: (618.858us) 500
goroutine 601 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2081c2d20, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2081c2d20, 0xc20833b950, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2081c2d20, 0x7f8a04dbf1b0, 0xc208215550)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2081c2d20, 0xc2080db860)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2081c2d20, 0xc2080db860)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2081c2d20, 0xc2080db860)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2081c2d20, 0xc2080db860)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2081c2d20, 0xc2080db860)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2083ab180, 0xc2080db860)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:52:01.552113 4877 server.go:324] GET /healthz: (21.926us) 200
I0112 18:52:03.710906 4877 server.go:324] GET /healthz: (11.448us) 200
I0112 18:52:03.712385 4877 server.go:324] GET /healthz: (6.304us) 200
I0112 18:52:03.712611 4877 server.go:324] GET /healthz: (4.702us) 200
I0112 18:52:03.745377 4877 server.go:324] GET /api/v1beta1/podInfo?podID=bd6bc202-9a8b-11e4-af56-42010af0dcb6&podNamespace=default: (10.552945ms) 200
I0112 18:52:03.746111 4877 server.go:324] GET /api/v1beta1/podInfo?podID=bc1262aa-9a8b-11e4-af56-42010af0dcb6&podNamespace=default: (9.641777ms) 200
I0112 18:52:03.746647 4877 server.go:324] GET /api/v1beta1/podInfo?podID=redis-3&podNamespace=default: (10.067402ms) 200
I0112 18:52:04.275580 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:52:04.277748 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:52:04.364718 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 37841f94e9e709b12cca7b7d801487dac964810810f107c5493a3c6a26141ee3
E0112 18:52:04.412639 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 37841f94e9e709b12cca7b7d801487dac964810810f107c5493a3c6a26141ee3: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:52:04.412690 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 37841f94e9e709b12cca7b7d801487dac964810810f107c5493a3c6a26141ee3: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:52:04.412896 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 37841f94e9e709b12cca7b7d801487dac964810810f107c5493a3c6a26141ee3 with error: API error (500): Cannot start container 37841f94e9e709b12cca7b7d801487dac964810810f107c5493a3c6a26141ee3: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:52:04.425391 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 37841f94e9e709b12cca7b7d801487dac964810810f107c5493a3c6a26141ee3: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:52:06.908703 4877 server.go:324] GET /healthz: (12.52us) 200
I0112 18:52:06.923391 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=9: (3.452535ms) 500
goroutine 601 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208142b40, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208142b40, 0xc2084d23f0, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208142b40, 0x7f8a04dbf1b0, 0xc208236b30)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208142b40, 0xc20814c410)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208142b40, 0xc20814c410)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208142b40, 0xc20814c410)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208142b40, 0xc20814c410)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208142b40, 0xc20814c410)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20823eaa0, 0xc20814c410)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:52:07.159943 4877 server.go:324] GET /stats/bc1262aa-9a8b-11e4-af56-42010af0dcb6/reasoning-gcs-ingest?num_stats=9: (2.924278ms) 500
goroutine 601 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2081430e0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2081430e0, 0xc2084d27e0, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2081430e0, 0x7f8a04dbf1b0, 0xc208237f80)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2081430e0, 0xc2084f5e10)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2081430e0, 0xc2084f5e10)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2081430e0, 0xc2084f5e10)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2081430e0, 0xc2084f5e10)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2081430e0, 0xc2084f5e10)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20823ebe0, 0xc2084f5e10)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:52:07.180519 4877 server.go:324] GET /stats/bd6bc202-9a8b-11e4-af56-42010af0dcb6/reasoning-redis-ingest?num_stats=9: (3.031581ms) 500
goroutine 601 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208143680, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208143680, 0xc2084d2bd0, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208143680, 0x7f8a04dbf1b0, 0xc208148580)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208143680, 0xc2083d6410)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208143680, 0xc2083d6410)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208143680, 0xc2083d6410)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208143680, 0xc2083d6410)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208143680, 0xc2083d6410)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20823ec80, 0xc2083d6410)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:52:07.194533 4877 server.go:324] GET /healthz: (11.853us) 200
I0112 18:52:07.229834 4877 server.go:324] GET /stats?num_stats=9: (31.317us) 301
I0112 18:52:07.231090 4877 server.go:324] GET /stats/: (540.215us) 500
goroutine 601 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208143ce0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208143ce0, 0xc20831a910, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208143ce0, 0x7f8a04dbf1b0, 0xc208148af0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208143ce0, 0xc2083d6b60)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208143ce0, 0xc2083d6b60)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208143ce0, 0xc2083d6b60)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208143ce0, 0xc2083d6b60)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208143ce0, 0xc2083d6b60)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20823efa0, 0xc2083d6b60)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:52:11.600971 4877 server.go:324] GET /healthz: (10.739us) 200
I0112 18:52:12.932605 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/cadvisor.manifest": default.cadvisor-agent (cadvisormanifes12uqn2ohido76855gdecd9roadm7l0)
I0112 18:52:12.932883 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/fluentd-es.manifest": default.fluentd-to-elasticsearch (fluentdesmanife2u464h05heqcpotoddodpnehjaqsde)
I0112 18:52:14.278383 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:52:14.282864 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:52:14.396883 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 1fb60ff5549ce17a7cfaf011717e317495037d54c15232a0960b081d6bdce456
E0112 18:52:14.428450 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 1fb60ff5549ce17a7cfaf011717e317495037d54c15232a0960b081d6bdce456: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:52:14.428505 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 1fb60ff5549ce17a7cfaf011717e317495037d54c15232a0960b081d6bdce456: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:52:14.428702 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 1fb60ff5549ce17a7cfaf011717e317495037d54c15232a0960b081d6bdce456 with error: API error (500): Cannot start container 1fb60ff5549ce17a7cfaf011717e317495037d54c15232a0960b081d6bdce456: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:52:14.428754 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 1fb60ff5549ce17a7cfaf011717e317495037d54c15232a0960b081d6bdce456: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:52:16.932357 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=9: (2.843951ms) 500
goroutine 601 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2081438c0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2081438c0, 0xc2084e2d80, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2081438c0, 0x7f8a04dbf1b0, 0xc208148cd0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2081438c0, 0xc2083d6dd0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2081438c0, 0xc2083d6dd0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2081438c0, 0xc2083d6dd0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2081438c0, 0xc2083d6dd0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2081438c0, 0xc2083d6dd0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20823e640, 0xc2083d6dd0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:52:17.275433 4877 server.go:324] GET /stats/bc1262aa-9a8b-11e4-af56-42010af0dcb6/reasoning-gcs-ingest?num_stats=10: (2.769539ms) 500
goroutine 601 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208143ec0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208143ec0, 0xc2084e3170, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208143ec0, 0x7f8a04dbf1b0, 0xc208149310)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208143ec0, 0xc2080da410)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208143ec0, 0xc2080da410)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208143ec0, 0xc2080da410)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208143ec0, 0xc2080da410)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208143ec0, 0xc2080da410)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20823e6e0, 0xc2080da410)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:52:17.294843 4877 server.go:324] GET /stats/bd6bc202-9a8b-11e4-af56-42010af0dcb6/reasoning-redis-ingest?num_stats=10: (2.87281ms) 500
goroutine 601 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2085f0420, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2085f0420, 0xc2084e3560, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2085f0420, 0x7f8a04dbf1b0, 0xc2081498a0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2085f0420, 0xc2080da9c0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2085f0420, 0xc2080da9c0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2085f0420, 0xc2080da9c0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2085f0420, 0xc2080da9c0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2085f0420, 0xc2080da9c0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20823e8c0, 0xc2080da9c0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:52:17.304345 4877 server.go:324] GET /healthz: (10.245us) 200
I0112 18:52:17.354205 4877 server.go:324] GET /stats?num_stats=10: (25.12us) 301
I0112 18:52:17.357323 4877 server.go:324] GET /stats/: (2.342243ms) 500
goroutine 601 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2085f09c0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2085f09c0, 0xc20833aa00, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2085f09c0, 0x7f8a04dbf1b0, 0xc208149d30)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2085f09c0, 0xc2080db5f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2085f09c0, 0xc2080db5f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2085f09c0, 0xc2080db5f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2085f09c0, 0xc2080db5f0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2085f09c0, 0xc2080db5f0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20823ebe0, 0xc2080db5f0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:52:18.469407 4877 server.go:324] GET /healthz: (12.057us) 200
I0112 18:52:19.983989 4877 server.go:324] GET /healthz: (14.403us) 200
I0112 18:52:21.641562 4877 server.go:324] GET /healthz: (14.381us) 200
I0112 18:52:24.280999 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:52:24.282908 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:52:24.396828 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 564e0bc289299de5ad2b09bda6e3e77a27bc00846d01d8d6c9781fffb8262edb
E0112 18:52:24.428371 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 564e0bc289299de5ad2b09bda6e3e77a27bc00846d01d8d6c9781fffb8262edb: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:52:24.428416 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 564e0bc289299de5ad2b09bda6e3e77a27bc00846d01d8d6c9781fffb8262edb: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:52:24.428624 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 564e0bc289299de5ad2b09bda6e3e77a27bc00846d01d8d6c9781fffb8262edb with error: API error (500): Cannot start container 564e0bc289299de5ad2b09bda6e3e77a27bc00846d01d8d6c9781fffb8262edb: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:52:24.434114 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 564e0bc289299de5ad2b09bda6e3e77a27bc00846d01d8d6c9781fffb8262edb: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:52:31.740340 4877 server.go:324] GET /healthz: (37.562us) 200
I0112 18:52:32.933923 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/cadvisor.manifest": default.cadvisor-agent (cadvisormanifes12uqn2ohido76855gdecd9roadm7l0)
I0112 18:52:32.934206 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/fluentd-es.manifest": default.fluentd-to-elasticsearch (fluentdesmanife2u464h05heqcpotoddodpnehjaqsde)
I0112 18:52:33.215619 4877 server.go:324] GET /healthz: (10.838us) 200
I0112 18:52:34.284123 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:52:34.286184 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:52:34.356700 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 13479a26ed25099393a72ef6b40454f5442687cdbea52efc242265981e3f170d
E0112 18:52:34.404408 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 13479a26ed25099393a72ef6b40454f5442687cdbea52efc242265981e3f170d: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:52:34.404453 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 13479a26ed25099393a72ef6b40454f5442687cdbea52efc242265981e3f170d: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:52:34.404674 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 13479a26ed25099393a72ef6b40454f5442687cdbea52efc242265981e3f170d with error: API error (500): Cannot start container 13479a26ed25099393a72ef6b40454f5442687cdbea52efc242265981e3f170d: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:52:34.410024 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 13479a26ed25099393a72ef6b40454f5442687cdbea52efc242265981e3f170d: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:52:35.080241 4877 server.go:324] GET /healthz: (21.491us) 200
I0112 18:52:35.080972 4877 server.go:324] GET /healthz: (6.024us) 200
I0112 18:52:35.081097 4877 server.go:324] GET /healthz: (4.325us) 200
I0112 18:52:35.119263 4877 server.go:324] GET /api/v1beta1/podInfo?podID=bd6bc202-9a8b-11e4-af56-42010af0dcb6&podNamespace=default: (9.949905ms) 200
I0112 18:52:35.119812 4877 server.go:324] GET /api/v1beta1/podInfo?podID=bc1262aa-9a8b-11e4-af56-42010af0dcb6&podNamespace=default: (9.137366ms) 200
I0112 18:52:35.120411 4877 server.go:324] GET /api/v1beta1/podInfo?podID=redis-3&podNamespace=default: (9.595983ms) 200
I0112 18:52:41.834252 4877 server.go:324] GET /healthz: (15.875us) 200
I0112 18:52:44.287298 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:52:44.289323 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:52:44.396754 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id fee54b2f1a9eeb61ac013d2e12c50c1113606d30fb02e132cec7c85b73b5da0f
E0112 18:52:44.420279 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container fee54b2f1a9eeb61ac013d2e12c50c1113606d30fb02e132cec7c85b73b5da0f: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:52:44.420321 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container fee54b2f1a9eeb61ac013d2e12c50c1113606d30fb02e132cec7c85b73b5da0f: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:52:44.420508 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id fee54b2f1a9eeb61ac013d2e12c50c1113606d30fb02e132cec7c85b73b5da0f with error: API error (500): Cannot start container fee54b2f1a9eeb61ac013d2e12c50c1113606d30fb02e132cec7c85b73b5da0f: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:52:44.425227 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container fee54b2f1a9eeb61ac013d2e12c50c1113606d30fb02e132cec7c85b73b5da0f: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:52:45.837641 4877 server.go:324] GET /healthz: (14.693us) 200
I0112 18:52:46.994478 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=10: (2.988918ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20848c960, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20848c960, 0xc2084bc630, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20848c960, 0x7f8a04dbf1b0, 0xc20837c1a0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20848c960, 0xc2084f4680)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20848c960, 0xc2084f4680)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20848c960, 0xc2084f4680)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20848c960, 0xc2084f4680)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20848c960, 0xc2084f4680)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2083abf40, 0xc2084f4680)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:52:47.229915 4877 server.go:324] GET /stats/bd6bc202-9a8b-11e4-af56-42010af0dcb6/reasoning-redis-ingest?num_stats=10: (2.880263ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20848cea0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20848cea0, 0xc2084bca20, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20848cea0, 0x7f8a04dbf1b0, 0xc20837c800)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20848cea0, 0xc2084f4a90)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20848cea0, 0xc2084f4a90)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20848cea0, 0xc2084f4a90)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20848cea0, 0xc2084f4a90)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20848cea0, 0xc2084f4a90)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208408000, 0xc2084f4a90)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:52:47.262177 4877 server.go:324] GET /stats/bc1262aa-9a8b-11e4-af56-42010af0dcb6/reasoning-gcs-ingest?num_stats=10: (2.940413ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20848d3e0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20848d3e0, 0xc2084bce10, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20848d3e0, 0x7f8a04dbf1b0, 0xc20837cee0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20848d3e0, 0xc2084f5040)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20848d3e0, 0xc2084f5040)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20848d3e0, 0xc2084f5040)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20848d3e0, 0xc2084f5040)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20848d3e0, 0xc2084f5040)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2084080a0, 0xc2084f5040)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:52:47.272660 4877 server.go:324] GET /healthz: (9.095us) 200
I0112 18:52:47.393932 4877 server.go:324] GET /stats?num_stats=10: (24.387us) 301
I0112 18:52:47.395226 4877 server.go:324] GET /stats/: (563.07us) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20848d980, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20848d980, 0xc2083a85a0, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20848d980, 0x7f8a04dbf1b0, 0xc20837d530)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20848d980, 0xc2084f5860)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20848d980, 0xc2084f5860)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20848d980, 0xc2084f5860)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20848d980, 0xc2084f5860)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20848d980, 0xc2084f5860)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208408320, 0xc2084f5860)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:52:51.867127 4877 server.go:324] GET /healthz: (11.932us) 200
I0112 18:52:52.935129 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/cadvisor.manifest": default.cadvisor-agent (cadvisormanifes12uqn2ohido76855gdecd9roadm7l0)
I0112 18:52:52.935402 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/fluentd-es.manifest": default.fluentd-to-elasticsearch (fluentdesmanife2u464h05heqcpotoddodpnehjaqsde)
I0112 18:52:54.290314 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:52:54.292491 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:52:54.338095 4877 restclient.go:141] Waiting for completion of operation 3371
E0112 18:52:54.406030 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container de0dee28a3366280f14cf4468b8b6644574f8aa330ba326264c950c6a1376892: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:52:54.406071 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container de0dee28a3366280f14cf4468b8b6644574f8aa330ba326264c950c6a1376892: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:52:56.341537 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id de0dee28a3366280f14cf4468b8b6644574f8aa330ba326264c950c6a1376892
I0112 18:52:56.346221 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id de0dee28a3366280f14cf4468b8b6644574f8aa330ba326264c950c6a1376892 with error: API error (500): Cannot start container de0dee28a3366280f14cf4468b8b6644574f8aa330ba326264c950c6a1376892: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:52:56.346268 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container de0dee28a3366280f14cf4468b8b6644574f8aa330ba326264c950c6a1376892: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:52:57.096296 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=9: (104.863988ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208442780, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208442780, 0xc208396090, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208442780, 0x7f8a04dbf1b0, 0xc208144050)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208442780, 0xc2084f5ba0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208442780, 0xc2084f5ba0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208442780, 0xc2084f5ba0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208442780, 0xc2084f5ba0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208442780, 0xc2084f5ba0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20823f2c0, 0xc2084f5ba0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:52:57.428413 4877 server.go:324] GET /stats/bc1262aa-9a8b-11e4-af56-42010af0dcb6/reasoning-gcs-ingest?num_stats=10: (3.130864ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2082ea0c0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2082ea0c0, 0xc208396480, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2082ea0c0, 0x7f8a04dbf1b0, 0xc2081448a0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2082ea0c0, 0xc2084f4000)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2082ea0c0, 0xc2084f4000)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2082ea0c0, 0xc2084f4000)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2082ea0c0, 0xc2084f4000)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2082ea0c0, 0xc2084f4000)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208408000, 0xc2084f4000)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:52:57.448869 4877 server.go:324] GET /stats/bd6bc202-9a8b-11e4-af56-42010af0dcb6/reasoning-redis-ingest?num_stats=10: (2.88502ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2082ea660, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2082ea660, 0xc208396870, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2082ea660, 0x7f8a04dbf1b0, 0xc2081451a0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2082ea660, 0xc2084f44e0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2082ea660, 0xc2084f44e0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2082ea660, 0xc2084f44e0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2082ea660, 0xc2084f44e0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2082ea660, 0xc2084f44e0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2084080a0, 0xc2084f44e0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:52:57.480744 4877 server.go:324] GET /healthz: (11.902us) 200
I0112 18:52:57.563497 4877 server.go:324] GET /stats?num_stats=10: (25.686us) 301
I0112 18:52:57.564882 4877 server.go:324] GET /stats/: (582.474us) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2082eac60, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2082eac60, 0xc2083a8820, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2082eac60, 0x7f8a04dbf1b0, 0xc2085fe040)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2082eac60, 0xc2084f4dd0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2082eac60, 0xc2084f4dd0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2082eac60, 0xc2084f4dd0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2082eac60, 0xc2084f4dd0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2082eac60, 0xc2084f4dd0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208408320, 0xc2084f4dd0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:52:58.499807 4877 server.go:324] GET /healthz: (13.369us) 200
I0112 18:53:02.089635 4877 server.go:324] GET /healthz: (12.173us) 200
I0112 18:53:04.293259 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:53:04.295087 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:53:04.380790 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id dd34bb141f0952cda2278cb510aa544871abbfeab460f1bc4f2bf44fabdc0096
E0112 18:53:04.428416 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container dd34bb141f0952cda2278cb510aa544871abbfeab460f1bc4f2bf44fabdc0096: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:53:04.428458 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container dd34bb141f0952cda2278cb510aa544871abbfeab460f1bc4f2bf44fabdc0096: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:53:04.428811 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id dd34bb141f0952cda2278cb510aa544871abbfeab460f1bc4f2bf44fabdc0096 with error: API error (500): Cannot start container dd34bb141f0952cda2278cb510aa544871abbfeab460f1bc4f2bf44fabdc0096: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:53:04.434004 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container dd34bb141f0952cda2278cb510aa544871abbfeab460f1bc4f2bf44fabdc0096: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:53:06.454897 4877 server.go:324] GET /healthz: (12.255us) 200
I0112 18:53:06.541829 4877 server.go:324] GET /healthz: (7.179us) 200
I0112 18:53:06.541963 4877 server.go:324] GET /healthz: (4.042us) 200
I0112 18:53:06.560112 4877 server.go:324] GET /api/v1beta1/podInfo?podID=redis-3&podNamespace=default: (19.321904ms) 200
I0112 18:53:06.575821 4877 server.go:324] GET /api/v1beta1/podInfo?podID=bd6bc202-9a8b-11e4-af56-42010af0dcb6&podNamespace=default: (6.956884ms) 200
I0112 18:53:06.576477 4877 server.go:324] GET /api/v1beta1/podInfo?podID=bc1262aa-9a8b-11e4-af56-42010af0dcb6&podNamespace=default: (7.415357ms) 200
I0112 18:53:07.060657 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=9: (3.238822ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20816bce0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20816bce0, 0xc2084febd0, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20816bce0, 0x7f8a04dbf1b0, 0xc2082143c0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20816bce0, 0xc2084f5040)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20816bce0, 0xc2084f5040)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20816bce0, 0xc2084f5040)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20816bce0, 0xc2084f5040)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20816bce0, 0xc2084f5040)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2083ab9a0, 0xc2084f5040)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:53:07.303447 4877 server.go:324] GET /stats/bc1262aa-9a8b-11e4-af56-42010af0dcb6/reasoning-gcs-ingest?num_stats=9: (3.244548ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2085f0240, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2085f0240, 0xc2084fefc0, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2085f0240, 0x7f8a04dbf1b0, 0xc208214930)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2085f0240, 0xc20814c410)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2085f0240, 0xc20814c410)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2085f0240, 0xc20814c410)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2085f0240, 0xc20814c410)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2085f0240, 0xc20814c410)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2083aba40, 0xc20814c410)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:53:07.427055 4877 server.go:324] GET /stats/bd6bc202-9a8b-11e4-af56-42010af0dcb6/reasoning-redis-ingest?num_stats=9: (106.026258ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2085f0780, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2085f0780, 0xc2084fe240, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2085f0780, 0x7f8a04dbf1b0, 0xc208214480)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2085f0780, 0xc20814c820)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2085f0780, 0xc20814c820)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2085f0780, 0xc20814c820)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2085f0780, 0xc20814c820)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2085f0780, 0xc20814c820)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2083abae0, 0xc20814c820)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:53:07.433549 4877 server.go:324] GET /healthz: (10.66us) 200
I0112 18:53:07.472160 4877 server.go:324] GET /stats?num_stats=9: (24.099us) 301
I0112 18:53:07.473194 4877 server.go:324] GET /stats/: (528.887us) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2085f0540, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2085f0540, 0xc20831a550, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2085f0540, 0x7f8a04dbf1b0, 0xc208214890)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2085f0540, 0xc20814dd40)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2085f0540, 0xc20814dd40)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2085f0540, 0xc20814dd40)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2085f0540, 0xc20814dd40)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2085f0540, 0xc20814dd40)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2084081e0, 0xc20814dd40)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:53:11.247453 4877 server.go:324] GET /healthz: (14.706us) 200
I0112 18:53:12.578554 4877 server.go:324] GET /healthz: (11.099us) 200
I0112 18:53:12.936163 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/cadvisor.manifest": default.cadvisor-agent (cadvisormanifes12uqn2ohido76855gdecd9roadm7l0)
I0112 18:53:12.936473 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/fluentd-es.manifest": default.fluentd-to-elasticsearch (fluentdesmanife2u464h05heqcpotoddodpnehjaqsde)
I0112 18:53:14.296172 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:53:14.298019 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:53:14.367716 4877 restclient.go:141] Waiting for completion of operation 3438
E0112 18:53:14.420330 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 48de2272c7317ff98bf0dd06e13aa4045dbdc822ec4d7e53cf5e6cc63ad13c60: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:53:14.420391 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 48de2272c7317ff98bf0dd06e13aa4045dbdc822ec4d7e53cf5e6cc63ad13c60: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:53:16.370601 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 48de2272c7317ff98bf0dd06e13aa4045dbdc822ec4d7e53cf5e6cc63ad13c60
I0112 18:53:16.374920 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 48de2272c7317ff98bf0dd06e13aa4045dbdc822ec4d7e53cf5e6cc63ad13c60 with error: API error (500): Cannot start container 48de2272c7317ff98bf0dd06e13aa4045dbdc822ec4d7e53cf5e6cc63ad13c60: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:53:16.379213 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 48de2272c7317ff98bf0dd06e13aa4045dbdc822ec4d7e53cf5e6cc63ad13c60: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:53:17.017274 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=9: (2.61738ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2081722a0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2081722a0, 0xc2081debd0, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2081722a0, 0x7f8a04dbf1b0, 0xc2082faf60)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2081722a0, 0xc20814dad0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2081722a0, 0xc20814dad0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2081722a0, 0xc20814dad0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2081722a0, 0xc20814dad0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2081722a0, 0xc20814dad0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2083ab040, 0xc20814dad0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:53:17.253767 4877 server.go:324] GET /stats/bc1262aa-9a8b-11e4-af56-42010af0dcb6/reasoning-gcs-ingest?num_stats=9: (2.632741ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2081727e0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2081727e0, 0xc2081defc0, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2081727e0, 0x7f8a04dbf1b0, 0xc2082fb750)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2081727e0, 0xc2080da820)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2081727e0, 0xc2080da820)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2081727e0, 0xc2080da820)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2081727e0, 0xc2080da820)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2081727e0, 0xc2080da820)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2083ab180, 0xc2080da820)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:53:17.273125 4877 server.go:324] GET /stats/bd6bc202-9a8b-11e4-af56-42010af0dcb6/reasoning-redis-ingest?num_stats=9: (2.523765ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208172d20, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208172d20, 0xc2081df3b0, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208172d20, 0x7f8a04dbf1b0, 0xc2082fbf40)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208172d20, 0xc2080daea0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208172d20, 0xc2080daea0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208172d20, 0xc2080daea0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208172d20, 0xc2080daea0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208172d20, 0xc2080daea0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2083ab220, 0xc2080daea0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:53:17.308408 4877 server.go:324] GET /healthz: (11.864us) 200
I0112 18:53:17.507484 4877 server.go:324] GET /stats?num_stats=9: (25.267us) 301
I0112 18:53:17.508986 4877 server.go:324] GET /stats/: (558.378us) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2081732c0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2081732c0, 0xc20833b630, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2081732c0, 0x7f8a04dbf1b0, 0xc2085fe330)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2081732c0, 0xc2084f4000)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2081732c0, 0xc2084f4000)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2081732c0, 0xc2084f4000)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2081732c0, 0xc2084f4000)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2081732c0, 0xc2084f4000)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2083ab5e0, 0xc2084f4000)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:53:23.210881 4877 server.go:324] GET /healthz: (11.711us) 200
I0112 18:53:23.865282 4877 server.go:324] GET /healthz: (11.107us) 200
I0112 18:53:24.298626 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:53:24.300571 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:53:24.396804 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id dc42824bf955232e90b5e3838cc46a7da14830ec671512eca61c640a700fcc56
E0112 18:53:24.420338 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container dc42824bf955232e90b5e3838cc46a7da14830ec671512eca61c640a700fcc56: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:53:24.420381 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container dc42824bf955232e90b5e3838cc46a7da14830ec671512eca61c640a700fcc56: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:53:24.420464 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id dc42824bf955232e90b5e3838cc46a7da14830ec671512eca61c640a700fcc56 with error: API error (500): Cannot start container dc42824bf955232e90b5e3838cc46a7da14830ec671512eca61c640a700fcc56: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:53:24.425572 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container dc42824bf955232e90b5e3838cc46a7da14830ec671512eca61c640a700fcc56: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:53:27.112102 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=9: (2.770218ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2085f0840, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2085f0840, 0xc2082ed680, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2085f0840, 0x7f8a04dbf1b0, 0xc20828ce20)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2085f0840, 0xc2084f4340)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2085f0840, 0xc2084f4340)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2085f0840, 0xc2084f4340)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2085f0840, 0xc2084f4340)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2085f0840, 0xc2084f4340)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208409ae0, 0xc2084f4340)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:53:27.342946 4877 server.go:324] GET /stats/bc1262aa-9a8b-11e4-af56-42010af0dcb6/reasoning-gcs-ingest?num_stats=9: (3.249326ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2085f0d20, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2085f0d20, 0xc2082eda70, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2085f0d20, 0x7f8a04dbf1b0, 0xc20828d600)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2085f0d20, 0xc2083d6ea0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2085f0d20, 0xc2083d6ea0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2085f0d20, 0xc2083d6ea0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2085f0d20, 0xc2083d6ea0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2085f0d20, 0xc2083d6ea0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208409b80, 0xc2083d6ea0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:53:27.362644 4877 server.go:324] GET /stats/bd6bc202-9a8b-11e4-af56-42010af0dcb6/reasoning-redis-ingest?num_stats=9: (2.825888ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2085f1260, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2085f1260, 0xc2082ede60, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2085f1260, 0x7f8a04dbf1b0, 0xc20828dcb0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2085f1260, 0xc2083d7380)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2085f1260, 0xc2083d7380)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2085f1260, 0xc2083d7380)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2085f1260, 0xc2083d7380)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2085f1260, 0xc2083d7380)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208409c20, 0xc2083d7380)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:53:27.471441 4877 server.go:324] GET /healthz: (15.032us) 200
I0112 18:53:27.543553 4877 server.go:324] GET /stats?num_stats=9: (26.743us) 301
I0112 18:53:27.545030 4877 server.go:324] GET /stats/: (544.286us) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2085f1860, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2085f1860, 0xc20831acd0, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2085f1860, 0x7f8a04dbf1b0, 0xc2082361a0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2085f1860, 0xc2083d7ba0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2085f1860, 0xc2083d7ba0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2085f1860, 0xc2083d7ba0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2085f1860, 0xc2083d7ba0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2085f1860, 0xc2083d7ba0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208409ea0, 0xc2083d7ba0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:53:32.937232 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/cadvisor.manifest": default.cadvisor-agent (cadvisormanifes12uqn2ohido76855gdecd9roadm7l0)
I0112 18:53:32.937582 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/fluentd-es.manifest": default.fluentd-to-elasticsearch (fluentdesmanife2u464h05heqcpotoddodpnehjaqsde)
I0112 18:53:33.259582 4877 server.go:324] GET /healthz: (11.854us) 200
I0112 18:53:34.301220 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:53:34.305618 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:53:34.444777 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 58ca940a78994f3aa9f0164f5e40241257c6cb338906b96dca29e825f3f7df78
E0112 18:53:34.472273 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 58ca940a78994f3aa9f0164f5e40241257c6cb338906b96dca29e825f3f7df78: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:53:34.472316 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 58ca940a78994f3aa9f0164f5e40241257c6cb338906b96dca29e825f3f7df78: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:53:34.472532 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 58ca940a78994f3aa9f0164f5e40241257c6cb338906b96dca29e825f3f7df78 with error: API error (500): Cannot start container 58ca940a78994f3aa9f0164f5e40241257c6cb338906b96dca29e825f3f7df78: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:53:34.477536 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 58ca940a78994f3aa9f0164f5e40241257c6cb338906b96dca29e825f3f7df78: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:53:37.008282 4877 server.go:324] GET /healthz: (12.757us) 200
I0112 18:53:37.221739 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=9: (2.903905ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2085f0ea0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2085f0ea0, 0xc2085fbef0, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2085f0ea0, 0x7f8a04dbf1b0, 0xc2081bca40)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2085f0ea0, 0xc2083d7e10)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2085f0ea0, 0xc2083d7e10)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2085f0ea0, 0xc2083d7e10)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2085f0ea0, 0xc2083d7e10)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2085f0ea0, 0xc2083d7e10)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208409ea0, 0xc2083d7e10)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:53:37.477267 4877 server.go:324] GET /stats/bc1262aa-9a8b-11e4-af56-42010af0dcb6/reasoning-gcs-ingest?num_stats=9: (2.619006ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2085f1440, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2085f1440, 0xc2084d6360, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2085f1440, 0x7f8a04dbf1b0, 0xc2081bd1e0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2085f1440, 0xc2084f5110)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2085f1440, 0xc2084f5110)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2085f1440, 0xc2084f5110)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2085f1440, 0xc2084f5110)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2085f1440, 0xc2084f5110)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2083aa780, 0xc2084f5110)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:53:37.496831 4877 server.go:324] GET /stats/bd6bc202-9a8b-11e4-af56-42010af0dcb6/reasoning-redis-ingest?num_stats=9: (2.792216ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2085f19e0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2085f19e0, 0xc2084d6750, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2085f19e0, 0x7f8a04dbf1b0, 0xc2081bd850)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2085f19e0, 0xc2084f55f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2085f19e0, 0xc2084f55f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2085f19e0, 0xc2084f55f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2085f19e0, 0xc2084f55f0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2085f19e0, 0xc2084f55f0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2083aa820, 0xc2084f55f0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:53:37.727967 4877 server.go:324] GET /healthz: (12.731us) 200
I0112 18:53:38.164000 4877 server.go:324] GET /healthz: (12.425us) 200
I0112 18:53:38.164161 4877 server.go:324] GET /healthz: (4.109us) 200
I0112 18:53:38.210706 4877 server.go:324] GET /healthz: (17.29us) 200
I0112 18:53:38.268184 4877 server.go:324] GET /api/v1beta1/podInfo?podID=redis-3&podNamespace=default: (5.115707ms) 200
I0112 18:53:38.289335 4877 server.go:324] GET /api/v1beta1/podInfo?podID=bc1262aa-9a8b-11e4-af56-42010af0dcb6&podNamespace=default: (7.090513ms) 200
I0112 18:53:38.289979 4877 server.go:324] GET /api/v1beta1/podInfo?podID=bd6bc202-9a8b-11e4-af56-42010af0dcb6&podNamespace=default: (7.530514ms) 200
I0112 18:53:38.503307 4877 server.go:324] GET /stats?num_stats=10: (24.51us) 301
I0112 18:53:38.504665 4877 server.go:324] GET /stats/: (682.135us) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20817c060, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20817c060, 0xc20833bb30, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20817c060, 0x7f8a04dbf1b0, 0xc2082363d0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20817c060, 0xc2083d75f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20817c060, 0xc2083d75f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20817c060, 0xc2083d75f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20817c060, 0xc2083d75f0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20817c060, 0xc2083d75f0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2083ab4a0, 0xc2083d75f0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:53:43.299013 4877 server.go:324] GET /healthz: (12.762us) 200
I0112 18:53:44.303873 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:53:44.307623 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:53:44.412837 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 2ba85ea72ec98ae4d035086f9d1042b185be79ac7eff020d7c6334684e241b53
E0112 18:53:44.444303 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 2ba85ea72ec98ae4d035086f9d1042b185be79ac7eff020d7c6334684e241b53: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:53:44.444351 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 2ba85ea72ec98ae4d035086f9d1042b185be79ac7eff020d7c6334684e241b53: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:53:44.444551 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 2ba85ea72ec98ae4d035086f9d1042b185be79ac7eff020d7c6334684e241b53 with error: API error (500): Cannot start container 2ba85ea72ec98ae4d035086f9d1042b185be79ac7eff020d7c6334684e241b53: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:53:44.449118 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 2ba85ea72ec98ae4d035086f9d1042b185be79ac7eff020d7c6334684e241b53: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:53:46.977164 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=8: (3.03595ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2085f0e40, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2085f0e40, 0xc2085f4000, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2085f0e40, 0x7f8a04dbf1b0, 0xc2081bd060)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2085f0e40, 0xc2083d7860)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2085f0e40, 0xc2083d7860)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2085f0e40, 0xc2083d7860)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2085f0e40, 0xc2083d7860)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2085f0e40, 0xc2083d7860)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208408be0, 0xc2083d7860)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:53:47.563659 4877 server.go:324] GET /stats/bd6bc202-9a8b-11e4-af56-42010af0dcb6/reasoning-redis-ingest?num_stats=9: (3.129063ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2085f1380, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2085f1380, 0xc2085f43f0, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2085f1380, 0x7f8a04dbf1b0, 0xc2081bd760)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2085f1380, 0xc2084f49c0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2085f1380, 0xc2084f49c0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2085f1380, 0xc2084f49c0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2085f1380, 0xc2084f49c0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2085f1380, 0xc2084f49c0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208408c80, 0xc2084f49c0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:53:47.597604 4877 server.go:324] GET /stats/bc1262aa-9a8b-11e4-af56-42010af0dcb6/reasoning-gcs-ingest?num_stats=9: (2.952917ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2085f18c0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2085f18c0, 0xc2085f47e0, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2085f18c0, 0x7f8a04dbf1b0, 0xc2081bdda0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2085f18c0, 0xc2084f4ea0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2085f18c0, 0xc2084f4ea0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2085f18c0, 0xc2084f4ea0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2085f18c0, 0xc2084f4ea0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2085f18c0, 0xc2084f4ea0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208408dc0, 0xc2084f4ea0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:53:47.618629 4877 server.go:324] GET /healthz: (13.027us) 200
I0112 18:53:47.703174 4877 server.go:324] GET /stats?num_stats=9: (25.989us) 301
I0112 18:53:47.704557 4877 server.go:324] GET /stats/: (595.378us) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2085f1ec0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2085f1ec0, 0xc208369db0, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2085f1ec0, 0x7f8a04dbf1b0, 0xc2082a02b0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2085f1ec0, 0xc2084f55f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2085f1ec0, 0xc2084f55f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2085f1ec0, 0xc2084f55f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2085f1ec0, 0xc2084f55f0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2085f1ec0, 0xc2084f55f0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208409040, 0xc2084f55f0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:53:50.526164 4877 server.go:324] GET /healthz: (11.399us) 200
I0112 18:53:52.938423 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/cadvisor.manifest": default.cadvisor-agent (cadvisormanifes12uqn2ohido76855gdecd9roadm7l0)
I0112 18:53:52.938705 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/fluentd-es.manifest": default.fluentd-to-elasticsearch (fluentdesmanife2u464h05heqcpotoddodpnehjaqsde)
I0112 18:53:53.824066 4877 server.go:324] GET /healthz: (12.076us) 200
I0112 18:53:54.306635 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:53:54.308793 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:53:54.404773 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 9cd8465997024b50cb720e49e859432e4259414ad84213e157003615e043f22e
E0112 18:53:54.440551 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 9cd8465997024b50cb720e49e859432e4259414ad84213e157003615e043f22e: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:53:54.440600 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 9cd8465997024b50cb720e49e859432e4259414ad84213e157003615e043f22e: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:53:54.440797 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 9cd8465997024b50cb720e49e859432e4259414ad84213e157003615e043f22e with error: API error (500): Cannot start container 9cd8465997024b50cb720e49e859432e4259414ad84213e157003615e043f22e: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:53:54.440828 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 9cd8465997024b50cb720e49e859432e4259414ad84213e157003615e043f22e: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:53:56.947965 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=9: (3.113618ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208298fc0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208298fc0, 0xc20839d9e0, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208298fc0, 0x7f8a04dbf1b0, 0xc208314920)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208298fc0, 0xc2084f5860)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208298fc0, 0xc2084f5860)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208298fc0, 0xc2084f5860)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208298fc0, 0xc2084f5860)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208298fc0, 0xc2084f5860)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208408280, 0xc2084f5860)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:53:57.199499 4877 server.go:324] GET /stats/bc1262aa-9a8b-11e4-af56-42010af0dcb6/reasoning-gcs-ingest?num_stats=9: (3.027393ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208299560, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208299560, 0xc20839ddd0, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208299560, 0x7f8a04dbf1b0, 0xc208315040)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208299560, 0xc2083d76c0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208299560, 0xc2083d76c0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208299560, 0xc2083d76c0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208299560, 0xc2083d76c0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208299560, 0xc2083d76c0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208408320, 0xc2083d76c0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:53:57.220819 4877 server.go:324] GET /stats/bd6bc202-9a8b-11e4-af56-42010af0dcb6/reasoning-redis-ingest?num_stats=9: (3.273678ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208299b00, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208299b00, 0xc208252240, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208299b00, 0x7f8a04dbf1b0, 0xc2083156b0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208299b00, 0xc2083d7ee0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208299b00, 0xc2083d7ee0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208299b00, 0xc2083d7ee0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208299b00, 0xc2083d7ee0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208299b00, 0xc2083d7ee0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2084083c0, 0xc2083d7ee0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:53:57.269905 4877 server.go:324] GET /healthz: (10.894us) 200
I0112 18:53:57.319443 4877 server.go:324] GET /stats?num_stats=9: (24.871us) 301
I0112 18:53:57.320797 4877 server.go:324] GET /stats/: (601.375us) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20813e240, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20813e240, 0xc20838b270, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20813e240, 0x7f8a04dbf1b0, 0xc208315c60)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20813e240, 0xc2084f4820)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20813e240, 0xc2084f4820)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20813e240, 0xc2084f4820)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20813e240, 0xc2084f4820)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20813e240, 0xc2084f4820)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2084086e0, 0xc2084f4820)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:54:03.666730 4877 server.go:324] GET /healthz: (14.428us) 200
I0112 18:54:03.910739 4877 server.go:324] GET /healthz: (12.669us) 200
I0112 18:54:04.309342 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:54:04.311256 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:54:04.396635 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id b60d96f9d1ef8afb6a8e95b4a8c2b2ae91899a85e2d44306ea2965bb70b960ba
E0112 18:54:04.444455 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container b60d96f9d1ef8afb6a8e95b4a8c2b2ae91899a85e2d44306ea2965bb70b960ba: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:54:04.444499 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container b60d96f9d1ef8afb6a8e95b4a8c2b2ae91899a85e2d44306ea2965bb70b960ba: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:54:04.444717 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id b60d96f9d1ef8afb6a8e95b4a8c2b2ae91899a85e2d44306ea2965bb70b960ba with error: API error (500): Cannot start container b60d96f9d1ef8afb6a8e95b4a8c2b2ae91899a85e2d44306ea2965bb70b960ba: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:54:04.449885 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container b60d96f9d1ef8afb6a8e95b4a8c2b2ae91899a85e2d44306ea2965bb70b960ba: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:54:07.081269 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=9: (105.401079ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2085329c0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2085329c0, 0xc208396090, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2085329c0, 0x7f8a04dbf1b0, 0xc20852a040)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2085329c0, 0xc2084f4a90)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2085329c0, 0xc2084f4a90)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2085329c0, 0xc2084f4a90)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2085329c0, 0xc2084f4a90)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2085329c0, 0xc2084f4a90)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20823f860, 0xc2084f4a90)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:54:07.303671 4877 server.go:324] GET /stats/bc1262aa-9a8b-11e4-af56-42010af0dcb6/reasoning-gcs-ingest?num_stats=9: (3.024932ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2085100c0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2085100c0, 0xc208396480, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2085100c0, 0x7f8a04dbf1b0, 0xc20852a530)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2085100c0, 0xc2084f4000)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2085100c0, 0xc2084f4000)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2085100c0, 0xc2084f4000)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2085100c0, 0xc2084f4000)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2085100c0, 0xc2084f4000)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208408000, 0xc2084f4000)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:54:07.324492 4877 server.go:324] GET /stats/bd6bc202-9a8b-11e4-af56-42010af0dcb6/reasoning-redis-ingest?num_stats=9: (2.917422ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208510660, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208510660, 0xc208396870, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208510660, 0x7f8a04dbf1b0, 0xc20852aa20)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208510660, 0xc2084f44e0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208510660, 0xc2084f44e0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208510660, 0xc2084f44e0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208510660, 0xc2084f44e0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208510660, 0xc2084f44e0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2084080a0, 0xc2084f44e0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:54:07.361857 4877 server.go:324] GET /healthz: (12.059us) 200
I0112 18:54:07.417618 4877 server.go:324] GET /stats?num_stats=10: (23.97us) 301
I0112 18:54:07.418818 4877 server.go:324] GET /stats/: (528.655us) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208510c60, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208510c60, 0xc2083a8960, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208510c60, 0x7f8a04dbf1b0, 0xc20852ae10)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208510c60, 0xc2084f4ea0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208510c60, 0xc2084f4ea0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208510c60, 0xc2084f4ea0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208510c60, 0xc2084f4ea0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208510c60, 0xc2084f4ea0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208408320, 0xc2084f4ea0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:54:10.020637 4877 server.go:324] GET /healthz: (11.32us) 200
I0112 18:54:10.030668 4877 server.go:324] GET /healthz: (10.902us) 200
I0112 18:54:10.030894 4877 server.go:324] GET /healthz: (5.61us) 200
I0112 18:54:10.040491 4877 server.go:324] GET /api/v1beta1/podInfo?podID=bc1262aa-9a8b-11e4-af56-42010af0dcb6&podNamespace=default: (5.74779ms) 200
I0112 18:54:10.060154 4877 server.go:324] GET /api/v1beta1/podInfo?podID=redis-3&podNamespace=default: (8.890892ms) 200
I0112 18:54:10.060688 4877 server.go:324] GET /api/v1beta1/podInfo?podID=bd6bc202-9a8b-11e4-af56-42010af0dcb6&podNamespace=default: (9.232758ms) 200
I0112 18:54:12.939676 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/cadvisor.manifest": default.cadvisor-agent (cadvisormanifes12uqn2ohido76855gdecd9roadm7l0)
I0112 18:54:12.939987 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/fluentd-es.manifest": default.fluentd-to-elasticsearch (fluentdesmanife2u464h05heqcpotoddodpnehjaqsde)
I0112 18:54:14.209622 4877 server.go:324] GET /healthz: (12.104us) 200
I0112 18:54:14.312315 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:54:14.314165 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:54:14.403056 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id ad98743de5f515e53bd16c72fc0a0032338d18d466b836e1e7690a0b0019443e
E0112 18:54:14.452345 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container ad98743de5f515e53bd16c72fc0a0032338d18d466b836e1e7690a0b0019443e: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:54:14.452389 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container ad98743de5f515e53bd16c72fc0a0032338d18d466b836e1e7690a0b0019443e: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:54:14.452597 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id ad98743de5f515e53bd16c72fc0a0032338d18d466b836e1e7690a0b0019443e with error: API error (500): Cannot start container ad98743de5f515e53bd16c72fc0a0032338d18d466b836e1e7690a0b0019443e: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:54:14.508353 4877 restclient.go:141] Waiting for completion of operation 3650
I0112 18:54:16.511213 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container ad98743de5f515e53bd16c72fc0a0032338d18d466b836e1e7690a0b0019443e: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:54:16.646198 4877 server.go:324] GET /healthz: (12.482us) 200
I0112 18:54:16.985277 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=9: (2.76214ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2084041e0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2084041e0, 0xc208184480, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2084041e0, 0x7f8a04dbf1b0, 0xc20838de60)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2084041e0, 0xc2084f5110)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2084041e0, 0xc2084f5110)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2084041e0, 0xc2084f5110)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2084041e0, 0xc2084f5110)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2084041e0, 0xc2084f5110)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208409180, 0xc2084f5110)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:54:17.204399 4877 server.go:324] GET /stats/bd6bc202-9a8b-11e4-af56-42010af0dcb6/reasoning-redis-ingest?num_stats=9: (2.669593ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208404720, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208404720, 0xc208184870, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208404720, 0x7f8a04dbf1b0, 0xc20837c4f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208404720, 0xc2084f4820)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208404720, 0xc2084f4820)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208404720, 0xc2084f4820)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208404720, 0xc2084f4820)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208404720, 0xc2084f4820)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208409220, 0xc2084f4820)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:54:17.239867 4877 server.go:324] GET /stats/bc1262aa-9a8b-11e4-af56-42010af0dcb6/reasoning-gcs-ingest?num_stats=9: (2.688845ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208404c60, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208404c60, 0xc208184c60, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208404c60, 0x7f8a04dbf1b0, 0xc20837cc50)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208404c60, 0xc2084f4d00)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208404c60, 0xc2084f4d00)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208404c60, 0xc2084f4d00)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208404c60, 0xc2084f4d00)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208404c60, 0xc2084f4d00)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2084092c0, 0xc2084f4d00)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:54:17.255980 4877 server.go:324] GET /healthz: (10.673us) 200
I0112 18:54:17.327543 4877 server.go:324] GET /stats?num_stats=9: (24.746us) 301
I0112 18:54:17.328978 4877 server.go:324] GET /stats/: (589.386us) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208405200, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208405200, 0xc2083a9450, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208405200, 0x7f8a04dbf1b0, 0xc20837d0d0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208405200, 0xc2084f55f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208405200, 0xc2084f55f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208405200, 0xc2084f55f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208405200, 0xc2084f55f0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208405200, 0xc2084f55f0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208409540, 0xc2084f55f0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:54:24.315396 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:54:24.317159 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:54:24.385945 4877 restclient.go:141] Waiting for completion of operation 3683
E0112 18:54:24.436236 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container d6915f0d2df86e2287a42114edc00c3c1a8889eb51b05a8d00094f7f9669c2a1: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:54:24.436276 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container d6915f0d2df86e2287a42114edc00c3c1a8889eb51b05a8d00094f7f9669c2a1: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:54:24.499327 4877 server.go:324] GET /healthz: (13.513us) 200
I0112 18:54:26.392967 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id d6915f0d2df86e2287a42114edc00c3c1a8889eb51b05a8d00094f7f9669c2a1
I0112 18:54:26.397575 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id d6915f0d2df86e2287a42114edc00c3c1a8889eb51b05a8d00094f7f9669c2a1 with error: API error (500): Cannot start container d6915f0d2df86e2287a42114edc00c3c1a8889eb51b05a8d00094f7f9669c2a1: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:54:26.458951 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container d6915f0d2df86e2287a42114edc00c3c1a8889eb51b05a8d00094f7f9669c2a1: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:54:26.516230 4877 restclient.go:141] Waiting for completion of operation 3691
I0112 18:54:26.987011 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=9: (3.019463ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208541260, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208541260, 0xc208273c20, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208541260, 0x7f8a04dbf1b0, 0xc208259b90)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208541260, 0xc2084f5860)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208541260, 0xc2084f5860)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208541260, 0xc2084f5860)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208541260, 0xc2084f5860)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208541260, 0xc2084f5860)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208408140, 0xc2084f5860)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:54:27.206009 4877 server.go:324] GET /stats/bd6bc202-9a8b-11e4-af56-42010af0dcb6/reasoning-redis-ingest?num_stats=9: (2.668433ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2085417a0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2085417a0, 0xc20815e090, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2085417a0, 0x7f8a04dbf1b0, 0xc2085fe160)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2085417a0, 0xc2084f4340)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2085417a0, 0xc2084f4340)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2085417a0, 0xc2084f4340)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2085417a0, 0xc2084f4340)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2085417a0, 0xc2084f4340)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2084081e0, 0xc2084f4340)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:54:27.239304 4877 server.go:324] GET /stats/bc1262aa-9a8b-11e4-af56-42010af0dcb6/reasoning-gcs-ingest?num_stats=9: (2.609721ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208541ce0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208541ce0, 0xc20815e480, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208541ce0, 0x7f8a04dbf1b0, 0xc2085fe650)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208541ce0, 0xc2084f48f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208541ce0, 0xc2084f48f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208541ce0, 0xc2084f48f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208541ce0, 0xc2084f48f0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208541ce0, 0xc2084f48f0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208408280, 0xc2084f48f0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:54:27.262062 4877 server.go:324] GET /healthz: (9.949us) 200
I0112 18:54:27.332079 4877 server.go:324] GET /stats?num_stats=9: (24.727us) 301
I0112 18:54:27.333463 4877 server.go:324] GET /stats/: (521.966us) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20840a2a0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20840a2a0, 0xc20833b0e0, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20840a2a0, 0x7f8a04dbf1b0, 0xc2085fea40)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20840a2a0, 0xc2084f5110)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20840a2a0, 0xc2084f5110)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20840a2a0, 0xc2084f5110)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20840a2a0, 0xc2084f5110)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20840a2a0, 0xc2084f5110)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2084085a0, 0xc2084f5110)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:54:29.332931 4877 server.go:324] GET /healthz: (29.651us) 200
I0112 18:54:32.940738 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/cadvisor.manifest": default.cadvisor-agent (cadvisormanifes12uqn2ohido76855gdecd9roadm7l0)
I0112 18:54:32.941049 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/fluentd-es.manifest": default.fluentd-to-elasticsearch (fluentdesmanife2u464h05heqcpotoddodpnehjaqsde)
I0112 18:54:34.318135 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:54:34.320181 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:54:34.396547 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 89929fb6e4207e95f6df4ad7f2e963739d67aae9513402ecd6e58f5c5db94ebf
E0112 18:54:34.420141 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 89929fb6e4207e95f6df4ad7f2e963739d67aae9513402ecd6e58f5c5db94ebf: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:54:34.420189 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 89929fb6e4207e95f6df4ad7f2e963739d67aae9513402ecd6e58f5c5db94ebf: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:54:34.420426 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 89929fb6e4207e95f6df4ad7f2e963739d67aae9513402ecd6e58f5c5db94ebf with error: API error (500): Cannot start container 89929fb6e4207e95f6df4ad7f2e963739d67aae9513402ecd6e58f5c5db94ebf: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:54:34.424949 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 89929fb6e4207e95f6df4ad7f2e963739d67aae9513402ecd6e58f5c5db94ebf: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:54:35.536443 4877 server.go:324] GET /healthz: (12.65us) 200
I0112 18:54:37.115402 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=9: (3.200787ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20850a3c0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20850a3c0, 0xc208508d80, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20850a3c0, 0x7f8a04dbf1b0, 0xc2082fbae0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20850a3c0, 0xc2084f5380)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20850a3c0, 0xc2084f5380)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20850a3c0, 0xc2084f5380)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20850a3c0, 0xc2084f5380)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20850a3c0, 0xc2084f5380)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2083abf40, 0xc2084f5380)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:54:37.384032 4877 server.go:324] GET /stats/bc1262aa-9a8b-11e4-af56-42010af0dcb6/reasoning-gcs-ingest?num_stats=10: (2.84832ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20850a8a0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20850a8a0, 0xc208509170, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20850a8a0, 0x7f8a04dbf1b0, 0xc2081d2480)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20850a8a0, 0xc2080da9c0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20850a8a0, 0xc2080da9c0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20850a8a0, 0xc2080da9c0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20850a8a0, 0xc2080da9c0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20850a8a0, 0xc2080da9c0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20823e960, 0xc2080da9c0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:54:37.404292 4877 server.go:324] GET /stats/bd6bc202-9a8b-11e4-af56-42010af0dcb6/reasoning-redis-ingest?num_stats=10: (2.802593ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20850ae40, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20850ae40, 0xc208509560, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20850ae40, 0x7f8a04dbf1b0, 0xc2081d2b50)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20850ae40, 0xc2080db110)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20850ae40, 0xc2080db110)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20850ae40, 0xc2080db110)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20850ae40, 0xc2080db110)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20850ae40, 0xc2080db110)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20823f220, 0xc2080db110)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:54:37.457445 4877 server.go:324] GET /healthz: (12.88us) 200
I0112 18:54:37.669447 4877 server.go:324] GET /stats?num_stats=10: (24.016us) 301
I0112 18:54:37.772518 4877 server.go:324] GET /stats/: (102.314366ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20850b3e0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20850b3e0, 0xc2083a80a0, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20850b3e0, 0x7f8a04dbf1b0, 0xc2081d2080)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20850b3e0, 0xc20814c1a0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20850b3e0, 0xc20814c1a0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20850b3e0, 0xc20814c1a0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20850b3e0, 0xc20814c1a0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20850b3e0, 0xc20814c1a0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20823e6e0, 0xc20814c1a0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:54:41.499847 4877 server.go:324] GET /healthz: (13.291us) 200
I0112 18:54:41.501763 4877 server.go:324] GET /healthz: (6.402us) 200
I0112 18:54:41.506094 4877 server.go:324] GET /healthz: (10.737us) 200
I0112 18:54:41.535081 4877 server.go:324] GET /api/v1beta1/podInfo?podID=bd6bc202-9a8b-11e4-af56-42010af0dcb6&podNamespace=default: (8.875608ms) 200
I0112 18:54:41.536529 4877 server.go:324] GET /api/v1beta1/podInfo?podID=bc1262aa-9a8b-11e4-af56-42010af0dcb6&podNamespace=default: (10.120032ms) 200
I0112 18:54:41.537552 4877 server.go:324] GET /api/v1beta1/podInfo?podID=redis-3&podNamespace=default: (7.430075ms) 200
I0112 18:54:42.277314 4877 server.go:324] GET /healthz: (13.004us) 200
I0112 18:54:44.321403 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:54:44.323435 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:54:44.396810 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 59ada988bc24b414424af66865b7b2d87d4eb034368f8fec9149dc6f7e7c60c7
E0112 18:54:44.444187 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 59ada988bc24b414424af66865b7b2d87d4eb034368f8fec9149dc6f7e7c60c7: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:54:44.444238 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 59ada988bc24b414424af66865b7b2d87d4eb034368f8fec9149dc6f7e7c60c7: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:54:44.444463 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 59ada988bc24b414424af66865b7b2d87d4eb034368f8fec9149dc6f7e7c60c7 with error: API error (500): Cannot start container 59ada988bc24b414424af66865b7b2d87d4eb034368f8fec9149dc6f7e7c60c7: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:54:44.449436 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 59ada988bc24b414424af66865b7b2d87d4eb034368f8fec9149dc6f7e7c60c7: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:54:46.084623 4877 server.go:324] GET /healthz: (12.596us) 200
I0112 18:54:46.992099 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=9: (3.129274ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20817d1a0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20817d1a0, 0xc2084742d0, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20817d1a0, 0x7f8a04dbf1b0, 0xc208149160)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20817d1a0, 0xc2084f40d0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20817d1a0, 0xc2084f40d0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20817d1a0, 0xc2084f40d0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20817d1a0, 0xc2084f40d0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20817d1a0, 0xc2084f40d0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2083ab220, 0xc2084f40d0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:54:47.211584 4877 server.go:324] GET /stats/bd6bc202-9a8b-11e4-af56-42010af0dcb6/reasoning-redis-ingest?num_stats=9: (3.433544ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20817d740, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20817d740, 0xc2084746c0, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20817d740, 0x7f8a04dbf1b0, 0xc2081496d0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20817d740, 0xc2080da340)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20817d740, 0xc2080da340)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20817d740, 0xc2080da340)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20817d740, 0xc2080da340)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20817d740, 0xc2080da340)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2083ab2c0, 0xc2080da340)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:54:47.243310 4877 server.go:324] GET /stats/bc1262aa-9a8b-11e4-af56-42010af0dcb6/reasoning-gcs-ingest?num_stats=9: (2.842216ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20817dc80, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20817dc80, 0xc208474ab0, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20817dc80, 0x7f8a04dbf1b0, 0xc208149cd0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20817dc80, 0xc2080da8f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20817dc80, 0xc2080da8f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20817dc80, 0xc2080da8f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20817dc80, 0xc2080da8f0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20817dc80, 0xc2080da8f0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2083ab400, 0xc2080da8f0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:54:47.266811 4877 server.go:324] GET /healthz: (10.954us) 200
I0112 18:54:47.313170 4877 server.go:324] GET /stats?num_stats=9: (24.208us) 301
I0112 18:54:47.314525 4877 server.go:324] GET /stats/: (546.714us) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208176240, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208176240, 0xc20831a9b0, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208176240, 0x7f8a04dbf1b0, 0xc208214290)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208176240, 0xc2080db450)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208176240, 0xc2080db450)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208176240, 0xc2080db450)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208176240, 0xc2080db450)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208176240, 0xc2080db450)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2083ab720, 0xc2080db450)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:54:52.941939 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/cadvisor.manifest": default.cadvisor-agent (cadvisormanifes12uqn2ohido76855gdecd9roadm7l0)
I0112 18:54:52.944131 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/fluentd-es.manifest": default.fluentd-to-elasticsearch (fluentdesmanife2u464h05heqcpotoddodpnehjaqsde)
I0112 18:54:54.068345 4877 logs.go:39] etcd DEBUG: recv.success.http://10.240.220.182:4001/v2/keys/registry/nodes/kubernetes-minion-4.c.eternal-empire-754.internal/boundpods?consistent=true&wait=true&waitIndex=2705
I0112 18:54:54.068517 4877 etcd.go:70] Watch closed (&api.Status{TypeMeta:api.TypeMeta{Kind:"", APIVersion:""}, ListMeta:api.ListMeta{SelfLink:"", ResourceVersion:""}, Status:"Failure", Message:"unexpected end of JSON input", Reason:"", Details:(*api.StatusDetails)(nil), Code:0}). Reopening.
I0112 18:54:54.324148 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:54:54.326448 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:54:54.378340 4877 restclient.go:141] Waiting for completion of operation 3788
E0112 18:54:54.444844 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 08e5de0d4393b492e9dfb9f91356b3c03008f91115ea724b29cc62e165c02b31: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:54:54.444905 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 08e5de0d4393b492e9dfb9f91356b3c03008f91115ea724b29cc62e165c02b31: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:54:55.068929 4877 logs.go:39] etcd DEBUG: get /registry/nodes/kubernetes-minion-4.c.eternal-empire-754.internal/boundpods [http://10.240.220.182:4001]
I0112 18:54:55.069016 4877 logs.go:39] etcd DEBUG: Connecting to etcd: attempt1forkeys/registry/nodes/kubernetes-minion-4.c.eternal-empire-754.internal/boundpods?consistent=true&recursive=false&sorted=false
I0112 18:54:55.069066 4877 logs.go:39] etcd DEBUG: send.request.to http://10.240.220.182:4001/v2/keys/registry/nodes/kubernetes-minion-4.c.eternal-empire-754.internal/boundpods?consistent=true&recursive=false&sorted=false | method GET
I0112 18:54:55.072017 4877 logs.go:39] etcd DEBUG: recv.response.fromhttp://10.240.220.182:4001/v2/keys/registry/nodes/kubernetes-minion-4.c.eternal-empire-754.internal/boundpods?consistent=true&recursive=false&sorted=false
I0112 18:54:55.072838 4877 logs.go:39] etcd DEBUG: recv.success.http://10.240.220.182:4001/v2/keys/registry/nodes/kubernetes-minion-4.c.eternal-empire-754.internal/boundpods?consistent=true&recursive=false&sorted=false
I0112 18:54:55.073964 4877 logs.go:39] etcd DEBUG: watch /registry/nodes/kubernetes-minion-4.c.eternal-empire-754.internal/boundpods [http://10.240.220.182:4001]
I0112 18:54:55.073986 4877 logs.go:39] etcd DEBUG: get /registry/nodes/kubernetes-minion-4.c.eternal-empire-754.internal/boundpods [http://10.240.220.182:4001]
I0112 18:54:55.074015 4877 logs.go:39] etcd DEBUG: Connecting to etcd: attempt1forkeys/registry/nodes/kubernetes-minion-4.c.eternal-empire-754.internal/boundpods?consistent=true&wait=true&waitIndex=3810
I0112 18:54:55.074044 4877 logs.go:39] etcd DEBUG: send.request.to http://10.240.220.182:4001/v2/keys/registry/nodes/kubernetes-minion-4.c.eternal-empire-754.internal/boundpods?consistent=true&wait=true&waitIndex=3810 | method GET
I0112 18:54:55.115799 4877 logs.go:39] etcd DEBUG: recv.response.fromhttp://10.240.220.182:4001/v2/keys/registry/nodes/kubernetes-minion-4.c.eternal-empire-754.internal/boundpods?consistent=true&wait=true&waitIndex=3810
I0112 18:54:55.347933 4877 server.go:324] GET /healthz: (20.019us) 200
I0112 18:54:56.116214 4877 server.go:324] GET /healthz: (10.892us) 200
I0112 18:54:56.381268 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 08e5de0d4393b492e9dfb9f91356b3c03008f91115ea724b29cc62e165c02b31
I0112 18:54:56.381342 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 08e5de0d4393b492e9dfb9f91356b3c03008f91115ea724b29cc62e165c02b31 with error: API error (500): Cannot start container 08e5de0d4393b492e9dfb9f91356b3c03008f91115ea724b29cc62e165c02b31: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:54:56.414186 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 08e5de0d4393b492e9dfb9f91356b3c03008f91115ea724b29cc62e165c02b31: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:54:56.971233 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=9: (3.526279ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2084f32c0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2084f32c0, 0xc208507dd0, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2084f32c0, 0x7f8a04dbf1b0, 0xc2082db250)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2084f32c0, 0xc2080db860)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2084f32c0, 0xc2080db860)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2084f32c0, 0xc2080db860)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2084f32c0, 0xc2080db860)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2084f32c0, 0xc2080db860)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20800f4a0, 0xc2080db860)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:54:57.392167 4877 server.go:324] GET /stats/bc1262aa-9a8b-11e4-af56-42010af0dcb6/reasoning-gcs-ingest?num_stats=10: (2.999983ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2084f3860, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2084f3860, 0xc2082c0240, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2084f3860, 0x7f8a04dbf1b0, 0xc2082db740)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2084f3860, 0xc2084f4270)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2084f3860, 0xc2084f4270)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2084f3860, 0xc2084f4270)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2084f3860, 0xc2084f4270)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2084f3860, 0xc2084f4270)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20800f540, 0xc2084f4270)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:54:57.412754 4877 server.go:324] GET /stats/bd6bc202-9a8b-11e4-af56-42010af0dcb6/reasoning-redis-ingest?num_stats=10: (2.940833ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2084f3da0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2084f3da0, 0xc2082c0630, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2084f3da0, 0x7f8a04dbf1b0, 0xc2082dbc30)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2084f3da0, 0xc2084f4820)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2084f3da0, 0xc2084f4820)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2084f3da0, 0xc2084f4820)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2084f3da0, 0xc2084f4820)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2084f3da0, 0xc2084f4820)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20800f5e0, 0xc2084f4820)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:54:57.454982 4877 server.go:324] GET /healthz: (11.005us) 200
I0112 18:54:57.520262 4877 server.go:324] GET /stats?num_stats=10: (24.403us) 301
I0112 18:54:57.521752 4877 server.go:324] GET /stats/: (644.679us) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2082d4360, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2082d4360, 0xc20816dc20, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2082d4360, 0x7f8a04dbf1b0, 0xc208552020)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2082d4360, 0xc2084f52b0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2082d4360, 0xc2084f52b0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2082d4360, 0xc2084f52b0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2082d4360, 0xc2084f52b0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2082d4360, 0xc2084f52b0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2082bc0a0, 0xc2084f52b0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:55:04.326996 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:55:04.329016 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:55:04.412750 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id d430cdd7c170b814455b5af3efaf80d1fd9daa559ce4f6b7aeae4a25720eb3d0
E0112 18:55:04.452226 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container d430cdd7c170b814455b5af3efaf80d1fd9daa559ce4f6b7aeae4a25720eb3d0: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:55:04.452282 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container d430cdd7c170b814455b5af3efaf80d1fd9daa559ce4f6b7aeae4a25720eb3d0: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:55:04.452479 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id d430cdd7c170b814455b5af3efaf80d1fd9daa559ce4f6b7aeae4a25720eb3d0 with error: API error (500): Cannot start container d430cdd7c170b814455b5af3efaf80d1fd9daa559ce4f6b7aeae4a25720eb3d0: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:55:04.457575 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container d430cdd7c170b814455b5af3efaf80d1fd9daa559ce4f6b7aeae4a25720eb3d0: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:55:06.156816 4877 server.go:324] GET /healthz: (13.558us) 200
I0112 18:55:06.954805 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=9: (3.68723ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208404060, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208404060, 0xc2081a5b90, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208404060, 0x7f8a04dbf1b0, 0xc208314b40)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208404060, 0xc2084f5520)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208404060, 0xc2084f5520)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208404060, 0xc2084f5520)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208404060, 0xc2084f5520)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208404060, 0xc2084f5520)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20823ea00, 0xc2084f5520)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:55:07.171033 4877 server.go:324] GET /stats/bd6bc202-9a8b-11e4-af56-42010af0dcb6/reasoning-redis-ingest?num_stats=9: (2.936766ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2084045a0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2084045a0, 0xc208538000, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2084045a0, 0x7f8a04dbf1b0, 0xc208315290)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2084045a0, 0xc2083d7d40)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2084045a0, 0xc2083d7d40)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2084045a0, 0xc2083d7d40)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2084045a0, 0xc2083d7d40)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2084045a0, 0xc2083d7d40)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20823ebe0, 0xc2083d7d40)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:55:07.206111 4877 server.go:324] GET /stats/bc1262aa-9a8b-11e4-af56-42010af0dcb6/reasoning-gcs-ingest?num_stats=9: (2.917603ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208404ae0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208404ae0, 0xc2085383f0, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208404ae0, 0x7f8a04dbf1b0, 0xc208315a30)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208404ae0, 0xc2084f4270)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208404ae0, 0xc2084f4270)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208404ae0, 0xc2084f4270)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208404ae0, 0xc2084f4270)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208404ae0, 0xc2084f4270)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20823ec80, 0xc2084f4270)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:55:07.253656 4877 server.go:324] GET /healthz: (10.926us) 200
I0112 18:55:07.307829 4877 server.go:324] GET /stats?num_stats=9: (23.72us) 301
I0112 18:55:07.309211 4877 server.go:324] GET /stats/: (539.246us) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2084050e0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2084050e0, 0xc208368b40, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2084050e0, 0x7f8a04dbf1b0, 0xc208315f40)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2084050e0, 0xc2084f4b60)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2084050e0, 0xc2084f4b60)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2084050e0, 0xc2084f4b60)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2084050e0, 0xc2084f4b60)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2084050e0, 0xc2084f4b60)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20823f180, 0xc2084f4b60)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:55:08.882156 4877 server.go:324] GET /healthz: (11.32us) 200
I0112 18:55:12.944959 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/cadvisor.manifest": default.cadvisor-agent (cadvisormanifes12uqn2ohido76855gdecd9roadm7l0)
I0112 18:55:12.945357 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/fluentd-es.manifest": default.fluentd-to-elasticsearch (fluentdesmanife2u464h05heqcpotoddodpnehjaqsde)
I0112 18:55:13.318641 4877 server.go:324] GET /healthz: (11.869us) 200
I0112 18:55:13.318804 4877 server.go:324] GET /healthz: (5.268us) 200
I0112 18:55:13.325596 4877 server.go:324] GET /healthz: (6.199us) 200
I0112 18:55:13.358528 4877 server.go:324] GET /api/v1beta1/podInfo?podID=bd6bc202-9a8b-11e4-af56-42010af0dcb6&podNamespace=default: (10.379296ms) 200
I0112 18:55:13.359075 4877 server.go:324] GET /api/v1beta1/podInfo?podID=bc1262aa-9a8b-11e4-af56-42010af0dcb6&podNamespace=default: (10.157747ms) 200
I0112 18:55:13.359701 4877 server.go:324] GET /api/v1beta1/podInfo?podID=redis-3&podNamespace=default: (10.654647ms) 200
I0112 18:55:14.329923 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:55:14.331883 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:55:14.444669 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 82274190525aa3a810adb3659968b95e789672831f999db1b2d95264e67c2bad
E0112 18:55:14.488241 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 82274190525aa3a810adb3659968b95e789672831f999db1b2d95264e67c2bad: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:55:14.488290 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 82274190525aa3a810adb3659968b95e789672831f999db1b2d95264e67c2bad: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:55:14.493194 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 82274190525aa3a810adb3659968b95e789672831f999db1b2d95264e67c2bad with error: API error (500): Cannot start container 82274190525aa3a810adb3659968b95e789672831f999db1b2d95264e67c2bad: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:55:14.493243 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 82274190525aa3a810adb3659968b95e789672831f999db1b2d95264e67c2bad: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:55:14.545671 4877 restclient.go:141] Waiting for completion of operation 3865
I0112 18:55:16.192142 4877 server.go:324] GET /healthz: (12.128us) 200
I0112 18:55:16.980749 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=9: (2.836697ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20848cde0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20848cde0, 0xc208434360, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20848cde0, 0x7f8a04dbf1b0, 0xc2081bd370)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20848cde0, 0xc2084f4ea0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20848cde0, 0xc2084f4ea0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20848cde0, 0xc2084f4ea0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20848cde0, 0xc2084f4ea0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20848cde0, 0xc2084f4ea0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208511b80, 0xc2084f4ea0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:55:17.215175 4877 server.go:324] GET /stats/bd6bc202-9a8b-11e4-af56-42010af0dcb6/reasoning-redis-ingest?num_stats=9: (2.817346ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20848d380, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20848d380, 0xc208434750, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20848d380, 0x7f8a04dbf1b0, 0xc2081bda60)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20848d380, 0xc2083d7790)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20848d380, 0xc2083d7790)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20848d380, 0xc2083d7790)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20848d380, 0xc2083d7790)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20848d380, 0xc2083d7790)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208511c20, 0xc2083d7790)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:55:17.247852 4877 server.go:324] GET /stats/bc1262aa-9a8b-11e4-af56-42010af0dcb6/reasoning-gcs-ingest?num_stats=9: (2.684474ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20848d920, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20848d920, 0xc208434b40, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20848d920, 0x7f8a04dbf1b0, 0xc2082a00a0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20848d920, 0xc2083d7c70)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20848d920, 0xc2083d7c70)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20848d920, 0xc2083d7c70)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20848d920, 0xc2083d7c70)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20848d920, 0xc2083d7c70)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208511cc0, 0xc2083d7c70)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:55:17.255496 4877 server.go:324] GET /healthz: (24.062us) 200
I0112 18:55:17.323985 4877 server.go:324] GET /stats?num_stats=9: (24.648us) 301
I0112 18:55:17.325370 4877 server.go:324] GET /stats/: (556.301us) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20848df20, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20848df20, 0xc208352460, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20848df20, 0x7f8a04dbf1b0, 0xc2082a0540)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20848df20, 0xc20814ca90)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20848df20, 0xc20814ca90)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20848df20, 0xc20814ca90)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20848df20, 0xc20814ca90)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20848df20, 0xc20814ca90)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208511f40, 0xc20814ca90)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:55:22.208643 4877 server.go:324] GET /healthz: (13.98us) 200
I0112 18:55:24.332365 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:55:24.334599 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:55:24.393776 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id fa2a02d992c2885f2b5c912c5e512ce15014ea63a16439cd6e9bc52ee9b6ed42
E0112 18:55:24.444438 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container fa2a02d992c2885f2b5c912c5e512ce15014ea63a16439cd6e9bc52ee9b6ed42: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:55:24.444481 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container fa2a02d992c2885f2b5c912c5e512ce15014ea63a16439cd6e9bc52ee9b6ed42: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:55:24.444681 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id fa2a02d992c2885f2b5c912c5e512ce15014ea63a16439cd6e9bc52ee9b6ed42 with error: API error (500): Cannot start container fa2a02d992c2885f2b5c912c5e512ce15014ea63a16439cd6e9bc52ee9b6ed42: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:55:24.450054 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container fa2a02d992c2885f2b5c912c5e512ce15014ea63a16439cd6e9bc52ee9b6ed42: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:55:26.254689 4877 server.go:324] GET /healthz: (13.27us) 200
I0112 18:55:26.966502 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=9: (3.162249ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208404d20, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208404d20, 0xc208571b00, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208404d20, 0x7f8a04dbf1b0, 0xc208338030)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208404d20, 0xc20814d790)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208404d20, 0xc20814d790)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208404d20, 0xc20814d790)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208404d20, 0xc20814d790)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208404d20, 0xc20814d790)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2084097c0, 0xc20814d790)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:55:27.327904 4877 server.go:324] GET /stats/bc1262aa-9a8b-11e4-af56-42010af0dcb6/reasoning-gcs-ingest?num_stats=9: (2.840775ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208405260, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208405260, 0xc208571ef0, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208405260, 0x7f8a04dbf1b0, 0xc208338610)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208405260, 0xc2084f40d0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208405260, 0xc2084f40d0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208405260, 0xc2084f40d0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208405260, 0xc2084f40d0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208405260, 0xc2084f40d0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208409860, 0xc2084f40d0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:55:27.347624 4877 server.go:324] GET /stats/bd6bc202-9a8b-11e4-af56-42010af0dcb6/reasoning-redis-ingest?num_stats=10: (2.521534ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208405800, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208405800, 0xc208468360, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208405800, 0x7f8a04dbf1b0, 0xc208338c50)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208405800, 0xc2084f45b0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208405800, 0xc2084f45b0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208405800, 0xc2084f45b0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208405800, 0xc2084f45b0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208405800, 0xc2084f45b0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208409900, 0xc2084f45b0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:55:27.363038 4877 server.go:324] GET /healthz: (5.308us) 200
I0112 18:55:27.444439 4877 server.go:324] GET /stats?num_stats=10: (13.429us) 301
I0112 18:55:27.445767 4877 server.go:324] GET /stats/: (505.501us) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208405da0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208405da0, 0xc20838b810, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208405da0, 0x7f8a04dbf1b0, 0xc208339080)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208405da0, 0xc2084f5040)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208405da0, 0xc2084f5040)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208405da0, 0xc2084f5040)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208405da0, 0xc2084f5040)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208405da0, 0xc2084f5040)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208409b80, 0xc2084f5040)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:55:32.946163 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/cadvisor.manifest": default.cadvisor-agent (cadvisormanifes12uqn2ohido76855gdecd9roadm7l0)
I0112 18:55:32.946491 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/fluentd-es.manifest": default.fluentd-to-elasticsearch (fluentdesmanife2u464h05heqcpotoddodpnehjaqsde)
I0112 18:55:34.335132 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:55:34.337029 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:55:34.427833 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 281762cab3c083e94116d519fca310189f7cb4b3483a898666e03d7435d7ea00
E0112 18:55:34.475721 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 281762cab3c083e94116d519fca310189f7cb4b3483a898666e03d7435d7ea00: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:55:34.475760 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 281762cab3c083e94116d519fca310189f7cb4b3483a898666e03d7435d7ea00: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:55:34.475928 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 281762cab3c083e94116d519fca310189f7cb4b3483a898666e03d7435d7ea00 with error: API error (500): Cannot start container 281762cab3c083e94116d519fca310189f7cb4b3483a898666e03d7435d7ea00: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:55:34.480975 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 281762cab3c083e94116d519fca310189f7cb4b3483a898666e03d7435d7ea00: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:55:35.182834 4877 server.go:324] GET /healthz: (10.402us) 200
I0112 18:55:36.443954 4877 server.go:324] GET /healthz: (21.468us) 200
I0112 18:55:37.010578 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=9: (3.386814ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208177140, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208177140, 0xc20815e3f0, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208177140, 0x7f8a04dbf1b0, 0xc2083d4420)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208177140, 0xc2084f5450)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208177140, 0xc2084f5450)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208177140, 0xc2084f5450)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208177140, 0xc2084f5450)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208177140, 0xc2084f5450)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20823ee60, 0xc2084f5450)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:55:37.230954 4877 server.go:324] GET /stats/bc1262aa-9a8b-11e4-af56-42010af0dcb6/reasoning-gcs-ingest?num_stats=9: (2.679322ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208177680, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208177680, 0xc20815e7e0, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208177680, 0x7f8a04dbf1b0, 0xc2083d4910)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208177680, 0xc2083d6820)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208177680, 0xc2083d6820)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208177680, 0xc2083d6820)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208177680, 0xc2083d6820)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208177680, 0xc2083d6820)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20823ef00, 0xc2083d6820)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:55:37.352188 4877 server.go:324] GET /stats/bd6bc202-9a8b-11e4-af56-42010af0dcb6/reasoning-redis-ingest?num_stats=9: (2.312581ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208177bc0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208177bc0, 0xc20815ebd0, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208177bc0, 0x7f8a04dbf1b0, 0xc2083d4e10)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208177bc0, 0xc2083d6d00)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208177bc0, 0xc2083d6d00)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208177bc0, 0xc2083d6d00)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208177bc0, 0xc2083d6d00)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208177bc0, 0xc2083d6d00)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20823efa0, 0xc2083d6d00)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:55:37.456496 4877 server.go:324] GET /healthz: (5.925us) 200
I0112 18:55:37.660312 4877 server.go:324] GET /stats?num_stats=10: (12.405us) 301
I0112 18:55:37.661380 4877 server.go:324] GET /stats/: (385.144us) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20846a1e0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20846a1e0, 0xc2081894f0, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20846a1e0, 0x7f8a04dbf1b0, 0xc2083d5200)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20846a1e0, 0xc2083d7860)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20846a1e0, 0xc2083d7860)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20846a1e0, 0xc2083d7860)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20846a1e0, 0xc2083d7860)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20846a1e0, 0xc2083d7860)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20823fa40, 0xc2083d7860)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:55:44.337823 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:55:44.339687 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:55:44.408106 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id d6ef66e7146bf416a9546a6114a917780da97d3d432561c0270ccd255badd958
E0112 18:55:44.447956 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container d6ef66e7146bf416a9546a6114a917780da97d3d432561c0270ccd255badd958: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:55:44.447996 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container d6ef66e7146bf416a9546a6114a917780da97d3d432561c0270ccd255badd958: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:55:44.448150 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id d6ef66e7146bf416a9546a6114a917780da97d3d432561c0270ccd255badd958 with error: API error (500): Cannot start container d6ef66e7146bf416a9546a6114a917780da97d3d432561c0270ccd255badd958: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:55:44.452884 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container d6ef66e7146bf416a9546a6114a917780da97d3d432561c0270ccd255badd958: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:55:44.812837 4877 server.go:324] GET /healthz: (9.264us) 200
I0112 18:55:44.812978 4877 server.go:324] GET /healthz: (4.312us) 200
I0112 18:55:44.813072 4877 server.go:324] GET /healthz: (3.864us) 200
I0112 18:55:44.851225 4877 server.go:324] GET /api/v1beta1/podInfo?podID=bc1262aa-9a8b-11e4-af56-42010af0dcb6&podNamespace=default: (10.076819ms) 200
I0112 18:55:44.852017 4877 server.go:324] GET /api/v1beta1/podInfo?podID=redis-3&podNamespace=default: (10.636798ms) 200
I0112 18:55:44.852610 4877 server.go:324] GET /api/v1beta1/podInfo?podID=bd6bc202-9a8b-11e4-af56-42010af0dcb6&podNamespace=default: (11.043672ms) 200
I0112 18:55:46.480795 4877 server.go:324] GET /healthz: (12.004us) 200
I0112 18:55:47.003319 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=9: (3.084862ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2081734a0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2081734a0, 0xc20849cab0, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2081734a0, 0x7f8a04dbf1b0, 0xc208148f90)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2081734a0, 0xc2083d7ad0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2081734a0, 0xc2083d7ad0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2081734a0, 0xc2083d7ad0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2081734a0, 0xc2083d7ad0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2081734a0, 0xc2083d7ad0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2083ab220, 0xc2083d7ad0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:55:47.313435 4877 server.go:324] GET /stats/bd6bc202-9a8b-11e4-af56-42010af0dcb6/reasoning-redis-ingest?num_stats=9: (104.517046ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208173980, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208173980, 0xc20832c090, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208173980, 0x7f8a04dbf1b0, 0xc208148070)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208173980, 0xc20814d860)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208173980, 0xc20814d860)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208173980, 0xc20814d860)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208173980, 0xc20814d860)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208173980, 0xc20814d860)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2083ab2c0, 0xc20814d860)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:55:47.345398 4877 server.go:324] GET /stats/bc1262aa-9a8b-11e4-af56-42010af0dcb6/reasoning-gcs-ingest?num_stats=9: (2.482622ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20846a0c0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20846a0c0, 0xc20832c480, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20846a0c0, 0x7f8a04dbf1b0, 0xc208148600)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20846a0c0, 0xc2084f40d0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20846a0c0, 0xc2084f40d0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20846a0c0, 0xc2084f40d0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20846a0c0, 0xc2084f40d0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20846a0c0, 0xc2084f40d0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208408000, 0xc2084f40d0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:55:47.364865 4877 server.go:324] GET /healthz: (5.141us) 200
I0112 18:55:47.400309 4877 server.go:324] GET /stats?num_stats=9: (11.262us) 301
I0112 18:55:47.401442 4877 server.go:324] GET /stats/: (390.042us) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20846a780, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20846a780, 0xc2083a8410, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20846a780, 0x7f8a04dbf1b0, 0xc208148b70)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20846a780, 0xc2084f48f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20846a780, 0xc2084f48f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20846a780, 0xc2084f48f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20846a780, 0xc2084f48f0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20846a780, 0xc2084f48f0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208408280, 0xc2084f48f0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:55:48.031431 4877 server.go:324] GET /healthz: (9.996us) 200
I0112 18:55:52.947283 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/cadvisor.manifest": default.cadvisor-agent (cadvisormanifes12uqn2ohido76855gdecd9roadm7l0)
I0112 18:55:52.947566 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/fluentd-es.manifest": default.fluentd-to-elasticsearch (fluentdesmanife2u464h05heqcpotoddodpnehjaqsde)
I0112 18:55:54.340777 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:55:54.342971 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:55:54.420339 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 0b3c130abce6d10eb2a791c2e950641289342cffae53b74705996153f06ab1fe
E0112 18:55:54.471981 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 0b3c130abce6d10eb2a791c2e950641289342cffae53b74705996153f06ab1fe: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:55:54.472030 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 0b3c130abce6d10eb2a791c2e950641289342cffae53b74705996153f06ab1fe: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:55:54.472227 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 0b3c130abce6d10eb2a791c2e950641289342cffae53b74705996153f06ab1fe with error: API error (500): Cannot start container 0b3c130abce6d10eb2a791c2e950641289342cffae53b74705996153f06ab1fe: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:55:54.488735 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 0b3c130abce6d10eb2a791c2e950641289342cffae53b74705996153f06ab1fe: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:55:56.512187 4877 server.go:324] GET /healthz: (11.718us) 200
I0112 18:55:56.984090 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=9: (3.411568ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208172de0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208172de0, 0xc2082aeea0, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208172de0, 0x7f8a04dbf1b0, 0xc2082a1c50)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208172de0, 0xc2084f4b60)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208172de0, 0xc2084f4b60)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208172de0, 0xc2084f4b60)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208172de0, 0xc2084f4b60)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208172de0, 0xc2084f4b60)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20823ee60, 0xc2084f4b60)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:55:57.595454 4877 server.go:324] GET /stats/bd6bc202-9a8b-11e4-af56-42010af0dcb6/reasoning-redis-ingest?num_stats=10: (2.983195ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208173320, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208173320, 0xc2082af290, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208173320, 0x7f8a04dbf1b0, 0xc20828c2c0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208173320, 0xc2083d7860)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208173320, 0xc2083d7860)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208173320, 0xc2083d7860)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208173320, 0xc2083d7860)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208173320, 0xc2083d7860)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20823ef00, 0xc2083d7860)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:55:57.630251 4877 server.go:324] GET /stats/bc1262aa-9a8b-11e4-af56-42010af0dcb6/reasoning-gcs-ingest?num_stats=10: (2.840011ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2081738c0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2081738c0, 0xc2082af680, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2081738c0, 0x7f8a04dbf1b0, 0xc20828c9e0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2081738c0, 0xc2083d7d40)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2081738c0, 0xc2083d7d40)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2081738c0, 0xc2083d7d40)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2081738c0, 0xc2083d7d40)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2081738c0, 0xc2083d7d40)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20823efa0, 0xc2083d7d40)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:55:57.646448 4877 server.go:324] GET /healthz: (5.504us) 200
I0112 18:55:57.694427 4877 server.go:324] GET /stats?num_stats=10: (31.494us) 301
I0112 18:55:57.695878 4877 server.go:324] GET /stats/: (569.392us) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2081c2120, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2081c2120, 0xc208188be0, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2081c2120, 0x7f8a04dbf1b0, 0xc20828cf00)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2081c2120, 0xc2080da8f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2081c2120, 0xc2080da8f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2081c2120, 0xc2080da8f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2081c2120, 0xc2080da8f0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2081c2120, 0xc2080da8f0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20823f360, 0xc2080da8f0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:56:00.777880 4877 server.go:324] GET /healthz: (22.573us) 200
I0112 18:56:04.343451 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:56:04.345282 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:56:04.452112 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 27fd28ff3985651b69f6ddacbc7b9d783fdff160281670b8c4953326c667654e
E0112 18:56:04.491940 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 27fd28ff3985651b69f6ddacbc7b9d783fdff160281670b8c4953326c667654e: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:56:04.491977 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 27fd28ff3985651b69f6ddacbc7b9d783fdff160281670b8c4953326c667654e: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:56:04.492043 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 27fd28ff3985651b69f6ddacbc7b9d783fdff160281670b8c4953326c667654e with error: API error (500): Cannot start container 27fd28ff3985651b69f6ddacbc7b9d783fdff160281670b8c4953326c667654e: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:56:04.497136 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 27fd28ff3985651b69f6ddacbc7b9d783fdff160281670b8c4953326c667654e: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:56:06.554431 4877 server.go:324] GET /healthz: (11.95us) 200
I0112 18:56:06.981202 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=9: (3.344574ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20848d800, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20848d800, 0xc2083b7290, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20848d800, 0x7f8a04dbf1b0, 0xc208325ea0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20848d800, 0xc2080dad00)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20848d800, 0xc2080dad00)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20848d800, 0xc2080dad00)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20848d800, 0xc2080dad00)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20848d800, 0xc2080dad00)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2084092c0, 0xc2080dad00)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:56:07.313391 4877 server.go:324] GET /stats/bd6bc202-9a8b-11e4-af56-42010af0dcb6/reasoning-redis-ingest?num_stats=9: (2.742482ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20848dd40, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20848dd40, 0xc2083b7680, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20848dd40, 0x7f8a04dbf1b0, 0xc2083145b0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20848dd40, 0xc2084f49c0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20848dd40, 0xc2084f49c0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20848dd40, 0xc2084f49c0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20848dd40, 0xc2084f49c0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20848dd40, 0xc2084f49c0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208409360, 0xc2084f49c0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:56:07.346555 4877 server.go:324] GET /stats/bc1262aa-9a8b-11e4-af56-42010af0dcb6/reasoning-gcs-ingest?num_stats=9: (2.355612ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2082d02a0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2082d02a0, 0xc2083b7a70, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2082d02a0, 0x7f8a04dbf1b0, 0xc208314c30)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2082d02a0, 0xc2084f5040)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2082d02a0, 0xc2084f5040)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2082d02a0, 0xc2084f5040)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2082d02a0, 0xc2084f5040)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2082d02a0, 0xc2084f5040)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208409400, 0xc2084f5040)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:56:07.363334 4877 server.go:324] GET /healthz: (5.302us) 200
I0112 18:56:07.413778 4877 server.go:324] GET /stats?num_stats=9: (13.916us) 301
I0112 18:56:07.414735 4877 server.go:324] GET /stats/: (361.263us) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2082d08a0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2082d08a0, 0xc2083694a0, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2082d08a0, 0x7f8a04dbf1b0, 0xc208315240)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2082d08a0, 0xc2084f5930)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2082d08a0, 0xc2084f5930)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2082d08a0, 0xc2084f5930)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2082d08a0, 0xc2084f5930)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2082d08a0, 0xc2084f5930)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208409680, 0xc2084f5930)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:56:12.948528 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/cadvisor.manifest": default.cadvisor-agent (cadvisormanifes12uqn2ohido76855gdecd9roadm7l0)
I0112 18:56:12.948895 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/fluentd-es.manifest": default.fluentd-to-elasticsearch (fluentdesmanife2u464h05heqcpotoddodpnehjaqsde)
I0112 18:56:13.368279 4877 server.go:324] GET /healthz: (11.38us) 200
I0112 18:56:14.346657 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:56:14.348676 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:56:14.436314 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 639f9e61e6909adffd9ddf857e8597ca70f947ca341cf80dc5ee7109c7fdb524
E0112 18:56:14.456009 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 639f9e61e6909adffd9ddf857e8597ca70f947ca341cf80dc5ee7109c7fdb524: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:56:14.456043 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 639f9e61e6909adffd9ddf857e8597ca70f947ca341cf80dc5ee7109c7fdb524: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:56:14.456158 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 639f9e61e6909adffd9ddf857e8597ca70f947ca341cf80dc5ee7109c7fdb524 with error: API error (500): Cannot start container 639f9e61e6909adffd9ddf857e8597ca70f947ca341cf80dc5ee7109c7fdb524: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:56:14.461836 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 639f9e61e6909adffd9ddf857e8597ca70f947ca341cf80dc5ee7109c7fdb524: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:56:16.190404 4877 server.go:324] GET /healthz: (12.684us) 200
I0112 18:56:16.190817 4877 server.go:324] GET /healthz: (10.07us) 200
I0112 18:56:16.195188 4877 server.go:324] GET /healthz: (6.398us) 200
I0112 18:56:16.226696 4877 server.go:324] GET /api/v1beta1/podInfo?podID=bc1262aa-9a8b-11e4-af56-42010af0dcb6&podNamespace=default: (11.598094ms) 200
I0112 18:56:16.227335 4877 server.go:324] GET /api/v1beta1/podInfo?podID=bd6bc202-9a8b-11e4-af56-42010af0dcb6&podNamespace=default: (11.564926ms) 200
I0112 18:56:16.228039 4877 server.go:324] GET /api/v1beta1/podInfo?podID=redis-3&podNamespace=default: (10.388807ms) 200
I0112 18:56:16.615471 4877 server.go:324] GET /healthz: (8.07us) 200
I0112 18:56:17.014489 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=9: (3.107977ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20848d080, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20848d080, 0xc208546120, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20848d080, 0x7f8a04dbf1b0, 0xc20834bd20)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20848d080, 0xc2084f5ba0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20848d080, 0xc2084f5ba0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20848d080, 0xc2084f5ba0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20848d080, 0xc2084f5ba0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20848d080, 0xc2084f5ba0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208408dc0, 0xc2084f5ba0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:56:17.235616 4877 server.go:324] GET /stats/bc1262aa-9a8b-11e4-af56-42010af0dcb6/reasoning-gcs-ingest?num_stats=9: (5.228907ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20848d5c0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20848d5c0, 0xc208546510, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20848d5c0, 0x7f8a04dbf1b0, 0xc2083383e0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20848d5c0, 0xc2083d6b60)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20848d5c0, 0xc2083d6b60)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20848d5c0, 0xc2083d6b60)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20848d5c0, 0xc2083d6b60)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20848d5c0, 0xc2083d6b60)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208408e60, 0xc2083d6b60)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:56:17.356535 4877 server.go:324] GET /stats/bd6bc202-9a8b-11e4-af56-42010af0dcb6/reasoning-redis-ingest?num_stats=9: (2.147908ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20848db60, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20848db60, 0xc208546900, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20848db60, 0x7f8a04dbf1b0, 0xc208338970)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20848db60, 0xc2083d7110)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20848db60, 0xc2083d7110)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20848db60, 0xc2083d7110)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20848db60, 0xc2083d7110)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20848db60, 0xc2083d7110)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208408f00, 0xc2083d7110)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:56:17.391575 4877 server.go:324] GET /healthz: (6.109us) 200
I0112 18:56:17.433868 4877 server.go:324] GET /stats?num_stats=9: (10.922us) 301
I0112 18:56:17.434925 4877 server.go:324] GET /stats/: (399.235us) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2082d0120, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2082d0120, 0xc208369680, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2082d0120, 0x7f8a04dbf1b0, 0xc208338df0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2082d0120, 0xc2083d7860)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2082d0120, 0xc2083d7860)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2082d0120, 0xc2083d7860)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2082d0120, 0xc2083d7860)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2082d0120, 0xc2083d7860)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208409180, 0xc2083d7860)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:56:24.349237 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:56:24.351123 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:56:24.468543 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 8746a51b44ec58137a468f486cbdef777a1281065e50208334db3083c50ee1e1
E0112 18:56:24.507732 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 8746a51b44ec58137a468f486cbdef777a1281065e50208334db3083c50ee1e1: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:56:24.507762 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 8746a51b44ec58137a468f486cbdef777a1281065e50208334db3083c50ee1e1: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:56:24.507919 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 8746a51b44ec58137a468f486cbdef777a1281065e50208334db3083c50ee1e1 with error: API error (500): Cannot start container 8746a51b44ec58137a468f486cbdef777a1281065e50208334db3083c50ee1e1: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:56:24.512583 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 8746a51b44ec58137a468f486cbdef777a1281065e50208334db3083c50ee1e1: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:56:26.645872 4877 server.go:324] GET /healthz: (10.882us) 200
I0112 18:56:26.983366 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=9: (3.097131ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2082d1140, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2082d1140, 0xc2083ba240, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2082d1140, 0x7f8a04dbf1b0, 0xc2083243a0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2082d1140, 0xc2083d7e10)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2082d1140, 0xc2083d7e10)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2082d1140, 0xc2083d7e10)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2082d1140, 0xc2083d7e10)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2082d1140, 0xc2083d7e10)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2084088c0, 0xc2083d7e10)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:56:27.202236 4877 server.go:324] GET /stats/bd6bc202-9a8b-11e4-af56-42010af0dcb6/reasoning-redis-ingest?num_stats=9: (2.446944ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2082d16e0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2082d16e0, 0xc2083ba630, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2082d16e0, 0x7f8a04dbf1b0, 0xc208324b70)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2082d16e0, 0xc2084f56c0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2082d16e0, 0xc2084f56c0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2082d16e0, 0xc2084f56c0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2082d16e0, 0xc2084f56c0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2082d16e0, 0xc2084f56c0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208408960, 0xc2084f56c0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:56:27.238222 4877 server.go:324] GET /stats/bc1262aa-9a8b-11e4-af56-42010af0dcb6/reasoning-gcs-ingest?num_stats=9: (2.319183ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2082d1c20, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2082d1c20, 0xc2083baa20, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2082d1c20, 0x7f8a04dbf1b0, 0xc208325350)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2082d1c20, 0xc2084f5ba0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2082d1c20, 0xc2084f5ba0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2082d1c20, 0xc2084f5ba0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2082d1c20, 0xc2084f5ba0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2082d1c20, 0xc2084f5ba0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208408aa0, 0xc2084f5ba0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:56:27.261926 4877 server.go:324] GET /healthz: (5.035us) 200
I0112 18:56:27.332782 4877 server.go:324] GET /stats?num_stats=9: (12.444us) 301
I0112 18:56:27.334161 4877 server.go:324] GET /stats/: (386.741us) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208298780, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208298780, 0xc2083521e0, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208298780, 0x7f8a04dbf1b0, 0xc208325890)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208298780, 0xc2083d65b0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208298780, 0xc2083d65b0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208298780, 0xc2083d65b0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208298780, 0xc2083d65b0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208298780, 0xc2083d65b0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208408d20, 0xc2083d65b0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:56:31.613700 4877 server.go:324] GET /healthz: (12.195us) 200
I0112 18:56:32.949743 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/cadvisor.manifest": default.cadvisor-agent (cadvisormanifes12uqn2ohido76855gdecd9roadm7l0)
I0112 18:56:32.950005 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/fluentd-es.manifest": default.fluentd-to-elasticsearch (fluentdesmanife2u464h05heqcpotoddodpnehjaqsde)
I0112 18:56:34.352125 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:56:34.354351 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:56:34.444147 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 3f5f5f249cca9a0cff7dfe2918f640c31b3e8dcb3893c8e89c44df424c718f62
E0112 18:56:34.471650 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 3f5f5f249cca9a0cff7dfe2918f640c31b3e8dcb3893c8e89c44df424c718f62: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:56:34.471683 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 3f5f5f249cca9a0cff7dfe2918f640c31b3e8dcb3893c8e89c44df424c718f62: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:56:34.487750 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 3f5f5f249cca9a0cff7dfe2918f640c31b3e8dcb3893c8e89c44df424c718f62 with error: API error (500): Cannot start container 3f5f5f249cca9a0cff7dfe2918f640c31b3e8dcb3893c8e89c44df424c718f62: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:56:34.487816 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 3f5f5f249cca9a0cff7dfe2918f640c31b3e8dcb3893c8e89c44df424c718f62: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:56:36.693332 4877 server.go:324] GET /healthz: (10.738us) 200
I0112 18:56:36.986448 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=9: (3.560142ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20840bb00, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20840bb00, 0xc20832ea20, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20840bb00, 0x7f8a04dbf1b0, 0xc2085fec70)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20840bb00, 0xc2083d6820)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20840bb00, 0xc2083d6820)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20840bb00, 0xc2083d6820)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20840bb00, 0xc2083d6820)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20840bb00, 0xc2083d6820)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20823fae0, 0xc2083d6820)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:56:37.202284 4877 server.go:324] GET /stats/bd6bc202-9a8b-11e4-af56-42010af0dcb6/reasoning-redis-ingest?num_stats=9: (2.978825ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208394060, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208394060, 0xc20832ee10, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208394060, 0x7f8a04dbf1b0, 0xc2085ff1f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208394060, 0xc2080daea0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208394060, 0xc2080daea0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208394060, 0xc2080daea0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208394060, 0xc2080daea0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208394060, 0xc2080daea0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208408000, 0xc2080daea0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:56:37.238708 4877 server.go:324] GET /stats/bc1262aa-9a8b-11e4-af56-42010af0dcb6/reasoning-gcs-ingest?num_stats=9: (2.493531ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208394660, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208394660, 0xc20832f200, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208394660, 0x7f8a04dbf1b0, 0xc2085ff6e0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208394660, 0xc2080db5f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208394660, 0xc2080db5f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208394660, 0xc2080db5f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208394660, 0xc2080db5f0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208394660, 0xc2080db5f0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2084080a0, 0xc2080db5f0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:56:37.261816 4877 server.go:324] GET /healthz: (5.545us) 200
I0112 18:56:37.343390 4877 server.go:324] GET /stats?num_stats=9: (11.693us) 301
I0112 18:56:37.344594 4877 server.go:324] GET /stats/: (451.266us) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208394c00, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208394c00, 0xc208189cc0, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208394c00, 0x7f8a04dbf1b0, 0xc2085ffad0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208394c00, 0xc2084f4410)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208394c00, 0xc2084f4410)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208394c00, 0xc2084f4410)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208394c00, 0xc2084f4410)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208394c00, 0xc2084f4410)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208408320, 0xc2084f4410)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:56:44.094500 4877 server.go:324] GET /healthz: (26.321us) 200
I0112 18:56:44.354855 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:56:44.356707 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:56:44.476004 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 152061b89710eefb2f28483a23ae5051f9b162f7a418aa94aca722fd7e4197eb
E0112 18:56:44.524202 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 152061b89710eefb2f28483a23ae5051f9b162f7a418aa94aca722fd7e4197eb: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:56:44.524258 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 152061b89710eefb2f28483a23ae5051f9b162f7a418aa94aca722fd7e4197eb: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:56:44.524411 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 152061b89710eefb2f28483a23ae5051f9b162f7a418aa94aca722fd7e4197eb with error: API error (500): Cannot start container 152061b89710eefb2f28483a23ae5051f9b162f7a418aa94aca722fd7e4197eb: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:56:44.524438 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 152061b89710eefb2f28483a23ae5051f9b162f7a418aa94aca722fd7e4197eb: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:56:46.736639 4877 server.go:324] GET /healthz: (11.65us) 200
I0112 18:56:46.950541 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=9: (2.997461ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20817dd40, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20817dd40, 0xc2082bd4d0, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20817dd40, 0x7f8a04dbf1b0, 0xc208148170)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20817dd40, 0xc2084f4680)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20817dd40, 0xc2084f4680)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20817dd40, 0xc2084f4680)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20817dd40, 0xc2084f4680)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20817dd40, 0xc2084f4680)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2083aae60, 0xc2084f4680)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:56:47.205925 4877 server.go:324] GET /stats/bc1262aa-9a8b-11e4-af56-42010af0dcb6/reasoning-gcs-ingest?num_stats=9: (3.028594ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208176240, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208176240, 0xc2082bd8c0, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208176240, 0x7f8a04dbf1b0, 0xc2081486e0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208176240, 0xc2083d71e0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208176240, 0xc2083d71e0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208176240, 0xc2083d71e0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208176240, 0xc2083d71e0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208176240, 0xc2083d71e0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2083ab040, 0xc2083d71e0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:56:47.224003 4877 server.go:324] GET /stats/bd6bc202-9a8b-11e4-af56-42010af0dcb6/reasoning-redis-ingest?num_stats=9: (2.396122ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2081767e0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2081767e0, 0xc2082bdcb0, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2081767e0, 0x7f8a04dbf1b0, 0xc208148d30)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2081767e0, 0xc2083d76c0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2081767e0, 0xc2083d76c0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2081767e0, 0xc2083d76c0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2081767e0, 0xc2083d76c0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2081767e0, 0xc2083d76c0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2083ab180, 0xc2083d76c0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:56:47.250005 4877 server.go:324] GET /healthz: (4.859us) 200
I0112 18:56:47.404827 4877 server.go:324] GET /stats?num_stats=10: (14.849us) 301
I0112 18:56:47.406196 4877 server.go:324] GET /stats/: (494.799us) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208176e40, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208176e40, 0xc20833bd10, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208176e40, 0x7f8a04dbf1b0, 0xc208149240)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208176e40, 0xc2083d7ee0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208176e40, 0xc2083d7ee0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208176e40, 0xc2083d7ee0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208176e40, 0xc2083d7ee0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208176e40, 0xc2083d7ee0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2083ab540, 0xc2083d7ee0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:56:47.506044 4877 server.go:324] GET /healthz: (7.078us) 200
I0112 18:56:47.506167 4877 server.go:324] GET /healthz: (4.123us) 200
I0112 18:56:47.511136 4877 server.go:324] GET /healthz: (5.138us) 200
I0112 18:56:47.531916 4877 server.go:324] GET /api/v1beta1/podInfo?podID=bd6bc202-9a8b-11e4-af56-42010af0dcb6&podNamespace=default: (9.652908ms) 200
I0112 18:56:47.532291 4877 server.go:324] GET /api/v1beta1/podInfo?podID=bc1262aa-9a8b-11e4-af56-42010af0dcb6&podNamespace=default: (10.174991ms) 200
I0112 18:56:47.544964 4877 server.go:324] GET /api/v1beta1/podInfo?podID=redis-3&podNamespace=default: (4.853278ms) 200
I0112 18:56:52.950814 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/cadvisor.manifest": default.cadvisor-agent (cadvisormanifes12uqn2ohido76855gdecd9roadm7l0)
I0112 18:56:52.951101 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/fluentd-es.manifest": default.fluentd-to-elasticsearch (fluentdesmanife2u464h05heqcpotoddodpnehjaqsde)
I0112 18:56:54.358229 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:56:54.360126 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:56:54.468305 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 9d4f49231aa1f0c3feac724a397acf6417c98eb0a1c3dd8cfe7e9c8de44db09d
E0112 18:56:54.504045 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 9d4f49231aa1f0c3feac724a397acf6417c98eb0a1c3dd8cfe7e9c8de44db09d: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:56:54.504098 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 9d4f49231aa1f0c3feac724a397acf6417c98eb0a1c3dd8cfe7e9c8de44db09d: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:56:54.504261 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 9d4f49231aa1f0c3feac724a397acf6417c98eb0a1c3dd8cfe7e9c8de44db09d with error: API error (500): Cannot start container 9d4f49231aa1f0c3feac724a397acf6417c98eb0a1c3dd8cfe7e9c8de44db09d: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:56:54.509370 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 9d4f49231aa1f0c3feac724a397acf6417c98eb0a1c3dd8cfe7e9c8de44db09d: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:56:56.828624 4877 server.go:324] GET /healthz: (26.843us) 200
I0112 18:56:56.876160 4877 server.go:324] GET /healthz: (7.417us) 200
I0112 18:56:56.959033 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=9: (3.085211ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2081c2000, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2081c2000, 0xc2084f81b0, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2081c2000, 0x7f8a04dbf1b0, 0xc208148000)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2081c2000, 0xc20814c5b0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2081c2000, 0xc20814c5b0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2081c2000, 0xc20814c5b0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2081c2000, 0xc20814c5b0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2081c2000, 0xc20814c5b0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20823edc0, 0xc20814c5b0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:56:57.221966 4877 server.go:324] GET /stats/bc1262aa-9a8b-11e4-af56-42010af0dcb6/reasoning-gcs-ingest?num_stats=9: (3.17427ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2081c2660, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2081c2660, 0xc2084f85a0, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2081c2660, 0x7f8a04dbf1b0, 0xc2081485c0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2081c2660, 0xc2083d6c30)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2081c2660, 0xc2083d6c30)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2081c2660, 0xc2083d6c30)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2081c2660, 0xc2083d6c30)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2081c2660, 0xc2083d6c30)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20823ee60, 0xc2083d6c30)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:56:57.241077 4877 server.go:324] GET /stats/bd6bc202-9a8b-11e4-af56-42010af0dcb6/reasoning-redis-ingest?num_stats=9: (2.772747ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2081c2c00, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2081c2c00, 0xc2084f8990, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2081c2c00, 0x7f8a04dbf1b0, 0xc208148c60)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2081c2c00, 0xc2083d7110)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2081c2c00, 0xc2083d7110)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2081c2c00, 0xc2083d7110)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2081c2c00, 0xc2083d7110)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2081c2c00, 0xc2083d7110)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20823ef00, 0xc2083d7110)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:56:57.367526 4877 server.go:324] GET /healthz: (5.791us) 200
I0112 18:56:57.454151 4877 server.go:324] GET /stats?num_stats=10: (11.676us) 301
I0112 18:56:57.455336 4877 server.go:324] GET /stats/: (388.533us) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2081c31a0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2081c31a0, 0xc208188fa0, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2081c31a0, 0x7f8a04dbf1b0, 0xc208149140)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2081c31a0, 0xc2083d7930)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2081c31a0, 0xc2083d7930)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2081c31a0, 0xc2083d7930)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2081c31a0, 0xc2083d7930)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2081c31a0, 0xc2083d7930)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20823f2c0, 0xc2083d7930)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:57:04.361394 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:57:04.363364 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:57:04.475887 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id de924123ee7a75dc0a70df46c96b2923b0b304cd33bb2db53aceffe4a993f60c
E0112 18:57:04.516005 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container de924123ee7a75dc0a70df46c96b2923b0b304cd33bb2db53aceffe4a993f60c: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:57:04.516045 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container de924123ee7a75dc0a70df46c96b2923b0b304cd33bb2db53aceffe4a993f60c: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:57:04.516238 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id de924123ee7a75dc0a70df46c96b2923b0b304cd33bb2db53aceffe4a993f60c with error: API error (500): Cannot start container de924123ee7a75dc0a70df46c96b2923b0b304cd33bb2db53aceffe4a993f60c: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:57:04.521032 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container de924123ee7a75dc0a70df46c96b2923b0b304cd33bb2db53aceffe4a993f60c: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:57:06.955250 4877 server.go:324] GET /healthz: (11.416us) 200
I0112 18:57:07.084358 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=9: (3.283249ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2082d11a0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2082d11a0, 0xc2084e5d40, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2082d11a0, 0x7f8a04dbf1b0, 0xc2083142f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2082d11a0, 0xc2083d7ba0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2082d11a0, 0xc2083d7ba0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2082d11a0, 0xc2083d7ba0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2082d11a0, 0xc2083d7ba0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2082d11a0, 0xc2083d7ba0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2084092c0, 0xc2083d7ba0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:57:07.625450 4877 server.go:324] GET /stats/bd6bc202-9a8b-11e4-af56-42010af0dcb6/reasoning-redis-ingest?num_stats=10: (2.624016ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2082d1740, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2082d1740, 0xc2084721b0, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2082d1740, 0x7f8a04dbf1b0, 0xc2083149e0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2082d1740, 0xc2084f5ad0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2082d1740, 0xc2084f5ad0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2082d1740, 0xc2084f5ad0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2082d1740, 0xc2084f5ad0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2082d1740, 0xc2084f5ad0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208409360, 0xc2084f5ad0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:57:07.659488 4877 server.go:324] GET /stats/bc1262aa-9a8b-11e4-af56-42010af0dcb6/reasoning-gcs-ingest?num_stats=10: (2.34013ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2082d1ce0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2082d1ce0, 0xc2084725a0, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2082d1ce0, 0x7f8a04dbf1b0, 0xc208315120)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2082d1ce0, 0xc2083d6000)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2082d1ce0, 0xc2083d6000)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2082d1ce0, 0xc2083d6000)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2082d1ce0, 0xc2083d6000)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2082d1ce0, 0xc2083d6000)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208409400, 0xc2083d6000)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:57:07.720710 4877 server.go:324] GET /healthz: (17.041us) 200
I0112 18:57:07.913026 4877 server.go:324] GET /stats?num_stats=10: (151.671us) 301
I0112 18:57:07.914126 4877 server.go:324] GET /stats/: (411.247us) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2082989c0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2082989c0, 0xc208369770, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2082989c0, 0x7f8a04dbf1b0, 0xc2083155f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2082989c0, 0xc2083d68f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2082989c0, 0xc2083d68f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2082989c0, 0xc2083d68f0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2082989c0, 0xc2083d68f0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2082989c0, 0xc2083d68f0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208409680, 0xc2083d68f0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:57:09.577238 4877 server.go:324] GET /healthz: (10.973us) 200
I0112 18:57:12.951860 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/cadvisor.manifest": default.cadvisor-agent (cadvisormanifes12uqn2ohido76855gdecd9roadm7l0)
I0112 18:57:12.952160 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/fluentd-es.manifest": default.fluentd-to-elasticsearch (fluentdesmanife2u464h05heqcpotoddodpnehjaqsde)
I0112 18:57:14.364091 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:57:14.366410 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:57:14.494302 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 0aea5a098c2ca1a7edeaf52c1969ace6593bc8b71cd418d0f733fdd269810da2
E0112 18:57:14.539744 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 0aea5a098c2ca1a7edeaf52c1969ace6593bc8b71cd418d0f733fdd269810da2: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:57:14.539788 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 0aea5a098c2ca1a7edeaf52c1969ace6593bc8b71cd418d0f733fdd269810da2: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:57:14.539959 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 0aea5a098c2ca1a7edeaf52c1969ace6593bc8b71cd418d0f733fdd269810da2 with error: API error (500): Cannot start container 0aea5a098c2ca1a7edeaf52c1969ace6593bc8b71cd418d0f733fdd269810da2: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:57:14.545645 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 0aea5a098c2ca1a7edeaf52c1969ace6593bc8b71cd418d0f733fdd269810da2: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:57:16.966309 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=9: (2.6548ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208298600, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208298600, 0xc208433170, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208298600, 0x7f8a04dbf1b0, 0xc20834a630)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208298600, 0xc2083d6b60)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208298600, 0xc2083d6b60)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208298600, 0xc2083d6b60)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208298600, 0xc2083d6b60)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208298600, 0xc2083d6b60)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208409720, 0xc2083d6b60)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:57:16.996176 4877 server.go:324] GET /healthz: (9.077us) 200
I0112 18:57:17.367025 4877 server.go:324] GET /stats/bc1262aa-9a8b-11e4-af56-42010af0dcb6/reasoning-gcs-ingest?num_stats=9: (2.779321ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208298ea0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208298ea0, 0xc208433560, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208298ea0, 0x7f8a04dbf1b0, 0xc20834ad70)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208298ea0, 0xc2083d61a0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208298ea0, 0xc2083d61a0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208298ea0, 0xc2083d61a0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208298ea0, 0xc2083d61a0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208298ea0, 0xc2083d61a0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208409a40, 0xc2083d61a0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:57:17.388160 4877 server.go:324] GET /stats/bd6bc202-9a8b-11e4-af56-42010af0dcb6/reasoning-redis-ingest?num_stats=9: (2.604093ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2082993e0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2082993e0, 0xc208433950, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2082993e0, 0x7f8a04dbf1b0, 0xc20834b3e0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2082993e0, 0xc2083d6820)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2082993e0, 0xc2083d6820)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2082993e0, 0xc2083d6820)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2082993e0, 0xc2083d6820)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2082993e0, 0xc2083d6820)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208409ae0, 0xc2083d6820)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:57:17.404440 4877 server.go:324] GET /healthz: (5.17us) 200
I0112 18:57:17.475209 4877 server.go:324] GET /stats?num_stats=9: (14.909us) 301
I0112 18:57:17.476296 4877 server.go:324] GET /stats/: (436.1us) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208299980, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208299980, 0xc20838a730, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208299980, 0x7f8a04dbf1b0, 0xc20834b950)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208299980, 0xc2083d71e0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208299980, 0xc2083d71e0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208299980, 0xc2083d71e0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208299980, 0xc2083d71e0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208299980, 0xc2083d71e0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208409d60, 0xc2083d71e0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:57:18.942539 4877 server.go:324] GET /healthz: (13.392us) 200
I0112 18:57:18.942675 4877 server.go:324] GET /healthz: (5.077us) 200
I0112 18:57:18.945325 4877 server.go:324] GET /healthz: (6.08us) 200
I0112 18:57:18.987667 4877 server.go:324] GET /api/v1beta1/podInfo?podID=bc1262aa-9a8b-11e4-af56-42010af0dcb6&podNamespace=default: (8.891447ms) 200
I0112 18:57:18.988181 4877 server.go:324] GET /api/v1beta1/podInfo?podID=bd6bc202-9a8b-11e4-af56-42010af0dcb6&podNamespace=default: (9.239043ms) 200
I0112 18:57:18.988742 4877 server.go:324] GET /api/v1beta1/podInfo?podID=redis-3&podNamespace=default: (8.747149ms) 200
I0112 18:57:22.461272 4877 server.go:324] GET /healthz: (12us) 200
I0112 18:57:24.366604 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:57:24.368555 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:57:24.460123 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 3d076576c1aaabc001d88d528df03f338f55255eba0f2e13a50fee45fae2e2ff
E0112 18:57:24.499591 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 3d076576c1aaabc001d88d528df03f338f55255eba0f2e13a50fee45fae2e2ff: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:57:24.499646 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 3d076576c1aaabc001d88d528df03f338f55255eba0f2e13a50fee45fae2e2ff: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:57:24.499781 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 3d076576c1aaabc001d88d528df03f338f55255eba0f2e13a50fee45fae2e2ff with error: API error (500): Cannot start container 3d076576c1aaabc001d88d528df03f338f55255eba0f2e13a50fee45fae2e2ff: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:57:24.505566 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 3d076576c1aaabc001d88d528df03f338f55255eba0f2e13a50fee45fae2e2ff: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:57:26.989146 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=9: (3.086779ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2082d03c0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2082d03c0, 0xc2083fa360, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2082d03c0, 0x7f8a04dbf1b0, 0xc208325290)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2082d03c0, 0xc2083d7450)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2082d03c0, 0xc2083d7450)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2082d03c0, 0xc2083d7450)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2082d03c0, 0xc2083d7450)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2082d03c0, 0xc2083d7450)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208408c80, 0xc2083d7450)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:57:27.033311 4877 server.go:324] GET /healthz: (6.177us) 200
I0112 18:57:27.312556 4877 server.go:324] GET /stats/bd6bc202-9a8b-11e4-af56-42010af0dcb6/reasoning-redis-ingest?num_stats=9: (2.581499ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2082d0960, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2082d0960, 0xc2083fa750, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2082d0960, 0x7f8a04dbf1b0, 0xc208325af0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2082d0960, 0xc2084f4ea0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2082d0960, 0xc2084f4ea0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2082d0960, 0xc2084f4ea0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2082d0960, 0xc2084f4ea0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2082d0960, 0xc2084f4ea0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208408e60, 0xc2084f4ea0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:57:27.350810 4877 server.go:324] GET /stats/bc1262aa-9a8b-11e4-af56-42010af0dcb6/reasoning-gcs-ingest?num_stats=9: (5.861835ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2082d0e40, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2082d0e40, 0xc2083fab40, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2082d0e40, 0x7f8a04dbf1b0, 0xc2083141c0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2082d0e40, 0xc2084f5520)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2082d0e40, 0xc2084f5520)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2082d0e40, 0xc2084f5520)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2082d0e40, 0xc2084f5520)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2082d0e40, 0xc2084f5520)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208408f00, 0xc2084f5520)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:57:27.375911 4877 server.go:324] GET /healthz: (21.355us) 200
I0112 18:57:27.466268 4877 server.go:324] GET /stats?num_stats=9: (11.736us) 301
I0112 18:57:27.467527 4877 server.go:324] GET /stats/: (413.966us) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2082d14a0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2082d14a0, 0xc208368a00, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2082d14a0, 0x7f8a04dbf1b0, 0xc208314840)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2082d14a0, 0xc2084f5d40)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2082d14a0, 0xc2084f5d40)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2082d14a0, 0xc2084f5d40)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2082d14a0, 0xc2084f5d40)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2082d14a0, 0xc2084f5d40)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208409180, 0xc2084f5d40)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:57:32.952995 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/cadvisor.manifest": default.cadvisor-agent (cadvisormanifes12uqn2ohido76855gdecd9roadm7l0)
I0112 18:57:32.953313 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/fluentd-es.manifest": default.fluentd-to-elasticsearch (fluentdesmanife2u464h05heqcpotoddodpnehjaqsde)
I0112 18:57:34.369099 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:57:34.371069 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:57:34.459634 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 774cc842a2404edc0047bcabc47b532c5ea820aaaf8cf7101f98ff32022eb96c
E0112 18:57:34.507824 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 774cc842a2404edc0047bcabc47b532c5ea820aaaf8cf7101f98ff32022eb96c: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:57:34.507858 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 774cc842a2404edc0047bcabc47b532c5ea820aaaf8cf7101f98ff32022eb96c: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:57:34.507982 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 774cc842a2404edc0047bcabc47b532c5ea820aaaf8cf7101f98ff32022eb96c with error: API error (500): Cannot start container 774cc842a2404edc0047bcabc47b532c5ea820aaaf8cf7101f98ff32022eb96c: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:57:34.515003 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 774cc842a2404edc0047bcabc47b532c5ea820aaaf8cf7101f98ff32022eb96c: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:57:35.327221 4877 server.go:324] GET /healthz: (9.826us) 200
I0112 18:57:36.955433 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=9: (3.04193ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208541bc0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208541bc0, 0xc208575dd0, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208541bc0, 0x7f8a04dbf1b0, 0xc2083d5940)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208541bc0, 0xc2083d6000)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208541bc0, 0xc2083d6000)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208541bc0, 0xc2083d6000)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208541bc0, 0xc2083d6000)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208541bc0, 0xc2083d6000)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2083abc20, 0xc2083d6000)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:57:37.068593 4877 server.go:324] GET /healthz: (9.25us) 200
I0112 18:57:37.183420 4877 server.go:324] GET /stats/bc1262aa-9a8b-11e4-af56-42010af0dcb6/reasoning-gcs-ingest?num_stats=9: (3.021405ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20840a4e0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20840a4e0, 0xc208400240, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20840a4e0, 0x7f8a04dbf1b0, 0xc2083d5f20)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20840a4e0, 0xc20814d860)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20840a4e0, 0xc20814d860)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20840a4e0, 0xc20814d860)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20840a4e0, 0xc20814d860)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20840a4e0, 0xc20814d860)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2083abf40, 0xc20814d860)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:57:37.203573 4877 server.go:324] GET /stats/bd6bc202-9a8b-11e4-af56-42010af0dcb6/reasoning-redis-ingest?num_stats=9: (2.636206ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20840aa20, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20840aa20, 0xc208400630, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20840aa20, 0x7f8a04dbf1b0, 0xc2085fe410)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20840aa20, 0xc2084f41a0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20840aa20, 0xc2084f41a0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20840aa20, 0xc2084f41a0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20840aa20, 0xc2084f41a0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20840aa20, 0xc2084f41a0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208408000, 0xc2084f41a0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:57:37.249802 4877 server.go:324] GET /healthz: (5.468us) 200
I0112 18:57:37.339896 4877 server.go:324] GET /stats?num_stats=9: (12.84us) 301
I0112 18:57:37.340953 4877 server.go:324] GET /stats/: (392.996us) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20840afc0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20840afc0, 0xc2083a8550, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20840afc0, 0x7f8a04dbf1b0, 0xc2085fe800)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20840afc0, 0xc2084f49c0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20840afc0, 0xc2084f49c0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20840afc0, 0xc2084f49c0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20840afc0, 0xc2084f49c0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20840afc0, 0xc2084f49c0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208408280, 0xc2084f49c0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:57:44.371752 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:57:44.373798 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:57:44.459919 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id de82822e4bfd4ef9e9279ae19d634a9ad13b42d4cd1766a86470cde12e48ca67
E0112 18:57:44.507755 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container de82822e4bfd4ef9e9279ae19d634a9ad13b42d4cd1766a86470cde12e48ca67: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:57:44.507789 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container de82822e4bfd4ef9e9279ae19d634a9ad13b42d4cd1766a86470cde12e48ca67: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:57:44.657443 4877 restclient.go:141] Waiting for completion of operation 4383
I0112 18:57:46.664886 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id de82822e4bfd4ef9e9279ae19d634a9ad13b42d4cd1766a86470cde12e48ca67 with error: API error (500): Cannot start container de82822e4bfd4ef9e9279ae19d634a9ad13b42d4cd1766a86470cde12e48ca67: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:57:46.664959 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container de82822e4bfd4ef9e9279ae19d634a9ad13b42d4cd1766a86470cde12e48ca67: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:57:46.988871 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=9: (3.160028ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2081772c0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2081772c0, 0xc2082cbd40, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2081772c0, 0x7f8a04dbf1b0, 0xc2081493b0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2081772c0, 0xc2084f4c30)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2081772c0, 0xc2084f4c30)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2081772c0, 0xc2084f4c30)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2081772c0, 0xc2084f4c30)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2081772c0, 0xc2084f4c30)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20823eaa0, 0xc2084f4c30)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:57:47.102958 4877 server.go:324] GET /healthz: (29.154us) 200
I0112 18:57:47.205709 4877 server.go:324] GET /stats/bd6bc202-9a8b-11e4-af56-42010af0dcb6/reasoning-redis-ingest?num_stats=9: (2.568678ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208177860, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208177860, 0xc20845c1b0, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208177860, 0x7f8a04dbf1b0, 0xc208149ab0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208177860, 0xc2083d76c0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208177860, 0xc2083d76c0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208177860, 0xc2083d76c0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208177860, 0xc2083d76c0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208177860, 0xc2083d76c0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20823edc0, 0xc2083d76c0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:57:47.236711 4877 server.go:324] GET /stats/bc1262aa-9a8b-11e4-af56-42010af0dcb6/reasoning-gcs-ingest?num_stats=9: (2.389287ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208177da0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208177da0, 0xc20845c5a0, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208177da0, 0x7f8a04dbf1b0, 0xc208214060)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208177da0, 0xc2083d7e10)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208177da0, 0xc2083d7e10)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208177da0, 0xc2083d7e10)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208177da0, 0xc2083d7e10)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208177da0, 0xc2083d7e10)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20823ee60, 0xc2083d7e10)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:57:47.260867 4877 server.go:324] GET /healthz: (4.69us) 200
I0112 18:57:47.308793 4877 server.go:324] GET /stats?num_stats=9: (31.538us) 301
I0112 18:57:47.310066 4877 server.go:324] GET /stats/: (581.024us) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20810e780, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20810e780, 0xc20831a730, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20810e780, 0x7f8a04dbf1b0, 0xc208214670)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20810e780, 0xc2080da4e0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20810e780, 0xc2080da4e0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20810e780, 0xc2080da4e0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20810e780, 0xc2080da4e0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20810e780, 0xc2080da4e0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc20823f220, 0xc2080da4e0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:57:48.054246 4877 server.go:324] GET /healthz: (10.044us) 200
I0112 18:57:50.333882 4877 server.go:324] GET /healthz: (11.52us) 200
I0112 18:57:50.339328 4877 server.go:324] GET /healthz: (5.665us) 200
I0112 18:57:50.339699 4877 server.go:324] GET /healthz: (4.979us) 200
I0112 18:57:50.379924 4877 server.go:324] GET /api/v1beta1/podInfo?podID=bc1262aa-9a8b-11e4-af56-42010af0dcb6&podNamespace=default: (12.7442ms) 200
I0112 18:57:50.380482 4877 server.go:324] GET /api/v1beta1/podInfo?podID=bd6bc202-9a8b-11e4-af56-42010af0dcb6&podNamespace=default: (10.669744ms) 200
I0112 18:57:50.391331 4877 server.go:324] GET /api/v1beta1/podInfo?podID=redis-3&podNamespace=default: (18.646861ms) 200
I0112 18:57:52.954102 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/cadvisor.manifest": default.cadvisor-agent (cadvisormanifes12uqn2ohido76855gdecd9roadm7l0)
I0112 18:57:52.954369 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/fluentd-es.manifest": default.fluentd-to-elasticsearch (fluentdesmanife2u464h05heqcpotoddodpnehjaqsde)
I0112 18:57:54.374561 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:57:54.376624 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:57:54.492055 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 7b57e1425dec78083ebefa49581f95a0a739ca685ac9738c6dace2727ab259e8
E0112 18:57:54.520157 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 7b57e1425dec78083ebefa49581f95a0a739ca685ac9738c6dace2727ab259e8: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:57:54.520213 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 7b57e1425dec78083ebefa49581f95a0a739ca685ac9738c6dace2727ab259e8: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:57:54.520380 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 7b57e1425dec78083ebefa49581f95a0a739ca685ac9738c6dace2727ab259e8 with error: API error (500): Cannot start container 7b57e1425dec78083ebefa49581f95a0a739ca685ac9738c6dace2727ab259e8: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:57:54.525478 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 7b57e1425dec78083ebefa49581f95a0a739ca685ac9738c6dace2727ab259e8: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:57:57.166456 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=9: (3.184765ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2081732c0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2081732c0, 0xc2085fa480, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2081732c0, 0x7f8a04dbf1b0, 0xc208148430)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2081732c0, 0xc2080da820)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2081732c0, 0xc2080da820)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2081732c0, 0xc2080da820)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2081732c0, 0xc2080da820)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2081732c0, 0xc2080da820)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2084097c0, 0xc2080da820)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:57:57.336410 4877 server.go:324] GET /healthz: (10.705us) 200
I0112 18:57:57.521059 4877 server.go:324] GET /stats/bd6bc202-9a8b-11e4-af56-42010af0dcb6/reasoning-redis-ingest?num_stats=10: (2.931748ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2081738c0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2081738c0, 0xc2085fa870, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2081738c0, 0x7f8a04dbf1b0, 0xc208148bb0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2081738c0, 0xc2083d65b0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2081738c0, 0xc2083d65b0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2081738c0, 0xc2083d65b0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2081738c0, 0xc2083d65b0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2081738c0, 0xc2083d65b0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2084099a0, 0xc2083d65b0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:57:57.552934 4877 server.go:324] GET /stats/bc1262aa-9a8b-11e4-af56-42010af0dcb6/reasoning-gcs-ingest?num_stats=10: (2.58288ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc208173da0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc208173da0, 0xc2085fac60, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc208173da0, 0x7f8a04dbf1b0, 0xc208149190)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc208173da0, 0xc2083d6d00)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc208173da0, 0xc2083d6d00)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc208173da0, 0xc2083d6d00)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc208173da0, 0xc2083d6d00)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc208173da0, 0xc2083d6d00)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208409a40, 0xc2083d6d00)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:57:57.745578 4877 server.go:324] GET /healthz: (12.074us) 200
I0112 18:57:58.268487 4877 server.go:324] GET /stats?num_stats=10: (29.819us) 301
I0112 18:57:58.269907 4877 server.go:324] GET /stats/: (586.618us) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2081c23c0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2081c23c0, 0xc208255c70, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2081c23c0, 0x7f8a04dbf1b0, 0xc2081495d0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2081c23c0, 0xc2083d7450)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2081c23c0, 0xc2083d7450)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2081c23c0, 0xc2083d7450)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc2081c23c0, 0xc2083d7450)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc2081c23c0, 0xc2083d7450)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208409cc0, 0xc2083d7450)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:58:01.400539 4877 server.go:324] GET /healthz: (10.518us) 200
I0112 18:58:04.377718 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:58:04.381692 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:58:04.459992 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 0244ead4b52c4366e845dcf0b8d27968ebe5de29b9f0792cf343b4274aac82ab
E0112 18:58:04.508471 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 0244ead4b52c4366e845dcf0b8d27968ebe5de29b9f0792cf343b4274aac82ab: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:58:04.508513 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 0244ead4b52c4366e845dcf0b8d27968ebe5de29b9f0792cf343b4274aac82ab: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:58:04.508664 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 0244ead4b52c4366e845dcf0b8d27968ebe5de29b9f0792cf343b4274aac82ab with error: API error (500): Cannot start container 0244ead4b52c4366e845dcf0b8d27968ebe5de29b9f0792cf343b4274aac82ab: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:58:04.508693 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 0244ead4b52c4366e845dcf0b8d27968ebe5de29b9f0792cf343b4274aac82ab: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:58:07.160199 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=8: (3.420558ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20813fda0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20813fda0, 0xc2082b1e60, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20813fda0, 0x7f8a04dbf1b0, 0xc208284a90)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20813fda0, 0xc2083d76c0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20813fda0, 0xc2083d76c0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20813fda0, 0xc2083d76c0)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20813fda0, 0xc2083d76c0)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20813fda0, 0xc2083d76c0)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208409180, 0xc2083d76c0)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:58:07.399898 4877 server.go:324] GET /stats/bd6bc202-9a8b-11e4-af56-42010af0dcb6/reasoning-redis-ingest?num_stats=9: (2.39618ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20816a300, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20816a300, 0xc2084c82d0, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20816a300, 0x7f8a04dbf1b0, 0xc208285160)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20816a300, 0xc2084f4340)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20816a300, 0xc2084f4340)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20816a300, 0xc2084f4340)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20816a300, 0xc2084f4340)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20816a300, 0xc2084f4340)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208409220, 0xc2084f4340)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:58:07.432728 4877 server.go:324] GET /stats/bc1262aa-9a8b-11e4-af56-42010af0dcb6/reasoning-gcs-ingest?num_stats=9: (2.502756ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20816a8a0, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20816a8a0, 0xc2084c86c0, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20816a8a0, 0x7f8a04dbf1b0, 0xc208285730)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20816a8a0, 0xc2084f4820)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20816a8a0, 0xc2084f4820)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20816a8a0, 0xc2084f4820)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20816a8a0, 0xc2084f4820)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20816a8a0, 0xc2084f4820)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc2084092c0, 0xc2084f4820)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:58:07.450158 4877 server.go:324] GET /healthz: (16.893us) 200
I0112 18:58:07.532257 4877 server.go:324] GET /stats?num_stats=9: (15.098us) 301
I0112 18:58:07.533253 4877 server.go:324] GET /stats/: (357.963us) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc20816ae40, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc20816ae40, 0xc208352a00, 0x47, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc20816ae40, 0x7f8a04dbf1b0, 0xc208285c30)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc20816ae40, 0xc2084f5110)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc20816ae40, 0xc2084f5110)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc20816ae40, 0xc2084f5110)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
net/http.HandlerFunc.ServeHTTP(0xc2081224d0, 0x7f8a04dcd680, 0xc20816ae40, 0xc2084f5110)
/usr/src/go/src/pkg/net/http/server.go:1235 +0x40
net/http.(*ServeMux).ServeHTTP(0xc208114b10, 0x7f8a04dcd680, 0xc20816ae40, 0xc2084f5110)
/usr/src/go/src/pkg/net/http/server.go:1511 +0x1a3
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).ServeHTTP(0xc208124320, 0x7f8a04dcd648, 0xc208409540, 0xc2084f5110)
/go/src/github.com/GoogleCloudPlatform/kuber
I0112 18:58:07.763603 4877 server.go:324] GET /healthz: (6.185us) 200
I0112 18:58:12.955193 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/cadvisor.manifest": default.cadvisor-agent (cadvisormanifes12uqn2ohido76855gdecd9roadm7l0)
I0112 18:58:12.955497 4877 file.go:171] Got pod from file "/etc/kubernetes/manifests/fluentd-es.manifest": default.fluentd-to-elasticsearch (fluentdesmanife2u464h05heqcpotoddodpnehjaqsde)
I0112 18:58:14.088867 4877 server.go:324] GET /healthz: (11.969us) 200
I0112 18:58:14.380814 4877 kubelet.go:793] Network container doesn't exist for pod "cadvisor-agent.default.file", killing and re-creating the pod
I0112 18:58:14.383227 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'pulled' Successfully pulled image "kubernetes/pause:latest"
I0112 18:58:14.491943 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'waiting', reason: 'created' Created with docker id 5f3e14df878788db1022de76cac8f4b40cacc53d5119f2b99baa0ad8d1593c15
E0112 18:58:14.523929 4877 kubelet.go:800] Failed to introspect network container: API error (500): Cannot start container 5f3e14df878788db1022de76cac8f4b40cacc53d5119f2b99baa0ad8d1593c15: Bind for 0.0.0.0:4194 failed: port is already allocated
; Skipping pod "cadvisor-agent.default.file"
E0112 18:58:14.523961 4877 kubelet.go:1023] Error syncing pod, skipping: API error (500): Cannot start container 5f3e14df878788db1022de76cac8f4b40cacc53d5119f2b99baa0ad8d1593c15: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:58:14.524134 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:"implicitly required container net"}): status: 'failed', reason: 'failed' Failed to start with docker id 5f3e14df878788db1022de76cac8f4b40cacc53d5119f2b99baa0ad8d1593c15 with error: API error (500): Cannot start container 5f3e14df878788db1022de76cac8f4b40cacc53d5119f2b99baa0ad8d1593c15: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:58:14.528701 4877 event.go:92] Event(api.ObjectReference{Kind:"BoundPod", Namespace:"default", Name:"cadvisor-agent", UID:"cadvisormanifes12uqn2ohido76855gdecd9roadm7l0", APIVersion:"v1beta2", ResourceVersion:"", FieldPath:""}): status: '', reason: 'failedSync' Error syncing pod, skipping: API error (500): Cannot start container 5f3e14df878788db1022de76cac8f4b40cacc53d5119f2b99baa0ad8d1593c15: Bind for 0.0.0.0:4194 failed: port is already allocated
I0112 18:58:16.952706 4877 server.go:324] GET /stats/redis-3/redis-master?num_stats=9: (3.372098ms) 500
goroutine 913 [running]:
github.com/GoogleCloudPlatform/kubernetes/pkg/httplog.(*respLogger).WriteHeader(0xc2082d0c00, 0x1f4)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/httplog/log.go:182 +0x9c
net/http.Error(0x7f8a04dcd680, 0xc2082d0c00, 0xc208434bd0, 0x8d, 0x1f4)
/usr/src/go/src/pkg/net/http/server.go:1244 +0x96
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).error(0xc208124340, 0x7f8a04dcd680, 0xc2082d0c00, 0x7f8a04dbf1b0, 0xc208307b80)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:108 +0xf5
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).serveStats(0xc208124340, 0x7f8a04dcd680, 0xc2082d0c00, 0xc2084f5450)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:370 +0x34f
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.(*Server).handleStats(0xc208124340, 0x7f8a04dcd680, 0xc2082d0c00, 0xc2084f5450)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:249 +0x45
github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.*Server.(github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet.handleStats)·fm(0x7f8a04dcd680, 0xc2082d0c00, 0xc2084f5450)
/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/kubelet/server.go:94 +0x44
@aullrich
Copy link

Steve, did you report this already somewhere? I have the same issue. As workaround I ended up killing the running cadvisor container (last line in your docker ps -a output).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment