Skip to content

Instantly share code, notes, and snippets.

@flaccid

flaccid/gist:00c4bbb9787fba7ec311

Created January 26, 2016 01:56
Show Gist options
  • Save flaccid/00c4bbb9787fba7ec311 to your computer and use it in GitHub Desktop.
Save flaccid/00c4bbb9787fba7ec311 to your computer and use it in GitHub Desktop.
Download ZIP
rancher agent failing docker stats for host, containers
Raw
gistfile1.txt
INFO: Starting agent for 0A90EA3346CA1D7B2B53
INFO: Access Key: 0A90EA3346CA1D7B2B53
INFO: Config URL: http://lister:8080/v1
INFO: Storage URL: http://lister:8080/v1
INFO: API URL: http://lister:8080/v1
INFO: IP: 192.168.0.9
INFO: Port:
INFO: Required Image: rancher/agent:v0.8.2
INFO: Current Image: rancher/agent:v0.8.2
INFO: Using image rancher/agent:v0.8.2
INFO: Downloading agent http://lister:8080/v1/configcontent/configscripts
INFO: Updating configscripts
INFO: Downloading http://lister:8080/v1//configcontent//configscripts current=
INFO: Running /var/lib/cattle/download/configscripts/configscripts-1-f0f3fb2e1110b5ada7c441705981f93a480313a324294321cff467f0c3e12319/apply.sh
INFO: Sending configscripts applied 1-f0f3fb2e1110b5ada7c441705981f93a480313a324294321cff467f0c3e12319
INFO: Updating pyagent
INFO: Downloading http://lister:8080/v1//configcontent//pyagent current=
INFO: Running /var/lib/cattle/download/pyagent/pyagent-1-9e3dcab12585149a65d818082279708965cd826df1937a55b24f48428f8f0c06069547103e24f5f4562a2db5d4805d60/apply.sh
INFO: Updating host-api
INFO: Downloading http://lister:8080/v1//configcontent//host-api current=
INFO: Running /var/lib/cattle/download/host-api/1-1dcc85d77415faddc4d6d204d2bd622d835de4b5ee4b472651419b58189c474a/apply.sh
INFO: Sending host-api applied 1-1dcc85d77415faddc4d6d204d2bd622d835de4b5ee4b472651419b58189c474a
INFO: Updating agent-binaries
INFO: Downloading http://lister:8080/v1//configcontent//agent-binaries current=
INFO: Running /var/lib/cattle/download/agent-binaries/1-4200f9b686342da8e941359211b1d8c5f98877ae293d0ead231d43507f1c9eae/apply.sh
INFO: Sending agent-binaries applied 1-4200f9b686342da8e941359211b1d8c5f98877ae293d0ead231d43507f1c9eae
INFO: Updating python-agent
INFO: Downloading http://lister:8080/v1//configcontent//python-agent current=
INFO: Running /var/lib/cattle/download/python-agent/1-ad86aa4dbbc9e669c5de1dc8e60f7559b4103660fc16a185c6cf05e46815821d/apply.sh
INFO: Sending python-agent applied 1-ad86aa4dbbc9e669c5de1dc8e60f7559b4103660fc16a185c6cf05e46815821d
INFO: Updating cadvisor
INFO: Downloading http://lister:8080/v1//configcontent//cadvisor current=
INFO: Running /var/lib/cattle/download/cadvisor/1-4d2b4356ab14bc1fa7ec7cd83f35b7e975a16cea01634683b577c9498c98de25/apply.sh
INFO: HOME -> ./
INFO: HOME -> ./bin/
INFO: HOME -> ./bin/cadvisor.sh
INFO: HOME -> ./bin/cadvisor
INFO: Sending cadvisor applied 1-4d2b4356ab14bc1fa7ec7cd83f35b7e975a16cea01634683b577c9498c98de25
INFO: Updating volmgr
INFO: Downloading http://lister:8080/v1//configcontent//volmgr current=
INFO: Running /var/lib/cattle/download/volmgr/1-c813690c24ae9a12f0792378c78a48f447b243517233d7969b99baefbea5af15/apply.sh
INFO: Sending volmgr applied 1-c813690c24ae9a12f0792378c78a48f447b243517233d7969b99baefbea5af15
INFO: Sending pyagent applied 1-9e3dcab12585149a65d818082279708965cd826df1937a55b24f48428f8f0c06069547103e24f5f4562a2db5d4805d60
INFO: Starting agent /var/lib/cattle/pyagent/apply.sh
INFO: Executing /var/lib/cattle/pyagent/main.py
INFO: Updating host-config
INFO: Downloading http://lister:8080/v1//configcontent//host-config current=
INFO: Running /var/lib/cattle/download/host-config/host-config-1-0bcb059551181dd598309e624e2150afe35f417b492277366bb525322759c7a3/apply.sh
INFO: HOME -> ./
INFO: HOME -> ./etc/
INFO: HOME -> ./etc/cattle/
INFO: HOME -> ./etc/cattle/api.crt
INFO: Sending host-config applied 1-0bcb059551181dd598309e624e2150afe35f417b492277366bb525322759c7a3
time="2016-01-26T01:52:17Z" level="info" msg="Starting event router."
time="2016-01-26T01:52:17Z" level="info" msg="Watching state directory: /var/lib/rancher/state/containers"
I0126 12:52:17.937091 10338 storagedriver.go:132] No backend storage selected
I0126 12:52:17.937124 10338 storagedriver.go:134] Caching stats in memory for 2m0s
I0126 12:52:17.937167 10338 manager.go:128] cAdvisor running in container: "/docker/c463aba991230841c49885bb18d85b49c15177cf22d3e855a92fcbd731312e77"
I0126 12:52:18.021304 10338 fs.go:108] Filesystem partitions: map[/dev/sdd1:{mountpoint:/media/astone-ext major:8 minor:49 fsType: blockSize:0} docker-8:1-3203100-pool:{mountpoint: major:7 minor:0 fsType:devicemapper blockSize:128} /dev/sda1:{mountpoint:/ major:8 minor:1 fsType: blockSize:0} /dev/sdc1:{mountpoint:/media/laser major:8 minor:33 fsType: blockSize:0}]
I0126 12:52:18.513689 10338 manager.go:163] Machine: {NumCores:4 CpuFrequency:3800000 MemoryCapacity:16791461888 MachineID:eabbb7843fbb4b93a56411dc44cc083f SystemUUID:90022B03-3404-3905-9E06-ED0700080009 BootID:3152980a-d2cd-446c-bbcf-fcebeac7e1cf Filesystems:[{Device:/dev/sdc1 Capacity:1968873193472} {Device:/dev/sdd1 Capacity:738248912896} {Device:docker-8:1-3203100-pool Capacity:107374182400} {Device:/dev/sda1 Capacity:118014062592}] DiskMap:map[8:0:{Name:sda Major:8 Minor:0 Size:120034123776 Scheduler:cfq} 8:16:{Name:sdb Major:8 Minor:16 Size:1000204885504 Scheduler:cfq} 8:32:{Name:sdc Major:8 Minor:32 Size:2000398934016 Scheduler:cfq} 8:48:{Name:sdd Major:8 Minor:48 Size:750156372480 Scheduler:cfq} 254:0:{Name:dm-0 Major:254 Minor:0 Size:107374182400 Scheduler:none} 254:1:{Name:dm-1 Major:254 Minor:1 Size:107374182400 Scheduler:none} 254:2:{Name:dm-2 Major:254 Minor:2 Size:107374182400 Scheduler:none} 254:3:{Name:dm-3 Major:254 Minor:3 Size:107374182400 Scheduler:none}] NetworkDevices:[{Name:eth0 MacAddress:90:2b:34:39:9e:ed Speed:1000 Mtu:1500} {Name:eth1 MacAddress:90:2b:34:39:9e:ac Speed:0 Mtu:1500} {Name:tun0 MacAddress: Speed:10 Mtu:1500} {Name:wlan0 MacAddress:44:6d:57:75:de:c5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:16791461888 Cores:[{Id:0 Threads:[0] Caches:[{Size:32768 Type:Data Level:1} {Size:32768 Type:Instruction Level:1} {Size:262144 Type:Unified Level:2}]} {Id:1 Threads:[1] Caches:[{Size:32768 Type:Data Level:1} {Size:32768 Type:Instruction Level:1} {Size:262144 Type:Unified Level:2}]} {Id:2 Threads:[2] Caches:[{Size:32768 Type:Data Level:1} {Size:32768 Type:Instruction Level:1} {Size:262144 Type:Unified Level:2}]} {Id:3 Threads:[3] Caches:[{Size:32768 Type:Data Level:1} {Size:32768 Type:Instruction Level:1} {Size:262144 Type:Unified Level:2}]}] Caches:[{Size:6291456 Type:Unified Level:3}]}] CloudProvider:Unknown InstanceType:Unknown}
I0126 12:52:18.514609 10338 manager.go:169] Version: {KernelVersion:4.3.3-3-ARCH ContainerOsVersion:Arch Linux DockerVersion:1.9.1 CadvisorVersion: CadvisorRevision:}
I0126 12:52:18.516073 10338 factory.go:194] System is using systemd
I0126 12:52:18.657205 10338 factory.go:236] Registering Docker factory
I0126 12:52:18.657643 10338 factory.go:93] Registering Raw factory
I0126 12:52:18.752925 10338 manager.go:1006] Started watching for new ooms in manager
I0126 12:52:18.753259 10338 oomparser.go:183] oomparser using systemd
I0126 12:52:18.753564 10338 manager.go:250] Starting recovery of all containers
I0126 12:52:18.756478 10338 manager.go:255] Recovery completed
I0126 12:52:18.758862 10338 cadvisor.go:96] Starting cAdvisor version: - on port 9344
2016-01-26 01:52:24,858 ERROR agent [140094868794256] [event.py:112] Error in request : 1ad9e47d-b309-4902-83a5-dcad7493bd9f
Traceback (most recent call last):
File "/var/lib/cattle/pyagent/cattle/agent/event.py", line 95, in _worker_main
resp = agent.execute(req)
File "/var/lib/cattle/pyagent/cattle/agent/__init__.py", line 15, in execute
return self._router.route(req)
File "/var/lib/cattle/pyagent/cattle/plugins/core/event_router.py", line 13, in route
resp = handler.execute(req)
File "/var/lib/cattle/pyagent/cattle/plugins/core/event_handlers.py", line 32, in execute
type.on_ping(event, resp)
File "/var/lib/cattle/pyagent/cattle/plugins/docker/compute.py", line 126, in on_ping
self._add_instances(ping, pong)
File "/var/lib/cattle/pyagent/cattle/plugins/docker/compute.py", line 138, in _add_instances
running, nonrunning = self._get_all_containers_by_state()
File "/var/lib/cattle/pyagent/cattle/plugins/docker/compute.py", line 171, in _get_all_containers_by_state
for c in client.containers(all=True):
File "/var/lib/cattle/pyagent/dist/docker/api/container.py", line 67, in containers
res = self._result(self._get(u, params=params), True)
File "/var/lib/cattle/pyagent/dist/docker/client.py", line 110, in _get
return self.get(url, **self._set_request_timeout(kwargs))
File "/var/lib/cattle/pyagent/dist/requests/sessions.py", line 480, in get
return self.request('GET', url, **kwargs)
File "/var/lib/cattle/pyagent/dist/requests/sessions.py", line 468, in request
resp = self.send(prep, **send_kwargs)
File "/var/lib/cattle/pyagent/dist/requests/sessions.py", line 576, in send
r = adapter.send(request, **kwargs)
File "/var/lib/cattle/pyagent/dist/requests/adapters.py", line 449, in send
raise ReadTimeout(e, request=request)
ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=2)
time="2016-01-26T01:52:36Z" level="info" msg="Processing event: &docker.APIEvents{Status:\"start\", ID:\"c463aba991230841c49885bb18d85b49c15177cf22d3e855a92fcbd731312e77\", From:\"-simulated-\", Time:0}"
time="2016-01-26T01:52:36Z" level="info" msg="Processing event: &docker.APIEvents{Status:\"start\", ID:\"4688226073ccaf7ed1b50c6e7eaa551a5ccb75cc77f4992a5253bf944654c442\", From:\"-simulated-\", Time:0}"
time="2016-01-26T01:52:36Z" level="info" msg="Connecting to proxy." url="ws://lister:8080/v1/connectbackend?token=eyJhbGciOiJSUzI1NiJ9.eyJleHAiOjE0NTM3NzM0NTYsInN1YiI6ImNhdHRsZSIsImlzcyI6Imh0dHA6XC9cL2NhdHRsZS5pbyIsInJlcG9ydGVkVXVpZCI6IjRiNTdhMzZhLTk0NjItNDk4OS1iZWE5LTFmNDhjNDJmMzQwMCIsImlhdCI6MTQ1Mzc3MzE1Niwia2lkIjoiZGVmYXVsdCJ9.K_s7-4bhvlVtXPAK08ZBEen-lU2nXZ4Dd_-j8MFC_SXVIeNtxaqL-uP119--OK27peagoXL5PgqhsenOceF3piSYZ_orzrsvdVoL-tM2MxN09-aehnKFIOVkg2i9bz7qf0SbAZwvGg8GzzmosvVKgrAHkmy4yHZ4taKudMdUZTGkTs7vsSNsdwx8SZl92GbOSUlfYgCNwhfzaGN1dJ9SNTm2q4afeK4666zULal6xMHMz_acGn3ALMRbt4RP9UUPklQZ6-DZMepXgBlFFiuHruyjS5-ahn5SklvFh1S4G_cj0Tc0rSzN2CNSVVcrkq3ab_0GybTplGpxypFFWNmnYw"
time="2016-01-26T01:52:39Z" level="info" msg="Processing event: &docker.APIEvents{Status:\"start\", ID:\"4688226073ccaf7ed1b50c6e7eaa551a5ccb75cc77f4992a5253bf944654c442\", From:\"-simulated-\", Time:0}"
panic: runtime error: index out of range
goroutine 33 [running]:
github.com/rancherio/host-api/stats.convertToAggregatedStats(0x0, 0x0, 0xc2080dc8d0, 0x8d3e90, 0x9, 0xc20811dc00, 0x0, 0x0, 0x3e8d96000, 0x0, ...)
/source/gopath/src/github.com/rancherio/host-api/stats/aggregated_stats.go:21 +0x590
github.com/rancherio/host-api/stats.writeAggregatedStats(0x0, 0x0, 0xc2080dc8d0, 0x8d3e90, 0x9, 0xc20811dc00, 0x0, 0x0, 0x3e8d96000, 0x7f45cd25bc98, ...)
/source/gopath/src/github.com/rancherio/host-api/stats/aggregated_stats.go:70 +0xb6
github.com/rancherio/host-api/stats.(*ContainerStatsHandler).Handle(0xb2a6d0, 0xc2080f2000, 0x24, 0xc2080f2029, 0x2bc, 0xc20809d9e0, 0xc2080ea360)
/source/gopath/src/github.com/rancherio/host-api/stats/container_stats.go:125 +0x14b5
created by github.com/rancherio/websocket-proxy/backend.connectToProxyWS
/source/Godeps/_workspace/src/github.com/rancherio/websocket-proxy/backend/backend.go:72 +0x5c5
goroutine 1 [IO wait]:
net.(*pollDesc).Wait(0xc20809a8b0, 0x72, 0x0, 0x0)
/usr/src/go/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc20809a8b0, 0x0, 0x0)
/usr/src/go/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).Read(0xc20809a850, 0xc20800d000, 0x1000, 0x1000, 0x0, 0x7f45cd256bf0, 0xc208126418)
/usr/src/go/src/net/fd_unix.go:242 +0x40f
net.(*conn).Read(0xc20802c850, 0xc20800d000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/src/go/src/net/net.go:121 +0xdc
bufio.(*Reader).fill(0xc2080ea300)
/usr/src/go/src/bufio/bufio.go:97 +0x1ce
bufio.(*Reader).Read(0xc2080ea300, 0xc208126410, 0x2, 0x8, 0x413cd0, 0x0, 0x0)
/usr/src/go/src/bufio/bufio.go:174 +0x26c
github.com/gorilla/websocket.(*Conn).readFull(0xc2080980f0, 0xc208126410, 0x2, 0x8, 0x0, 0x0)
/source/Godeps/_workspace/src/github.com/gorilla/websocket/conn.go:542 +0xab
github.com/gorilla/websocket.(*Conn).advanceFrame(0xc2080980f0, 0x8ea850, 0x0, 0x0)
/source/Godeps/_workspace/src/github.com/gorilla/websocket/conn.go:566 +0x15c
github.com/gorilla/websocket.(*Conn).NextReader(0xc2080980f0, 0xc20809da00, 0x0, 0x0, 0x0, 0x0)
/source/Godeps/_workspace/src/github.com/gorilla/websocket/conn.go:706 +0x7e
github.com/gorilla/websocket.(*Conn).ReadMessage(0xc2080980f0, 0xc2080f2000, 0x0, 0x0, 0x0, 0x0, 0x0)
/source/Godeps/_workspace/src/github.com/gorilla/websocket/conn.go:769 +0x6a
github.com/rancherio/websocket-proxy/backend.connectToProxyWS(0xc2080980f0, 0xc2080cff50)
/source/Godeps/_workspace/src/github.com/rancherio/websocket-proxy/backend/backend.go:53 +0x168
github.com/rancherio/websocket-proxy/backend.ConnectToProxy(0xc208040500, 0x259, 0xc2080cff50)
/source/Godeps/_workspace/src/github.com/rancherio/websocket-proxy/backend/backend.go:32 +0x45d
main.main()
/source/main.go:93 +0xfac
goroutine 5 [chan receive]:
github.com/golang/glog.(*loggingT).flushDaemon(0xb21b80)
/source/Godeps/_workspace/src/github.com/golang/glog/glog.go:879 +0x78
created by github.com/golang/glog.init·1
/source/Godeps/_workspace/src/github.com/golang/glog/glog.go:410 +0x2a7
goroutine 17 [syscall, 2 minutes, locked to thread]:
runtime.goexit()
/usr/src/go/src/runtime/asm_amd64.s:2232 +0x1
goroutine 7 [chan receive, 1 minutes]:
github.com/rancherio/go-machine-service/locks.locker()
/source/Godeps/_workspace/src/github.com/rancherio/go-machine-service/locks/locks.go:61 +0x6c
created by github.com/rancherio/go-machine-service/locks.init·1
/source/Godeps/_workspace/src/github.com/rancherio/go-machine-service/locks/locks.go:7 +0x5c
goroutine 16 [chan receive, 1 minutes]:
github.com/rancherio/host-api/events.(*EventRouter).routeEvents(0xc20803b7d0)
/source/gopath/src/github.com/rancherio/host-api/events/event_router.go:62 +0x56
created by github.com/rancherio/host-api/events.(*EventRouter).Start
/source/gopath/src/github.com/rancherio/host-api/events/event_router.go:43 +0x107
goroutine 20 [syscall]:
syscall.Syscall6(0xe8, 0xc, 0xc208103cb4, 0x7, 0xffffffffffffffff, 0x0, 0x0, 0xc20801ea80, 0x41894f, 0xc2080c1560)
/usr/src/go/src/syscall/asm_linux_amd64.s:46 +0x5
syscall.EpollWait(0xc, 0xc208103cb4, 0x7, 0x7, 0xffffffffffffffff, 0x0, 0x0, 0x0)
/usr/src/go/src/syscall/zsyscall_linux_amd64.go:376 +0x93
gopkg.in/fsnotify%2ev1.(*fdPoller).wait(0xc2080c65c0, 0xc208064a00, 0x0, 0x0)
/source/Godeps/_workspace/src/gopkg.in/fsnotify.v1/inotify_poller.go:85 +0xc7
gopkg.in/fsnotify%2ev1.(*Watcher).readEvents(0xc20802e5f0)
/source/Godeps/_workspace/src/gopkg.in/fsnotify.v1/inotify.go:179 +0x16f
created by gopkg.in/fsnotify%2ev1.NewWatcher
/source/Godeps/_workspace/src/gopkg.in/fsnotify.v1/inotify.go:58 +0x32b
goroutine 24 [IO wait, 1 minutes]:
net.(*pollDesc).Wait(0xc20809a760, 0x72, 0x0, 0x0)
/usr/src/go/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc20809a760, 0x0, 0x0)
/usr/src/go/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).Read(0xc20809a700, 0xc2080cb000, 0x1000, 0x1000, 0x0, 0x7f45cd256bf0, 0xc208079220)
/usr/src/go/src/net/fd_unix.go:242 +0x40f
net.(*conn).Read(0xc20802c440, 0xc2080cb000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/src/go/src/net/net.go:121 +0xdc
bufio.(*Reader).fill(0xc208064660)
/usr/src/go/src/bufio/bufio.go:97 +0x1ce
bufio.(*Reader).ReadSlice(0xc208064660, 0x41b20a, 0x0, 0x0, 0x0, 0x0, 0x0)
/usr/src/go/src/bufio/bufio.go:295 +0x257
net/http/internal.readLine(0xc208064660, 0x0, 0x0, 0x0, 0x0, 0x0)
/usr/src/go/src/net/http/internal/chunked.go:110 +0x5a
net/http/internal.(*chunkedReader).beginChunk(0xc2080ce270)
/usr/src/go/src/net/http/internal/chunked.go:47 +0x46
net/http/internal.(*chunkedReader).Read(0xc2080ce270, 0xc208092000, 0x200, 0x200, 0x0, 0x0, 0x0)
/usr/src/go/src/net/http/internal/chunked.go:77 +0xbb
net/http.(*body).readLocked(0xc20802bf00, 0xc208092000, 0x200, 0x200, 0x0, 0x0, 0x0)
/usr/src/go/src/net/http/transfer.go:584 +0x7a
net/http.(*body).Read(0xc20802bf00, 0xc208092000, 0x200, 0x200, 0x0, 0x0, 0x0)
/usr/src/go/src/net/http/transfer.go:579 +0x115
encoding/json.(*Decoder).readValue(0xc2080d8000, 0xc207ff25ff, 0x0, 0x0)
/usr/src/go/src/encoding/json/stream.go:124 +0x5e1
encoding/json.(*Decoder).Decode(0xc2080d8000, 0x710ba0, 0xc2080da000, 0x0, 0x0)
/usr/src/go/src/encoding/json/stream.go:44 +0x7b
github.com/fsouza/go-dockerclient.func·006(0xc20806e360, 0xc208077080)
/source/Godeps/_workspace/src/github.com/fsouza/go-dockerclient/event.go:289 +0x1b7
created by github.com/fsouza/go-dockerclient.(*Client).eventHijack
/source/Godeps/_workspace/src/github.com/fsouza/go-dockerclient/event.go:307 +0x625
goroutine 31 [runnable]:
github.com/rancherio/websocket-proxy/backend.func·001()
/source/Godeps/_workspace/src/github.com/rancherio/websocket-proxy/backend/backend.go:42 +0x6d
created by github.com/rancherio/websocket-proxy/backend.connectToProxyWS
/source/Godeps/_workspace/src/github.com/rancherio/websocket-proxy/backend/backend.go:49 +0x152
goroutine 18 [select]:
github.com/fsouza/go-dockerclient.(*eventMonitoringState).monitorEvents(0xc20809a1c0, 0xc20803e700)
/source/Godeps/_workspace/src/github.com/fsouza/go-dockerclient/event.go:175 +0x41c
created by github.com/fsouza/go-dockerclient.(*eventMonitoringState).enableEventMonitoring
/source/Godeps/_workspace/src/github.com/fsouza/go-dockerclient/event.go:148 +0x16f
goroutine 19 [select, 1 minutes]:
github.com/rancherio/host-api/events.watchInternalFn(0xc2080641e0, 0x7ffd44bc8c9f, 0x21, 0x1dcd65000, 0x2540be400, 0x9bd6b8, 0x0, 0x0, 0x0)
/source/gopath/src/github.com/rancherio/host-api/events/rancher_state_watcher.go:140 +0xaba
github.com/rancherio/host-api/events.(*rancherStateWatcher).watch(0xc20802e410)
/source/gopath/src/github.com/rancherio/host-api/events/rancher_state_watcher.go:57 +0x1d9
created by github.com/rancherio/host-api/events.(*DockerEventsProcessor).Process
/source/gopath/src/github.com/rancherio/host-api/events/entry.go:49 +0x331
goroutine 21 [select]:
github.com/rancherio/host-api/events.func·003()
/source/gopath/src/github.com/rancherio/host-api/events/rancher_state_watcher.go:103 +0x678
created by github.com/rancherio/host-api/events.watchInternalFn
/source/gopath/src/github.com/rancherio/host-api/events/rancher_state_watcher.go:124 +0x614
goroutine 22 [select]:
github.com/rancherio/host-api/events.func·004()
/source/gopath/src/github.com/rancherio/host-api/events/rancher_state_watcher.go:172 +0x22d
created by github.com/rancherio/host-api/events.initHealthCheck
/source/gopath/src/github.com/rancherio/host-api/events/rancher_state_watcher.go:181 +0x233
goroutine 23 [select]:
github.com/rancherio/host-api/events.monitorHealth(0xc208064c60, 0xc20809aa10, 0x2540be400)
/source/gopath/src/github.com/rancherio/host-api/events/rancher_state_watcher.go:189 +0x2a7
created by github.com/rancherio/host-api/events.watchInternalFn
/source/gopath/src/github.com/rancherio/host-api/events/rancher_state_watcher.go:138 +0x8fa
goroutine 29 [IO wait, 1 minutes]:
net.(*pollDesc).Wait(0xc20809b2c0, 0x72, 0x0, 0x0)
/usr/src/go/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc20809b2c0, 0x0, 0x0)
/usr/src/go/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).Read(0xc20809b260, 0xc20807d000, 0x1000, 0x1000, 0x0, 0x7f45cd256bf0, 0xc2080780b8)
/usr/src/go/src/net/fd_unix.go:242 +0x40f
net.(*conn).Read(0xc20802c420, 0xc20807d000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/src/go/src/net/net.go:121 +0xdc
net/http.noteEOFReader.Read(0x7f45cd25acf8, 0xc20802c420, 0xc208076ec8, 0xc20807d000, 0x1000, 0x1000, 0x79f3a0, 0x0, 0x0)
/usr/src/go/src/net/http/transport.go:1270 +0x6e
net/http.(*noteEOFReader).Read(0xc2080c69c0, 0xc20807d000, 0x1000, 0x1000, 0xc208010000, 0x0, 0x0)
<autogenerated>:125 +0xd4
bufio.(*Reader).fill(0xc2080eaa20)
/usr/src/go/src/bufio/bufio.go:97 +0x1ce
bufio.(*Reader).Peek(0xc2080eaa20, 0x1, 0x0, 0x0, 0x0, 0x0, 0x0)
/usr/src/go/src/bufio/bufio.go:132 +0xf0
net/http.(*persistConn).readLoop(0xc208076e70)
/usr/src/go/src/net/http/transport.go:842 +0xa4
created by net/http.(*Transport).dialConn
/usr/src/go/src/net/http/transport.go:660 +0xc9f
goroutine 34 [chan receive]:
github.com/rancherio/host-api/stats.func·002(0xc20802c480)
/source/gopath/src/github.com/rancherio/host-api/stats/container_stats.go:70 +0x5c
created by github.com/rancherio/host-api/stats.(*ContainerStatsHandler).Handle
/source/gopath/src/github.com/rancherio/host-api/stats/container_stats.go:76 +0xca5
goroutine 30 [select, 1 minutes]:
net/http.(*persistConn).writeLoop(0xc208076e70)
/usr/src/go/src/net/http/transport.go:945 +0x41d
created by net/http.(*Transport).dialConn
/usr/src/go/src/net/http/transport.go:661 +0xcbc
goroutine 35 [semacquire]:
sync.(*Cond).Wait(0xc2080a6030)
/usr/src/go/src/sync/cond.go:62 +0x9e
io.(*pipe).read(0xc2080a6000, 0xc2080ca000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/src/go/src/io/pipe.go:52 +0x303
io.(*PipeReader).Read(0xc20802c478, 0xc2080ca000, 0x1000, 0x1000, 0x654d222c5d5b3a22, 0x0, 0x0)
/usr/src/go/src/io/pipe.go:134 +0x5b
bufio.(*Scanner).Scan(0xc20803e080, 0xc2080ca000)
/usr/src/go/src/bufio/scan.go:180 +0x688
github.com/rancherio/host-api/stats.func·003(0xc20802c478)
/source/gopath/src/github.com/rancherio/host-api/stats/container_stats.go:80 +0x1af
created by github.com/rancherio/host-api/stats.(*ContainerStatsHandler).Handle
/source/gopath/src/github.com/rancherio/host-api/stats/container_stats.go:92 +0xd3e
goroutine 37 [runnable]:
net/http.(*persistConn).readLoop(0xc208076210)
/usr/src/go/src/net/http/transport.go:928 +0x9ce
created by net/http.(*Transport).dialConn
/usr/src/go/src/net/http/transport.go:660 +0xc9f
goroutine 38 [select]:
net/http.(*persistConn).writeLoop(0xc208076210)
/usr/src/go/src/net/http/transport.go:945 +0x41d
created by net/http.(*Transport).dialConn
/usr/src/go/src/net/http/transport.go:661 +0xcbc
time="2016-01-26T01:54:21Z" level="info" msg="Starting event router."
time="2016-01-26T01:54:21Z" level="info" msg="Watching state directory: /var/lib/rancher/state/containers"
time="2016-01-26T01:54:21Z" level="info" msg="Processing event: &docker.APIEvents{Status:\"start\", ID:\"c463aba991230841c49885bb18d85b49c15177cf22d3e855a92fcbd731312e77\", From:\"-simulated-\", Time:0}"
time="2016-01-26T01:54:21Z" level="info" msg="Processing event: &docker.APIEvents{Status:\"start\", ID:\"4688226073ccaf7ed1b50c6e7eaa551a5ccb75cc77f4992a5253bf944654c442\", From:\"-simulated-\", Time:0}"
time="2016-01-26T01:54:21Z" level="info" msg="Connecting to proxy." url="ws://lister:8080/v1/connectbackend?token=eyJhbGciOiJSUzI1NiJ9.eyJleHAiOjE0NTM3NzM1NjEsInN1YiI6ImNhdHRsZSIsImlzcyI6Imh0dHA6XC9cL2NhdHRsZS5pbyIsInJlcG9ydGVkVXVpZCI6IjRiNTdhMzZhLTk0NjItNDk4OS1iZWE5LTFmNDhjNDJmMzQwMCIsImlhdCI6MTQ1Mzc3MzI2MSwia2lkIjoiZGVmYXVsdCJ9.LwfGWZZKmvrrLDyBCI_3s6PUfAKyQP5mLvVaY7Ij8PKcKvD7Z26Ye0GiU65nH3ejpbyq--z5Smo_ZWfUVFzCz5TArELppaWhF947ffdxlMwHuPTI5_XXnfD481tVO5UM2GRMRi2uP0pnGmMUNwt6yWRKNmIx_Y1ryqMT6XxBCiaIrlO1eNnvVY_brmpdyW5DLM0_YwtmLeV_4g2BeIki9eHbm2dvOBU6UJsw8M1yk_D0Gxe_XVx5KwKsqXU7nCwsBH6JXMI54fYghxCeHC7f0CZ6qZHiOfuqqD1emGxVkGqhS-zvtObQk_widlasw2tW7UTgtqo9Xy4ARfRFbIpmVw"
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment